CN105578063A - Image processing method and terminal - Google Patents
Image processing method and terminal Download PDFInfo
- Publication number
- CN105578063A CN105578063A CN201510413773.7A CN201510413773A CN105578063A CN 105578063 A CN105578063 A CN 105578063A CN 201510413773 A CN201510413773 A CN 201510413773A CN 105578063 A CN105578063 A CN 105578063A
- Authority
- CN
- China
- Prior art keywords
- image
- black
- parameter
- white
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 18
- 238000000034 method Methods 0.000 claims abstract description 19
- 238000012545 processing Methods 0.000 claims abstract description 15
- 238000006073 displacement reaction Methods 0.000 claims description 23
- 239000000284 extract Substances 0.000 claims description 22
- 238000013519 translation Methods 0.000 claims description 22
- 239000013598 vector Substances 0.000 claims description 19
- 238000000605 extraction Methods 0.000 claims description 14
- 238000001914 filtration Methods 0.000 claims description 14
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 238000004040 coloring Methods 0.000 claims description 9
- 230000003287 optical effect Effects 0.000 claims description 6
- 230000000694 effects Effects 0.000 abstract description 9
- 238000013507 mapping Methods 0.000 description 6
- 238000005286 illumination Methods 0.000 description 5
- 239000000203 mixture Substances 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000006698 induction Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
Landscapes
- Image Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention discloses an image processing method. The method comprises the steps that a color image photographed by a first camera and a black-and-white image photographed by a second camera at the same time are acquired, and the first camera and the second camera are arranged at the same side of a terminal; the color information parameters of all the pixel points in the color image are extracted; the gray scale information parameters of all the pixel points in the black-and-white image are extracted; and the color information parameters of corresponding pixel points in an output image are determined according to the color information parameters of the pixel points in the color image and the gray scale information parameters of the corresponding pixel points in the black-and-white image. The invention also discloses an image processing terminal. With application of the image processing method and terminal, the photographing effect of the image under the condition of low brightness can be improved.
Description
Technical field
The present invention relates to electronic technology field, particularly relate to a kind of image processing method and terminal.
Background technology
Along with the development of electronic product and image processing techniques is more and more quicker, people require also more and more higher to the shooting effect of the image that electronic product is taken.At present, electronic product is generally realize by an integrated colour imagery shot function taken color photographs, colour imagery shot realizes the perception of environment to external world by focusing on white light, and extraneous light is except white light (visible ray), also there is infrared ray, when being in the environment of low-light level, white light is little and infrared ray account for leading, the color pixel that when this just causes taking under low-light level environment, infrared ray is formed on a sensor can interfere with the coloured image that white light is formed on a sensor, thus make the photo taken there is color error ratio, shooting effect is poor.
Summary of the invention
Embodiment of the present invention technical problem to be solved is, provides a kind of image processing method and terminal, can improve the shooting effect of low illumination conditions hypograph and present effect.
In order to solve the problems of the technologies described above, embodiments provide a kind of image processing method, described method comprises:
Obtain the coloured image of the first camera shooting and the black and white image of same time second camera shooting, described first camera and described second camera are positioned at the same side of terminal;
Extract the color information parameter of each pixel in described coloured image;
Extract the half-tone information parameter of each pixel in described black and white image;
According to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image.
Correspondingly, the embodiment of the present invention additionally provides a kind of image processing terminal, comprising:
Image collection module, the black and white image that coloured image and same time second camera for obtaining the first camera shooting are taken, described first camera and described second camera are positioned at the same side of terminal;
Colouring information extraction module, for extracting the color information parameter of each pixel in described coloured image;
Half-tone information extraction module, for extracting the half-tone information parameter of each pixel in described black and white image;
Output image module, for the half-tone information parameter according to corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determines the color information parameter of corresponding pixel points in output image.
The coloured image of the embodiment of the present invention by the shooting of acquisition first camera and the black and white image of same time second camera shooting, extract the color information parameter of each pixel in described coloured image, extract the half-tone information parameter of each pixel in described black and white image, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image, improve the shooting effect of low illumination conditions hypograph.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the schematic flow sheet of a kind of image processing method in the embodiment of the present invention;
Fig. 2 is the schematic flow sheet of image processing method in another embodiment of the present invention;
Fig. 3 is the composition structural representation of a kind of image processing terminal in the embodiment of the present invention;
Fig. 4 is the output image module composition structure chart of Fig. 3 in the embodiment of the present invention;
Fig. 5 is the registration module composition structure chart of Fig. 3 in the embodiment of the present invention;
Fig. 6 is the schematic diagram of virtual borderlines in the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Fig. 1 is the schematic flow sheet of a kind of image processing method in the embodiment of the present invention, and this method flow process can be implemented by image processing terminal, and described image processing terminal can comprise mobile phone, notebook computer, panel computer, digital camera etc.Method flow as shown in the figure in the present embodiment can comprise:
Step S101, obtain the coloured image of the first camera shooting and the black and white image of same time second camera shooting, described first camera and described second camera are positioned at the same side of terminal.
Concrete, after the photographing instruction receiving user, described be positioned at the same side the first camera and second camera will carry out finding a view taking pictures, the relative position of described first camera and described second camera can be one on the other or a first from left right, and both relative distance is wanted ensure in shooting process, the acquisition parameters such as viewfinder range, angle of described first camera and described second camera is consistent all substantially.Described first camera is provided with the ultrared colorized optical filtering mirror of filtering, and when taking pictures under such low-light level, white light a small amount of in environment can arrive transducer through described first camera, makes described first camera photograph coloured image by focusing on white light; Described second camera is provided with the infrared filter of filtering white light, because infrared ray does not reduce during low-light level, infrared ray arrives transducer through described second camera, makes described second camera photograph the black and white image being filtered white light.Afterwards, terminal obtains the described coloured image of the first camera shooting and the black and white image of described second camera shooting, for extracting the parameter of pixel further.
Further alternative, when terminal induction to environment brightness value lower than preset luminance threshold time, open photoflash lamp when can take described coloured image and described black and white image respectively by described first camera and described second camera and irradiate fill-in light to shooting direction, described fill-in light comprises white light and infrared ray.Due to the existence of optical filtering, two kinds of light can not produce interference to the described coloured image of shooting and described black and white image mutually, and therefore white light is only to give the first camera light filling, infrared ray only to give second camera light filling, to improve the brightness of shooting environmental.
Step S102, extracts the color information parameter of each pixel in described coloured image.
Concrete, described coloured image is made up of the pixel of some, and described each pixel all comprises color information parameter, and described coloured image is preserved and reduced to terminal by the color information parameter extracting described each pixel.It should be noted that, the color information parameter of coloured image described here is the RGB parameter of RGB color space, wherein R, G and B are the color space component of described coloured image at RGB color space, represent the numerical value that Red Green Blue light is shared in each pixel respectively.Different R, G and B numerical value can represent different colourity, therefore by extracting described RGB parameter, can obtain the colouring information of each pixel in described coloured image.
Step S103, extracts the half-tone information parameter of each pixel in described black and white image.
Concrete, described black and white image is made up of the pixel of some, and described each pixel all comprises half-tone information parameter, and described black and white image is preserved and reduced to terminal by the half-tone information parameter extracting described each pixel.It should be noted that, the half-tone information parameter of black and white image described here is the YUV parameter of YUV color space, wherein Y, U and V are the color space component of described black and white image at YUV color space, represent luminance component Y and chromatic component U, V of each pixel respectively, wherein chromatic component can describe tone and saturation.If only have Y-signal component and do not have U, V component, the image represented so is like this exactly black and white gray level image.Therefore by extracting described YUV parameter, the half-tone information of each pixel in described black and white image can be obtained.
Step S104, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determines the color information parameter of corresponding pixel points in output image.
Concrete, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in the described coloured image that step S102 and step S103 extract and described black and white image, can synthesize the color information parameter of the corresponding pixel points obtaining described output image, thus described output image can be preserved, reduces and be presented to described terminal just according to the color information parameter of the corresponding pixel points of described output image.The half-tone information parameter (luminance component Y) of each pixel that described black and white image comprises than described coloured image is more accurate, and the color information parameter (rgb space component) of each pixel that described coloured image comprises than described black and white image is more accurate, after synthesis, described output image quality just can improve.In concrete enforcement, first can carry out image registration to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.Afterwards, described black and white image is become the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space, again the RGB parametric compensation of described black and white image is given the RGB parameter of described coloured image, determine the RGB parameter of described output image, finally preserve according to the RGB parameter of described output image or show described output image.
The coloured image of the embodiment of the present invention by the shooting of acquisition first camera and the black and white image of same time second camera shooting, extract the color information parameter of each pixel in described coloured image, extract the half-tone information parameter of each pixel in described black and white image, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image, improve the shooting effect of low illumination conditions hypograph.
Fig. 2 is the schematic flow sheet of image processing method in another embodiment of the present invention.Method flow as shown in the figure in the present embodiment can comprise:
Step S201, obtain the coloured image of the first camera shooting and the black and white image of same time second camera shooting, described first camera and described second camera are positioned at the same side of terminal.
Concrete grammar refer step S101.
Step S202, determines the displacement difference vector between described coloured image and described black and white image.
Concrete, owing to there is certain distance between the first camera and second camera, certain skew will be there is in the described coloured image of the first camera shooting and the described black and white image of second camera shooting, therefore need to carry out image registration to described coloured image and described black and white image, first just need the displacement difference vector determined between described coloured image and described black and white image.In concrete enforcement, described terminal, by the similar features point of detection two images, extracts at least one group of fixed reference feature point pair of described coloured image and described black and white image; According to described fixed reference feature point to the reference coordinate respectively on described coloured image and described black and white image, determine the virtual borderlines relation of described coloured image and described black and white image; Then described mapping relations are converted into corresponding displacement difference vector.Described displacement difference vector have recorded the distance size and correspondence direction that described coloured image and described black and white image spatially differ, important parameter when being translation compensation.For the simplest example, as shown in Figure 6, in plane X-Y-coordinate system, one group of fixed reference feature point of described coloured image and described black and white image is (1,1) and (2,2) to coordinate, and so obtaining its mapping relations is X
2=X
1+ 1, Y
2=Y
1+ 1, then obtaining displacement difference vector as shown in the figure according to these mapping relations.
Step S203, according to described displacement difference vector, carries out translation compensation to described coloured image and described black and white image.
Concrete, after determining described displacement difference vector, described terminal just can according to the direction of this displacement difference vectors directed and distance size, translation compensation is carried out to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.To the image registration of described coloured image and described black and white image, can be with described black and white image for reference to carrying out image registration to described coloured image, also can be for reference to carrying out image registration to described black and white image with described coloured image.In concrete enforcement, can with described black and white image for reference carry out translation compensation to described coloured image, namely described black and white image keeps motionless, coloured image described in a translation; Or conversely, can with described coloured image for reference carry out translation compensation to described black and white image, namely described coloured image keeps motionless, black and white image described in a translation; On the other hand, also can set a reference coordinate, by described black and white image and described coloured image with described reference coordinate for reference to carrying out translation compensation, namely described black and white image and described coloured image are all to the position translation of reference coordinate.Because the above two can reduce time and the difficulty of image procossing, therefore select a method as translation compensation in the above two here.
Step S204, extracts the RGB parameter of each pixel in described coloured image at RGB color space.
Concrete, described coloured image is made up of the pixel of some, and described each pixel all comprises the RGB parameter of RGB color space, and described coloured image is preserved and reduced to terminal by the RGB parameter extracting described each pixel.It should be noted that, R, G and B are the color space component of described coloured image at RGB color space here, represent the numerical value that Red Green Blue light is shared in each pixel respectively.Different R, G and B numerical value can represent different colourity, therefore by extracting described RGB parameter, can obtain the colouring information of each pixel in described coloured image.
Step S205, extracts the YUV parameter of each pixel in described black and white image at YUV color space.
Concrete, described black and white image is made up of the pixel of some, and described each pixel all comprises the YUV parameter of YUV color space, and described black and white image is preserved and reduced to terminal by the YUV parameter extracting described each pixel.It should be noted that, Y, U and V are the color space component of described black and white image at YUV color space here, and represent luminance component Y and chromatic component U, V of each pixel respectively, wherein chromatic component can describe tone and saturation.If only have Y-signal component and do not have U, V component, the image represented so is like this exactly black and white gray level image.Therefore by extracting described YUV parameter, the half-tone information of each pixel in described black and white image can be obtained.Further, step S202 and step S203 has carried out registration to described coloured image and described black and white image, and the pixel collected in the pixel therefore collected in described coloured image for same photographic subjects position and described black and white image exists relation one to one.
Step S206, becomes the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space by described black and white image.
Concrete, the conversion formula of described YUV parameter and described RGB parameter is as follows:
R＝1.164(Y-16)+1.596(V-128)
G＝1.164(Y-16)-0.813(V-128)-0.391(U-128)
B＝1.164(Y-16)+2.018(U-128)
After step S205 extracts the YUV parameter of each pixel in described black and white image at YUV color space, just can utilize this group conversion formula, described black and white image is become the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space, the color space of each pixel of described like this black and white image and described coloured image just can be consistent.
Step S207, according to the RGB parameter of described black and white image and the RGB parameter of described coloured image, determines the RGB parameter of described output image.
Concrete, after described terminal obtains the RGB parameter of described black and white image and the RGB parameter of described coloured image respectively, the RGB parametric compensation of described black and white image can be given the RGB parameter of described coloured image, to determine the RGB parameter of described output image.Here compensation can be partial-compensation also can be whole compensation, concrete compensation way can by the quality settings threshold value of described coloured image of taking out to described first camera, the many indexs such as definition, brightness, contrast are judged, such as, when the many index of described coloured image exceedes described threshold value, represent the quality hit the target of described coloured image, only need the partial-compensation of the RGB parameter of the described black and white image of 50%; When the many index of described coloured image does not exceed described threshold value, represent the non-hit the target of the quality of described coloured image, the RGB parameter of described black and white image all can be compensated to the RGB parameter of described coloured image.Concrete example, the RGB parameter supposing the target pixel points of described black and white image is [66, 20, 57], described coloured image be [91 with the RGB parameter of described target pixel points corresponding pixel points, 52, 43], and the many index of described coloured image does not exceed described threshold value, at this moment just by the RGB parameter [66 of the described target pixel points of described black and white image, 20, 57] all compensate to the RGB parameter [91 of the pixel of the described coloured image corresponding with described target pixel points, 52, 43], then the RGB parameter of the described target pixel points of described output image is just described R, G, value [157 after the superposition of B component correspondence, 72, 100].Just can be obtained the RGB parameter of each pixel of described output image by described method, final described terminal can be preserved according to the RGB parameter of each pixel of described output image and show described output image.
The coloured image of the embodiment of the present invention by the shooting of acquisition first camera and the black and white image of same time second camera shooting, extract the color information parameter of each pixel in described coloured image, extract the half-tone information parameter of each pixel in described black and white image, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image, improve the shooting effect of low illumination conditions hypograph.
Fig. 3 is the composition structural representation of a kind of image processing terminal in the embodiment of the present invention, and described image processing terminal can comprise mobile phone, notebook computer, panel computer, digital camera etc.Terminal as shown in the figure in the present embodiment can comprise:
Image collection module 310, the black and white image that coloured image and same time second camera for obtaining the first camera shooting are taken, described first camera and described second camera are positioned at the same side of terminal.
Concrete, after the photographing instruction receiving user, described be positioned at the same side the first camera and second camera will carry out finding a view taking pictures, the relative position of described first camera and described second camera can be one on the other or a first from left right, and both relative distance is wanted ensure in shooting process, the acquisition parameters such as viewfinder range, angle of described first camera and described second camera is consistent all substantially.Described first camera is provided with the ultrared colorized optical filtering mirror of filtering, and when taking pictures under such low-light level, white light a small amount of in environment can arrive transducer through described first camera, makes described first camera photograph coloured image by focusing on white light; Described second camera is provided with the infrared filter of filtering white light, because infrared ray does not reduce during low-light level, infrared ray arrives transducer through described second camera, makes described second camera photograph the black and white image being filtered white light.Afterwards, described image collection module 310 obtains the described coloured image of the first camera shooting and the black and white image of described second camera shooting, for extracting the parameter of pixel further.
Colouring information extraction module 320, for extracting the color information parameter of each pixel in described coloured image.
Concrete, described coloured image is made up of the pixel of some, described each pixel all comprises color information parameter, and described coloured image is preserved and reduced to described colouring information extraction module 320 by the color information parameter extracting described each pixel.It should be noted that, the color information parameter of coloured image described here is the RGB parameter of RGB color space, wherein R, G and B are the color space component of described coloured image at RGB color space, represent the numerical value that Red Green Blue light is shared in each pixel respectively.Different R, G and B numerical value can represent different colourity, therefore by extracting described RGB parameter, can obtain the colouring information of each pixel in described coloured image.
Half-tone information extraction module 330, for extracting the half-tone information parameter of each pixel in described black and white image.
Concrete, described black and white image is made up of the pixel of some, described each pixel all comprises half-tone information parameter, and described black and white image is preserved and reduced to described half-tone information extraction module 330 by the half-tone information parameter extracting described each pixel.It should be noted that, the half-tone information parameter of black and white image described here is the YUV parameter of YUV color space, wherein Y, U and V are the color space component of described black and white image at YUV color space, represent luminance component Y and chromatic component U, V of each pixel respectively, wherein chromatic component can describe tone and saturation.If only have Y-signal component and do not have U, V component, the image represented so is like this exactly black and white gray level image.Therefore by extracting described YUV parameter, the half-tone information of each pixel in described black and white image can be obtained.Further, registration module 360 can carry out registration to described coloured image and described black and white image, there is one to one relation when the pixel collected gathers in the pixel therefore collected in described coloured image for same photographic subjects position and described black and white image.
Output image module 340, for the half-tone information parameter according to corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determines the color information parameter of corresponding pixel points in output image.
Concrete, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in the described coloured image that colouring information extraction module 320 and half-tone information extraction module 330 extract and described black and white image, can synthesize the color information parameter of the corresponding pixel points obtaining described output image, thus described output image can be preserved, reduces and be presented to described output image module 340 just according to the color information parameter of the corresponding pixel points of described output image.The half-tone information parameter (luminance component Y) of each pixel that described black and white image comprises than described coloured image is more accurate, and the color information parameter (rgb space component) of each pixel that described coloured image comprises than described black and white image is more accurate, after synthesis, described output image quality just can improve.
Further, described output image module 340 also comprises: parameter conversion unit 341 and parameter conversion unit 341, as described in Figure 4.
Parameter conversion unit 341, for becoming the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space by described black and white image.
Concrete, the conversion formula of described YUV parameter and described RGB parameter is as follows:
R＝1.164(Y-16)+1.596(V-128)
G＝1.164(Y-16)-0.813(V-128)-0.391(U-128)
B＝1.164(Y-16)+2.018(U-128)
After half-tone information extraction module 330 extracts the YUV parameter of each pixel in described black and white image at YUV color space, parameter conversion unit 341 just can utilize this group conversion formula, described black and white image is become the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space, described like this black and white image just can be consistent with the color space of each pixel of described coloured image.
Parameter determination unit 342, for according to the RGB parameter of described black and white image and the RGB parameter of described coloured image, determines the RGB parameter of described output image.
Concrete, after described colouring information extraction module 320 and described half-tone information extraction module 330 obtain the RGB parameter of described black and white image and the RGB parameter of described coloured image respectively, the RGB parametric compensation of described black and white image can be given the RGB parameter of described coloured image by described parameter determination unit 342, to determine the RGB parameter of described output image.Here compensation can be partial-compensation also can be whole compensation, concrete compensation way can by the quality settings threshold value of described coloured image of taking out to described first camera, the many indexs such as definition, brightness, contrast are judged, such as, when the many index of described coloured image exceedes described threshold value, represent the quality hit the target of described coloured image, only need the partial-compensation of the RGB parameter of the described black and white image of 50%; When the many index of described coloured image does not exceed described threshold value, represent the non-hit the target of the quality of described coloured image, the RGB parameter of described black and white image all can be compensated to the RGB parameter of described coloured image.Concrete example, the RGB parameter supposing the target pixel points of described black and white image is [66, 20, 57], described coloured image be [91 with the RGB parameter of described target pixel points corresponding pixel points, 52, 43], and the many index of described coloured image does not exceed described threshold value, at this moment just by the RGB parameter [66 of the described target pixel points of described black and white image, 20, 57] all compensate to described coloured image with the RGB parameter [91 of described target pixel points corresponding pixel points, 52, 43], then the RGB parameter of the described target pixel points of described output image is just described R, G, value [157 after the superposition of B component correspondence, 72, 100].Just can be obtained the RGB parameter of each pixel of described output image by described method, final described output image module 340 can be preserved according to the RGB parameter of each pixel of described output image and show described output image.
Flash module 350, open photoflash lamp during for taking described coloured image and described black and white image respectively by described first camera and described second camera and irradiate fill-in light to shooting direction, described fill-in light comprises white light and infrared light.
Concrete optional, when terminal induction to environment brightness value lower than preset luminance threshold time, open photoflash lamp when can take described coloured image and described black and white image respectively by flash module 350 to described first camera and described second camera and irradiate fill-in light to shooting direction, described fill-in light comprises white light and infrared ray.Due to the existence of optical filtering, two kinds of light can not produce interference to the described coloured image of shooting and described black and white image mutually, and therefore white light is only to give the first camera light filling, infrared ray only to give second camera light filling, to improve the brightness of shooting environmental.
Registration module 360, for carrying out image registration to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.
Described registration module 360 comprises: displacement difference determining unit 361 and compensating unit 362, as described in Figure 5.
Displacement difference determining unit 361, for determining the displacement difference vector between described coloured image and described black and white image.
Concrete, owing to there is certain distance between the first camera and second camera, will be there is certain skew in the described coloured image of the first camera shooting and the described black and white image of second camera shooting, therefore need to carry out image registration to described coloured image and described black and white image.In concrete enforcement, described displacement difference determining unit 361, by the similar features point of detection two images, extracts at least one group of fixed reference feature point pair of described coloured image and described black and white image; According to described fixed reference feature point to the reference coordinate respectively on described coloured image and described black and white image, determine the virtual borderlines relation of described coloured image and described black and white image; Then described mapping relations are converted into corresponding displacement difference vector.Described displacement difference vector have recorded the distance size and correspondence direction that described coloured image and described black and white image spatially differ, important parameter when being translation compensation.For the simplest example, as shown in Figure 6, in plane X-Y-coordinate system, one group of fixed reference feature point of described coloured image and described black and white image is (1,1) and (2,2) to coordinate, and so obtaining its mapping relations is X
2=X
1+ 1, Y
2=Y
1+ 1, then obtaining displacement difference vector as shown in the figure according to these mapping relations.
Compensating unit 362, for according to described displacement difference vector, carries out translation compensation to institute's coloured image and described black and white image.
Concrete, after determining described displacement difference vector, described compensating unit 362 just can according to the direction of this displacement difference vectors directed and distance size, translation compensation is carried out to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.To the image registration of described coloured image and described black and white image, can be with described black and white image for reference to carrying out image registration to described coloured image, also can be for reference to carrying out image registration to described black and white image with described coloured image.In concrete enforcement, can with described black and white image for reference carry out translation compensation to described coloured image, namely described black and white image keeps motionless, coloured image described in a translation; Or conversely, can with described coloured image for reference carry out translation compensation to described black and white image, namely described coloured image keeps motionless, black and white image described in a translation; On the other hand, also can set a reference coordinate, by described black and white image and described coloured image with described reference coordinate for reference to carrying out translation compensation, namely described black and white image and described coloured image are all to the position translation of reference coordinate.Because the above two can reduce time and the difficulty of image procossing, therefore select a method as translation compensation in the above two here.
The coloured image of the embodiment of the present invention by the shooting of acquisition first camera and the black and white image of same time second camera shooting, extract the color information parameter of each pixel in described coloured image, extract the half-tone information parameter of each pixel in described black and white image, according to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image, improve the shooting effect of low illumination conditions hypograph.
One of ordinary skill in the art will appreciate that all or part of flow process realized in above-described embodiment method, that the hardware that can carry out instruction relevant by computer program has come, described program can be stored in a computer read/write memory medium, this program, when performing, can comprise the flow process of the embodiment as above-mentioned each side method.Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-OnlyMemory, ROM) or random store-memory body (RandomAccessMemory, RAM) etc.
Above disclosedly be only present pre-ferred embodiments, certainly can not limit the interest field of the present invention with this, therefore according to the equivalent variations that the claims in the present invention are done, still belong to the scope that the present invention is contained.
Claims (14)
1. an image processing method, is characterized in that, described method comprises:
Obtain the coloured image of the first camera shooting and the black and white image of same time second camera shooting, described first camera and described second camera are positioned at the same side of terminal;
Extract the color information parameter of each pixel in described coloured image;
Extract the half-tone information parameter of each pixel in described black and white image;
According to the half-tone information parameter of corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determine the color information parameter of corresponding pixel points in output image.
2. image processing method as claimed in claim 1, it is characterized in that, the color information parameter of described coloured image is the RGB parameter of RGB color space, and the half-tone information parameter of described black and white image is the YUV parameter of YUV color space;
The half-tone information parameter of corresponding pixel points in the described color information parameter according to pixel in described coloured image and described black and white image, determine that in output image, the color information parameter of corresponding pixel points comprises:
Described black and white image is become the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space;
According to the RGB parameter of described black and white image and the RGB parameter of described coloured image, determine the RGB parameter of described output image.
3. image processing method as claimed in claim 1, it is characterized in that, described first camera is provided with the ultrared colorized optical filtering mirror of filtering, and described second camera is provided with the infrared filter of filtering white light.
4. image processing method as claimed in claim 1, it is characterized in that, described method also comprises:
Open photoflash lamp when taking described coloured image and described black and white image respectively by described first camera and described second camera and irradiate fill-in light to shooting direction, described fill-in light comprises white light and infrared ray.
5. image processing method as claimed in claim 1, is characterized in that, also comprise before the color information parameter of each pixel in the described coloured image of described extraction:
Image registration is carried out to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.
6. image processing method as claimed in claim 5, is characterized in that, describedly carries out image registration to described coloured image and described black and white image and comprises:
Determine the displacement difference vector between described coloured image and described black and white image;
According to described displacement difference vector, translation compensation is carried out to described coloured image and described black and white image.
7. image processing method as claimed in claim 5, it is characterized in that, describedly image registration is carried out to described coloured image and described black and white image comprise: with described black and white image for reference to carrying out image registration to described coloured image, or with described coloured image for reference to carrying out image registration to described black and white image.
8. an image processing terminal, is characterized in that, described terminal comprises:
Image collection module, the black and white image that coloured image and same time second camera for obtaining the first camera shooting are taken, described first camera and described second camera are positioned at the same side of terminal;
Colouring information extraction module, for extracting the color information parameter of each pixel in described coloured image;
Half-tone information extraction module, for extracting the half-tone information parameter of each pixel in described black and white image;
Output image module, for the half-tone information parameter according to corresponding pixel points in the color information parameter of pixel in described coloured image and described black and white image, determines the color information parameter of corresponding pixel points in output image.
9. image processing terminal as claimed in claim 8, it is characterized in that, the color information parameter of described coloured image is the RGB parameter of RGB color space, and the half-tone information parameter of described black and white image is the YUV parameter of YUV color space;
Described output image module comprises:
Parameter conversion unit, for becoming the RGB parameter of described RGB color space at the YUV Parameter Switch of described YUV color space by described black and white image;
Parameter determination unit, for according to the RGB parameter of described black and white image and the RGB parameter of described coloured image, determines the RGB parameter of described output image.
10. image processing terminal as claimed in claim 8, it is characterized in that, described first camera is provided with the ultrared colorized optical filtering mirror of filtering, and described second camera is provided with the infrared filter of filtering white light.
11. image processing terminals as claimed in claim 8, it is characterized in that, described terminal also comprises:
Flash module, open photoflash lamp during for taking described coloured image and described black and white image respectively by described first camera and described second camera and irradiate fill-in light to shooting direction, described fill-in light comprises white light and infrared light.
12. image processing terminals as claimed in claim 8, it is characterized in that, described terminal also comprises:
Registration module, for carrying out image registration to described coloured image and described black and white image, to determine the corresponding relation of the pixel for the pixel of same photographic subjects position in described coloured image and described black and white image.
13. image processing terminals as claimed in claim 12, it is characterized in that, described registration module comprises:
Displacement difference determining unit, for determining the displacement difference vector between described coloured image and described black and white image;
Compensating unit, for according to described displacement difference vector, carries out translation compensation to institute's coloured image and described black and white image.
14. image processing terminals as claimed in claim 12, it is characterized in that, describedly image registration is carried out to described coloured image and described black and white image comprise: with described black and white image for reference to carrying out image registration to described coloured image, or with described coloured image for reference to carrying out image registration to described black and white image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510413773.7A CN105578063B (en) | 2015-07-14 | 2015-07-14 | A kind of image processing method and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510413773.7A CN105578063B (en) | 2015-07-14 | 2015-07-14 | A kind of image processing method and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105578063A true CN105578063A (en) | 2016-05-11 |
| CN105578063B CN105578063B (en) | 2018-04-10 |
Family
ID=55887670
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510413773.7A Active CN105578063B (en) | 2015-07-14 | 2015-07-14 | A kind of image processing method and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105578063B (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106060419A (en) * | 2016-06-30 | 2016-10-26 | 维沃移动通信有限公司 | Photographing method and mobile terminal |
| CN106101666A (en) * | 2016-06-30 | 2016-11-09 | 维沃移动通信有限公司 | The method of a kind of image color reservation and mobile terminal |
| CN106412534A (en) * | 2016-10-27 | 2017-02-15 | 成都西纬科技有限公司 | Method and device for adjusting image brightness |
| CN106454290A (en) * | 2016-10-12 | 2017-02-22 | 成都西纬科技有限公司 | Dual-camera image processing system and method thereof |
| CN106454077A (en) * | 2016-09-26 | 2017-02-22 | 宇龙计算机通信科技(深圳)有限公司 | Photographing method, photographing apparatus and terminal |
| CN106550227A (en) * | 2016-10-27 | 2017-03-29 | 成都西纬科技有限公司 | A kind of image saturation method of adjustment and device |
| CN107087108A (en) * | 2017-05-18 | 2017-08-22 | 努比亚技术有限公司 | A kind of image processing method and device based on dual camera |
| CN107493431A (en) * | 2017-08-31 | 2017-12-19 | 努比亚技术有限公司 | A kind of image taking synthetic method, terminal and computer-readable recording medium |
| CN107566730A (en) * | 2017-09-27 | 2018-01-09 | 维沃移动通信有限公司 | A kind of panoramic picture image pickup method and mobile terminal |
| CN108022227A (en) * | 2017-12-29 | 2018-05-11 | 努比亚技术有限公司 | A kind of black and white background photo acquisition methods, device and computer-readable recording medium |
| WO2018082165A1 (en) * | 2016-11-03 | 2018-05-11 | 华为技术有限公司 | Optical imaging method and apparatus |
| WO2018119787A1 (en) * | 2016-12-28 | 2018-07-05 | 华为技术有限公司 | Demosaicing method and device |
| CN108445010A (en) * | 2018-03-12 | 2018-08-24 | 昆山国显光电有限公司 | Automatic optical detection method and device |
| CN108540736A (en) * | 2018-04-03 | 2018-09-14 | 深圳新亮智能技术有限公司 | Infrared laser illuminates the camera chain of Color License Plate |
| CN108737728A (en) * | 2018-05-03 | 2018-11-02 | Oppo广东移动通信有限公司 | A kind of image capturing method, terminal and computer storage media |
| CN109120911A (en) * | 2018-07-09 | 2019-01-01 | 武汉斗鱼网络科技有限公司 | A kind of video method for transformation, device, equipment and medium |
| CN109785251A (en) * | 2018-12-25 | 2019-05-21 | 北京中科慧眼科技有限公司 | A kind of picture quality method for improving, device and automated driving system |
| US10341543B2 (en) | 2016-04-28 | 2019-07-02 | Qualcomm Incorporated | Parallax mask fusion of color and mono images for macrophotography |
| CN110326288A (en) * | 2017-03-02 | 2019-10-11 | 索尼公司 | Image processing equipment and imaging device |
| CN110476056A (en) * | 2017-04-26 | 2019-11-19 | 深圳配天智能技术研究院有限公司 | A kind of visible detection method, detection device and robot |
| CN111479075A (en) * | 2020-04-02 | 2020-07-31 | 青岛海信移动通信技术股份有限公司 | Photographing terminal and image processing method thereof |
| CN111970432A (en) * | 2019-05-20 | 2020-11-20 | 华为技术有限公司 | Image processing method and image processing device |
| CN112133101A (en) * | 2020-09-22 | 2020-12-25 | 杭州海康威视数字技术股份有限公司 | Method and device for enhancing license plate area, camera device, computing equipment and storage medium |
| CN112822465A (en) * | 2019-11-15 | 2021-05-18 | 北京小米移动软件有限公司 | Terminal device and image processing method |
| CN113038017A (en) * | 2021-03-24 | 2021-06-25 | 重庆中科云从科技有限公司 | Image acquisition method, image acquisition device and computer-readable storage medium |
| US12096101B2 (en) | 2019-08-21 | 2024-09-17 | Huizhou Tcl Mobile Communication Co., Ltd. | Terminal, photographing method and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103986875A (en) * | 2014-05-29 | 2014-08-13 | 宇龙计算机通信科技(深圳)有限公司 | Image acquiring device, method and terminal and video acquiring method |
| CN104463112A (en) * | 2014-11-27 | 2015-03-25 | 深圳市科葩信息技术有限公司 | Method and system for carrying out biological recognition through RGB+IR image sensor |
| CN105049718A (en) * | 2015-07-06 | 2015-11-11 | 深圳市金立通信设备有限公司 | Image processing method and terminal |
-
2015
- 2015-07-14 CN CN201510413773.7A patent/CN105578063B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103986875A (en) * | 2014-05-29 | 2014-08-13 | 宇龙计算机通信科技(深圳)有限公司 | Image acquiring device, method and terminal and video acquiring method |
| CN104463112A (en) * | 2014-11-27 | 2015-03-25 | 深圳市科葩信息技术有限公司 | Method and system for carrying out biological recognition through RGB+IR image sensor |
| CN105049718A (en) * | 2015-07-06 | 2015-11-11 | 深圳市金立通信设备有限公司 | Image processing method and terminal |
Cited By (39)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10362205B2 (en) | 2016-04-28 | 2019-07-23 | Qualcomm Incorporated | Performing intensity equalization with respect to mono and color images |
| US10341543B2 (en) | 2016-04-28 | 2019-07-02 | Qualcomm Incorporated | Parallax mask fusion of color and mono images for macrophotography |
| CN106101666A (en) * | 2016-06-30 | 2016-11-09 | 维沃移动通信有限公司 | The method of a kind of image color reservation and mobile terminal |
| CN106060419A (en) * | 2016-06-30 | 2016-10-26 | 维沃移动通信有限公司 | Photographing method and mobile terminal |
| CN106060419B (en) * | 2016-06-30 | 2019-05-17 | 维沃移动通信有限公司 | A kind of photographic method and mobile terminal |
| CN106454077A (en) * | 2016-09-26 | 2017-02-22 | 宇龙计算机通信科技(深圳)有限公司 | Photographing method, photographing apparatus and terminal |
| CN106454077B (en) * | 2016-09-26 | 2021-02-23 | 宇龙计算机通信科技(深圳)有限公司 | Shooting method, shooting device and terminal |
| CN106454290A (en) * | 2016-10-12 | 2017-02-22 | 成都西纬科技有限公司 | Dual-camera image processing system and method thereof |
| CN106412534B (en) * | 2016-10-27 | 2018-09-11 | 成都西纬科技有限公司 | A kind of brightness of image adjusting method and device |
| CN106412534A (en) * | 2016-10-27 | 2017-02-15 | 成都西纬科技有限公司 | Method and device for adjusting image brightness |
| CN106550227A (en) * | 2016-10-27 | 2017-03-29 | 成都西纬科技有限公司 | A kind of image saturation method of adjustment and device |
| US10810720B2 (en) | 2016-11-03 | 2020-10-20 | Huawei Technologies Co., Ltd. | Optical imaging method and apparatus |
| CN108605097A (en) * | 2016-11-03 | 2018-09-28 | 华为技术有限公司 | Optical imaging method and its device |
| CN108605097B (en) * | 2016-11-03 | 2020-09-08 | 华为技术有限公司 | Optical imaging method and device |
| WO2018082165A1 (en) * | 2016-11-03 | 2018-05-11 | 华为技术有限公司 | Optical imaging method and apparatus |
| WO2018119787A1 (en) * | 2016-12-28 | 2018-07-05 | 华为技术有限公司 | Demosaicing method and device |
| US11017501B2 (en) | 2016-12-28 | 2021-05-25 | Huawei Technologies Co., Ltd. | Demosaicing method and apparatus |
| CN110326288A (en) * | 2017-03-02 | 2019-10-11 | 索尼公司 | Image processing equipment and imaging device |
| CN110326288B (en) * | 2017-03-02 | 2021-07-06 | 索尼公司 | Image processing apparatus and imaging apparatus |
| CN110476056A (en) * | 2017-04-26 | 2019-11-19 | 深圳配天智能技术研究院有限公司 | A kind of visible detection method, detection device and robot |
| CN110476056B (en) * | 2017-04-26 | 2022-02-18 | 深圳配天智能技术研究院有限公司 | Visual detection method, detection equipment and robot |
| CN107087108A (en) * | 2017-05-18 | 2017-08-22 | 努比亚技术有限公司 | A kind of image processing method and device based on dual camera |
| CN107493431A (en) * | 2017-08-31 | 2017-12-19 | 努比亚技术有限公司 | A kind of image taking synthetic method, terminal and computer-readable recording medium |
| CN107566730A (en) * | 2017-09-27 | 2018-01-09 | 维沃移动通信有限公司 | A kind of panoramic picture image pickup method and mobile terminal |
| CN107566730B (en) * | 2017-09-27 | 2019-10-15 | 维沃移动通信有限公司 | A kind of panoramic picture image pickup method and mobile terminal |
| CN108022227A (en) * | 2017-12-29 | 2018-05-11 | 努比亚技术有限公司 | A kind of black and white background photo acquisition methods, device and computer-readable recording medium |
| CN108445010A (en) * | 2018-03-12 | 2018-08-24 | 昆山国显光电有限公司 | Automatic optical detection method and device |
| CN108540736A (en) * | 2018-04-03 | 2018-09-14 | 深圳新亮智能技术有限公司 | Infrared laser illuminates the camera chain of Color License Plate |
| CN108737728A (en) * | 2018-05-03 | 2018-11-02 | Oppo广东移动通信有限公司 | A kind of image capturing method, terminal and computer storage media |
| CN108737728B (en) * | 2018-05-03 | 2021-06-11 | Oppo广东移动通信有限公司 | Image shooting method, terminal and computer storage medium |
| CN109120911A (en) * | 2018-07-09 | 2019-01-01 | 武汉斗鱼网络科技有限公司 | A kind of video method for transformation, device, equipment and medium |
| CN109785251A (en) * | 2018-12-25 | 2019-05-21 | 北京中科慧眼科技有限公司 | A kind of picture quality method for improving, device and automated driving system |
| CN111970432A (en) * | 2019-05-20 | 2020-11-20 | 华为技术有限公司 | Image processing method and image processing device |
| US12096101B2 (en) | 2019-08-21 | 2024-09-17 | Huizhou Tcl Mobile Communication Co., Ltd. | Terminal, photographing method and storage medium |
| CN112822465A (en) * | 2019-11-15 | 2021-05-18 | 北京小米移动软件有限公司 | Terminal device and image processing method |
| CN111479075A (en) * | 2020-04-02 | 2020-07-31 | 青岛海信移动通信技术股份有限公司 | Photographing terminal and image processing method thereof |
| CN112133101A (en) * | 2020-09-22 | 2020-12-25 | 杭州海康威视数字技术股份有限公司 | Method and device for enhancing license plate area, camera device, computing equipment and storage medium |
| CN112133101B (en) * | 2020-09-22 | 2021-11-26 | 杭州海康威视数字技术股份有限公司 | Method and device for enhancing license plate area, camera device, computing equipment and storage medium |
| CN113038017A (en) * | 2021-03-24 | 2021-06-25 | 重庆中科云从科技有限公司 | Image acquisition method, image acquisition device and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105578063B (en) | 2018-04-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105578063A (en) | Image processing method and terminal | |
| CN105554483B (en) | A kind of image processing method and terminal | |
| CN107977940B (en) | Background blurring processing method, device and equipment | |
| US10645268B2 (en) | Image processing method and apparatus of terminal, and terminal | |
| CN103366352B (en) | Apparatus and method for producing the image that background is blurred | |
| KR20200031689A (en) | Image processing methods, devices and devices | |
| CN111738970A (en) | Image fusion method and device and computer readable storage medium | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| CN105049718A (en) | Image processing method and terminal | |
| US9460497B2 (en) | Image enhancement methods and systems using the same | |
| CN108717691B (en) | Image fusion method and device, electronic equipment and medium | |
| KR20170019359A (en) | Local adaptive histogram equalization | |
| CN107707789B (en) | Method, computing device and storage medium for providing a color high resolution image of a scene | |
| CN111837155A (en) | Image processing method and apparatus | |
| CN108012078A (en) | Brightness of image processing method, device, storage medium and electronic equipment | |
| CN105245863A (en) | Image processing device that performs white balance control, method of controlling the same, and image pickup apparatus | |
| CN107682611B (en) | Focusing method and device, computer readable storage medium and electronic equipment | |
| CN107948511A (en) | Brightness of image processing method, device, storage medium and electronic equipment | |
| CN112991245A (en) | Double-shot blurring processing method and device, electronic equipment and readable storage medium | |
| CN114866754A (en) | Automatic white balance method and device, computer readable storage medium and electronic equipment | |
| CN106550227A (en) | A kind of image saturation method of adjustment and device | |
| WO2021145913A1 (en) | Estimating depth based on iris size | |
| CN111866369B (en) | Image processing method and device | |
| CN114862734A (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN109300186B (en) | Image processing method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |