CN107481198A - Image processing method, device, computer-readable recording medium and computer equipment - Google Patents
Image processing method, device, computer-readable recording medium and computer equipment Download PDFInfo
- Publication number
- CN107481198A CN107481198A CN201710624551.9A CN201710624551A CN107481198A CN 107481198 A CN107481198 A CN 107481198A CN 201710624551 A CN201710624551 A CN 201710624551A CN 107481198 A CN107481198 A CN 107481198A
- Authority
- CN
- China
- Prior art keywords
- defogging
- image
- parameter value
- transmissivity
- single image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 30
- 238000012545 processing Methods 0.000 claims abstract description 89
- 238000000034 method Methods 0.000 claims abstract description 15
- 238000012876 topography Methods 0.000 claims abstract description 9
- 230000009977 dual effect Effects 0.000 claims description 6
- 239000003595 mist Substances 0.000 description 17
- 238000003384 imaging method Methods 0.000 description 14
- 238000005516 engineering process Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012937 correction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000000889 atomisation Methods 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- G06T5/70—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4038—Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- G06T5/73—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20182—Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Abstract
The present invention relates to a kind of image processing method, device, computer-readable recording medium and computer equipment.Multiple pending images are obtained, multiple described images are topography in panoramic picture；The defogging weight and defogging parameter value of single image in multiple described images are obtained successively, and defogging processing is carried out to the single image according to the defogging parameter value and defogging weight；Multiple image mosaics are into an image after defogging is handled.The above method, defogging processing is carried out to multiple small angle high-definition pictures of acquisition, then multiple image mosaics after defogging is handled are into an image.Avoid when obtaining wide-angle image, the problem of image resolution ratio is relatively low, fogging image.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of image processing method, device, computer-readable deposit
Storage media and computer equipment.
Background technology
Mist is natural phenomena common in daily life, and the appearance of mist can cause atmospheric visibility to reduce, and is shot in the greasy weather
During image, atmospheric visibility, which reduces, can make it that the picture contrast of shooting is poor, definition is low.Therefore, after greasy weather shooting image,
Need to carry out defogging processing to image.Defogging processing to image may include a variety of defogging algorithms, and different defogging algorithms has
Different models, the image type that different defogging algorithms is applicable are also different.
The content of the invention
The embodiment of the present invention provides a kind of image processing method, device, computer-readable recording medium and computer equipment,
The definition of image after defogging can be improved.
A kind of image processing method, including：
Multiple pending images are obtained, multiple described images are topography in panoramic picture；
The defogging weight and defogging parameter value of single image in multiple described images are obtained successively, according to the defogging parameter
Value and defogging weight carry out defogging processing to the single image；
Multiple image mosaics are into an image after defogging is handled.
A kind of image processing apparatus, including：
Acquisition module, for obtaining multiple pending images, multiple described images are topography in panoramic picture；
Defogging module, for obtaining the defogging weight and defogging parameter value of single image in multiple described images, root successively
Defogging processing is carried out to the single image according to the defogging parameter value and defogging weight；
Concatenation module, for multiple image mosaics after defogging is handled into an image.
One or more includes the non-volatile computer readable storage medium storing program for executing of computer executable instructions, when the calculating
When machine executable instruction is executed by one or more processors so that the computing device image processing method as described above
Method.
A kind of computer equipment, including memory and processor, computer-readable instruction are stored in the memory, institute
When stating instruction by the computing device so that the computing device image processing method as described above.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is the internal structure schematic diagram of mobile terminal in one embodiment；
Fig. 2 is the flow chart of image processing method in one embodiment；
Fig. 3 is the flow chart of image processing method in another embodiment；
Fig. 4 is the flow chart of image processing method in another embodiment；
Fig. 5 is the structured flowchart of image processing apparatus in one embodiment；
Fig. 6 is the structured flowchart of image processing apparatus in another embodiment；
Fig. 7 is the structured flowchart of image processing apparatus in another embodiment；
Fig. 8 is the schematic diagram of image processing circuit in one embodiment.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right below in conjunction with drawings and Examples
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
So that computer equipment is mobile terminal as an example.Fig. 1 is the internal structure signal of mobile terminal 10 in one embodiment
Figure.As shown in figure 1, the mobile terminal 10 includes the processor, non-volatile memory medium, memory storage connected by system bus
Device and network interface, display screen and input unit.Wherein, the non-volatile memory medium of mobile terminal 10 is stored with operating system
And computer-readable instruction.To realize a kind of image processing method when the computer-readable instruction is executed by processor.The processing
Device is used to provide calculating and control ability, supports the operation of whole mobile terminal 10.Built-in storage in mobile terminal 10 is non-
The operation of computer-readable instruction in volatile storage medium provides environment.Network interface is used to lead to server progress network
Letter.The display screen of mobile terminal 10 can be LCDs or electric ink display screen etc., and input unit can be display
The button, trace ball or the Trackpad that are set on the touch layer or the shell of mobile terminal 10 covered on screen or outer
Keyboard, Trackpad or mouse for connecing etc..The mobile terminal 10 can be mobile phone, tablet personal computer or personal digital assistant or wearing
Formula equipment etc..It will be understood by those skilled in the art that the structure shown in Fig. 1, the only part related to application scheme
The block diagram of structure, the restriction for the mobile terminal 10 being applied thereon to application scheme, specific mobile terminal are not formed
10 can include, than more or less parts shown in figure, either combining some parts or arranging with different parts.
Fig. 2 is the flow chart of image processing method in one embodiment.As shown in Fig. 2 a kind of image processing method, including
Step 202 is to step 206.Wherein：
Step 202, multiple pending images are obtained, multiple described images are topography in panoramic picture.
In image imaging process, by the hardware limitation of imaging device itself, the visual angle of imaging device is generally smaller and regards
Open country immobilizes, and can not obtain the visual field wider full scene image in a big way.And image resolution ratio and photographed scene regard
Angle mutually restricts, and increase image aspects can then bring resolution ratio to decline, the Quality Down of image, fogging image.And pass through by
There are multiple small angle image mosaics of certain overlapping region, can obtain the wide-angle image of high resolution, image clearly.
Specifically, multiple pending images can be image containing mist or the normal image without mist.Multiple images are
Refer to the image of two or more than two.Multiple above-mentioned images are topography in panoramic picture, and every image is extremely in multiple images
Few and other image have lap, and multiple images are sliceable to form an image.Above-mentioned multiple pending images can
For the image of fixed focal length shooting, or the not image of fixed focal length shooting.Above-mentioned multiple pending images can be same
The image of equipment shooting, or the image of distinct device shooting.
Step 204, the defogging weight and defogging parameter value of single image in multiple described images are obtained successively, according to described
Defogging parameter value and defogging weight carry out defogging processing to the single image.
Specifically, after multiple pending images are got, the defogging of every image in multiple images can be obtained successively
Weight and defogging parameter value.Above-mentioned defogging weight refers to the degree to image defogging；Defogging parameter value refers to according to defogging algorithm
Used parameter during defogging is carried out to image.
Defogging processing to image includes many algorithms, such as dark primary priori defogging algorithm, single image defogging algorithm.
By taking single image defogging algorithm as an example, defogging parameter value may include air light value, transmissivity and air light value；With dark primary priori
Exemplified by defogging algorithm, defogging parameter value includes air light value and transmissivity.Defogging parameter value is obtained based on dark primary elder generation checking method
The step of include：
Obtain atmospherical scattering model
I (x)=J (x) t (x)+A (1-t (x))
Wherein, I (x) is the image information observed, and J (x) is the radiation information from target, that is, the nothing after recovery
Mist image, x represent the locus of a certain pixel in image, and t (x) is transmissivity, and A is the air light value of infinite point.Air
Light value can be calculated by the gray-scale map of pending image to be obtained, also by pair of air light value and weather condition and current time
Answer Relation acquisition.Under normal conditions, estimation of the pixel of maximum intensity in image as air light value can be selected.Assuming that A is
Given value, the very low passage of channel value be present in tri- passages of RGB in pending image, and the channel value then may be used close to zero
To obtain：
Can get transmissivity by above formula is：
WhereinAs image containing mist can introduce one 0 to 1 in the dark primary value in x fields
Between weights ω transmissivity is adjusted, that is, introduce the regulation of defogging weights omega to the defogging degree of image, then finally ask for
Defogging parameter be that transmissivity expression formula is as follows：
In order to ensure defog effect, a threshold value t can be set to transmissivity0, then the light intensity of scenery when fogless
For：
According to acquisition it is fogless when still life light intensity then can to pending image carry out defogging processing.
Step 206, multiple image mosaics are into an image after defogging is handled.
Specifically, can be by multiple image mosaics into an image after multiple images after getting defogging processing.Scheming
In the splicing of picture, influenceed, spelled by factors such as hardware deficiency, shooting angle, the scene dynamics changes of imaging device itself
Connect the image to be formed and there may be excessive discontinuous, the jointed problem of image of colour brightness between image.Calculated by image co-registration
Method can obtain that tone is consistent, the natural seamless image splicing of transition.Wherein, wrapped by the step of Image Fusion stitching image
Include：
(1) feature point description operator in image is extracted, that is, extracting can be with the operator of Expressive Features point in image.
(2) characteristic matching is carried out.Wherein the algorithm of characteristic matching includes Kd-Tree algorithms, approximate KNN algorithm etc..
(3) matching characteristic point is extracted.After obtaining matching characteristic point according to Feature Correspondence Algorithm, the characteristic point of matching is extracted.
(4) image co-registration.Fusion is carried out to image can use bilinear interpolation, medium filtering etc..
Image processing method in the embodiment of the present invention, multiple small angle high-definition pictures of acquisition are carried out at defogging
Reason, then multiple image mosaics after defogging is handled are into an image.Avoid when obtaining wide-angle image, image resolution ratio
The problem of relatively low, fogging image.
In one embodiment, the defogging weight of single image in multiple described images is obtained described in step step 204
Including：The mistiness degree parameter value of the single image is obtained, the thing of the single image is determined according to the mistiness degree parameter value
Away from parameter value；The defogging weight of the single image is determined according to the object distance parameter value.
Specifically, the mistiness degree of image and the relational expression of air light value and transmissivity are：
F (x)=A* (1-t (x))
Wherein, F (x) represents mistiness degree, and when air light value A is fixed given value, the smaller then mistiness degree of transmissivity is bigger,
The more big then mistiness degree of transmissivity is smaller.After the air light value and transmissivity of each pixel in getting pending image, i.e.,
The mistiness degree parameter value of each pixel in pending image can be asked for.
After mistiness degree parameter value is got, object distance parameter value can be obtained according to mistiness degree parameter value.Wherein, image containing mist
Mistiness degree and object distance meet relational expression as follows：
F (x)=1-e-βd(x)
Wherein, β represents the scattering coefficient of air, d (x) expression things away from, mistiness degree F (x) and object distance d (x) exponent function relations,
Mistiness degree F (x) exponentially increases with object distance d (x) increase.
Then object distance d (x) and mistiness degree F (x) relation is：
Each pixel in image can be obtained according to the air light value of each pixel and transmissivity in the image of acquisition
Mistiness degree parameter value, after mistiness degree parameter value is got, you can obtain object distance parameter value corresponding to each pixel in image.
Wherein, object distance parameter value of the object distance parameter value average as image of all pixels point in image can be asked for.It is pre- in mobile terminal
There is the mapping table between object distance parameter value and defogging weight.The defogging weight of every image in multiple images are got
Afterwards, defogging processing can be carried out to every image in multiple images successively.If table 1 below is between object distance parameter value and defogging weight
Mapping table.
Mapping table between the object distance parameter value of table 1 and defogging weight
| Object distance parameter value (m) | Defogging weight |
| <2 | 0.1 |
| >=2 and<5 | 0.3 |
| >=5 and<10 | 0.5 |
| >=10 and<15 | 0.8 |
| ≥15 | 1 |
Image processing method in the embodiment of the present invention, different defogging weights is set according to the object distance of image.I.e. to difference
The defogging degree that image is set according to object distance is different.Under normal circumstances, the region mistiness degree of object distance farther out is higher in image, to figure
As unified defogging can cause the halfway problem of defogging in image.The defogging weight of image is set according to the object distance of image, can be made
Must be more intelligent to the defogging of image, image defogging is more thorough, and picture quality is higher after defogging.
In one embodiment, methods described also includes：Obtain the brightness value average of multiple images；Splicing is obtained
The brightness value of an image be adjusted to the brightness value average.
Specifically, after an image of multiple image mosaics formation is got, the image being spliced into can have brightness value
Uneven situation.By obtaining the brightness value of every image in multiple images, then the average of the brightness value of multiple images is asked for,
Brightness value average according to multiple images adjusts the brightness value of stitching image.
Image processing method in the embodiment of the present invention, by obtaining the brightness value average of multiple images, further according to acquisition
The brightness value averages of multiple images adjusts the brightness value of stitching image, can make the brightness value of image after splicing evenly.And
By way of the brightness value average for obtaining multiple images, the brightness value of acquisition can be made closer to the brightness of actual photographed image
Value situation, the image for obtaining splicing are truer.
In one embodiment, the defogging parameter value includes air light value and transmissivity；It is described to be joined according to the defogging
Numerical value and defogging weight, which carry out defogging processing to the single image, to be included：
Step 302, the transmissivity factor of each passage in default tri- passages of RGB is obtained.
Step 304, the transmissivity of each passage in tri- passages of RGB is obtained according to the transmissivity factor.
Step 306, according to the transmissivity of each passage in tri- passages of the air light value and RGB respectively to RGB tri-
Passage carries out defogging processing.
Specifically, influence of the mist pollution to tri- passages of RGB is different, when using defogging algorithm to image entirety defogging,
Mist in image on G passages and channel B can not remove completely.Further, influence of the mist of same concentrations to tri- passages of RGB
Transmissivity highest, the transmissivity of channel B of difference, wherein R passages are minimum, the transmissivity of G passages is positioned between the two；And in mist
During concentration increase, the difference between tri- passages of RGB also increases.In the present embodiment, the transmissivity factor is preset to tri- passages of RGB
ωR、ωG、ωB, wherein,
ωR=1
ωG=(0.9+0.1*t (x))2
ωB=(0.7+0.3*t (x))2
The transmissivity t of tri- each passages of passage of RGB is asked for according to the default transmissivity factorR、tG、tB。
tR=ωR* t (x)=t (x)
tG=ωG* t (x)=t (x) * (0.9+0.1*t (x))2
tB=ωB* t (x)=t (x) * (0.7+0.3*t (x))2
Wherein, t (x) is the transmissivity of pending image, it is assumed that the air light value A of pending image is given value, according to
Formula：
T (x) in above-mentioned formula is replaced with into t successivelyR、tG、tB, you can tri- passages of RGB in pending image are entered successively
The processing of row defogging.
Image processing method in the embodiment of the present invention, defogging processing is carried out successively to tri- passages of RGB of pending image,
Different defogging intensity is realized to tri- passages of RGB, breaches G caused by uniformly carrying out defogging processing to image in conventional art
The situation that mist can not remove completely on passage and channel B, defog effect is more preferable, and mist elimination image quality is higher.
In one embodiment, above-mentioned image processing method also includes：
Step 402, if the single image is the image that dual camera shooting obtains, the prospect of the single image is distinguished
Region and background area.
Step 404, defogging processing is carried out respectively to the foreground area and the background area.
Specifically, when mobile terminal has the first camera and second camera, it can control the first camera and second
Camera is different to the focusing position of same scenery.For example, the focusing position of the first camera is relatively near, the focusing of second camera
Position is farther out.Shot simultaneously with second camera using the first camera, and the first camera and second camera are clapped
The picture for taking the photograph acquisition carries out synthesis processing, can specifically use Image Super-resolution Reconstruction technology to the first camera and second camera
The picture that shooting obtains is synthesized.In the composite image, the image of nearer the first camera shooting acquisition of focusing position is
Foreground area；The image that the second camera shooting of focusing position farther out obtains is background area.Gone to composograph
During mist, foreground area and background area can be collected to composograph and carries out defogging respectively.Specifically, can be to foreground area and background
Region sets different defogging grades, and foreground area and background area are carried out at defogging respectively according to the defogging grade of setting
Reason.For example, after foreground area in getting composograph and background area, the defogging grade higher to foreground area setting,
Relatively low defogging grade is set to background area, i.e., goes atomization degree for the treatment of higher foreground area, background area is gone
Atomization process degree is relatively low.In other embodiments, it is right after the first camera and second camera shooting get picture
The picture that nearer the first camera shooting of focusing position obtains sets higher defogging grade, and according to the defogging grade of setting
Carry out defogging processing；The picture obtained to the second camera shooting of focusing position farther out sets relatively low defogging grade, and presses
Defogging processing is carried out according to the defogging grade of setting.The picture that the shooting of the first camera obtains after defogging is handled again is handled with defogging
The picture that second camera shooting obtains afterwards is synthesized.
Fig. 5 is the structured flowchart of image processing apparatus in one embodiment.As shown in figure 5, a kind of image processing apparatus, bag
Include acquisition module 502, defogging module 504 and concatenation module 506.Wherein：
Acquisition module 502, for obtaining multiple pending images, multiple described images are Local map in panoramic picture
Picture.
Defogging module 504, for obtaining the defogging weight and defogging parameter value of single image in multiple described images successively,
Defogging processing is carried out to the single image according to the defogging parameter value and defogging weight.
Concatenation module 506, for multiple image mosaics after defogging is handled into an image.
In one embodiment, the defogging module 504 is additionally operable to obtain the mistiness degree parameter value of the single image, root
The object distance parameter value of the single image is determined according to the mistiness degree parameter value；According to the object distance parameter value determine described in individual
The defogging weight of image.
In one embodiment, the defogging parameter value includes air light value and transmissivity；The defogging module 504 is also used
In the transmissivity factor for obtaining each passage in default tri- passages of RGB；It is logical that RGB tri- is obtained according to the transmissivity factor
The transmissivity of each passage in road；According to the transmissivity of each passage in tri- passages of the air light value and RGB respectively to RGB
Three passages carry out defogging processing.
Fig. 6 is the structured flowchart of image processing apparatus in another embodiment.As shown in fig. 6, a kind of image processing apparatus,
Including acquisition module 602, defogging module 604, concatenation module 606 and brightness adjusting section 608.Wherein, acquisition module 602, go
Mist module 604, concatenation module 606 are identical with corresponding functions of modules in Fig. 5.
Brightness adjusting section 608, for obtaining the brightness value average of multiple images；The image obtained will be spliced
Brightness value be adjusted to the brightness value average.
Fig. 7 is the structured flowchart of image processing apparatus in another embodiment.As shown in fig. 7, a kind of image processing apparatus,
Including acquisition module 702, defogging module 704, concatenation module 706 and discriminating module 708.Wherein, acquisition module 702, defogging mould
Block 704, concatenation module 706 are identical with corresponding functions of modules in Fig. 5.
Discriminating module 708, if being the image that dual camera shooting obtains for the single image, distinguish individual described figure
The foreground area of picture and background area；
Defogging module 704 is additionally operable to carry out defogging processing respectively to the foreground area and the background area.
The division of modules is only used for for example, in other embodiments, will can scheme in above-mentioned image processing apparatus
As processing unit is divided into different modules as required, to complete all or part of function of above-mentioned image processing apparatus.
The embodiment of the present invention additionally provides a kind of computer-readable recording medium.One or more can perform comprising computer
The non-volatile computer readable storage medium storing program for executing of instruction, when the computer executable instructions are executed by one or more processors
When so that the computing device following steps：
(1) multiple pending images are obtained, multiple described images are topography in panoramic picture；
(2) the defogging weight and defogging parameter value of single image in multiple described images are obtained successively, according to the defogging
Parameter value and defogging weight carry out defogging processing to the single image；
(3) multiple image mosaics are into an image after defogging is handled.
In one embodiment, the defogging weight of single image includes in multiple images described in the acquisition：Described in acquisition
The mistiness degree parameter value of single image, the object distance parameter value of the single image is determined according to the mistiness degree parameter value；According to
The object distance parameter value determines the defogging weight of the single image.
In one embodiment, above-mentioned image processing method also includes：Obtain the brightness value average of multiple images；Will
The brightness value for splicing the image obtained is adjusted to the brightness value average.
In one embodiment, the defogging parameter value includes air light value and transmissivity；It is described to be joined according to the defogging
Numerical value and defogging weight, which carry out defogging processing to the single image, to be included：Obtain each passage in default tri- passages of RGB
The transmissivity factor；The transmissivity of each passage in tri- passages of RGB is obtained according to the transmissivity factor；According to the air
The transmissivity of each passage carries out defogging processing to tri- passages of RGB respectively in tri- passages of light value and RGB.
In one embodiment, above-mentioned image processing method also includes：If the single image is dual camera, shooting obtains
The image taken, distinguish foreground area and the background area of the single image；To the foreground area and the background area point
Carry out not defogging processing.
The embodiment of the present invention also provides a kind of computer equipment.Above computer equipment includes image processing circuit, figure
As process circuit can utilize hardware and/or component software to realize, it may include define ISP (Image Signal
Processing, picture signal processing) pipeline various processing units.Fig. 8 is that image processing circuit shows in one embodiment
It is intended to.As shown in figure 8, for purposes of illustration only, the various aspects of the image processing techniques related to the embodiment of the present invention are only shown.
As shown in figure 8, image processing circuit includes ISP processors 840 and control logic device 850.Imaging device 810 is caught
View data handled first by ISP processors 840, ISP processors 840 view data is analyzed with catch can be used for it is true
The image statistics of fixed and/or imaging device 810 one or more control parameters.Imaging device 810 may include there is one
The camera of individual or multiple lens 812 and imaging sensor 814.Imaging sensor 814 may include colour filter array (such as
Bayer filters), imaging sensor 814 can obtain the luminous intensity caught with each imaging pixel of imaging sensor 814 and wavelength
Information, and the one group of raw image data that can be handled by ISP processors 840 is provided.Sensor 820 can be connect based on sensor 820
Raw image data is supplied to ISP processors 840 by mouth type.The interface of sensor 820 can utilize SMIA (Standard
Mobile Imaging Architecture, Standard Mobile Imager framework) interface, other serial or parallel camera interfaces or
The combination of above-mentioned interface.
ISP processors 840 handle raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processors 840 can be carried out at one or more images to raw image data
Reason operation, statistical information of the collection on view data.Wherein, image processing operations can be by identical or different bit depth precision
Carry out.
ISP processors 840 can also receive pixel data from video memory 830.For example, from the interface of sensor 820 by original
Beginning pixel data is sent to video memory 830, and the raw pixel data in video memory 830 is available to ISP processors
840 is for processing.Video memory 830 can be independent in a part, storage device or electronic equipment for storage arrangement
Private memory, and may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.
When receiving the raw image data from the interface of sensor 820 or from video memory 830, ISP processing
Device 840 can carry out one or more image processing operations, such as time-domain filtering.View data after processing can be transmitted to be stored to image
Device 930, to carry out other processing before shown.ISP processors 940 can also be from the reception processing of video memory 930
Data, the image real time transfer in original domain and in RGB and YCbCr color spaces is carried out to above-mentioned processing data.After processing
View data may be output to display 880, for user watch and/or by graphics engine or GPU (Graphics
Processing Unit, graphics processor) further processing.In addition, the output of ISP processors 840 also can be transmitted and be deposited to image
Reservoir 830, and display 880 can read view data from video memory 830.In one embodiment, video memory 830
It can be configured as realizing one or more frame buffers.In addition, the output of ISP processors 840 can be transmitted to encoder/decoder
870, so as to encoding/decoding image data.The view data of coding can be saved, and on the equipment of display 880 is shown in it
Preceding decompression.
View data after the processing of ISP processors 840 can be transmitted to defogging module 860, so as to before shown to figure
As carrying out defogging processing.Defogging module 860 may include to obtain single image in multiple images to the processing of view data defogging
Mist weight and defogging parameter value, defogging processing is carried out to single image according to above-mentioned defogging weight and defogging parameter value.Wherein, go
Mist module 860 can be CPU (Central Processing Unit, central processing unit), GPU (Graphics in mobile terminal
Processing Unit, graphics processor) or coprocessor etc..After view data is carried out defogging processing by defogging module 860,
View data after can defogging be handled is sent to encoder/decoder 870, so as to encoding/decoding image data.The figure of coding
As data can be saved, and show with the equipment of display 880 before decompress.It is understood that at defogging module 860
View data after reason can directly be issued display 880 and shown without encoder/decoder 870.ISP processors
View data after 840 processing can also first pass through encoder/decoder 870 and handle, and then be carried out again by defogging module 860
Processing.Above-mentioned encoder/decoder 870 can be CPU, GPU or coprocessor etc. in mobile terminal.
The statistics that ISP processors 840 determine, which can be transmitted, gives the unit of control logic device 850.For example, statistics can wrap
Include the image sensings such as automatic exposure, AWB, automatic focusing, flicker detection, black level compensation, the shadow correction of lens 812
The statistical information of device 814.Control logic device 850 may include the processor and/or micro-control for performing one or more routines (such as firmware)
Device processed, one or more routines according to the statistics of reception, can determine control parameter and the ISP processing of imaging device 810
The control parameter of device 840.For example, control parameter may include the control parameter of sensor 820 (such as gain, the integration of spectrum assignment
Time), camera flash control parameter, the group of the control parameter of lens 812 (such as focus on or zoom focal length) or these parameters
Close.ISP control parameters may include the gain level for being used for AWB and color adjustment (for example, RGB processing during) and
Color correction matrix, and the shadow correction parameter of lens 812.
It it is below the step of realizing image processing method with image processing techniques in Fig. 8：
(1) multiple pending images are obtained, multiple described images are topography in panoramic picture；
(2) the defogging weight and defogging parameter value of single image in multiple described images are obtained successively, according to the defogging
Parameter value and defogging weight carry out defogging processing to the single image；
(3) multiple image mosaics are into an image after defogging is handled.
In one embodiment, the defogging weight of single image includes in multiple images described in the acquisition：Described in acquisition
The mistiness degree parameter value of single image, the object distance parameter value of the single image is determined according to the mistiness degree parameter value；According to
The object distance parameter value determines the defogging weight of the single image.
In one embodiment, above-mentioned image processing method also includes：Obtain the brightness value average of multiple images；Will
The brightness value for splicing the image obtained is adjusted to the brightness value average.
In one embodiment, the defogging parameter value includes air light value and transmissivity；It is described to be joined according to the defogging
Numerical value and defogging weight, which carry out defogging processing to the single image, to be included：Obtain each passage in default tri- passages of RGB
The transmissivity factor；The transmissivity of each passage in tri- passages of RGB is obtained according to the transmissivity factor；According to the air
The transmissivity of each passage carries out defogging processing to tri- passages of RGB respectively in tri- passages of light value and RGB.
In one embodiment, above-mentioned image processing method also includes：If the single image is dual camera, shooting obtains
The image taken, distinguish foreground area and the background area of the single image；To the foreground area and the background area point
Carry out not defogging processing.
One of ordinary skill in the art will appreciate that realize all or part of flow in above-described embodiment method, being can be with
The hardware of correlation is instructed to complete by computer program, described program can be stored in a non-volatile computer and can be read
In storage medium, the program is upon execution, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, described storage is situated between
Matter can be magnetic disc, CD, read-only memory (Read-O more ly Memory, ROM) etc..
Embodiment described above only expresses the several embodiments of the present invention, and its description is more specific and detailed, but simultaneously
Therefore the limitation to the scope of the claims of the present invention can not be interpreted as.It should be pointed out that for one of ordinary skill in the art
For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the guarantor of the present invention
Protect scope.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (12)
- A kind of 1. image processing method, it is characterised in that including：Multiple pending images are obtained, multiple described images are topography in panoramic picture；Obtain the defogging weight and defogging parameter value of single image in multiple described images successively, according to the defogging parameter value and Defogging weight carries out defogging processing to the single image；Multiple image mosaics are into an image after defogging is handled.
- 2. image processing method according to claim 1, it is characterised in that individual figure in multiple images described in the acquisition The defogging weight of picture includes：The mistiness degree parameter value of the single image is obtained, the object distance of the single image is determined according to the mistiness degree parameter value Parameter value；The defogging weight of the single image is determined according to the object distance parameter value.
- 3. image processing method according to claim 1, it is characterised in that methods described also includes：Obtain the brightness value average of multiple images；The brightness value for splicing the image obtained is adjusted to the brightness value average.
- 4. image processing method according to claim 1, it is characterised in that：The defogging parameter value includes air light value and transmissivity；It is described that single image progress defogging processing is included according to the defogging parameter value and defogging weight：Obtain the transmissivity factor of each passage in default tri- passages of RGB；The transmissivity of each passage in tri- passages of RGB is obtained according to the transmissivity factor；Defogging is carried out to tri- passages of RGB according to the transmissivity of each passage in tri- passages of the air light value and RGB respectively Processing.
- 5. image processing method according to claim 1, it is characterised in that methods described also includes：If the single image is the image that dual camera shooting obtains, the foreground area and background area of the single image are distinguished Domain；Defogging processing is carried out respectively to the foreground area and the background area.
- A kind of 6. image processing apparatus, it is characterised in that including：Acquisition module, for obtaining multiple pending images, multiple described images are topography in panoramic picture；Defogging module, for obtaining the defogging weight and defogging parameter value of single image in multiple described images successively, according to institute State defogging parameter value and defogging weight and defogging processing is carried out to the single image；Concatenation module, for multiple image mosaics after defogging is handled into an image.
- 7. image processing apparatus according to claim 6, it is characterised in that：The defogging module is additionally operable to obtain the mistiness degree parameter value of the single image, is determined according to the mistiness degree parameter value The object distance parameter value of the single image；The defogging weight of the single image is determined according to the object distance parameter value.
- 8. image processing apparatus according to claim 6, it is characterised in that described device also includes：Brightness adjusting section, for obtaining the brightness value average of multiple images；The brightness of the image obtained will be spliced Value is adjusted to the brightness value average.
- 9. image processing apparatus according to claim 6, it is characterised in that：The defogging parameter value includes air light value and transmissivity；The defogging module is additionally operable to obtain the transmissivity factor of each passage in default tri- passages of RGB；According to described Penetrate the transmissivity that the rate factor obtains each passage in tri- passages of RGB；According to each in tri- passages of the air light value and RGB The transmissivity of passage carries out defogging processing to tri- passages of RGB respectively.
- 10. image processing apparatus according to claim 6, it is characterised in that described device also includes：Discriminating module, if being the image that dual camera shooting obtains for the single image, before distinguishing the single image Scene area and background area；The defogging module is additionally operable to carry out defogging processing respectively to the foreground area and the background area.
- 11. one or more includes the non-volatile computer readable storage medium storing program for executing of computer executable instructions, when the calculating When machine executable instruction is executed by one or more processors so that the computing device such as any one of claim 1 to 5 Described image processing method.
- 12. a kind of computer equipment, including memory and processor, computer-readable instruction is stored in the memory, institute When stating instruction by the computing device so that the computing device is at the image as any one of claim 1 to 5 Reason method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710624551.9A CN107481198B (en) | 2017-07-27 | 2017-07-27 | Image processing method, image processing device, computer-readable storage medium and computer equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710624551.9A CN107481198B (en) | 2017-07-27 | 2017-07-27 | Image processing method, image processing device, computer-readable storage medium and computer equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107481198A true CN107481198A (en) | 2017-12-15 |
| CN107481198B CN107481198B (en) | 2020-01-10 |
Family
ID=60597817
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710624551.9A Active CN107481198B (en) | 2017-07-27 | 2017-07-27 | Image processing method, image processing device, computer-readable storage medium and computer equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107481198B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114697533A (en) * | 2020-12-30 | 2022-07-01 | 深圳Tcl数字技术有限公司 | Image processing method and device, computer readable storage medium and smart television |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102510482A (en) * | 2011-11-29 | 2012-06-20 | 蔡棽 | Image splicing reconstruction and overall monitoring method for improving visibility and visual distance |
| WO2013029337A1 (en) * | 2011-08-30 | 2013-03-07 | Fujitsu Limited | Image defogging method and system |
| CN103034977A (en) * | 2011-09-30 | 2013-04-10 | 株式会社日立制作所 | Image defogging method and corresponding image defogging device |
| CN104732494A (en) * | 2015-03-23 | 2015-06-24 | 无锡中科智能农业发展有限责任公司 | Tissue culturing monitoring method and system based on image mist elimination |
| EP2568438A3 (en) * | 2011-09-08 | 2016-09-14 | Fujitsu Limited | Image defogging method and system |
| CN106033597A (en) * | 2015-03-17 | 2016-10-19 | 杭州海康威视数字技术股份有限公司 | Image defogging method and equipment thereof |
| CN106780376A (en) * | 2016-12-07 | 2017-05-31 | 中国农业科学院农业信息研究所 | The background image dividing method of partitioning algorithm is detected and combined based on conspicuousness |
-
2017
- 2017-07-27 CN CN201710624551.9A patent/CN107481198B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013029337A1 (en) * | 2011-08-30 | 2013-03-07 | Fujitsu Limited | Image defogging method and system |
| EP2568438A3 (en) * | 2011-09-08 | 2016-09-14 | Fujitsu Limited | Image defogging method and system |
| CN103034977A (en) * | 2011-09-30 | 2013-04-10 | 株式会社日立制作所 | Image defogging method and corresponding image defogging device |
| CN102510482A (en) * | 2011-11-29 | 2012-06-20 | 蔡棽 | Image splicing reconstruction and overall monitoring method for improving visibility and visual distance |
| CN106033597A (en) * | 2015-03-17 | 2016-10-19 | 杭州海康威视数字技术股份有限公司 | Image defogging method and equipment thereof |
| CN104732494A (en) * | 2015-03-23 | 2015-06-24 | 无锡中科智能农业发展有限责任公司 | Tissue culturing monitoring method and system based on image mist elimination |
| CN106780376A (en) * | 2016-12-07 | 2017-05-31 | 中国农业科学院农业信息研究所 | The background image dividing method of partitioning algorithm is detected and combined based on conspicuousness |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114697533A (en) * | 2020-12-30 | 2022-07-01 | 深圳Tcl数字技术有限公司 | Image processing method and device, computer readable storage medium and smart television |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107481198B (en) | 2020-01-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107424198A (en) | Image processing method, device, mobile terminal and computer-readable recording medium | |
| CN108805103A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN107194900A (en) | Image processing method, device, computer-readable recording medium and mobile terminal | |
| CN108055452A (en) | Image processing method, device and equipment | |
| CN107911625A (en) | Light measuring method, device, readable storage medium storing program for executing and computer equipment | |
| CN107493432A (en) | Image processing method, device, mobile terminal and computer-readable recording medium | |
| CN107424133A (en) | Image defogging method, device, computer can storage medium and mobile terminals | |
| CN107481186A (en) | Image processing method, device, computer-readable recording medium and computer equipment | |
| CN108024054A (en) | Image processing method, device and equipment | |
| CN107395991A (en) | Image combining method, device, computer-readable recording medium and computer equipment | |
| CN107317967A (en) | Image processing method, device, mobile terminal and computer-readable recording medium | |
| CN107563979A (en) | Image processing method, device, computer-readable recording medium and computer equipment | |
| CN109089041A (en) | Recognition methods, device, electronic equipment and the storage medium of photographed scene | |
| WO2019029573A1 (en) | Image blurring method, computer-readable storage medium and computer device | |
| CN107277299A (en) | Image processing method, device, mobile terminal and computer-readable recording medium | |
| CN107465903A (en) | Image white balance method, device and computer-readable recording medium | |
| CN107454317B (en) | Image processing method, image processing device, computer-readable storage medium and computer equipment | |
| CN107194901A (en) | Image processing method, device, computer equipment and computer-readable recording medium | |
| CN107317969A (en) | Image defogging method, device, computer can storage medium and mobile terminals | |
| CN107277369B (en) | Image processing method, device, computer readable storage medium and computer equipment | |
| CN107392870B (en) | Image processing method, image processing device, mobile terminal and computer readable storage medium | |
| CN107341782B (en) | Image processing method, image processing device, computer equipment and computer readable storage medium | |
| CN107454318B (en) | Image processing method, image processing device, mobile terminal and computer readable storage medium | |
| CN107454328B (en) | Image processing method, device, computer readable storage medium and computer equipment | |
| CN107295261A (en) | Image defogging processing method, device, storage medium and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: OPPO Guangdong Mobile Communications Co., Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: Guangdong Opel Mobile Communications Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |