CN107317967A - Image processing method, device, mobile terminal and computer-readable recording medium - Google Patents
Image processing method, device, mobile terminal and computer-readable recording medium Download PDFInfo
- Publication number
- CN107317967A CN107317967A CN201710624485.5A CN201710624485A CN107317967A CN 107317967 A CN107317967 A CN 107317967A CN 201710624485 A CN201710624485 A CN 201710624485A CN 107317967 A CN107317967 A CN 107317967A
- Authority
- CN
- China
- Prior art keywords
- blue sky
- image
- pending image
- processing
- defogging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
The present invention relates to a kind of image processing method, device, mobile terminal and computer-readable recording medium.The above method, including：Obtain pending image；Judge in the pending image whether to include blue sky, if comprising extracting the blue sky region in the pending image；Defogging processing is carried out to the blue sky region.Above-mentioned image processing method, device, mobile terminal and computer-readable recording medium, automatically the saturation degree in blue sky region in pending image is improved, and retain the raw information in non-blue sky region, processing by mistake is not carried out to other non-blue sky regions, make the image after the defogging processing of carry out blue sky region more true, natural.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of image processing method, device, mobile terminal and meter
Calculation machine readable storage medium storing program for executing.
Background technology
Saturation degree refers to the purity of the bright-coloured program, also referred to as color of color, saturation degree depend in color containing color into
Divide the ratio with colour killing composition (grey).In daily life, user shoots picture by imaging device such as camera
Afterwards, often selection adjusts the saturation degree of picture, makes the effect of picture more preferable by improving the saturation degree of picture.And in traditional side
In formula, the general intensity value that picture is manually adjusted by user of regulation picture saturation degree is cumbersome.
The content of the invention
The embodiment of the present invention provides a kind of image processing method, device, mobile terminal and computer-readable recording medium, can
To improve the saturation degree in the blue sky region in image automatically.
A kind of image processing method, including：
Obtain pending image；
Judge in the pending image whether to include blue sky, if comprising extracting the blue sky in the pending image
Region；
Defogging processing is carried out to the blue sky region.
In one of the embodiments, it is described to judge blue sky whether is included in the pending image, including：
Gather the acquisition parameters associated with the pending image；
If the acquisition parameters meet preparatory condition, it is determined that include blue sky in the pending image.
In one of the embodiments, the blue sky region extracted in the pending image, including：
By the pending image from the first color space conversion to the second color space；
Obtain the parameter area that each color parameter is matched with blue sky in second color space；
The parameter area matched according to each described color parameter with blue sky extracts the blue sky area in the pending image
Domain.
In one of the embodiments, it is described to blue sky region progress defogging processing, including：
Determine the mistiness degree in the blue sky region；
The modifying factor matched with the mistiness degree is chosen, and transmissivity is obtained according to modifying factor calculating；
Defogging processing is carried out to the blue sky region according to the transmissivity.
In one of the embodiments, methods described, in addition to：
Obtain the brightness value for carrying out the image after defogging processing；
If the brightness value is less than predetermined threshold value, the brightness value of the image after the progress defogging processing is adjusted to institute
State predetermined threshold value.
A kind of image processing apparatus, including：
Image collection module, for obtaining pending image；
Judge module, for judging whether include blue sky in the pending image；
Extraction module, if for including blue sky in the pending image, extracting the blue sky in the pending image
Region；
Defogging module, for carrying out defogging processing to the blue sky region.
In one of the embodiments, the judge module, including：
Collecting unit, for gathering the acquisition parameters associated with the pending image；
Determining unit, if meeting preparatory condition for the acquisition parameters, it is determined that indigo plant is included in the pending image
My god；
The extraction module, including：
Converting unit, for by the pending image from the first color space conversion to the second color space；
Parameter area acquiring unit, for obtaining the ginseng that each color parameter is matched with blue sky in second color space
Number scope；
Extraction unit, the parameter area for being matched according to each described color parameter with blue sky extracts the pending figure
Blue sky region as in.
In one of the embodiments, the defogging module, including：
Determining unit, the mistiness degree for determining the blue sky region；
Computing unit, for choosing the modifying factor matched with the mistiness degree, and is calculated according to the modifying factor
To transmissivity；
Defogging unit, for carrying out defogging processing to the blue sky region according to the transmissivity.
In one of the embodiments, described device also includes：
Luminance acquisition module, the brightness value of the image after defogging processing is carried out for obtaining；
Adjusting module, if being less than predetermined threshold value for the brightness value, by the image after the progress defogging processing
Brightness value is adjusted to the predetermined threshold value.
A kind of mobile terminal, including memory, processor and storage are on a memory and the meter that can run on a processor
Calculation machine program, realizes method as described above during the computing device described program.
A kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the computer program
Method as described above is realized when being executed by processor.
Above-mentioned image processing method, device, mobile terminal and computer-readable recording medium, obtain pending image, if
Blue sky is included in pending image, then extracts the blue sky region in pending image, defogging processing is carried out to blue sky region, automatically
The saturation degree in blue sky region in pending image is improved, the blue sky of image is strengthened, image is manually adjusted without user
Saturation degree, it is easy to operate, and retain the raw information in non-blue sky region, processing by mistake is not carried out to other non-blue sky regions, make into
Image after the defogging processing of row blue sky region is more true, natural.
Brief description of the drawings
Fig. 1 is the block diagram of mobile terminal in one embodiment；
Fig. 2 is the schematic flow sheet of image processing method in one embodiment；
Fig. 3 be one embodiment in extract pending image blue sky region schematic flow sheet；
Fig. 4 is the schematic flow sheet for carrying out defogging processing in one embodiment to the blue sky region of extraction；
Fig. 5 is the block diagram of image processing apparatus in one embodiment；
Fig. 6 is the block diagram of extraction module in one embodiment；
Fig. 7 is the block diagram of defogging module in one embodiment；
Fig. 8 is the schematic diagram of image processing circuit in one embodiment.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right below in conjunction with drawings and Examples
The present invention is further elaborated.It should be appreciated that specific embodiment described herein is only to explain the present invention, not
For limiting the present invention.
It is appreciated that term " first " used in the present invention, " second " etc. can be used to describe various elements herein,
But these elements should not be limited by these terms.These terms are only used for distinguishing first element and another element.Citing comes
Say, without departing from the scope of the invention, the first client can be referred to as the second client, and similarly, can be by
Second client is referred to as the first client.First client and the second client both clients, but it is not same visitor
Family end.
Fig. 1 is the block diagram of mobile terminal in one embodiment.As shown in figure 1, the mobile terminal includes passing through system bus
Processor, non-volatile memory medium, built-in storage and the network interface of connection, display screen and input unit.Wherein, it is mobile whole
The non-volatile memory medium at end is stored with operating system and computer executable instructions, and the computer executable instructions are processed
A kind of image processing method that device is provided when performing with realizing in the embodiment of the present invention.The processor, which is used to provide, to be calculated and controls
Ability, supports the operation of whole mobile terminal.Built-in storage in mobile terminal is the computer in non-volatile memory medium
The operation of readable instruction provides environment.Network interface is used to carry out network service with server.The display screen of mobile terminal can be with
LCDs or electric ink display screen etc., input unit can be the touch layer that is covered on display screen or
The button, trace ball or the Trackpad that are set on mobile terminal case or external keyboard, Trackpad or mouse etc..Should
Mobile terminal can be mobile phone, tablet personal computer or personal digital assistant or Wearable etc..Those skilled in the art can be with
Understand that the structure shown in Fig. 1 is only the block diagram of the part-structure related to application scheme, do not constituted to the application
The restriction for the mobile terminal that scheme is applied thereon, specific mobile terminal can include more more or less than shown in figure
Part, either combines some parts or is arranged with different parts.
As shown in Fig. 2 comprising the following steps in one embodiment there is provided a kind of image processing method：
Step 210, pending image is obtained.
Pending image can be arbitrary image, including image containing mist and the normal image without mist, wherein, there is mist
In weather, the particle such as water droplet is more in air, and object to imaging device, the distance such as camera, video camera is more remote, air grain
Influence of the son to imaging is bigger, and image containing mist generally has that contrast is low, saturation degree is low and tone due to the influence of atmospheric particles
The problems such as skew.
Step 220, judge whether include blue sky in pending image, if so, step 230 is then performed, if it is not, then performing step
Rapid 250.
The pending image of acquisition for mobile terminal, can determine whether whether include blue sky in pending image, if comprising blue sky, can
The blue sky region in pending image is extracted, the blue sky in pending image is strengthened, the saturation degree in blue sky is improved.One
In individual embodiment, mobile terminal can gather the acquisition parameters associated with pending image, and it is pre- to judge whether acquisition parameters meet
If condition, wherein, acquisition parameters may include shooting height, shooting direction and shooting of the imaging device when shooting pending picture
Distance etc., shooting direction may include angle of inclination and anglec of rotation etc. again.Mobile terminal can be gathered by sensors such as gyroscopes
The acquisition parameters associated with pending image, mobile terminal, which can be pre-set, includes each in the condition matched with blue sky, condition
The value range of individual acquisition parameters.The acquisition parameters of collection value range corresponding with condition can be compared for mobile terminal, sentence
Whether the acquisition parameters of disconnected collection meet preparatory condition, for example, default condition may include that shooting height is more than 1 meter, inclination angle
Degree to first-class, but is not limited to this more than 45 degree and direction of rotation.
If the acquisition parameters of collection meet preparatory condition, illustrate to include sky in pending image, can be to pending image
In sky areas be identified, and extract RGB (red, green, blue color space) information of sky areas, can be by sky areas
RGB information is compared with default blue sky RGB information scope, so as to determine whether blue sky.If the RGB information of sky areas
Meet default blue sky RGB information scope, then can determine that and blue sky is included in pending image.
Step 230, the blue sky region in pending image is extracted.
If including blue sky in pending image, mobile terminal can extract the blue sky region in pending image, in this implementation
In example, blue sky region can only include the sky areas of blueness, other object targets not including white clouds etc..Mobile terminal will can be waited to locate
In the sky areas that reason image recognition goes out, the pixel that RGB information meets default blue sky RGB information scope is extracted, group
Into blue sky region.
Step 240, defogging processing is carried out to blue sky region.
In the present embodiment, mobile terminal can carry out defogging processing according to defogging algorithm to the blue sky region of extraction, wherein,
Defogging algorithm may include the defogging algorithm based on image enhaucament and the defogging algorithm based on image restoration, going based on image enhaucament
Mist algorithm may include defogging algorithm based on defogging algorithm theoretical RetineX, based on histogram equalization etc., multiple based on image
Former defogging algorithm may include defogging algorithm based on atmospherical scattering model etc..In the present embodiment, mobile terminal can be by dark
Primary colors elder generation's checking method carries out defogging processing to the blue sky region of extraction, wherein, dark primary elder generation checking method belongs to a kind of and is based on image
The defogging algorithm of recovery.
Pending image is described using atmospherical scattering model in dark primary elder generation checking method, the atmospherical scattering model can
As shown in formula (1)：
I (x)=J (x) t (x)+A (1-t (x)) (1)；
Wherein, I (x) represents pending image, and J (x) represents the image to being obtained after processing image progress defogging processing, t
(x) transmissivity is represented, A represents air light value.For fog free images, some pixels always have at least one in tri- passages of RGB
Individual Color Channel has a very low value, and the value of the Color Channel is close to zero.Therefore, for arbitrary image, its dark channel image
Can be as shown in formula (2)：
Wherein, Jdark(x) dark channel image, J are representedc(y) value of Color Channel is represented, Ω (x) is represented using pixel x in
One window of the heart.According to formula (1) and formula (2), shown in the calculation formula such as formula (3) that transmissivity can be derived：
And in actual life, can also there is some particles even fine day white clouds, in air, see the object of distant place still
The presence of mist can be experienced, and the presence of mist allows the mankind to feel the presence of the depth of field, therefore, can introduce one between [0,1]
The transmissivity asked for is adjusted modifying factor, then introduces the calculating of transmissivity after modifying factor and can be modified to formula by formula (3)
(4)：
Wherein, ω represents the modifying factor adjusted to transmissivity, and the defogging degree that modifying factor can be according to demand is selected
Take, ω is smaller to represent that defogging degree is smaller, ω is bigger to represent that defogging degree is bigger.
Mobile terminal is extracted behind the blue sky region of pending image, and the dark channel diagram in blue sky region can be asked for according to formula (2)
Picture, and obtain the air light value in blue sky region, wherein, mobile terminal can by the pixel of the dark channel image in blue sky region according to
Brightness is ranked up, and extracts according to brightness preceding 0.1% pixel from big to small, then determine in the blue sky region of extraction with
The brightness value of the corresponding position of pixel of extraction, regard the brightness value of the pixel wherein with highest brightness value as atmosphere light
Value.After acquisition for mobile terminal air light value, the transmissivity in the blue sky region extracted can be calculated according to formula (4), and will transmission
Rate brings formula (1) into, asks for obtaining the blue sky region after defogging processing.Mobile terminal defogging can be handled after blue sky region with treating
Other non-blue sky regions in processing image are merged, the image after generation processing.The blue sky region of pending image is entered
The processing of row defogging, can strengthen blue sky region, improve the saturation degree in blue sky region, make the blue sky of pending image more blue.
Above-mentioned image processing method, obtains pending image, if including blue sky in pending image, extracts pending figure
Blue sky region as in, carries out defogging processing to blue sky region, the saturation degree in blue sky region in pending image is improved automatically, right
The blue sky of image is strengthened, and the saturation degree of image is manually adjusted without user, easy to operate, and retains the original in non-blue sky region
Other non-blue sky regions are not carried out processing by mistake by beginning information, make the image after the defogging processing of carry out blue sky region it is more true, oneself
So.
As shown in figure 3, in one embodiment, step 230 extracts the blue sky region in pending image, including following step
Suddenly：
Step 302, by pending image from the first color space conversion to the second color space.
If mobile terminal is judged to include blue sky in pending image, pending image can be turned from the first color space
The second color space is shifted to, in the present embodiment, the first color space can be RGB, the second color space can be (tone, full for HSV
With degree, lightness color space) or other color spaces, however it is not limited to this.Mobile terminal can be according to RGB's and HSV
Conversion formula changes pending image to HSV from RGB, and the conversion formula that RGB changes to HSV can be as shown in formula (5)：
V=max (5)；
Wherein, max represents pixel value maximum in RGB color, and min represents pixel in RGB color most
Small value.
Step 304, the parameter area that each color parameter is matched with blue sky in the second color space is obtained.
Mobile terminal can pre-set the parameter area that each color parameter is matched with blue sky in the second color space.
In hsv color space, color parameter may include H (Hue, tone), S (Saturation, saturation degree) and V (Value, lightness),
Wherein, H is measured with angle, and span is 0 °~360 °, is calculated counterclockwise since red, and red is 0 °, green
For 120 °, blueness is 240 °；S represents color close to the degree of spectrum colour, and the ratio shared by spectrum colour is bigger, and color is close to spectrum
The degree of color is higher, and the saturation degree of color is also higher, and saturation degree is high, and color is general deep and gorgeous；V represents bright journey
Degree, for light source colour, brightness value is relevant with the brightness of illuminator；For object color, the transmittance or reflection of this value and object
Than relevant, the usual spans of V are 0% (black) to 100% (white).Mobile terminal can pre-set tri- color parameters of H, S, V
The parameter area matched with blue sky.
Step 306, the parameter area matched according to each color parameter with blue sky extracts the blue sky area in pending image
Domain.
Mobile terminal can obtain the HSV information of each pixel in the sky areas that pending image recognition goes out, and by day dead zone
The HSV information of each pixel is compared with the parameter area that default tri- color parameters of H, S, V are matched with blue sky in domain, extracts
HSV is satisfied by the pixel of preset parameter range, obtains the blue sky region of pending image.
In the present embodiment, can by pending image from the first color space conversion be the second color space, and extract treat
The blue sky region of image is handled, it is convenient that defogging processing only is carried out to the blue sky region in pending image, extract blue sky region
Other non-blue sky regions are not carried out processing by mistake by saturation degree, make the image after the defogging processing of carry out blue sky region it is more true, oneself
So.
As shown in figure 4, in one embodiment, step 240 carries out defogging processing to blue sky region, comprises the following steps：
Step 402, the mistiness degree in blue sky region is determined.
Mobile terminal can ask for the dark channel image in the blue sky region extracted according to formula (2), and true according to dark channel image
Determine the mistiness degree in blue sky region, dark channel image can be estimated to the mistiness degree image as blue sky region.In one embodiment,
Also the depth of view information in blue sky region can be obtained, and the mistiness degree in blue sky region is determined according to the depth of view information in blue sky region, wherein,
The exponentially increase with the increase of the depth of field of mistiness degree.
Step 404, the modifying factor matched with mistiness degree is chosen, and transmissivity is obtained according to modifying factor calculating.
The corresponding relation of mistiness degree and modifying factor ω can be pre-established, and chooses what is matched with the mistiness degree in blue sky region
Modifying factor, wherein, the mistiness degree in blue sky region is smaller, illustrates that the degree for needing to carry out defogging is smaller, can choose less repair
Positive divisor ω, the mistiness degree in blue sky region is bigger, illustrates that the degree for needing to carry out defogging is bigger, can choose larger modifying factor
ω.In the present embodiment, when the mistiness degree in the blue sky region of extraction is smaller, modifying factor ω can choose 0.5, can obtain effect
The enhanced image in preferable blue sky.
Step 406, defogging processing is carried out to blue sky region according to transmissivity.
The modifying factor matched with the mistiness degree in blue sky region of selection can be substituted into formula (4) by mobile terminal, and calculating is obtained
The transmissivity in blue sky region, and according to formula (1), ask for obtaining the blue sky region after defogging processing, mobile terminal can be by defogging
Blue sky region after reason is merged with other non-blue sky regions in pending image, the image after generation processing.
In the present embodiment, the modifying factor of matching can be chosen according to the mistiness degree in the blue sky region of extraction, according to blue sky
The mistiness degree in region carries out different degrees of defogging to blue sky region, and the effect of saturation degree for making raising blue sky region more preferably, makes
Carry out the image after the processing of blue sky region defogging more true, natural.
In one embodiment, above-mentioned image processing method, in addition to：Obtain the brightness for carrying out the image after defogging processing
Value, if the brightness value is less than predetermined threshold value, predetermined threshold value is adjusted to by the brightness value for carrying out the image after defogging processing.
Blue sky region after mobile terminal handles defogging is merged with other non-blue sky regions in pending image,
Image after generation processing, can obtain the brightness value of the image after processing, and the brightness value and predetermined threshold value are compared, and sentence
It is disconnected whether to need that the image after processing is carried out to highlight processing.If the brightness value of the image after processing is more than or equal to default threshold
Value, then need not carry out highlighting processing, can be to the image after processing if the brightness value of the image after processing is less than predetermined threshold value
Progress highlights processing, and the brightness value of the image after processing is adjusted to predetermined threshold value, wherein, predetermined threshold value is used to represent preferable bright
Degree, under the desired level, image can have preferable vision perception, for example, predetermined threshold value can be equivalent for 130,132, but not
It is limited to this.
In the present embodiment, can adjust automatically carry out the brightness value of the image after defogging processing, can have image more preferable
Visual display effect, and manually adjust without user the saturation degree of image, it is easy to operate.
As shown in figure 5, in one embodiment there is provided a kind of image processing apparatus 500, including image collection module 510,
Judge module 520, extraction module 530 and defogging module 540.
Image collection module 510, for obtaining pending image.
Judge module 520, for judging whether include blue sky in pending image.
In one embodiment, judge module 520, including collecting unit and determining unit.
Collecting unit, for gathering the acquisition parameters associated with pending image.
Determining unit, if meeting preparatory condition for acquisition parameters, it is determined that blue sky is included in pending image.
Extraction module 530, if for including blue sky in pending image, extracting the blue sky region in pending image.
Defogging module 540, for carrying out defogging processing to blue sky region.
Above-mentioned image processing apparatus, obtains pending image, if including blue sky in pending image, extracts pending figure
Blue sky region as in, carries out defogging processing to blue sky region, the saturation degree in blue sky region in pending image is improved automatically, right
The blue sky of image is strengthened, and the saturation degree of image is manually adjusted without user, easy to operate, and retains the original in non-blue sky region
Other non-blue sky regions are not carried out processing by mistake by beginning information, make the image after the defogging processing of carry out blue sky region it is more true, oneself
So.
As shown in fig. 6, in one embodiment, extraction module 530 includes converting unit 532, parameter area acquiring unit
534 and extraction unit 536.
Converting unit 532, for by pending image from the first color space conversion to the second color space.
Parameter area acquiring unit 534, for obtaining the ginseng that each color parameter is matched with blue sky in the second color space
Number scope.
Extraction unit 536, the parameter area for being matched according to each color parameter with blue sky is extracted in pending image
Blue sky region.
In the present embodiment, can by pending image from the first color space conversion be the second color space, and extract treat
The blue sky region of image is handled, it is convenient that defogging processing only is carried out to the blue sky region in pending image, extract blue sky region
Other non-blue sky regions are not carried out processing by mistake by saturation degree, make the image after the defogging processing of carry out blue sky region it is more true, oneself
So.
As shown in fig. 7, in one embodiment, defogging module 540 includes determining unit 542, computing unit 544 and defogging
Unit 546.
Determining unit 542, the mistiness degree for determining blue sky region.
Computing unit 544, is transmitted for choosing the modifying factor matched with mistiness degree, and being calculated according to modifying factor
Rate.
Defogging unit 546, for carrying out defogging processing to blue sky region according to transmissivity.
In the present embodiment, the modifying factor of matching can be chosen according to the mistiness degree in the blue sky region of extraction, according to blue sky
The mistiness degree in region carries out different degrees of defogging to blue sky region, and the effect of saturation degree for making raising blue sky region more preferably, makes
Carry out the image after the processing of blue sky region defogging more true, natural.
In one embodiment, above-mentioned image processing apparatus 500, except including image collection module 510, judge module
520th, extraction module 530 and defogging module 540, in addition to luminance acquisition module and adjusting module.
Luminance acquisition module, the brightness value of the image after defogging processing is carried out for obtaining.
Adjusting module, if being less than predetermined threshold value for brightness value, the brightness value for carrying out the image after defogging processing is adjusted
Whole is predetermined threshold value.
In the present embodiment, can adjust automatically carry out the brightness value of the image after defogging processing, can have image more preferable
Visual display effect, and manually adjust without user the saturation degree of image, it is easy to operate.
The division of modules is only used for for example, in other embodiments, will can push away in above-mentioned image processing apparatus
Recommend information generation device and be divided into different modules as required, to complete all or part of above-mentioned recommendation information generating means
Function.
The embodiment of the present invention also provides a kind of mobile terminal.Above-mentioned mobile terminal is included at image processing circuit, image
Managing circuit can be realized using hardware and/or component software, it may include define ISP (Image Signal Processing, figure
As signal transacting) the various processing units of pipeline.Fig. 8 is the schematic diagram of image processing circuit in one embodiment.Such as Fig. 8 institutes
Show, for purposes of illustration only, only showing the various aspects of the image processing techniques related to the embodiment of the present invention.
As shown in figure 8, image processing circuit includes ISP processors 840 and control logic device 850.Imaging device 810 is caught
View data handled first by ISP processors 840, ISP processors 840 view data is analyzed with catch can be used for it is true
The image statistics of one or more control parameters of fixed and/or imaging device 810.Imaging device 810 may include there is one
The camera of individual or multiple lens 812 and imaging sensor 814.Imaging sensor 814 may include colour filter array (such as
Bayer filters), imaging sensor 814 can obtain the luminous intensity caught with each imaging pixel of imaging sensor 814 and wavelength
Information, and the one group of raw image data that can be handled by ISP processors 840 is provided.Sensor 820 can be connect based on sensor 820
Raw image data is supplied to ISP processors 840 by mouth type.The interface of sensor 820 can utilize SMIA (Standard
Mobile Imaging Architecture, Standard Mobile Imager framework) interface, other serial or parallel camera interfaces or
The combination of above-mentioned interface.
ISP processors 840 handle raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processors 840 can be carried out at one or more images to raw image data
Reason operation, statistical information of the collection on view data.Wherein, image processing operations can be by identical or different bit depth precision
Carry out.
ISP processors 840 can also receive pixel data from video memory 830.For example, from the interface of sensor 820 by original
The raw pixel data that beginning pixel data is sent in video memory 830, video memory 830 is available to ISP processors
840 is for processing.Video memory 830 can be independent in a part, storage device or the electronic equipment of storage arrangement
Private memory, and may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.
When receiving the raw image data from the interface of sensor 820 or from video memory 830, ISP processing
Device 840 can carry out one or more image processing operations, such as time-domain filtering.View data after processing, which can be transmitted, gives image storage
Device 830, to carry out other processing before shown.ISP processors 840 can also be from the reception processing of video memory 930
Data, the image real time transfer in original domain and in RGB and YCbCr color spaces is carried out to above-mentioned processing data.After processing
View data may be output to display 880, for user watch and/or by graphics engine or GPU (Graphics
Processing Unit, graphics processor) further processing.In addition, the output of ISP processors 840 also can be transmitted and be deposited to image
Reservoir 830, and display 880 can read view data from video memory 830.In one embodiment, video memory 830
It can be configured as realizing one or more frame buffers.In addition, the output of ISP processors 840 can be transmitted to encoder/decoder
870, so as to encoding/decoding image data.The view data of coding can be saved, and in display and the equipment of display 880 it
Preceding decompression.
The step of ISP processors 840 handle view data includes：To view data carry out VFE (Video FrontEnd,
Video front) handle and CPP (Camera Post Processing, camera post processing) processing.At the VFE of view data
Reason may include correct view data contrast or brightness, modification record in a digital manner illumination conditions data, to picture number
According to compensate processing (such as white balance, automatic growth control, γ correction etc.), to view data be filtered processing etc..To figure
It may include to zoom in and out image as the CPP processing of data, preview frame and record frame be provided to each path.Wherein, CPP can make
Preview frame and record frame are handled with different codecs.
View data after ISP processing can be transmitted to defogging module 860, to carry out defogging to image before shown
Processing.Defogging module 860 can carry out defogging processing etc. to the blue sky region of the pending image of extraction.Wherein, defogging module 860
Can be CPU (Central Processing Unit, central processing unit), GPU or coprocessor in mobile terminal etc..Defogging mould
Block 860 carries out view data after defogging processing, and the view data after can defogging be handled is sent to encoder/decoder 870,
So as to encoding/decoding image data.The view data of coding can be saved, and in display and the equipment of display 880 before solve
Compression.It is understood that the view data after defogging module 860 is handled can be without encoder/decoder 870, directly
Display 880 is issued to be shown.View data after the processing of ISP processors 840 can also first pass through encoder/decoder
870 processing, are then handled by defogging module 860 again.Above-mentioned encoder/decoder can be CPU, GPU in mobile terminal
Or coprocessor etc..
The statistics that ISP processors 840 are determined, which can be transmitted, gives the unit of control logic device 850.For example, statistics can be wrapped
Include the image sensings such as automatic exposure, AWB, automatic focusing, flicker detection, black level compensation, the shadow correction of lens 812
The statistical information of device 814.Control logic device 850 may include the processor and/or micro-control for performing one or more routines (such as firmware)
Device processed, one or more routines can determine control parameter and the IPS processing of imaging device 810 according to the statistics of reception
The control parameter of device 840.For example, control parameter may include the control parameter of sensor 820 (such as integration of gain, spectrum assignment
Time), camera flash control parameter, the group of the control parameter of lens 812 (such as focus on or zoom focal length) or these parameters
Close.ISP control parameters may include to be used for AWB and color adjustment (for example, RGB processing during) gain level and
Color correction matrix, and the shadow correction parameter of lens 812.
In the present embodiment, above-mentioned image processing method can be realized with the image processing techniques in Fig. 8.
In one embodiment there is provided a kind of computer-readable recording medium, computer program is stored thereon with, the calculating
Machine program realizes above-mentioned image processing method when being executed by processor.
One of ordinary skill in the art will appreciate that realize all or part of flow in above-described embodiment method, being can be with
The hardware of correlation is instructed to complete by computer program, described program can be stored in a non-volatile computer and can be read
In storage medium, the program is upon execution, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, described storage is situated between
Matter can be magnetic disc, CD, read-only memory (Read-Only Memory, ROM) etc..
Each technical characteristic of embodiment described above can be combined arbitrarily, to make description succinct, not to above-mentioned reality
Apply all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, the scope of this specification record is all considered to be.
Embodiment described above only expresses the several embodiments of the present invention, and it describes more specific and detailed, but simultaneously
Can not therefore it be construed as limiting the scope of the patent.It should be pointed out that coming for one of ordinary skill in the art
Say, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the protection of the present invention
Scope.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (11)
1. a kind of image processing method, it is characterised in that including：
Obtain pending image；
Judge in the pending image whether to include blue sky, if comprising extracting the blue sky region in the pending image；
Defogging processing is carried out to the blue sky region.
2. according to the method described in claim 1, it is characterised in that described whether to judge in the pending image comprising indigo plant
My god, including：
Gather the acquisition parameters associated with the pending image；
If the acquisition parameters meet preparatory condition, it is determined that include blue sky in the pending image.
3. according to the method described in claim 1, it is characterised in that the blue sky region extracted in the pending image,
Including：
By the pending image from the first color space conversion to the second color space；
Obtain the parameter area that each color parameter is matched with blue sky in second color space；
The parameter area matched according to each described color parameter with blue sky extracts the blue sky region in the pending image.
4. according to the method described in claim 1, it is characterised in that described to carry out defogging processing to the blue sky region, including：
Determine the mistiness degree in the blue sky region；
The modifying factor matched with the mistiness degree is chosen, and transmissivity is obtained according to modifying factor calculating；
Defogging processing is carried out to the blue sky region according to the transmissivity.
5. according to any described method of Claims 1-4, it is characterised in that methods described, in addition to：
Obtain the brightness value for carrying out the image after defogging processing；
If the brightness value is less than predetermined threshold value, the brightness value of the image after the progress defogging processing is adjusted to described pre-
If threshold value.
6. a kind of image processing apparatus, it is characterised in that including：
Image collection module, for obtaining pending image；
Judge module, for judging whether include blue sky in the pending image；
Extraction module, if for including blue sky in the pending image, extracting the blue sky region in the pending image；
Defogging module, for carrying out defogging processing to the blue sky region.
7. device according to claim 6, it is characterised in that the judge module, including：
Collecting unit, for gathering the acquisition parameters associated with the pending image；
Determining unit, if meeting preparatory condition for the acquisition parameters, it is determined that blue sky is included in the pending image；
The extraction module, including：
Converting unit, for by the pending image from the first color space conversion to the second color space；
Parameter area acquiring unit, for obtaining the parameter model that each color parameter is matched with blue sky in second color space
Enclose；
Extraction unit, the parameter area for being matched according to each described color parameter with blue sky is extracted in the pending image
Blue sky region.
8. device according to claim 6, it is characterised in that the defogging module, including：
Determining unit, the mistiness degree for determining the blue sky region；
Computing unit, is obtained for choosing the modifying factor matched with the mistiness degree, and being calculated according to the modifying factor
Penetrate rate；
Defogging unit, for carrying out defogging processing to the blue sky region according to the transmissivity.
9. according to any described device of claim 6 to 8, it is characterised in that described device also includes：
Luminance acquisition module, the brightness value of the image after defogging processing is carried out for obtaining；
Adjusting module, if being less than predetermined threshold value for the brightness value, by the brightness of the image after the progress defogging processing
Value is adjusted to the predetermined threshold value.
10. a kind of mobile terminal, including memory, processor and storage are on a memory and the calculating that can run on a processor
Machine program, realizes the method as described in claim 1 to 5 is any during the computing device described program.
11. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the computer program
The method as described in claim 1 to 5 is any is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710624485.5A CN107317967B (en) | 2017-07-27 | 2017-07-27 | Image processing method, image processing device, mobile terminal and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710624485.5A CN107317967B (en) | 2017-07-27 | 2017-07-27 | Image processing method, image processing device, mobile terminal and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107317967A true CN107317967A (en) | 2017-11-03 |
| CN107317967B CN107317967B (en) | 2020-03-27 |
Family
ID=60175044
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710624485.5A Active CN107317967B (en) | 2017-07-27 | 2017-07-27 | Image processing method, image processing device, mobile terminal and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107317967B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107948618A (en) * | 2017-12-11 | 2018-04-20 | 广东欧珀移动通信有限公司 | Image processing method, device, computer-readable recording medium and computer equipment |
| CN109003237A (en) * | 2018-07-03 | 2018-12-14 | 深圳岚锋创视网络科技有限公司 | Sky filter method, device and the portable terminal of panoramic picture |
| CN109712126A (en) * | 2018-12-21 | 2019-05-03 | 深圳市华星光电半导体显示技术有限公司 | Image identification method and device |
| CN109934781A (en) * | 2019-02-27 | 2019-06-25 | 合刃科技（深圳）有限公司 | Image processing method, device, terminal device and computer readable storage medium |
| CN112434581A (en) * | 2020-11-14 | 2021-03-02 | 武汉中海庭数据技术有限公司 | Outdoor target color identification method and system, electronic device and storage medium |
| CN113239939A (en) * | 2021-05-12 | 2021-08-10 | 北京杰迈科技股份有限公司 | Track signal lamp identification method, module and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104935902A (en) * | 2015-06-02 | 2015-09-23 | 三星电子（中国）研发中心 | Image color enhancement method and device, and electronic equipment |
| CN105450923A (en) * | 2014-09-25 | 2016-03-30 | 索尼公司 | Image processing method, image processing device and electronic device |
| US20160189354A1 (en) * | 2014-12-26 | 2016-06-30 | Ricoh Company, Ltd. | Image processing system, image processing device, and image processing method |
| CN105872373A (en) * | 2016-03-31 | 2016-08-17 | 北京奇虎科技有限公司 | Automatic defogging photographing method, device and equipment |
| CN106131441A (en) * | 2016-09-06 | 2016-11-16 | 北京小米移动软件有限公司 | Photographic method and device, electronic equipment |
-
2017
- 2017-07-27 CN CN201710624485.5A patent/CN107317967B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105450923A (en) * | 2014-09-25 | 2016-03-30 | 索尼公司 | Image processing method, image processing device and electronic device |
| US20160189354A1 (en) * | 2014-12-26 | 2016-06-30 | Ricoh Company, Ltd. | Image processing system, image processing device, and image processing method |
| CN104935902A (en) * | 2015-06-02 | 2015-09-23 | 三星电子（中国）研发中心 | Image color enhancement method and device, and electronic equipment |
| CN105872373A (en) * | 2016-03-31 | 2016-08-17 | 北京奇虎科技有限公司 | Automatic defogging photographing method, device and equipment |
| CN106131441A (en) * | 2016-09-06 | 2016-11-16 | 北京小米移动软件有限公司 | Photographic method and device, electronic equipment |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107948618A (en) * | 2017-12-11 | 2018-04-20 | 广东欧珀移动通信有限公司 | Image processing method, device, computer-readable recording medium and computer equipment |
| CN109003237A (en) * | 2018-07-03 | 2018-12-14 | 深圳岚锋创视网络科技有限公司 | Sky filter method, device and the portable terminal of panoramic picture |
| US11887362B2 (en) | 2018-07-03 | 2024-01-30 | Arashi Vision Inc. | Sky filter method for panoramic images and portable terminal |
| CN109712126A (en) * | 2018-12-21 | 2019-05-03 | 深圳市华星光电半导体显示技术有限公司 | Image identification method and device |
| CN109934781A (en) * | 2019-02-27 | 2019-06-25 | 合刃科技（深圳）有限公司 | Image processing method, device, terminal device and computer readable storage medium |
| CN112434581A (en) * | 2020-11-14 | 2021-03-02 | 武汉中海庭数据技术有限公司 | Outdoor target color identification method and system, electronic device and storage medium |
| CN113239939A (en) * | 2021-05-12 | 2021-08-10 | 北京杰迈科技股份有限公司 | Track signal lamp identification method, module and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107317967B (en) | 2020-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107424198B (en) | Image processing method, image processing device, mobile terminal and computer readable storage medium | |
| CN107451969A (en) | Image processing method, device, mobile terminal and computer-readable recording medium | |
| CN107317967A (en) | Image processing method, device, mobile terminal and computer-readable recording medium | |
| CN108805103A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN108024107A (en) | Image processing method, device, electronic equipment and computer-readable recording medium | |
| CN107493432A (en) | Image processing method, device, mobile terminal and computer-readable recording medium | |
| CN107395991B (en) | Image synthesis method, image synthesis device, computer-readable storage medium and computer equipment | |
| CN107509031A (en) | Image processing method, device, mobile terminal and computer-readable recording medium | |
| CN108156435A (en) | Image processing method and device, computer readable storage medium and computer equipment | |
| CN107563976A (en) | U.S. face parameter acquiring method, device, readable storage medium storing program for executing and computer equipment | |
| CN110213502A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN107993209A (en) | Image processing method, device, computer-readable recording medium and electronic equipment | |
| CN107194901B (en) | Image processing method, image processing device, computer equipment and computer readable storage medium | |
| CN107945106B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN107277299A (en) | Image processing method, device, mobile terminal and computer-readable recording medium | |
| CN108900785A (en) | Exposal control method, device and electronic equipment | |
| CN108063926A (en) | Image processing method and device, computer readable storage medium and computer equipment | |
| CN107464225B (en) | Image processing method, image processing device, computer-readable storage medium and mobile terminal | |
| CN107277369B (en) | Image processing method, device, computer readable storage medium and computer equipment | |
| CN107341782A (en) | Image processing method, device, computer equipment and computer-readable recording medium | |
| CN115802183B (en) | Image processing method and related device | |
| CN108259754A (en) | Image processing method and device, computer readable storage medium and computer equipment | |
| CN107392870B (en) | Image processing method, image processing device, mobile terminal and computer readable storage medium | |
| CN107580205A (en) | White balance adjustment method and device | |
| CN107454318A (en) | Image processing method, device, mobile terminal and computer-readable recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |