CN104732496B - A kind of video streaming image defogging processing method and display device - Google Patents
A kind of video streaming image defogging processing method and display device Download PDFInfo
- Publication number
- CN104732496B CN104732496B CN201510128196.7A CN201510128196A CN104732496B CN 104732496 B CN104732496 B CN 104732496B CN 201510128196 A CN201510128196 A CN 201510128196A CN 104732496 B CN104732496 B CN 104732496B
- Authority
- CN
- China
- Prior art keywords
- pixel
- picture frame
- processed
- value
- defogging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The embodiment of the invention discloses a kind of video streaming image defogging processing method and display devices, are related to field of image processing, to provide a kind of method for carrying out defogging processing in display screen end real-time synchronization based on Mean Filtering Algorithm.In embodiments of the present invention, picture frame to be processed is obtained；According to distribution of the adjacent pixel of each pixel and each pixel in picture frame to be processed on color space, determine the environmental light intensity of each pixel in picture frame to be processed, and defogging is carried out treated distribution of each pixel on color space according to distribution of each pixel in a upper picture frame for picture frame to be processed on color space and to a upper picture frame, determine the global atmosphere light of picture frame to be processed；According to environmental light intensity and global atmosphere light, defogging processing is carried out to each pixel in picture frame to be processed, obtains carrying out picture frame to be processed defogging treated image frame data；To realize above-mentioned function.
Description
Technical field
The present invention relates to field of image processing more particularly to a kind of video streaming image defogging processing methods and display device.
Background technique
Traditional display screen usually only provides simple brightness/contrast for image quality adjustment and adjusts, and video monitoring
Display picture is highly prone to boisterous influence, therefore serves the peace of intelligent traffic monitoring, cell security monitoring etc.
Anti- display screen has strong real-time defogging demand.
The defogging algorithm of mainstream at present, is all based on greatly the principle of dark channel prior, although the defogging skill based on dark
Art is good to common mist scene adaptability, and significant effect is used widely, however since this algorithm has certain complexity
Property, therefore the defogging technology based on dark is extremely difficult to large-size images the requirement handled in real time.
Summary of the invention
The embodiment of the present invention provides a kind of video streaming image defogging processing method and display device, is based on to provide one kind
The method that Mean Filtering Algorithm carries out defogging processing in display screen end real-time synchronization.
The embodiment of the invention provides a kind of video streaming image defogging processing method, which includes：
Obtain picture frame to be processed；
According to distribution of the adjacent pixel of each pixel and each pixel in the picture frame to be processed on color space,
Determine the environmental light intensity of each pixel in the picture frame to be processed, and according in a upper picture frame for the picture frame to be processed
Distribution of each pixel on color space and defogging carried out treated each pixel on color space to a upper picture frame
Distribution, determine the global atmosphere light of the picture frame to be processed；
According to the environmental light intensity and the global atmosphere light, defogging is carried out to each pixel in the picture frame to be processed
Processing obtains carrying out the picture frame to be processed defogging treated image frame data.
The embodiment of the invention also provides a kind of display device, which includes：
On-site programmable gate array FPGA is sent to the carrying wait locate of liquid crystal display control panel TCON for intercepting and capturing and parsing
The first signal for managing image frame data executes following defogging to the picture frame to be processed and handles, and will carry that treated
The second signal of image frame data is exported to the TCON；The defogging is handled：According in the picture frame to be processed
Each pixel and each pixel distribution of the adjacent pixel on color space, determine each pixel in the picture frame to be processed
Environmental light intensity, and according to distribution of each pixel in a upper picture frame for the picture frame to be processed on color space and to this
A upper picture frame carries out defogging treated distribution of each pixel on color space, determines the overall situation of the picture frame to be processed
Atmosphere light；According to the environmental light intensity and the global atmosphere light, defogging is carried out to each pixel in the picture frame to be processed
Processing obtains carrying out the picture frame to be processed defogging treated image frame data；
The TCON, for receiving by the second signal of carrying of exporting of the FPGA treated image frame data,
Driving signal is provided according to the second signal for display screen；
The display screen, the driving signal provided for receiving the TCON, and image is shown according to the driving signal.
From above-mentioned technical method can be seen that the embodiment of the present invention can according in picture frame to be processed each pixel and
Distribution of the adjacent pixel of each pixel on color space, so that it is determined that having gone out the environment light of each pixel in picture frame to be processed
By force；Also, according to distribution of each pixel in a upper picture frame for picture frame to be processed on color space and to a figure on this
As frame carries out defogging treated distribution of each pixel on color space, so that it is determined that having gone out the whole of picture frame to be processed
Global atmosphere light；And then using the global atmosphere light of the environmental light intensity of each pixel and full frame image, in picture frame to be processed
Each pixel carries out defogging processing one by one, obtains carrying out defogging treated image frame data to picture frame to be processed；As it can be seen that at this
In inventive embodiments, when needing to carry out defogging processing to current image frame, it is only necessary to according to the upper figure for having scanned and having handled
The associated pixel data of related data and current image frame as frame can be to current image frame progress defogging processing, thus simple
Change calculation process, realizes the function of carrying out Quick demisting to picture frame.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly introduced, it should be apparent that, drawings in the following description are only some embodiments of the invention, for this
For the those of ordinary skill in field, without any creative labor, it can also be obtained according to these attached drawings
His attached drawing.
Fig. 1 is the flow diagram of defogging process provided in an embodiment of the present invention；
Fig. 2 is the flow diagram of image defogging processing method provided in an embodiment of the present invention；
Fig. 3 is the flow diagram provided in an embodiment of the present invention that defogging processing is carried out based on FPGA；
Fig. 4 is the flow diagram of RGB data provided in an embodiment of the present invention processing；
Fig. 5 is the flow diagram provided in an embodiment of the present invention that Mean Filtering Algorithm is realized based on FPGA；
Fig. 6 is a kind of structural schematic diagram of display device provided in an embodiment of the present invention.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with attached drawing to the present invention make into
It is described in detail to one step, it is clear that described embodiments are only a part of the embodiments of the present invention, rather than whole implementation
Example.Based on the embodiments of the present invention, obtained by those of ordinary skill in the art without making creative efforts
All other embodiment, shall fall within the protection scope of the present invention.
The embodiment of the present invention can be adapted for based on FPGA that (Field-Programmable Gate Array, scene can
Program gate array) the defogging solution of technology, it is particularly suitable for video monitoring display apparatus side (such as various liquid crystal displays dress
Set) automatic Quick demisting solution.In embodiments of the present invention, original foggy image can be automatic at liquid crystal display device end
It is shown again after carrying out defogging processing, effectively improves the image displaying quality of the video monitoring under the bad weathers such as mist, haze.Through
Test, the embodiment of the present invention can preferably serve the fields such as intelligent transportation, video monitoring.
The embodiment of the present invention is based on FPGA technology and defogging algorithm is optimized and is improved for FPGA platform characteristic,
On the basis of guaranteeing preferably defog effect, realize to high-definition liquid crystal display end (such as：Resolution ratio reaches 1920*
1080 or more) do not change display screen refreshing frequency (such as：While 60Hz), the function of synchronous automatic defogging.In the present invention
In embodiment, foggy image or video only need to be accessed, i.e., using scheme provided in an embodiment of the present invention automatically in liquid crystal
Realize defogging processing quickly, synchronous in showing device end；Further, the liquid crystal display device in the embodiment of the present invention can also be set
Dehazing function key is set, provide capable of being opened by one key for user or closes the dehazing function in display device, utilizes the embodiment of the present invention
The method of offer may not need user and be manually entered or adjustment parameter, can have mist scene to be automatically performed at defogging for difference
Reason, and the embodiment of the present invention can reach operation requirement merely with fpga chip, and the reality of defogging processing is greatly improved
Shi Xing.
FPGA, i.e. field programmable gate array, it is that occur as one of integrated circuit fields semi-custom circuit
, the exploitation of FPGA is very different relative to the exploitation of PC, single-chip microcontroller, and FPGA is based on concurrent operation, with Hardware description language
Speech has very big difference to realize, compared to the operation of the sequence of PC or single-chip microcontroller.Since FPGA has the concurrency of processing of circuit, because
This can satisfy the processing requirement of supercomputing.Image procossing is carried out with FPGA technology may be used also while completing a large amount of operations
To meet the requirement of real-time of processing.
Based on FPGA processing technique, whole image defogging system can be made, have many advantages, such as algorithm washability, upgradability,
Algorithm can be upgraded in the case of keeping hardware configuration constant.It is carried out by using Verilog hardware program language
Circuit design is burned onto FPGA with layout by comprehensive, becomes the processing chip with dehazing function.For liquid crystal display
Defogging mode is realized, is sent the Low Voltage Differential Signal LVDS liquid crystal display signal of TCON plate to by the way that mainboard is truncated, is flowed through it
FPGA handles chip to complete defogging process.For the LVDS signal flowed into, signal conversion is carried out to it first, is translated into
Then rgb signal carries out mist elimination image enhancing processing with image processing techniques to rgb signal, finally believes processed RGB
Number be converted into new LVDS signal passes out to TCON plate again.
Fig. 1 shows system processing block schematic illustration provided in an embodiment of the present invention, as shown in Figure 1, the system at least may be used
To include：Liquid crystal display mainboard 11, FPGA handle chip 12 and TCon13.Wherein, FPGA is mainly used for executing following function
Energy：LVDS signal turns rgb signal；LVDS system-related signal phase delay；RGB image defogging；Rgb signal turns LVDS signal.
As it can be seen that predominantly following three emphasis of process that the defogging mode in the embodiment of the present invention is related to：LVDS conversion
For RGB data process, RGB data is carried out defogging processing process and will treated RGB data reverts to LVDS letter
Number process.
Fig. 2 shows the flow diagrams of image defogging processing method provided in an embodiment of the present invention, as shown in Fig. 2, should
Process is mainly that the process for carrying out defogging processing to RGB data is illustrated：
Step 21：Obtain picture frame to be processed.
Step 22：According to point of the adjacent pixel of each pixel and each pixel in picture frame to be processed on color space
Cloth determines the environmental light intensity of each pixel in picture frame to be processed；And according to each picture in a upper picture frame for picture frame to be processed
Distribution of the element on color space and defogging carried out treated distribution of each pixel on color space to a picture frame on this,
Determine the global atmosphere light of picture frame to be processed.
Step 23：According to environmental light intensity and global atmosphere light, defogging processing is carried out to each pixel in picture frame to be processed,
It obtains carrying out defogging treated image frame data to picture frame to be processed.
It should be noted that in the above-mentioned steps 22 of the embodiment of the present invention, the step of determining the environmental light intensity of each pixel
The step of with the global atmosphere light of determination picture frame to be processed, above-mentioned two step may be performed simultaneously, and can also first carry out really
The step of environmental light intensity of fixed each pixel, executes the step of global atmosphere light for determining picture frame to be processed again, can also first carry out
The step of determining the global atmosphere light of picture frame to be processed executes the step of environmental light intensity for determining each pixel again.
The embodiment of the present invention is described in detail below.
Fig. 3 shows the flow diagram provided in an embodiment of the present invention that defogging processing is carried out based on FPGA, such as Fig. 3 institute
Show, which includes：
Step 31：FPGA is intercepted and captured and is parsed the carrying image frame data to be handled for being sent to liquid crystal display control panel TCON
First signal.
When specific implementation, the first signal can be a kind of Low Voltage Differential Signal LVDS, wherein the first signal is carried wait locate
Manage rGB data signal, synchronization signal and the clock signal of image.
Step 32：FPGA executes defogging processing to picture frame to be processed, and the image frame data that will carry that treated
Second signal is exported to TCON.
When specific implementation, in computer vision field, generallys use following physical model and (for convenience, below will
The physical model is referred to as formula (1)) influence caused by image of the bad weathers such as haze described：
Formula (1) is specially：I (x)=J (x) t (x)+A (1-t (x))
In above-mentioned formula (1), I (x) indicates the foggy image observed, J (x) indicates background image, i.e., nothing to be restored
Mist image, A are global atmosphere light (Atmospheric Light), and t (x) is medium permeability related with the depth of field, indicate to penetrate
Ratio shared by the light that medium is not absorbed, dissipates and reaches imaging device.In embodiments of the present invention, the process nature of demisting
On be the process for recovering A and t (x) according to I (x), and finally obtaining J (x).For convenience, the embodiment of the present invention will be public
J (x) t (x) (i.e. J (x) is multiplied by t (x)) in formula (1) is known as dc-decay part, and A (1-t (x)) is known as environmental light intensity, is
Facilitate description, environmental light intensity is expressed as L (x)=A (1-t (x)).
Fig. 4 shows the flow diagram of RGB data processing provided in an embodiment of the present invention, as shown in figure 4, the process can
Think：
Step S11：Each pixel in picture frame to be processed original pixel value in R, G and B color channel respectively is obtained,
And minimum value of each pixel in the original pixel value in R, G and B color channel in picture frame to be processed is determined as respectively
The minimum pixel value M (x) of the pixel, the embodiment of the present invention can determine the minimum pixel of each pixel by following formula (2)
Value M (x).
Formula (2) is specially：M (x)=minc∈{r,g,b}(Ic(x))
Wherein, c ∈ { r, g, b } is used to indicate any in R Color Channel, G Color Channel and B color channel, Ic(x) it uses
In pixel value of the expression pixel x in R Color Channel, G Color Channel or B color channel；Min () is to be minimized operation.
Step S12：For the pixel in picture frame to be processed, determines the minimum pixel value of the pixel and determine and be somebody's turn to do
The mean value of the minimum pixel value of the adjacent each pixel of pixel, by the minimum in the minimum pixel value and mean value of the pixel determined
It is worth the environmental light intensity as the pixel, the embodiment of the present invention can utilize mean filter by following formula (3) and formula (4)
Mode determines the environmental light intensity of each pixel, and (embodiment of the present invention will be by the environmental light intensity of each pixel in picture frame to be processed
The image data of composition is known as environment light figure).Wherein, the Function () in Fig. 4 indicates function operation.
Formula (3) is specially：
The embodiment of the present invention can use formula (3) and carry out mean filter to M (x), and determination obtains Mave(x).Wherein saTable
Show using pixel x as place-centric, using a as the rectangular area of radius；Average is to be averaged operation.
Formula (4) is specially：L (x)=min (min (ρ mav,0.9)Mave(x),M(x))
Wherein mav256 times of the mean value diminution for all elements in M (x) obtains, and ρ is default correction parameter, due to formula (4)
In 0.9 upper limit limitation, it is known that the effective range of ρ be 0≤ρ≤1/mav。
By above-mentioned formula (3) and (4), the embodiment of the present invention can use Mave(x) environmental light intensity L (x) is determined, with
And the environment light figure of picture frame to be processed.
The embodiment of the present invention provides a kind of mode of determining environmental light intensity by way of example.It is public in embodiments of the present invention
The derivation process of formula (4) is specifically as follows：The minimum value that certain area around a pixel is utilized in the embodiment of the present invention is logical
Road mean value can substantially react the principle of transmissivity t (x) variation tendency, specifically：
By above-mentioned formula (1) it can be concluded thatTo on the right side of equal signCarry out mean value
Filtering, and you can get it for combination above-mentioned formula (2)：
And on the basis of calculated t (x), in addition default corrected value, as：
Wherein,
To prevent excessive defogging from making image color cast, the embodiment of the present invention can be tended to choose biggish medium permeability,
And practical experience is combined, after limiting relevant parameter value, finally show that medium permeability is：
Due to L (x)=A (1-t (x)), formula (4) are finally obtained.
It should be noted that the embodiment of the present invention only gives a kind of mode for calculating environmental light intensity L (x), all utilizations
Mean Filtering Algorithm determines that the scheme of environmental light intensity L (x) belongs to the protection scope of the embodiment of the present invention, and which is not described herein again.
Step S13：Obtain each pixel in a upper picture frame respectively the original pixel value in R, G and B color channel and
Defogging treated each pixel is carried out in R, G and B color channel to a upper picture frame and goes back original pixel value, and by original pixels
Maximum value in value is determined as the first reference pixel value, and minimum is gone back in the pixel value obtained after original pixel value mean filter
Maximum value is determined as the second reference pixel value；By the mean value of the first reference value and the second reference value, it is determined as picture frame to be processed
Global atmosphere light.
Wherein, a upper picture frame carries out defogging treated that go back original pixel value of each pixel in R, G and B color channel is
The RGB value of each pixel is obtained after carrying out defogging processing to a upper picture frame using method provided in an embodiment of the present invention.
Specifically, continuing with above-mentioned formula (1) and formula (5), the value range of global atmosphere light A can be determined
For：max(MaveP(x))≤A≤max(IP(x))
Wherein, MaveP(x) pixel obtained after original pixel value mean filter is gone back for the pixel x minimum in a upper picture frame
Value, max (IP(x)) original pixel value for the pixel x in a upper picture frame in R, G and B color channel.
Further, it can be obtained：A=ω max (MaveP(x))+(1-ω)max(IP(x))
Wherein, 0≤ω≤1
The embodiment of the present invention in order to further increase the rapidity of algorithm, and prevent value offset it is excessive, therefore enable ω=
0.5, following formula (6) are obtained, global atmosphere light A can be found out：
Formula (6) is specially：
Step S14：According to environmental light intensity and global atmosphere light, each pixel in picture frame to be processed is carried out at defogging
Reason obtains carrying out defogging treated image frame data to picture frame to be processed.
Specifically, can use following formula (7) after environmental light intensity and global atmosphere light is calculated and recover original
Beginning fog free images：
Formula (7) is specially：
Step 33：TCON is received by the second signal of carrying of exporting of FPGA treated image frame data, according to the
Binary signal provides driving signal for display screen.
Step 34：Display screen receives the driving signal that TCON is provided, and shows image according to driving signal.
When specific implementation, the embodiment of the present invention utilizes original after carrying out defogging processing using the above method to RGB data
Synchronization signal in LVDS signal and clock signal will treated that RGB data is converted to LVDS signal and exports to TCOM.
The embodiment of the present invention can also realize that above-mentioned defogging handles operation using FPGA, can specifically be divided into three parts, point
It is not：Utilize the processing delay in FPGA realization mean filter, FPGA and the processing using FPGA to part floating point parameters.
First, the realization of mean filter.Fig. 5 shows provided in an embodiment of the present invention based on FPGA realization mean filter calculation
The flow diagram of method, as shown in Figure 5：
Mean filter be to a pixel value, to around centered on it in a certain size window all elements mean value
To replace original pixel value.If without using caching calculate, due to be entirely stored in RAM (Random-Access Memory, at random
Access memory) in the reading of image will receive the limitation of bandwidth, a set of address bus each clock cycle can be only done to one
The random read-write of a address, the mean filter having a size of the region w × w need w × w period to be read out.Therefore it is filtered to realize
Wave device can carry out reading data simultaneously to w row, to meet each clock cycle simultaneously first by data buffer storage to w row buffer
Export the requirement of w pixel value to filter function processing module.The pixel stream that accompanying image each clock cycle is sent out, separately there is w-
1 row buffer synchronism output pixel stream, can achieve the purpose that w × w window filtering.Since each row of data will be calculated w times,
While filtering, the data by lastrow buffer area is needed to be input to next line, that is, can reach the effect of row data reuse
Fruit.The FIFO (First Input First Output, First Input First Output) based on two-port RAM building of fpga chip is slow
Storage, it is whole to meet this characteristic for having timing input and output well, therefore w-1 FIFO buffer is together with image input data
Stream, together forms w row inlet flow.
In embodiments of the present invention, filtering may include：
A, for the triple channel minimum value data flow Stream of input picturemin, caching w-1 row to FIFO buffer；
B, since w row, w-1 FIFO line buffer area, with StreamminIt is synchronous to input w data to mean filter mould
Block；
C, every a line data fifo stream shunts and inputs next row fifo buffer.
For mean filter module, inside is the queue of every column data summation sum, includes w sum value, corresponding window
In mouthful every column data and, be in addition a column and the multiple adder that is added, calculate each total value for arranging and being added, window is arranged
For 2 multiple when, as a result displacement output after to get corresponding pixel points mean filter result.
Processing delay in second, FPGA.
In Synchronous sequential logic circuit, data are every all to generate prolonging for a clock cycle by a processing component
Late.Data distribution processing then summarize, image alignment is output to memory or display screen etc. requires to calculate corresponding delay, with right
Neat data differentiate active traffic starting position, could generate correct result.
When rgb signal progress demisting is disposed and goes back to LVDS signal.It needs to carry out phase to row, field, enable signal etc.
Otherwise the delay answered will cause offset, mistake etc. that screen is shown, postpone as the signal streams such as signal conversion and demisting processing
Summation through the clock cycle spent by assembly line.
Wherein, formula is usedIndicate the summation T of all delays on the main recovery line of FPGAlatency。
It specifically can be used to indicate that LVDS signal is converted to the delay of rgb signal, the delay of rgb signal demisting, rgb signal revert to
The delay of LVDS signal.Because an end data be input to other end data output have transmission delay, to row, field,
Enable signal is delayed exactly to notify other end：A new frame, a line, the information such as effectively are when to start to transmit
's.In above-mentioned formula, what Components was indicated is the component that signal flows through；Latency indicates delay.
Third, the processing to part floating point parameters.
It is transformed to integer according to certain multiple is expanded using floating number, replaces with the original of shift operation as far as possible with multiplication and division
Then, come promoted FPGA speed, reduce design difficulty.
The embodiment of the present invention is with L (x)=min (min (ρ mav,0.9)Mave(x), M (x)) for be illustrated, such as：ρ can
1.5 are taken, thenTo be set to compared with 0.9 is more convenientThen all to remove
Method operation can be completed by shifting.So for min (ρ mav, 0.9) selection, can be moved to right by 3*average (M (x))
4 obtain compared with 29.
It can be seen from the above technical proposal that the defogging processing technique provided in an embodiment of the present invention based on FPGA, can make
Whole image defogging system, has many advantages, such as algorithm washability, upgradability, can be in the situation for keeping hardware configuration constant
Under, algorithm is upgraded.Circuit design is carried out by using Verilog hardware program language, by comprehensive and layout burning
To FPGA, the processing chip with dehazing function is become.It realizes for the defogging mode of liquid crystal display, is passed by truncation mainboard
The Low Voltage Differential Signal LVDS liquid crystal display signal for giving TCON plate makes it flow through FPGA processing chip to complete defogging process.
For the LVDS signal flowed into, signal conversion is carried out to it first, is translated into rgb signal, then to rgb signal with figure
As processing technique progress mist elimination image enhancing processing, new LVDS signal finally is converted by processed rgb signal and is sent again
TCON plate is arrived out.
Based on the same technical idea, Fig. 6 shows a kind of structural representation of display device provided in an embodiment of the present invention
Figure, as shown in fig. 6, the apparatus may include：
On-site programmable gate array FPGA 61 is sent to the carrying of liquid crystal display control panel TCON 62 for intercepting and capturing and parsing
First signal of image frame data to be handled executes following defogging to the picture frame to be processed and handles, and will carry place
The second signal of image frame data after reason is exported to the TCON 62；The defogging is handled：According to described to be processed
Distribution of the adjacent pixel of each pixel and each pixel in picture frame on color space, determines in the picture frame to be processed
The environmental light intensity of each pixel, and point according to each pixel in a upper picture frame for the picture frame to be processed on color space
Cloth and defogging treated distribution of each pixel on color space is carried out to a picture frame on this, determines the image to be processed
The global atmosphere light of frame；According to the environmental light intensity and the global atmosphere light, to each pixel in the picture frame to be processed
Defogging processing is carried out, obtains carrying out the picture frame to be processed defogging treated image frame data；
The TCON 62, for receiving, by carrying of exporting of the FPGA 61, treated the second of image frame data
Signal is that display screen 63 provides driving signal according to the second signal；
The display screen 63, the driving signal provided for receiving the TCON 62, and shown according to the driving signal
Image.
Optionally, the FPGA 61 is specifically used for：Each pixel in the picture frame to be processed is obtained respectively in R, G and B
Original pixel value in Color Channel, and respectively by each pixel in the picture frame to be processed in R, G and B color channel
Minimum value in original pixel value is determined as the minimum pixel value of the pixel；For the pixel in the picture frame to be processed,
It determines the minimum pixel value of the pixel and determines the mean value of the minimum pixel value of each pixel adjacent with the pixel, will determine
The pixel minimum pixel value and the mean value in environmental light intensity of the minimum value as the pixel.
Optionally, the FPGA 61 is specifically used for：Each pixel in a upper picture frame is obtained respectively in R, G and B face
Original pixel value in chrominance channel and defogging carried out treated each pixel respectively in R, G and B color to a upper picture frame
Original pixel value is gone back in channel, and the maximum value in the original pixel value is determined as the first reference pixel value, and will be described
Maximum value also in original pixel value is determined as the second reference pixel value；Wherein, the original pixel value of going back is to a upper image
Frame carries out defogging treated each pixel value；By the mean value of first reference value and the second reference value, it is determined as described wait locate
Manage the global atmosphere light of picture frame.
Optionally, the FPGA 61 is specifically used for：Calculate each pixel original pixel value and each pixel environmental light intensity it
Between difference；Defogging processing is carried out to the difference using the medium permeability of each pixel, by the collection of treated each pixel value
Conjunction is determined as carrying out the picture frame to be processed defogging treated image frame data；Wherein, the medium permeability with should
The environmental light intensity of pixel is related to global atmosphere light.
Optionally, the FPGA 61 is specifically used for：The environmental light intensity L (x) is determined according to following formula one；
The formula one is：L (x)=min (min (ρ * mav,0.9)Mave(x),M(x))
Global atmosphere light A is determined according to following formula two；
The formula two is：
Defogging processing is carried out to the picture frame to be processed according to following formula three, the image frame data J that obtains that treated
(x)；
The formula three is：
Wherein, the M (x) is minimum pixel value of the pixel x in R, G and B color channel；The mavIt is by institute in M (x)
There is the mean value of element to reduce 256 times to obtain；It is describedWherein saIndicate with pixel x be
Center, using a as the rectangular area of radius, average be averaged operation；The MavePIt (x) is the picture in a upper picture frame
The minimum pixel value of plain x；The I (x) includes original pixel value of the picture frame to be processed in R, G and B color channel；Institute
State IP(x) include original pixel value of the pixel x in R, G and B color channel in a upper picture frame；The min () is
It is minimized operation, the max () is to be maximized operation；The ρ is default corrected value and 0≤ρ≤1/mav。
Optionally, the FPGA 61 is specifically used for：Parse the rGB data signal carried in first signal, synchronous letter
Number and clock signal, the defogging is executed to the rGB data signal and is handled；It, will using the synchronization signal and clock signal
RGB data signal that treated is converted to low-voltage differential signal LVDS signal and exports to the TCON 62.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
The processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices is instructed, so that
A stream in flow chart can be achieved by the instruction that the computer or the processor of other programmable data processing devices execute
The function of being specified in journey or multiple processes and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one process or multiple processes and/or block diagrams of flow chart
One box or multiple boxes in specify function the step of.
Although preferred embodiments of the present invention have been described, it is created once a person skilled in the art knows basic
Property concept, then additional changes and modifications can be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as
It selects embodiment and falls into all change and modification of the scope of the invention.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (7)
1. a kind of video streaming image defogging processing method, which is characterized in that the processing method includes：
Picture frame to be processed is obtained according to Low Voltage Differential Signal LVDS；
With the clock cycle of the LVDS signal, stored using field programmable gate array FPGA chip based on double-port random
Multiple First Input First Output FIFO buffers of device RAM building carry out reading data, the row buffering as row buffer simultaneously
Lastrow buffer data, which shunts, in area inputs next row buffer, according to each pixel in the picture frame to be processed and respectively
Distribution of the adjacent pixel of pixel on color space determines the environmental light intensity of each pixel in the picture frame to be processed, and root
According to distribution of each pixel in a upper picture frame for the picture frame to be processed on color space and to a upper picture frame
Defogging treated distribution of each pixel on color space is carried out, determines the global atmosphere light of the picture frame to be processed；
According to the environmental light intensity and the global atmosphere light, each pixel in the picture frame to be processed is carried out at defogging
Reason obtains carrying out the picture frame to be processed defogging treated image frame data；
According to the summation of delay, by the progress defogging, treated that image frame data is converted into LVDS signal and exports；It is described
The summation of delay includes that LVDS signal is converted to the delay of rgb signal, the delay of rgb signal demisting, rgb signal revert to LVDS
The delay of signal；
Wherein it is determined that the global atmosphere light of the picture frame to be processed, including：
Obtain each pixel in upper picture frame original pixel value in R, G and B color channel and on described respectively
One picture frame carries out defogging, and treated that each pixel goes back original pixel value in R, G and B color channel respectively, and will be described original
Maximum value in pixel value is determined as the first reference pixel value, and the maximum value gone back in original pixel value is determined as the second reference
Pixel value；Wherein, the original pixel value of going back is to the upper picture frame progress defogging treated each pixel value；
By the mean value of first reference value and the second reference value, it is determined as the global atmosphere light of the picture frame to be processed.
2. the method as described in claim 1, which is characterized in that the environment of each pixel in the determination picture frame to be processed
Light intensity, including：
Obtain each pixel original pixel value in R, G and B color channel, and general respectively respectively in the picture frame to be processed
Minimum value of each pixel in the original pixel value in R, G and B color channel in the picture frame to be processed is determined as the picture
The minimum pixel value of element；
For the pixel in the picture frame to be processed, determines the minimum pixel value of the pixel and determination is adjacent with the pixel
Each pixel minimum pixel value mean value, by the minimum pixel value for the pixel determined and the mean value minimum value make
For the environmental light intensity of the pixel.
3. the method as described in claim 1, which is characterized in that carried out at defogging to each pixel in the picture frame to be processed
Reason, including：
Calculate the difference between the original pixel value of each pixel and the environmental light intensity of each pixel；
Defogging processing is carried out to the difference using the medium permeability of each pixel,
The set of treated each pixel value is determined as carrying out the picture frame to be processed defogging treated number of image frames
According to；Wherein, the medium permeability is related to the environmental light intensity of the pixel and global atmosphere light.
4. method as claimed in any one of claims 1-3, which is characterized in that determine the environment light according to following formula one
Strong L (x)；
The formula one is：L (x)=min (min (ρ * mav,0.9)Mave(x),M(x))
Global atmosphere light A is determined according to following formula two；
The formula two is：
Defogging processing is carried out to the picture frame to be processed according to following formula three, the image frame data J (x) that obtains that treated；
The formula three is：
Wherein, the M (x) is minimum pixel value of the pixel x in R, G and B color channel；The mavIt is by members all in M (x)
The mean value of element reduces 256 times and obtains；It is describedWherein saIndicate centered on pixel x,
Using a as the rectangular area of radius, average is to be averaged operation；The MaveP(x) defogging processing is carried out for a upper picture frame
Pixel x afterwards goes back original pixel value in R, G and B color channel；The I (x) be the picture frame to be processed pixel x R,
Original pixel value in G and B color channel；The IPIt (x) is the pixel x in a upper picture frame in R, G and B color channel
In original pixel value；The min () is is minimized operation, the max () is to be maximized operation；The ρ is default school
Positive value and 0≤ρ≤1/mav。
5. a kind of display device, which is characterized in that the device includes：
On-site programmable gate array FPGA is sent to the carrying figure to be handled of liquid crystal display control panel TCON for intercepting and capturing and parsing
As the first LVDS signal of frame data, following defogging is executed to the picture frame to be processed and is handled, and will carry that treated
2nd LVDS signal of image frame data is exported to the TCON；The defogging is handled：Believe with the first LVDS
Number clock cycle, the multiple FIFO buffers constructed using fpga chip based on double-port RAM RAM are slow as row
It rushing area while carrying out reading data, lastrow buffer data, which shunts, in the row buffer inputs next row buffer, according to
Distribution of the adjacent pixel of each pixel and each pixel in the picture frame to be processed on color space determines described wait locate
The environmental light intensity of each pixel in picture frame is managed, and according to each pixel in a upper picture frame for the picture frame to be processed in color
Distribution spatially and defogging carried out treated distribution of each pixel on color space to a picture frame on this, determine described in
The global atmosphere light of picture frame to be processed；According to the environmental light intensity and the global atmosphere light, to the picture frame to be processed
In each pixel carry out defogging processing, obtain carrying out the picture frame to be processed defogging treated image frame data；According to
The summation of delay, by the progress defogging, treated that image frame data is converted into the 2nd LVDS signal and exports；The delay
Summation include that the first LVDS signal is converted to the delay of rgb signal, the delay of rgb signal demisting, rgb signal revert to second
The delay of LVDS signal；
The TCON, for receiving by the 2nd LVDS signal of carrying of exporting of the FPGA treated image frame data,
Driving signal is provided according to the 2nd LVDS signal for display screen；
The display screen, the driving signal provided for receiving the TCON, and image is shown according to the driving signal；
Wherein, the FPGA is specifically used for：
Obtain each pixel in upper picture frame original pixel value in R, G and B color channel and on described respectively
One picture frame carries out defogging, and treated that each pixel goes back original pixel value in R, G and B color channel respectively, and will be described original
Maximum value in pixel value is determined as the first reference pixel value, and the maximum value gone back in original pixel value is determined as the second ginseng
Examine pixel value；Wherein, the original pixel value of going back is to the upper picture frame progress defogging treated each pixel value；
By the mean value of first reference value and the second reference value, it is determined as the global atmosphere light of the picture frame to be processed.
6. device as claimed in claim 5, which is characterized in that the FPGA is specifically used for：
Obtain each pixel original pixel value in R, G and B color channel, and general respectively respectively in the picture frame to be processed
Minimum value of each pixel in the original pixel value in R, G and B color channel in the picture frame to be processed is determined as the picture
The minimum pixel value of element；
For the pixel in the picture frame to be processed, determines the minimum pixel value of the pixel and determination is adjacent with the pixel
Each pixel minimum pixel value mean value, by the minimum pixel value for the pixel determined and the mean value minimum value make
For the environmental light intensity of the pixel.
7. device as claimed in claim 5, which is characterized in that the FPGA is specifically used for：
Calculate the difference between the original pixel value of each pixel and the environmental light intensity of each pixel；Utilize the medium permeability of each pixel
Defogging processing is carried out to the difference, the set of treated each pixel value is determined as removing the picture frame to be processed
Mist treated image frame data；Wherein, the medium permeability is related to the environmental light intensity of the pixel and global atmosphere light.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510128196.7A CN104732496B (en) | 2015-03-23 | 2015-03-23 | A kind of video streaming image defogging processing method and display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510128196.7A CN104732496B (en) | 2015-03-23 | 2015-03-23 | A kind of video streaming image defogging processing method and display device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104732496A CN104732496A (en) | 2015-06-24 |
| CN104732496B true CN104732496B (en) | 2018-11-30 |
Family
ID=53456367
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510128196.7A Active CN104732496B (en) | 2015-03-23 | 2015-03-23 | A kind of video streaming image defogging processing method and display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104732496B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104616269A (en) * | 2015-02-27 | 2015-05-13 | 深圳市中兴移动通信有限公司 | Image defogging method and shooting device |
| CN105469372A (en) * | 2015-12-30 | 2016-04-06 | 广西师范大学 | Mean filtering-based fog-degraded image sharp processing method |
| CN114331920B (en) * | 2022-03-09 | 2022-06-24 | 浙江大华技术股份有限公司 | Image processing method and device, storage medium, and electronic device |
| CN115802055B (en) * | 2023-01-30 | 2023-06-20 | 孔像汽车科技(武汉)有限公司 | Image defogging processing method and device based on FPGA, chip and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103700079A (en) * | 2013-12-17 | 2014-04-02 | 中国科学院深圳先进技术研究院 | Image defogging method and device |
| CN103714520A (en) * | 2013-12-26 | 2014-04-09 | 深圳英飞拓科技股份有限公司 | Digital video image enhancement achieving system and method based on FPGA |
| CN103745438A (en) * | 2013-12-31 | 2014-04-23 | 中国科学院深圳先进技术研究院 | Haze removing method for large-area background light haze-containing image |
-
2015
- 2015-03-23 CN CN201510128196.7A patent/CN104732496B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103700079A (en) * | 2013-12-17 | 2014-04-02 | 中国科学院深圳先进技术研究院 | Image defogging method and device |
| CN103714520A (en) * | 2013-12-26 | 2014-04-09 | 深圳英飞拓科技股份有限公司 | Digital video image enhancement achieving system and method based on FPGA |
| CN103745438A (en) * | 2013-12-31 | 2014-04-23 | 中国科学院深圳先进技术研究院 | Haze removing method for large-area background light haze-containing image |
Non-Patent Citations (8)
| Title |
|---|
| Fast Visibility Restoration from a Single Color or Gray Level Image;Jean-Philippe Tarel 等;《2009 IEEE 12th International Conference on Computer Vision (ICCV)》;20091231;全文 * |
| 关于OLED亮度和寿命的优化研究;刁玉洁;《中国优秀硕士学位论文全文数据库 信息科技辑》;20150115;第2015年卷(第1期);正文第26、28-30页 * |
| 基于FPGA的LED电视动态背光系统设计;卿启新 等;《微计算机信息》;20111231;第27卷(第3期);全文 * |
| 基于FPGA的单幅图像去雾算法研究及其实现;毕娟;《中国优秀硕士学位论文全文数据库 信息科技辑》;20130315(第03期);第I138-1191页 * |
| 基于FPGA的图像去雾算法改进及实现;李健;《中国优秀硕士学位论文全文数据库 信息科技辑》;20141115(第11期);第I138-350页 * |
| 基于FPGA的视频雾场景去除算法研究与实现;韩子奇;《中国优秀硕士学位论文全文数据库 信息科技辑》;20140115(第01期);正文第35页 * |
| 基于单幅图像的快速去雾算法;刘倩 等;《(第25届中国控制与决策会议)论文集》;20131203;正文第1节第1段,第2.2节，第3节第1段,表1 * |
| 幅图像去雾算法的研究及其FPGA实现;吴岳骏;《中国优秀硕士学位论文全文数据库 信息科技辑》;20131215(第S2期);第I138-1331页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104732496A (en) | 2015-06-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104732496B (en) | A kind of video streaming image defogging processing method and display device | |
| CN105653224B (en) | A kind of splice displaying system and its display methods | |
| CN105120187B (en) | A kind of image processing method of laser television, system and laser television | |
| CN105704407B (en) | A kind of display processing unit, device and method | |
| CN104025586B (en) | Resolution ratio strengthens 3D Video Rendering system and method | |
| CN108702514B (en) | High dynamic range image processing method and device | |
| CN108574794A (en) | Image processing method, device and display equipment, computer readable storage medium | |
| CN109871192A (en) | A kind of display methods, device, electronic equipment and computer readable storage medium | |
| CN105872419A (en) | Display method, device and liquid crystal television | |
| CN108235055A (en) | Transparent video implementation method and equipment in AR scenes | |
| CN102426514A (en) | Synchronous displaying method and device for large-screen spliced wall | |
| CN103745687A (en) | Image display method and image display device | |
| EP3451280A1 (en) | Display apparatus and image processing method increasing the picture resolution | |
| CN113808242A (en) | Image synthesis method and device and image processing equipment | |
| CN106161987B (en) | A kind of more image Display on the same screen methods and more image Display on the same screen systems | |
| CN110691203A (en) | Multi-path panoramic video splicing display method and system based on texture mapping | |
| WO2020000538A1 (en) | Device for increasing contrast and display | |
| EP3107283A1 (en) | Method and apparatus for transmitting video signal | |
| CN102186097A (en) | Three-dimensional (3D) image display method, device and equipment | |
| CN111292677B (en) | Image display processing method and device, computer equipment and storage medium | |
| JPH01307388A (en) | X-y matrix type display device | |
| Byanju et al. | A comparative study of superimposition techniques for enhancing the projector resolution: Simulations and experiments | |
| US8488897B2 (en) | Method and device for image filtering | |
| CN104851411B (en) | A kind of display drive method, device and display system | |
| CN117710271B (en) | Transparency processing method and system based on Hai Si 2D acceleration platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Patentee after: Hisense Video Technology Co.,Ltd. Address before: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Patentee before: HISENSE ELECTRIC Co.,Ltd. |