CN104732496A - Defogging processing method and display device for video stream images - Google Patents
Defogging processing method and display device for video stream images Download PDFInfo
- Publication number
- CN104732496A CN104732496A CN201510128196.7A CN201510128196A CN104732496A CN 104732496 A CN104732496 A CN 104732496A CN 201510128196 A CN201510128196 A CN 201510128196A CN 104732496 A CN104732496 A CN 104732496A
- Authority
- CN
- China
- Prior art keywords
- pixel
- picture frame
- pixel value
- value
- mist elimination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The embodiment of the invention discloses a defogging processing method and a display device for video stream images, relates to the field of image processing, and provides a method synchronously performing defogging processing at the display screen end in real time based on an average filtering algorithm. The defogging processing method comprises the steps of obtaining a to-be-processed image frame; determining the environmental light intensity of all pixels in the to-be-processed image frame according to all the pixels in the to-be-process image frame and the distribution of the adjacent pixels of all the pixels on a color space, and determining global atmospheric light of the to-be-processed image frame according to the distribution of all pixels in a last image frame of the to-be-processed image frame in a color space and the distribution of all pixels of the last image frame after defogging processing is performed in a color space; performing defogging processing on all the pixels in the to-be-processed image frame according to the environmental light intensity and the global atmospheric light to obtain image frame data of the to-be-processed image frame after defogging processing is performed; accordingly, the above functions are achieved.
Description
Technical field
The present invention relates to image processing field, particularly relate to a kind of video streaming image mist elimination disposal route and display device.
Background technology
Traditional display screen, usually simple brightness/contrast is only provided to regulate for image quality adjustment, and the display frame of video monitoring is very easily subject to boisterous impact, the security protection display screen of therefore serving the aspect such as intelligent traffic monitoring, community security monitoring has strong real-time mist elimination demand.
The mist elimination algorithm of current main flow, it is mostly the principle based on dark channel prior, although good to common mist scene adaptability based on the mist elimination technology of dark, Be very effective, be used widely, but there is certain complicacy due to this algorithm, the mist elimination technology therefore based on dark is difficult to for large-size images the requirement reaching process in real time.
Summary of the invention
The embodiment of the present invention provides a kind of video streaming image mist elimination disposal route and display device, in order to provide a kind of method of carrying out mist elimination process based on Mean Filtering Algorithm at display screen end real-time synchronization.
Embodiments provide a kind of video streaming image mist elimination disposal route, this disposal route comprises:
Obtain pending picture frame;
According to the distribution of neighbor on color space of each pixel in described pending picture frame and each pixel, determine the environmental light intensity of each pixel in described pending picture frame, and carry out the distribution of each pixel on color space after mist elimination process according to the distribution of each pixel in a upper picture frame of described pending picture frame on color space with to a picture frame on described, determine the overall atmosphere light of described pending picture frame;
According to described environmental light intensity and described overall atmosphere light, mist elimination process is carried out to each pixel in described pending picture frame, obtain carrying out the image frame data after mist elimination process to described pending picture frame.
The embodiment of the present invention additionally provides a kind of display device, and this device comprises:
On-site programmable gate array FPGA, for intercepting and capturing and resolving the first signal carrying pending image frame data sending to liquid crystal display control panel TCON, following mist elimination process is performed to described pending picture frame, and exports the secondary signal carrying the image frame data after process to described TCON; Described mist elimination process is specially: according to the distribution of neighbor on color space of each pixel in described pending picture frame and each pixel, determine the environmental light intensity of each pixel in described pending picture frame, and according to the distribution of each pixel in a upper picture frame of described pending picture frame on color space with carry out the distribution of each pixel on color space after mist elimination process to a picture frame on this, determine the overall atmosphere light of described pending picture frame; According to described environmental light intensity and described overall atmosphere light, mist elimination process is carried out to each pixel in described pending picture frame, obtain carrying out the image frame data after mist elimination process to described pending picture frame;
Described TCON, for receiving the secondary signal carrying the image frame data after process exported by described FPGA, according to described secondary signal for display screen provides drive singal;
Described display screen, for receiving the drive singal that described TCON provides, and according to described drive singal display image.
As can be seen from above-mentioned technical method, the embodiment of the present invention according to the distribution of neighbor on color space of each pixel in pending picture frame and each pixel, thus can define the environmental light intensity of each pixel in pending picture frame; And, according to the distribution of each pixel in a upper picture frame of pending picture frame on color space with carry out the distribution of each pixel on color space after mist elimination process to a picture frame on this, thus define the overall atmosphere light of the entirety of pending picture frame; And then utilize the overall atmosphere light of the environmental light intensity of each pixel and whole two field picture, one by one mist elimination process is carried out to each pixel in pending picture frame, obtains carrying out the image frame data after mist elimination process to pending picture frame; Visible, in embodiments of the present invention, when needs carry out mist elimination process to current image frame, only need according to have scanned and the related data of the upper picture frame processed and the associated pixel data of current image frame can carry out mist elimination process to current image frame, thus simplify calculation process, achieve the function of picture frame being carried out to Quick demisting.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, below the accompanying drawing used required in describing embodiment is briefly introduced, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
The schematic flow sheet of the mist elimination process that Fig. 1 provides for the embodiment of the present invention;
The schematic flow sheet of the image mist elimination disposal route that Fig. 2 provides for the embodiment of the present invention;
The schematic flow sheet carrying out mist elimination process based on FPGA that Fig. 3 provides for the embodiment of the present invention;
The schematic flow sheet of the RGB data process that Fig. 4 provides for the embodiment of the present invention;
The schematic flow sheet realizing Mean Filtering Algorithm based on FPGA that Fig. 5 provides for the embodiment of the present invention;
The structural representation of a kind of display device that Fig. 6 provides for the embodiment of the present invention.
Embodiment
In order to make the object, technical solutions and advantages of the present invention clearly, below in conjunction with accompanying drawing, the present invention is described in further detail, and obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making other embodiments all obtained under creative work prerequisite, belong to the scope of protection of the invention.
The embodiment of the present invention goes for based on FPGA (Field-Programmable Gate Array, field programmable gate array) the mist elimination solution of technology, be particularly useful for the automatic Quick demisting solution of video monitoring display apparatus side (as various liquid crystal indicator).In embodiments of the present invention, original have mist image to show after liquid crystal indicator end can carry out mist elimination process automatically again, effectively improves the image displaying quality of video monitoring under the inclement weather such as mist, haze.After tested, the embodiment of the present invention can preferably serve the field such as intelligent transportation, video monitoring.
The embodiment of the present invention is based on FPGA technology, for FPGA platform characteristic, mist elimination algorithm is optimized and is improved, on the basis ensureing preferably mist elimination effect, achieve to high-definition liquid crystal display end (such as: resolution reach 1920*1080 and more than) do not change display screen refreshing frequency (such as: 60Hz) while, the function of synchronous automatic defogging.In embodiments of the present invention, only need have access to mist image or video, the scheme that the embodiment of the present invention can be utilized to provide realizes quick, synchronous mist elimination process at liquid crystal indicator end automatically; Further, liquid crystal indicator in the embodiment of the present invention can also arrange mist elimination function button, there is provided a key to open for user or close the mist elimination function in display device, the method utilizing the embodiment of the present invention to provide manually can input or regulating parameter without the need to user, mist scene can be had automatically to complete mist elimination process for difference, and the embodiment of the present invention only utilizes fpga chip can reach computing requirement, and has increased substantially the real-time of mist elimination process.
FPGA, i.e. field programmable gate array, it occurs as a kind of semi-custom circuit in integrated circuit fields, the exploitation of FPGA has a great difference relative to the exploitation of PC, single-chip microcomputer, FPGA is based on concurrent operation, realize with hardware description language, have very large difference compared to the sequential operation of PC or single-chip microcomputer.Because FPGA has the concurrency of processing of circuit, the processing requirements of supercomputing therefore can be met.Carry out image procossing with FPGA technology, while completing a large amount of computing, the requirement of real-time of process can also be met.
Based on FPGA treatment technology, whole image mist elimination system can being made, there is the advantages such as algorithm washability, upgradability, when keeping hardware configuration constant, algorithm can be upgraded.By using Verilog hardware program language to carry out circuit design, be burned onto FPGA through comprehensive and layout, namely it become the process chip with mist elimination function.Mist elimination pattern for liquid crystal display realizes, and sends the Low Voltage Differential Signal LVDS liquid crystal display signal of TCON plate by blocking mainboard to, makes it flow through FPGA process chip to complete mist elimination process.For the LVDS signal flow to, first signal conversion is carried out to it, be translated into rgb signal, then use image processing techniques to carry out mist elimination image enhancement processing to rgb signal, finally the rgb signal processed is converted into new LVDS signal and again passes out to TCON plate.
Fig. 1 shows the system process block schematic illustration that the embodiment of the present invention provides, and as shown in Figure 1, this system at least can comprise: LCDs mainboard 11, FPGA process chip 12 and TCon13.Wherein, FPGA is mainly used in performing following function: LVDS signal turns rgb signal; LVDS system-related signal phase delay; RGB image mist elimination; Rgb signal turns LVDS signal.
Visible, the process that the mist elimination pattern in the embodiment of the present invention relates to be mainly following three emphasis: LVDS be converted to RGB data process, RGB data is carried out mist elimination process process and the RGB data after process is reverted to the process of LVDS signal.
Fig. 2 shows the schematic flow sheet of the image mist elimination disposal route that the embodiment of the present invention provides, and as shown in Figure 2, this flow process is mainly illustrated the process that RGB data carries out mist elimination process:
Step 21: obtain pending picture frame.
Step 22: according to the distribution of neighbor on color space of each pixel in pending picture frame and each pixel, determine the environmental light intensity of each pixel in pending picture frame; And according to the distribution of each pixel in a upper picture frame of pending picture frame on color space with carry out the distribution of each pixel on color space after mist elimination process to a picture frame on this, determine the overall atmosphere light of pending picture frame.
Step 23: environmentally light intensity and overall atmosphere light, carries out mist elimination process to each pixel in pending picture frame, obtains carrying out the image frame data after mist elimination process to pending picture frame.
It should be noted that, in the above-mentioned steps 22 of the embodiment of the present invention, the step of the step determining the environmental light intensity of each pixel and the overall atmosphere light determining pending picture frame, above-mentioned two steps can perform simultaneously, the step that also first can perform the environmental light intensity determining each pixel performs the step of the overall atmosphere light determining pending picture frame again, and the step that first can also perform the overall atmosphere light determining pending picture frame performs the step of the environmental light intensity determining each pixel again.
Below the embodiment of the present invention is described in detail.
Fig. 3 shows the schematic flow sheet carrying out mist elimination process based on FPGA that the embodiment of the present invention provides, and as shown in Figure 3, this flow process comprises:
Step 31:FPGA intercepts and captures and resolves the first signal carrying pending image frame data sending to liquid crystal display control panel TCON.
During specific implementation, the first signal can be a kind of Low Voltage Differential Signal LVDS, and wherein the first signal carries the RGB data signal of pending image, synchronizing signal and clock signal.
Step 32:FPGA performs mist elimination process to pending picture frame, and exports the secondary signal carrying the image frame data after process to TCON.
During specific implementation, at computer vision field, the impact usually adopting following physical model (for convenience, below by this physical model referred to as formula (1)) to describe the inclement weathers such as haze to cause image:
Formula (1) is specially: I (x)=J (x) t (x)+A (1-t (x))
In above-mentioned formula (1), what I (x) expression was observed has mist image, J (x) represents background image, namely to be restored without mist image, A is overall atmosphere light (Atmospheric Light), t (x) is the medium permeability relevant with the depth of field, represents not absorbed through medium, disperse and arrive the ratio shared by light of imaging device.In embodiments of the present invention, the process nature of demist is recover A and t (x) according to I (x), and finally obtains the process of J (x).For convenience, J (x) t (x) (namely J (x) is multiplied by t (x)) in formula (1) is called dc-decay part by the embodiment of the present invention, A (1-t (x)) is called environmental light intensity, for convenience of describing, environmental light intensity is expressed as L (x)=A (1-t (x)).
Fig. 4 shows the schematic flow sheet of the RGB data process that the embodiment of the present invention provides, and as shown in Figure 4, this flow process can be:
Step S11: obtain the original pixel value of each pixel respectively in R, G and B Color Channel in pending picture frame, and respectively the minimum value in the original pixel value of each pixel in pending picture frame in R, G and B Color Channel being defined as the minimum pixel value M (x) of this pixel, the embodiment of the present invention can determine the minimum pixel value M (x) of each pixel by following formula (2).
Formula (2) is specially: M (x)=min
c ∈ { r, g, b}(I
c(x))
Wherein, { r, g, b} are arbitrary for what represent in R Color Channel, G Color Channel and B Color Channel, I for c ∈
cx () is for representing the pixel value of pixel x in R Color Channel, G Color Channel or B Color Channel; Min () is for getting minimum operation.
Step S12: for the pixel in pending picture frame, determine the minimum pixel value of this pixel and determine the average of the minimum pixel value of each pixel adjacent with this pixel, using the environmental light intensity of the minimum value in the minimum pixel value of this pixel determined and average as this pixel, the embodiment of the present invention can utilize the mode of mean filter to determine the environmental light intensity (view data that the environmental light intensity by each pixel in pending picture frame forms is called surround lighting figure by the embodiment of the present invention) of each pixel by following formula (3) and formula (4).Wherein, Function () the presentation function computing in Fig. 4.
Formula (3) is specially:
The embodiment of the present invention can utilize formula (3) to carry out mean filter to M (x), determines to obtain M
ave(x).Wherein s
arepresenting with pixel x for place-centric, take a as the rectangular area of radius; Average is computing of averaging.
Formula (4) is specially: L (x)=min (min (ρ m
av, 0.9) and M
ave(x), M (x))
Wherein m
avobtain for the average of all elements in M (x) reduces 256 times, ρ is for presetting correction parameter, and due to the restriction of 0.9 upper limit in formula (4), the effective range of known ρ is 0≤ρ≤1/m
av.
By above-mentioned formula (3) and (4), the embodiment of the present invention can utilize M
avex () determines environmental light intensity L (x), and the surround lighting figure of pending picture frame.
The embodiment of the present invention provides a kind of mode determining environmental light intensity by way of example.The derivation of formula (4) is specifically as follows in embodiments of the present invention: the minimum value passage average that the embodiment of the present invention make use of certain area around a pixel roughly can react the principle of transmissivity t (x) variation tendency, concrete:
Can be drawn by above-mentioned formula (1)
on the right side of equal sign
carry out mean filter, and can draw in conjunction with above-mentioned formula (2):
And on the basis of the t (x) calculated, add default corrected value, be:
Wherein,
For preventing excessive mist elimination from making image color cast, the embodiment of the present invention can be tended to choose larger medium permeability, and in conjunction with practical experience, after limiting correlation parameter value, finally show that medium permeability is:
Due to L (x)=A (1-t (x)), finally draw formula (4).
It should be noted that; the embodiment of the present invention only gives a kind of mode of computing environment light intensity L (x); every protection domain utilizing the scheme of Mean Filtering Algorithm determination environmental light intensity L (x) all to belong to the embodiment of the present invention, repeats no more here.
Step S13: obtain original pixel value respectively in R, G and B Color Channel of each pixel in a upper picture frame and on a picture frame carry out mist elimination process after each pixel in R, G and B Color Channel, go back original pixel value, and the maximal value in original pixel value is defined as the first reference pixel value, and the maximal value of going back in original pixel value is defined as the second reference pixel value; By the average of the first reference value and the second reference value, be defined as the overall atmosphere light of pending picture frame.
Wherein, each pixel after a upper picture frame carries out mist elimination process in R, G and B Color Channel to go back original pixel value be the method that utilizes the embodiment of the present invention to provide on a picture frame carry out mist elimination process after obtain the RGB value of each pixel.
Concrete, continue to utilize above-mentioned formula (1) and formula (5), can determine that the span of overall atmosphere light A is: max (M
ave(x))≤A≤max (I (x))
Further, can obtain: A=ω max (M
ave(x))+(1-ω) max (I (x))
Wherein, 0≤ω≤1
The embodiment of the present invention is in order to improve the rapidity of algorithm further, and it is excessive to prevent value from offseting, and therefore makes ω=0.5, obtains following formula (6), can obtain overall atmosphere light A:
Formula (6) is specially:
Step S14: environmentally light intensity and overall atmosphere light, carries out mist elimination process to each pixel in pending picture frame, obtains carrying out the image frame data after mist elimination process to pending picture frame.
Concrete, after calculating environmental light intensity and overall atmosphere light, following formula (7) can be utilized to recover original in mist image:
Formula (7) is specially:
Step 33:TCON receives the secondary signal carrying the image frame data after process exported by FPGA, according to secondary signal for display screen provides drive singal.
Step 34: display screen receives the drive singal that TCON provides, and according to drive singal display image.
During specific implementation, the embodiment of the present invention, after utilize said method to carry out mist elimination process to RGB data, utilizes the synchronizing signal in former LVDS signal and clock signal that the RGB data after process is converted to LVDS signal and exports TCOM to.
The embodiment of the present invention can also utilize FPGA to realize above-mentioned mist elimination process computing, specifically can be divided into three parts, be respectively: utilize FPGA realize the process time delay in mean filter, FPGA and utilize FPGA to the process of part floating point parameters.
The first, the realization of mean filter.Fig. 5 shows the schematic flow sheet realizing Mean Filtering Algorithm based on FPGA that the embodiment of the present invention provides, as shown in Figure 5:
Mean filter is to a pixel value, in order to centered by it around in a certain size window the average of all elements replace original pixel value.If do not use buffer memory to calculate, RAM (Random-Access Memory is stored in due to whole, random access memory) in the reading of image can be subject to the restriction of bandwidth, a set of address bus each clock period can only complete the random read-write to an address, be of a size of the mean filter in w × w region, need w × w cycle to read.Therefore for realize wave filter can first by data buffer storage to w row buffer, carry out digital independent to w is capable, meet each clock period exports the requirement of w pixel value to filter function processing module simultaneously simultaneously.The pixel stream that accompanying image each clock period is sent, separately has w-1 row buffer synchronism output pixel stream, can reach the object of w × w window filtering.Because each row of data by calculating w time, while filtering, will need the data of lastrow buffer zone to be input to next line, can reach the reusable effect of row data.FIFO (the First Input First Output built based on two-port RAM of fpga chip, First Input First Output) buffer, wholely meet well the characteristic that this has sequential input and output, therefore w-1 FIFO buffer is together with image input traffic, together form w row inlet flow.
In embodiments of the present invention, filtering can comprise:
A, triple channel minimum value data stream Stream for input picture
min, buffer memory w-1 is capable of FIFO buffer;
B, from w is capable, w-1 FIFO row buffer, with Stream
minsynchronous input w data are to mean filter module;
C, every a line data fifo stream, the next row fifo buffer of shunting input.
For mean filter module, inside is the queue of every column data summation sum, comprise w sum value, in corresponding window every column data and, the multiple totalizer being row in addition and being added, calculates the total value of each row and addition, when window being set to the multiple of 2, after result displacement exports, obtain corresponding pixel points mean filter result.
Processing delay in the second, FPGA.
In Synchronous sequential logic circuit, data often all can produce the delay of a clock cycle through a processing element.Then data distribution process gathers, image alignment outputs to internal memory or display screen etc. all needs to calculate corresponding delay, with align data or differentiation active traffic starting position, could produce correct result.
Rgb signal carry out demist be disposed go back to LVDS signal time.Need to postpone accordingly row, field, enable signal etc., otherwise the skew, mistake etc. of screen display can be caused, postpone for the signals such as signal conversion and demist process flow through the summation of clock period spent by streamline.
Wherein, formula is used
represent on the main recovery line of FPGA, the summation T of all time delays
latency.Specifically may be used for representing the time delay that LVDS signal is converted to the time delay of rgb signal, the time delay of rgb signal demist, rgb signal revert to LVDS signal.Export have transmission delay because an end data is input to an other end data, therefore, carrying out time delay to row, field, enable signal is exactly to notify other one end: a new frame, a line, the information such as effective when start transmission.In above-mentioned formula, what Components represented is the parts that signal flows through; Latency represents time delay.
3rd, to the process of part floating point parameters.
Expand certain multiple according to employing floating number and be transformed to integer, replace with the principle of shift operation with multiplication and division as far as possible, promote FPGA speed, reduce design difficulty.
The embodiment of the present invention is with L (x)=min (min (ρ m
av, 0.9) and M
ave(x), M (x)) be described for example, such as: ρ desirable 1.5, then
for more conveniently comparing with 0.9, be set to
so all divide operations can have been come by displacement.So for min (ρ m
av, 0.9) choose, moving to right 4 to compare with 29 by 3*average (M (x)) draws.
As can be seen from technique scheme, the mist elimination treatment technology based on FPGA that the embodiment of the present invention provides, can make whole image mist elimination system, have the advantages such as algorithm washability, upgradability, when keeping hardware configuration constant, algorithm can be upgraded.By using Verilog hardware program language to carry out circuit design, be burned onto FPGA through comprehensive and layout, namely it become the process chip with mist elimination function.Mist elimination pattern for liquid crystal display realizes, and sends the Low Voltage Differential Signal LVDS liquid crystal display signal of TCON plate by blocking mainboard to, makes it flow through FPGA process chip to complete mist elimination process.For the LVDS signal flow to, first signal conversion is carried out to it, be translated into rgb signal, then use image processing techniques to carry out mist elimination image enhancement processing to rgb signal, finally the rgb signal processed is converted into new LVDS signal and again passes out to TCON plate.
Based on identical technical conceive, Fig. 6 shows the structural representation of a kind of display device that the embodiment of the present invention provides, and as shown in Figure 6, this device can comprise:
On-site programmable gate array FPGA 61, for intercepting and capturing and resolving the first signal carrying pending image frame data sending to liquid crystal display control panel TCON62, following mist elimination process is performed to described pending picture frame, and exports the secondary signal carrying the image frame data after process to described TCON 62; Described mist elimination process is specially: according to the distribution of neighbor on color space of each pixel in described pending picture frame and each pixel, determine the environmental light intensity of each pixel in described pending picture frame, and according to the distribution of each pixel in a upper picture frame of described pending picture frame on color space with carry out the distribution of each pixel on color space after mist elimination process to a picture frame on this, determine the overall atmosphere light of described pending picture frame; According to described environmental light intensity and described overall atmosphere light, mist elimination process is carried out to each pixel in described pending picture frame, obtain carrying out the image frame data after mist elimination process to described pending picture frame;
Described TCON 62, for receiving the secondary signal carrying the image frame data after process exported by described FPGA 61, according to described secondary signal for display screen 63 provides drive singal;
Described display screen 63, for receiving the drive singal that described TCON 62 provides, and according to described drive singal display image.
Optionally, described FPGA 61 specifically for: obtain the original pixel value of each pixel respectively in R, G and B Color Channel in described pending picture frame, and the minimum value in the original pixel value of each pixel in described pending picture frame in R, G and B Color Channel be defined as the minimum pixel value of this pixel respectively; For the pixel in described pending picture frame, determine the minimum pixel value of this pixel and determine the average of the minimum pixel value of each pixel adjacent with this pixel, using the environmental light intensity of the minimum value in the minimum pixel value of this pixel determined and described average as this pixel.
Optionally, described FPGA 61 specifically for: obtain original pixel value respectively in R, G and B Color Channel of each pixel in a described upper picture frame and each pixel after mist elimination process is carried out to a picture frame on described and go back original pixel value respectively in R, G and B Color Channel, and the maximal value in described original pixel value is defined as the first reference pixel value, and described maximal value of going back in original pixel value is defined as the second reference pixel value; Wherein, going back original pixel value described in is carry out each pixel value after mist elimination process to a described upper picture frame; By the average of described first reference value and the second reference value, be defined as the overall atmosphere light of described pending picture frame.
Optionally, described FPGA 61 specifically for: calculate the difference between the original pixel value of each pixel and the environmental light intensity of each pixel; Utilize the medium permeability of each pixel to carry out mist elimination process to described difference, the set of each pixel value after process is defined as carrying out the image frame data after mist elimination process to described pending picture frame; Wherein, described medium permeability is relevant with overall atmosphere light to the environmental light intensity of this pixel.
Optionally, described FPGA 61 specifically for: determine described environmental light intensity L (x) according to following formula one;
Described formula one is: L (x)=min (min (ρ * m
av, 0.9) and M
ave(x), M (x))
Overall atmosphere light A is determined according to following formula two;
Described formula two is:
According to following formula three, mist elimination process is carried out to described pending picture frame, obtain the image frame data J (x) after processing;
Described formula three is:
Wherein, described M (x) is the minimum pixel value of pixel x in R, G and B Color Channel; Described m
avthe average of all elements in M (x) is reduced 256 times obtain; Described
wherein s
aexpression is the rectangular area of radius centered by pixel x, with a, and average is computing of averaging; Described M
avePx () is the minimum pixel value of the pixel x in a upper picture frame; Described I (x) comprises the original pixel value of described pending picture frame in R, G and B Color Channel; Described I
px () comprises the original pixel value of pixel x in R, G and B Color Channel in a described upper picture frame; Described min () is for getting minimum operation, described max () for getting maximum operation; Described ρ is for presetting corrected value and 0≤ρ≤1/m
av.
Optionally, described FPGA 61 specifically for: resolve RGB data signal, synchronizing signal and the clock signal of carrying in described first signal, described mist elimination process performed to described RGB data signal; Utilize described synchronizing signal and clock signal, the RGB data signal after process is converted to low-voltage differential signal LVDS signal and exports described TCON 62 to.
The present invention describes with reference to according to the process flow diagram of the method for the embodiment of the present invention, equipment (system) and computer program and/or block scheme.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block scheme and/or square frame and process flow diagram and/or block scheme and/or square frame.These computer program instructions can be provided to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device, make the function that the instruction that performed by the processor of this computing machine or other programmable data processing device can be specified in a flow process in realization flow figure or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing device, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be loaded in computing machine or other programmable data processing device, make on computing machine or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computing machine or other programmable devices is provided for the step realizing the function of specifying in a flow process of process flow diagram or a square frame of multiple flow process and/or block scheme or multiple square frame.
Although describe the preferred embodiments of the present invention, those skilled in the art once obtain the basic creative concept of cicada, then can make other change and amendment to these embodiments.So claims are intended to be interpreted as comprising preferred embodiment and falling into all changes and the amendment of the scope of the invention.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.
Claims (10)
1. a video streaming image mist elimination disposal route, is characterized in that, this disposal route comprises:
Obtain pending picture frame;
According to the distribution of neighbor on color space of each pixel in described pending picture frame and each pixel, determine the environmental light intensity of each pixel in described pending picture frame, and carry out the distribution of each pixel on color space after mist elimination process according to the distribution of each pixel in a upper picture frame of described pending picture frame on color space with to a picture frame on described, determine the overall atmosphere light of described pending picture frame;
According to described environmental light intensity and described overall atmosphere light, mist elimination process is carried out to each pixel in described pending picture frame, obtain carrying out the image frame data after mist elimination process to described pending picture frame.
2. the method for claim 1, is characterized in that, the described environmental light intensity determining each pixel in described pending picture frame, comprising:
Obtain the original pixel value of each pixel respectively in R, G and B Color Channel in described pending picture frame, and the minimum value in the original pixel value of each pixel in described pending picture frame in R, G and B Color Channel is defined as the minimum pixel value of this pixel respectively;
For the pixel in described pending picture frame, determine the minimum pixel value of this pixel and determine the average of the minimum pixel value of each pixel adjacent with this pixel, using the environmental light intensity of the minimum value in the minimum pixel value of this pixel determined and described average as this pixel.
3. the method for claim 1, is characterized in that, the described overall atmosphere light determining described pending picture frame, comprising:
Obtain original pixel value respectively in R, G and B Color Channel of each pixel in a described upper picture frame and each pixel after mist elimination process is carried out to a picture frame on described and go back original pixel value respectively in R, G and B Color Channel, and the maximal value in described original pixel value is defined as the first reference pixel value, described maximal value of going back in original pixel value is defined as the second reference pixel value; Wherein, going back original pixel value described in is carry out each pixel value after mist elimination process to a described upper picture frame;
By the average of described first reference value and the second reference value, be defined as the overall atmosphere light of described pending picture frame.
4. the method for claim 1, is characterized in that, carries out mist elimination process, comprising each pixel in described pending picture frame:
Calculate the difference between the original pixel value of each pixel and the environmental light intensity of each pixel;
The medium permeability of each pixel is utilized to carry out mist elimination process to described difference,
The set of each pixel value after process is defined as carrying out the image frame data after mist elimination process to described pending picture frame; Wherein, described medium permeability is relevant with overall atmosphere light to the environmental light intensity of this pixel.
5. the method according to any one of claim 1-4, is characterized in that, determines described environmental light intensity L (x) according to following formula one;
Described formula one is: L (x)=min (min (ρ * m
av, 0.9) and M
ave(x), M (x))
Overall atmosphere light A is determined according to following formula two;
Described formula two is:
According to following formula three, mist elimination process is carried out to described pending picture frame, obtain the image frame data J (x) after processing;
Described formula three is:
Wherein, described M (x) is the minimum pixel value of pixel x in R, G and B Color Channel; Described m
avthe average of all elements in M (x) is reduced 256 times obtain; Described
wherein s
aexpression is the rectangular area of radius centered by pixel x, with a, and average is computing of averaging; Described M
avePx () is the minimum pixel value of the pixel x in a upper picture frame; Described I (x) comprises the original pixel value of described pending picture frame in R, G and B Color Channel; Described I
px () comprises the original pixel value of pixel x in R, G and B Color Channel in a described upper picture frame; Described min () is for getting minimum operation, described max () for getting maximum operation; Described ρ is for presetting corrected value and 0≤ρ≤1/m
av.
6. a display device, is characterized in that, this device comprises:
On-site programmable gate array FPGA, for intercepting and capturing and resolving the first signal carrying pending image frame data sending to liquid crystal display control panel TCON, following mist elimination process is performed to described pending picture frame, and exports the secondary signal carrying the image frame data after process to described TCON; Described mist elimination process is specially: according to the distribution of neighbor on color space of each pixel in described pending picture frame and each pixel, determine the environmental light intensity of each pixel in described pending picture frame, and according to the distribution of each pixel in a upper picture frame of described pending picture frame on color space with carry out the distribution of each pixel on color space after mist elimination process to a picture frame on this, determine the overall atmosphere light of described pending picture frame; According to described environmental light intensity and described overall atmosphere light, mist elimination process is carried out to each pixel in described pending picture frame, obtain carrying out the image frame data after mist elimination process to described pending picture frame;
Described TCON, for receiving the secondary signal carrying the image frame data after process exported by described FPGA, according to described secondary signal for display screen provides drive singal;
Described display screen, for receiving the drive singal that described TCON provides, and according to described drive singal display image.
7. device as claimed in claim 6, is characterized in that, described FPGA specifically for:
Obtain the original pixel value of each pixel respectively in R, G and B Color Channel in described pending picture frame, and the minimum value in the original pixel value of each pixel in described pending picture frame in R, G and B Color Channel is defined as the minimum pixel value of this pixel respectively;
For the pixel in described pending picture frame, determine the minimum pixel value of this pixel and determine the average of the minimum pixel value of each pixel adjacent with this pixel, using the environmental light intensity of the minimum value in the minimum pixel value of this pixel determined and described average as this pixel.
8. device as claimed in claim 6, is characterized in that, described FPGA specifically for:
Obtain original pixel value respectively in R, G and B Color Channel of each pixel in a described upper picture frame and each pixel after mist elimination process is carried out to a picture frame on described and go back original pixel value respectively in R, G and B Color Channel, and the maximal value in described original pixel value is defined as the first reference pixel value, and described maximal value of going back in original pixel value is defined as the second reference pixel value; Wherein, going back original pixel value described in is carry out each pixel value after mist elimination process to a described upper picture frame;
By the average of described first reference value and the second reference value, be defined as the overall atmosphere light of described pending picture frame.
9. device as claimed in claim 6, is characterized in that, described FPGA specifically for:
Calculate the difference between the original pixel value of each pixel and the environmental light intensity of each pixel; Utilize the medium permeability of each pixel to carry out mist elimination process to described difference, the set of each pixel value after process is defined as carrying out the image frame data after mist elimination process to described pending picture frame; Wherein, described medium permeability is relevant with overall atmosphere light to the environmental light intensity of this pixel.
10. the device according to any one of claim 6-9, is characterized in that, described FPGA specifically for:
Resolve RGB data signal, synchronizing signal and the clock signal of carrying in described first signal, described mist elimination process is performed to described RGB data signal;
Utilize described synchronizing signal and clock signal, the RGB data signal after process is converted to low-voltage differential signal LVDS signal and exports described TCON to.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510128196.7A CN104732496B (en) | 2015-03-23 | 2015-03-23 | A kind of video streaming image defogging processing method and display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510128196.7A CN104732496B (en) | 2015-03-23 | 2015-03-23 | A kind of video streaming image defogging processing method and display device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104732496A true CN104732496A (en) | 2015-06-24 |
| CN104732496B CN104732496B (en) | 2018-11-30 |
Family
ID=53456367
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510128196.7A Active CN104732496B (en) | 2015-03-23 | 2015-03-23 | A kind of video streaming image defogging processing method and display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104732496B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104616269A (en) * | 2015-02-27 | 2015-05-13 | 深圳市中兴移动通信有限公司 | Image defogging method and shooting device |
| CN105469372A (en) * | 2015-12-30 | 2016-04-06 | 广西师范大学 | Mean filtering-based fog-degraded image sharp processing method |
| CN114331920A (en) * | 2022-03-09 | 2022-04-12 | 浙江大华技术股份有限公司 | Image processing method and device, storage medium and electronic device |
| CN115802055A (en) * | 2023-01-30 | 2023-03-14 | 孔像汽车科技(武汉)有限公司 | Image defogging method and device based on FPGA, chip and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103700079A (en) * | 2013-12-17 | 2014-04-02 | 中国科学院深圳先进技术研究院 | Image defogging method and device |
| CN103714520A (en) * | 2013-12-26 | 2014-04-09 | 深圳英飞拓科技股份有限公司 | Digital video image enhancement achieving system and method based on FPGA |
| CN103745438A (en) * | 2013-12-31 | 2014-04-23 | 中国科学院深圳先进技术研究院 | Haze removing method for large-area background light haze-containing image |
-
2015
- 2015-03-23 CN CN201510128196.7A patent/CN104732496B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103700079A (en) * | 2013-12-17 | 2014-04-02 | 中国科学院深圳先进技术研究院 | Image defogging method and device |
| CN103714520A (en) * | 2013-12-26 | 2014-04-09 | 深圳英飞拓科技股份有限公司 | Digital video image enhancement achieving system and method based on FPGA |
| CN103745438A (en) * | 2013-12-31 | 2014-04-23 | 中国科学院深圳先进技术研究院 | Haze removing method for large-area background light haze-containing image |
Non-Patent Citations (9)
| Title |
|---|
| JEAN-PHILIPPE TAREL 等: "Fast Visibility Restoration from a Single Color or Gray Level Image", 《2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV)》 * |
| 刁玉洁: "关于OLED亮度和寿命的优化研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 刘倩 等: "基于单幅图像的快速去雾算法", 《(第25届中国控制与决策会议)论文集》 * |
| 卿启新 等: "基于FPGA的LED电视动态背光系统设计", 《微计算机信息》 * |
| 吴岳骏: "幅图像去雾算法的研究及其FPGA实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 李健: "基于FPGA的图像去雾算法改进及实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 李卫平 等编著: "《运动控制系统原理与应用》", 30 June 2013, 武汉：华中科技大学出版社 * |
| 毕娟: "基于FPGA的单幅图像去雾算法研究及其实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 韩子奇: "基于FPGA的视频雾场景去除算法研究与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104616269A (en) * | 2015-02-27 | 2015-05-13 | 深圳市中兴移动通信有限公司 | Image defogging method and shooting device |
| CN105469372A (en) * | 2015-12-30 | 2016-04-06 | 广西师范大学 | Mean filtering-based fog-degraded image sharp processing method |
| CN114331920A (en) * | 2022-03-09 | 2022-04-12 | 浙江大华技术股份有限公司 | Image processing method and device, storage medium and electronic device |
| CN114331920B (en) * | 2022-03-09 | 2022-06-24 | 浙江大华技术股份有限公司 | Image processing method and device, storage medium, and electronic device |
| CN115802055A (en) * | 2023-01-30 | 2023-03-14 | 孔像汽车科技(武汉)有限公司 | Image defogging method and device based on FPGA, chip and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104732496B (en) | 2018-11-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103885611B (en) | A kind of method and apparatus for adjusting image | |
| CN104732496A (en) | Defogging processing method and display device for video stream images | |
| CN103886849B (en) | Method and apparatus for aligning frame data | |
| US20110096095A1 (en) | Display device and method for adjusting image on display screen of the same | |
| TWI433546B (en) | Image resolution adjusting devices, display devices and image resolution adjusting methods | |
| US10079005B2 (en) | Display substrate, display device and resolution adjustment method for display substrate | |
| CN102426514B (en) | Synchronous displaying method and device for large-screen spliced wall | |
| CN103745687B (en) | Method for displaying image and image display device | |
| CN105872419A (en) | Display method, device and liquid crystal television | |
| EP4287633A1 (en) | Video frame interpolation method and apparatus, and electronic device | |
| CN102855482A (en) | Method and device for processing picture | |
| CN104732497A (en) | Image defogging method, FPGA and defogging system including FPGA | |
| US20110084966A1 (en) | Method for forming three-dimension images and related display module | |
| Liu et al. | Large size single image fast defogging and the real time video defogging FPGA architecture | |
| US20130033487A1 (en) | Image transforming device and method | |
| CN101383951B (en) | Picture splitting device | |
| KR101906422B1 (en) | Image quality processing method and display device using the same | |
| CN104299252A (en) | Picture display switching transition method and system thereof | |
| CN104240213A (en) | Display method and device | |
| CN106055299A (en) | Method for realizing rotation of images in any angle on multiple display equipment | |
| CN103024430A (en) | Control display method and system for simulating red, green and blue (RGB) signal | |
| EP3107283A1 (en) | Method and apparatus for transmitting video signal | |
| CN105657252B (en) | Image processing method and mobile terminal in a kind of mobile terminal | |
| TWI447693B (en) | Pixel data conversion apparatus and method for display with delta panel arrangement | |
| CN104202588A (en) | 3D (Three-Dimensional) signal shear method and system and 3D signal windowing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Patentee after: Hisense Video Technology Co.,Ltd. Address before: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Patentee before: HISENSE ELECTRIC Co.,Ltd. |