CN102780889B - Video image processing method, device and equipment - Google Patents
Video image processing method, device and equipment Download PDFInfo
- Publication number
- CN102780889B CN102780889B CN201110123609.4A CN201110123609A CN102780889B CN 102780889 B CN102780889 B CN 102780889B CN 201110123609 A CN201110123609 A CN 201110123609A CN 102780889 B CN102780889 B CN 102780889B
- Authority
- CN
- China
- Prior art keywords
- pixel
- saturation
- original image
- luminance
- colourity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title abstract 3
- 238000000034 method Methods 0.000 claims abstract description 72
- 238000013507 mapping Methods 0.000 claims abstract description 67
- 238000012545 processing Methods 0.000 claims description 35
- 241000023320 Luma <angiosperm> Species 0.000 claims description 9
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 claims description 9
- 230000002708 enhancing effect Effects 0.000 claims description 6
- 230000002123 temporal effect Effects 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 12
- 230000000007 visual effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 101100325756 Arabidopsis thaliana BAM5 gene Proteins 0.000 description 2
- 102100031584 Cell division cycle-associated 7-like protein Human genes 0.000 description 2
- 101000777638 Homo sapiens Cell division cycle-associated 7-like protein Proteins 0.000 description 2
- 101150046378 RAM1 gene Proteins 0.000 description 2
- 101100476489 Rattus norvegicus Slc20a2 gene Proteins 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/77—Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/68—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a video image processing method, a device and equipment. The method comprises determining an average chrominance saturation level and an average luminance contrast ratio of an original image according to luminance components and chrominance components of pixels of the original image; comparing the determined chrominance saturation level with a set saturation enhancement threshold to determine a chrominance saturation adjustment amount, and comparing the determined the average luminance contrast ratio with a contrast enhancement threshold to determine a luminance contrast adjustment amount; generating a mapping table containing the chrominance components and the luminance components after the pixels are enhanced and adjusted according to the chrominance saturation adjustment amount, the luminance contrast adjustment amount and a set intensity control coefficient; and adjusting the chrominance and the luminance of the pixels of the original image according to the mapping table to obtain an enhanced target image. According to the video image processing method, the device and the equipment, the chrominance saturation and the luminance contrast ratio of the image can be adjusted automatically according to the luminance and the chrominance of the original image to obtain a good video display effect.
Description
Technical field
The present invention relates to video image post-processing technology field, espespecially a kind of method of video image processing, device and equipment.
Background technology
HSI model is a kind of from human visual system, describes the visual color model of color with tone (Hue), saturation (Saturation), brightness (Intensity).From human eye vision, the display effect of image depends primarily on the comprehensive function of colourity saturation and luminance contrast, in general higher colourity saturation, and color can be made stronger, and image is more bright-coloured; The dynamic range of larger luminance contrast, the color contrast of image can be made stronger, and stereovision is distincter.Wherein, colourity saturation and luminance contrast are coordinated corresponding, the overall visual effect of guarantee image is best, if luminance contrast is too high and colourity saturation deficiency can make image seem pale, colourity saturation too high luminance contrast deficiency then can make image seem dim.The object that dynamic colourity saturation and luminance contrast strengthen is to make the display effect of video image reach best.
Prior art adjustment colourity saturation and luminance contrast are all reach based on manually changing rgb pixel value the display effect comparatively had, and make its applicable human eye vision, reach good visual effect.But when manually adjusting, if the video image color skewness of input or colourity exist the situation of the frequent saltus step of interframe, then manually adjust its colourity saturation and luminance contrast will become pretty troublesome.
Visible, automatically do not adjust video image chroma and brightness in prior art, make it obtain the implementation method of good video display effect, and manually adjust more difficult yet, Adjustment effect is not good.
Summary of the invention
The embodiment of the present invention provides a kind of method of video image processing, device and equipment, in order to solve existing brightness and the colourity that automatically can not adjust video image, the problem that Adjustment effect is not good.
A kind of method of video image processing, comprising:
According to luminance component and the chromatic component of each pixel of original image, determine the average chrominance saturation of original image and average luminance contrast;
The saturation of the average chrominance saturation determined and setting is strengthened thresholding compare, determine colourity saturation adjustment amount, and the mean flow rate contrast determined and contrast strengthen thresholding are compared, determine luminance contrast adjustment amount;
According to the strength control coefficient of the colourity saturation adjustment amount determined and luminance contrast adjustment amount and setting, determine colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, generate and comprise the mapping table that each pixel strengthens the chromatic component after adjusting and luminance component;
Colourity and brightness adjustment process is carried out, the target image after the process that is enhanced according to each pixel of described mapping table to described original image.
A kind of video image processing device, comprising:
Statistical module, for according to the luminance component of each pixel of original image and chromatic component, determines the average chrominance saturation of original image and average luminance contrast;
Control module, compare for the saturation of the average chrominance determined saturation and setting is strengthened thresholding, determine colourity saturation adjustment amount, and the mean flow rate contrast determined and contrast strengthen thresholding are compared, determine luminance contrast adjustment amount;
Mapping block, for the strength control coefficient according to the colourity saturation adjustment amount determined and luminance contrast adjustment amount and setting, determine colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, generate and comprise the mapping table that each pixel strengthens the chromatic component after adjusting and luminance component;
Adjusting module, for carrying out colourity and brightness adjustment process according to each pixel of described mapping table to described original image, the target image after the process that is enhanced.
A kind of video image processing apparatus, comprising: CPU, memory and video image processing device; Wherein, video image processing device comprises: control unit, statistic unit, temporary storage location, map unit, data-moving unit and adjustment unit;
Described CPU, for the request processing data according to each unit comprised in video image processing device;
Data-moving unit, for moving the data of original image from memory, and restores in reservoir by the data-moving after process;
Described temporary storage location, for the temporary luminance component and the chromatic component that need each pixel of original image of statistics, and temporal data moves the data of the pixel of the pending adjustment that unit is moved;
Described control unit, moves unit moving data for controlling control data, controls the average chrominance saturation of statistic unit determination original image and average luminance contrast; The saturation of the average chrominance saturation determined and setting is strengthened thresholding compare, determine colourity saturation adjustment amount, and the mean flow rate contrast determined and contrast strengthen thresholding are compared, determine luminance contrast adjustment amount; Control map unit and generate mapping table; Control adjustment unit and carry out colourity and brightness adjustment process
Statistic unit, for according to the luminance component of each pixel of original image and chromatic component, determines the average chrominance saturation of original image and average luminance contrast;
Map unit, for the strength control coefficient according to the colourity saturation adjustment amount determined and luminance contrast adjustment amount and setting, determine colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, generate and comprise the mapping table that each pixel strengthens the chromatic component after adjusting and luminance component;
Adjustment unit, for carrying out colourity and brightness adjustment process according to described mapping table to described each pixel to original image, the target image after the process that is enhanced.
Beneficial effect of the present invention is as follows:
The method of video image processing that the embodiment of the present invention provides, device and equipment, by the calculating to original image each pixel colourity saturation and luminance contrast, determine its average chrominance saturation and luminance contrast respectively with saturation thresholding and the difference of contrast thresholding of setting, according to its difference determination adjustment direction, and the adjusted value of bond strength control coefrficient determination colourity saturation and luminance contrast, generate the mapping table comprising the mapping relations of original image and each pixel chromatic component of target image and luminance component, then automatically the luminance component of each pixel of original image and chromatic component are adjusted according to mapping table.The method realizes simple, convenient, and automatically can adjust targetedly based on the brightness of original image and colourity, achieves the adjustment automatically in real time of video image.The method does not need too much system resource overhead, with the less utilization of resources, can obtain self-adjusting object, have stronger general applicability, can obtain better Adjustment effect, making video image display effect better relative to manually adjusting.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, forms a part of the present invention, and schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is the flow chart of method of video image processing in the embodiment of the present invention;
Fig. 2 is video image pixel-map relation schematic diagram in the embodiment of the present invention;
Fig. 3 is the structural representation of video image processing device in the embodiment of the present invention;
Fig. 4 is the structural representation of video image processing apparatus in the embodiment of the present invention;
Fig. 5 is the concrete structure exemplary plot of video image processing apparatus in the embodiment of the present invention.
Embodiment
In order to make technical problem to be solved by this invention, technical scheme and beneficial effect clearly, understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
Adjusted the method for colourity and brightness by HIS model, generally comprise two steps:
Step 1. strengthens colourity saturation S, and highlight contrast I simultaneously.
Step 2. expands the dynamic range of luminance contrast I, also expands the dynamic range of colourity saturation S simultaneously.Comparatively strong to the dynamic range level of stretch of the lower image of luminance contrast, vice versa.
In order to realize the colourity saturation of video image and the automatic adjustment of luminance contrast of input in real time, obtain best video display effect, the embodiment of the present invention provides a kind of method of video image processing, utilize less hardware resource, realize the automatic enhancing process of colourity saturation and luminance contrast.The method flow process as shown in Figure 1, comprises the steps:
Step S101: the luminance component and the chromatic component that obtain each pixel of original image.
Obtain the data of each pixel of original image according to the first address of original image, comprise luminance component (Y) and chromatic component (UV).
Step S102: according to luminance component and the chromatic component of each pixel of original image, determine the average chrominance saturation of original image and average luminance contrast.
According to the luminance component of each pixel of original image, determine that the process of the average chrominance saturation of original image is as follows:
1) according to the brightness histogram of original image, the luma component values sum of all pixels in statistics original image.
2) according to the pixel total quantity of adding up in the luma component values sum of all pixels and original image that obtain, mean flow rate contrast is determined.
According to the luma component values of pixel each in luminance histogram statistics original image, such as statistics has the quantity of the pixel of brightness value a, has the quantity of the pixel of brightness value b respectively, ... etc., after all pixels are added up, calculate the mean value of brightness value according to the total quantity of pixel, obtain mean flow rate contrast.
Wherein, brightness histogram is a kind of global approach that can be used for changing pixel luminance component, when realizing luminance contrast enhancing to image, for changing the local filtering technique of pixel value, can obtain better image overall appearance effect.
According to the chromatic component of each pixel of original image, determine that the process of the mean flow rate contrast of original image is as follows:
1) according to two Chromaticity parameters U and V of the chromatic component (UV) of pixel each in original image, the colourity intensity value of each pixel is calculated respectively.
The colourity intensity value S of calculating pixel point, specifically according to following formulae discovery:
Above-mentioned formula carrys out the colourity saturation of simplified characterization pixel by the space length of U, V component value (128,128) on U, V component value and gray scale axle, by regular for colourity saturation in the scope of [0,100].
When using hardware implementing to use above-mentioned formulae discovery saturation, owing to relating to the algorithm of quadratic sum evolution, the account form of flowing water can be adopted to realize for open algorithm wherein.Multiplication is first utilized to obtain the value of quadratic sum V-128 square of U-128, then the result being added gained is input to fast square root flowing water module, 64+32+4 (meeting binary expansion) is expanded into by 100, the result that rooting module exports carries out three sub-additions, minimize again with displacement, finally obtain the value of saturation.
2) the colourity intensity value sum of all pixels in original image is added up.
After the colourity saturation calculating all pixels of original image, the colourity intensity value sum of all pixels in original image can be calculated easily.
3) according to the pixel total quantity of adding up in the colourity intensity value sum of all pixels and original image that obtain, average chrominance saturation is determined.
The statistics of above-mentioned colourity saturation and luminance contrast, and the calculating of average chrominance saturation and average luminance contrast realize the mapping adjustment service of original image and target image for follow-up.
Step S103: the saturation of the average chrominance saturation determined and setting is strengthened thresholding and compares, determine colourity saturation adjustment amount, and the mean flow rate contrast determined and contrast strengthen thresholding are compared, determine luminance contrast adjustment amount.
The saturation of the average chrominance saturation determined and setting is strengthened thresholding compare, if the saturation that average chrominance saturation is greater than or less than setting strengthens thresholding, then show that original image color is too bright-coloured or bright-coloured not, need to adjust it.Now, determine that the difference of saturation enhancing thresholding and the average chrominance saturation set is saturation adjustment amount, realize the adjustment of the colourity saturation to original image.Such as: if the saturation that average chrominance saturation is greater than setting strengthens thresholding, then need to reduce colourity saturation, the saturation adjustment amount now obtained is negative value; If the saturation that average chrominance saturation is less than setting strengthens thresholding, then need to strengthen colourity saturation, the saturation adjustment amount now obtained on the occasion of.
The mean flow rate contrast determined and contrast strengthen thresholding are compared, if mean flow rate contrast is greater than or less than the contrast strengthen thresholding of setting, then shows that original image brightness is crossed bright or excessively dark, need to adjust it.Now, determine that the difference of contrast strengthen thresholding and the mean flow rate contrast set is setting contrast amount, realize the adjustment of the luminance contrast to original image.Such as: mean flow rate contrast is greater than the contrast strengthen thresholding of setting, then need to reduce luminance contrast, the setting contrast amount now obtained is negative value; Mean flow rate contrast is less than the contrast strengthen thresholding of setting, then need the contrast that highlights, the setting contrast amount now obtained on the occasion of.
Step S104: according to the strength control coefficient of the colourity saturation adjustment amount determined and luminance contrast adjustment amount and setting, determine colourity saturation adjusted value and the luminance contrast adjusted value of each pixel.
Wherein, determine that colourity saturation adjusted value is the product of colourity saturation adjustment amount and strength control coefficient; And determine that luminance contrast adjusted value is the product of luminance contrast adjustment amount and strength control coefficient.
Such as: the strength control coefficient of setting is 1.2, the colourity saturation adjustment amount determined, namely saturation strengthens the difference of thresholding and average chrominance saturation is 5, then the adjusted value of colourity saturation is 6.The adjusted value of luminance contrast is also similar calculating.
Step S105: according to colourity saturation adjusted value and the luminance contrast adjusted value of determining each pixel, generates and comprises the mapping table that each pixel strengthens the chromatic component after adjusting and luminance component.The process generating mapping table comprises:
1) according to colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, the adjusted value of the chromatic component of each pixel and the adjusted value of luminance component is determined respectively.
2) according to chromatic component and the luminance component of each pixel in the adjusted value of the chromatic component of each pixel and the adjusted value of luminance component and original image, the mapping table of the chromatic component after comprising adjustment and luminance component is generated.
Luminance component and chromatic component wherein after the adjustment of each pixel, according to the luminance component of each pixel of original image and the original value of chromatic component, obtain according to after the adjusted value of the chromatic component determined and the adjusted value adjustment of luminance component.
That is, generating the process of mapping table is the process luminance component of pixel each in original image and chromatic component being mapped one by one to adjustment.Such as, in the mapping table of generation, the relation of the initial data of original image and the mapping (enum) data of target image as shown in Figure 2, and mapping table characterizes the mapping relations of the YUV of each pixel in each pixel of original image and target image.As shown in Figure 2, straight line represents original pixels mapping (enum) data, and broken line represents dynamic mapping mapping (enum) data.Wherein, x-axis represents that original pixel number represents the pixel number certificate of mapping according to, y-axis.Its span is scope 0 ~ 255.
As can be seen from Figure 2, when the average chrominance saturation determined and average luminance contrast are less than threshold values, need mapping table broken line point to adjust upward, when the average chrominance saturation determined and average luminance contrast are greater than threshold values, need mapping table broken line point to adjust downwards.The amplitude of adjustment is determined with reference to strength control coefficient.
Step S106: each pixel of mapping table to original image according to generating carries out colourity and brightness adjustment process, the target image after the process that is enhanced.Specifically comprise:
I) according to original image first address, in units of block of pixels, the data of each block of pixels of original image are moved successively.That is, preferably, when setting up mapping table, being carry out in units of pixel, and after establishing mapping table, when the colourity of original image and brightness are adjusted, then adjusting in units of block of pixels.Wherein, a block of pixels, also can be called that macro block comprises 16 × 16 pixels.
Chromatic component after each pixel adjustment of the original image ii) comprised in query mappings table and luminance component, find in the block of pixels moved out the chromatic component after the adjustment of each pixel comprised and luminance component; Chromatic component after the adjustment of each pixel comprised in the block of pixels moved out and luminance component are adjusted to the chromatic component after finding adjustment and luminance component respectively, obtain the data after the adjustment of the block of pixels moved out;
Iii) until adjusted block of pixels all in original image, the target image after the process that is enhanced.
In said method, original image first address, target image first address, picture traverse, picture altitude, colourity saturation strengthen thresholding, luminance contrast strengthens thresholding, strength control coefficient etc., are all provided by application layer when practical application.Wherein colourity saturation strengthens thresholding, luminance contrast strengthens thresholding, strength control coefficient can set as required.After adjustment image being carried out to colourity saturation and luminance contrast, make that the display effect of video image is better, color is softer, brightness is preferably.Thus it is bright or excessively dark to make the display of video image cross, for user, then can seems more comfortable, be more suitable for the sensory experience of human eye vision.
Based on the above-mentioned method of video image processing that the embodiment of the present invention provides, the embodiment of the present invention also provides a kind of video image processing device, and its structure as shown in Figure 3, comprising: statistical module 101, control module 102, mapping block 103 and adjusting module 104.
Statistical module 101, for according to the luminance component of each pixel of original image and chromatic component, determines the average chrominance saturation of original image and average luminance contrast.
Control module 102, compare for the saturation of the average chrominance determined saturation and setting is strengthened thresholding, determine colourity saturation adjustment amount, and the mean flow rate contrast determined and contrast strengthen thresholding are compared, determine luminance contrast adjustment amount.
Mapping block 103, for the strength control coefficient according to the colourity saturation adjustment amount determined and luminance contrast adjustment amount and setting, determine colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, generate and comprise the mapping table that each pixel strengthens the chromatic component after adjusting and luminance component.
Adjusting module 104, for carrying out colourity and brightness adjustment process according to each pixel of described mapping table to original image, the target image after the process that is enhanced.
Preferably, above-mentioned statistical module 101, specifically for:
According to two Chromaticity parameters U and V of the chromatic component of pixel each in original image, calculate the colourity intensity value of each pixel respectively; The colourity intensity value sum of all pixels in statistics original image; According to the pixel total quantity of adding up in the colourity intensity value sum of all pixels and described original image that obtain, determine average chrominance saturation;
According to the brightness histogram of original image, the luma component values sum of all pixels in statistics original image; According to the pixel total quantity of adding up in the luma component values sum of all pixels and described original image that obtain, determine mean flow rate contrast.
Preferably, above-mentioned control module 102, specifically for:
Determine that the saturation enhancing thresholding of setting and the difference of average chrominance saturation are described saturation adjustment amount; And determine that the difference of contrast strengthen thresholding and described mean flow rate contrast is described luminance contrast adjustment amount.
Preferably, above-mentioned mapping block 103, specifically for:
Determine that colourity saturation adjusted value is the product of colourity saturation adjustment amount and strength control coefficient; And determine that luminance contrast adjusted value is the product of luminance contrast adjustment amount and strength control coefficient.
Preferably, above-mentioned mapping block 103, specifically for:
According to colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, determine the adjusted value of the chromatic component of each pixel and the adjusted value of luminance component respectively; According to chromatic component and the luminance component of each pixel in the adjusted value of the chromatic component of each pixel and the adjusted value of luminance component and original image, generate the mapping table of the chromatic component after comprising adjustment and luminance component.
Preferably, above-mentioned video image processing device, also comprises:
Data-moving module 105, for according to original image first address, in units of block of pixels, moves the data of each block of pixels of original image successively; And according to the first address of target image, by the data-moving of the block of pixels after adjustment to the corresponding stored position in target image, until adjusted block of pixels all in original image, the target image after the process that is enhanced.
Preferably, above-mentioned adjusting module 104, specifically for the chromatic component after each pixel adjustment of the original image that comprises in query mappings table and luminance component, find in the block of pixels moved out the chromatic component after the adjustment of each pixel comprised and luminance component; Chromatic component after the adjustment of each pixel comprised in the block of pixels moved out and luminance component are adjusted to the chromatic component after finding adjustment and luminance component respectively, obtain the data after the adjustment of the block of pixels moved out.
The above-mentioned method of video image processing provided based on the embodiment of the present invention and device, the embodiment of the present invention also provides a kind of video image processing apparatus, its structure as shown in Figure 4, comprising: CPU (CPU), memory (external RAM) and video image processing device; Wherein, video image processing device comprises: control unit (cc_ctrl), statistic unit (cc_check), temporary storage location (On ChipRAM, RAM on sheet), map unit (cc_mapgene), data-moving unit (cc_dma) and adjustment unit (cc_piexlmap).
CPU (CPU), for the request processing data according to each unit comprised in video image processing device.
Data-moving unit (cc_dma), for moving the data of original image from memory, and restores the data-moving after process in reservoir.Namely cc_dma primary responsibility address ram in the calculating and sheet of DDR address calculates and completes transfer of data between the two.
Temporary storage location, for the temporary luminance component and the chromatic component that need each pixel of original image of statistics, and temporal data moves the data of the pixel of the pending adjustment that unit is moved.
Control unit (cc_ctrl), moves unit moving data for controlling control data, controls the average chrominance saturation of statistic unit determination original image and average luminance contrast; The saturation of the average chrominance saturation determined and setting is strengthened thresholding compare, determine colourity saturation adjustment amount, and the mean flow rate contrast determined and contrast strengthen thresholding are compared, determine luminance contrast adjustment amount; Control map unit and generate mapping table; Control adjustment unit and carry out colourity and brightness adjustment process.The i.e. control of cc_ctrl primary responsibility entirety, comprises Row control, DMA Read-write Catrol, comprises the pixel number from cc_dma, cc_check, cc_pixelmap according to carrying out the enable arbitration of data, address and read-write.This is because data by a data channel carrying, can only can only have a cell operation at every turn, control unit is therefore needed to carry out read-write arbitration.
Statistic unit (cc_check), for according to the luminance component of each pixel of original image and chromatic component, determines the average chrominance saturation of original image and average luminance contrast.Namely cc_check primary responsibility calculates average chrominance saturation and average luminance contrast according to the YUV value of the video image of input, realizes colourity and brightness enhancing process.
Map unit (cc_mapgene), for the strength control coefficient according to the colourity saturation adjustment amount determined and luminance contrast adjustment amount and setting, determine colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, generate and comprise the mapping table that each pixel strengthens the chromatic component after adjusting and luminance component.Namely cc_mapgene primary responsibility generates mapping table.
Adjustment unit (cc_pixelmap), for carrying out colourity and brightness adjustment process according to described mapping table to described each pixel to original image, the target image after the process that is enhanced.Cc_pixelmap primary responsibility is according to the colourity of mapping table adjustment video image and brightness.
The function that above-mentioned control unit (cc_ctrl), statistic unit (cc_check), map unit (cc_mapgene), data-moving unit (cc_dma) and adjustment unit (cc_piexlmap) realize, with reference to the description of statistical module 101, control module 102, mapping block 103, adjusting module 104 and data-moving module 105 in the video image processing device shown in above-mentioned Fig. 3, repeats no more herein.
When the above-mentioned macroblock size based on 16 × 16 processes, in testing process, highly can not calculate for each up and down approximate 3/16 of the video image of input, all according to 16 × 16 process when detecting, namely, when close to 3/16 image size reciprocal time, the data of inadequate 16 row of afterbody are cast out.
The data that above-mentioned data-moving unit (cc_dma) moves video image according to block of pixels from RAM process.Control unit (cc_ctrl) detection signal, control statistic unit (cc_check) to add up the luminance component of each pixel and chromatic component, obtain average chrominance saturation and luminance contrast, control data moves the data that unit (cc_dma) moves next block of pixels, by that analogy until process all block of pixels simultaneously.Now, data adopt the carrying of soldier's pang pattern.
Above-mentioned temporary storage location (On Chip RAM) is for the temporary pending data moved.
After obtaining average chrominance saturation and luminance contrast, control unit (cc_ctrl) controls map unit (cc_mapgene) and completes the operation generating mapping table.
After mapping table generates, control unit (cc_ctrl) control data moves unit (cc_dma) moving data in units of block of pixels, and be temporarily stored on temporary storage location (On Chip RAM), then control to search mapping table, by adjustment unit (cc_piexlmap), adjustment is carried out to the brightness of the block of pixels moved and colourity and process.Now, data are also adopt the carrying of soldier's pang pattern, until the adjustment of whole video image processes.
A kind of concrete structure of this video image processing apparatus as shown in Figure 5.Wherein, refinement has been carried out to the function of temporary storage location (On Chip RAM).
Cc_yuv_arbiter subelement is responsible for from cc_dma, cc_check, the pixel number of cc_pixelmap is according to carrying out data and address and reading and writing enable arbitration, cc_yuv_arbiter subelement connects the double buffering that RAM on two sheets (YUV RAM1 and YUV RAM2) realizes data, thus can realize mapping statistical computation.Cc_maphist_arbiter subelement is then to cc_check, the histogram of cc_pixelmap and mapping table carry out the enable arbitration of data, address, read-write, and cc_maphist_arbiter subelement connects RAM on two sheets (YUV RAM1 and YUV RAM2) and realizes data buffering
The above-mentioned method of video image processing that the embodiment of the present invention provides, automatic realization is to the colourity of video image and brightness adjustment, it adopts simple hardware modifications to realize, reusable good, be easy to integrated, can be widely used in being integrated in SOC (system on a chip) (System onChip, the SoC) system of high performance interconnect bus (as AHB system bus etc.).The method can support high-resolution, the resolution that such as 400 × 240,352 × 288 grades are higher.
Realize the method equipment to realize based on SoC system ahb bus architecture design the most ripe at present, equipment compatibility is good, revises a little, also goes for the system or equipment of other high-performance SOC (system on a chip) buses, as AXI etc.And this device adopts pipeline mode to realize colourity saturation and luminance contrast calculates; Adopt ping pong scheme moving data, effectively raise bandwidth, saved system resource.
Above-mentioned explanation illustrate and describes a preferred embodiment of the present invention, but as previously mentioned, be to be understood that the present invention is not limited to the form disclosed by this paper, should not regard the eliminating to other embodiments as, and can be used for other combinations various, amendment and environment, and can in invention contemplated scope described herein, changed by the technology of above-mentioned instruction or association area or knowledge.And the change that those skilled in the art carry out and change do not depart from the spirit and scope of the present invention, then all should in the protection range of claims of the present invention.
Claims (14)
1. a method of video image processing, is characterized in that, comprising:
According to luminance component and the chromatic component of each pixel of original image, determine the average chrominance saturation of original image and average luminance contrast;
The saturation of the average chrominance saturation determined and setting is strengthened thresholding compare, determine colourity saturation adjustment amount, and the mean flow rate contrast determined and contrast strengthen thresholding are compared, determine luminance contrast adjustment amount;
According to the strength control coefficient of the colourity saturation adjustment amount determined and luminance contrast adjustment amount and setting, determine colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, generate and comprise the mapping table that each pixel strengthens the chromatic component after adjusting and luminance component;
Colourity and brightness adjustment process is carried out, the target image after the process that is enhanced according to each pixel of described mapping table to described original image.
2. the method for claim 1, is characterized in that, the described luminance component according to each pixel of original image and chromatic component, determines the average chrominance saturation of original image and average luminance contrast, specifically comprises:
According to two Chromaticity parameters U and V of the chromatic component of pixel each in described original image, calculate the colourity intensity value of each pixel respectively; Add up the colourity intensity value sum of all pixels in described original image; According to the pixel total quantity of adding up in the colourity intensity value sum of all pixels and described original image that obtain, determine average chrominance saturation;
According to the brightness histogram of described original image, add up the luma component values sum of all pixels in described original image; According to the pixel total quantity of adding up in the luma component values sum of all pixels and described original image that obtain, determine mean flow rate contrast.
3. method as claimed in claim 2, is characterized in that, the colourity intensity value S of calculating pixel point, specifically according to following formulae discovery:
。
4. the method for claim 1, is characterized in that, describedly determines colourity saturation adjustment amount, specifically comprises: determine that the difference that the saturation set strengthens thresholding and average chrominance saturation is described saturation adjustment amount;
Describedly determine luminance contrast adjustment amount, specifically comprise: determine that the difference of contrast strengthen thresholding and described mean flow rate contrast is described luminance contrast adjustment amount.
5. the method for claim 1, is characterized in that, described colourity saturation adjusted value and the luminance contrast adjusted value determining each pixel, specifically comprises:
Determine that colourity saturation adjusted value is the product of described colourity saturation adjustment amount and described strength control coefficient; And determine that luminance contrast adjusted value is the product of described luminance contrast adjustment amount and described strength control coefficient.
6. the method for claim 1, is characterized in that, described generation comprises the mapping table that each pixel strengthens the chromatic component after adjusting and luminance component, specifically comprises:
According to colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, determine the adjusted value of the chromatic component of each pixel and the adjusted value of luminance component respectively;
According to chromatic component and the luminance component of each pixel in the adjusted value of chromatic component of described each pixel and the adjusted value of luminance component and original image, generate the mapping table of the chromatic component after comprising adjustment and luminance component.
7. the method as described in as arbitrary in claim 1-6, is characterized in that, carry out colourity and brightness adjustment process according to each pixel of described mapping table to described original image, and the target image after the process that is enhanced, specifically comprises:
According to described original image first address, in units of block of pixels, move the data of each block of pixels of original image successively;
Chromatic component after each pixel adjustment of the original image comprised in query mappings table and luminance component, find in the block of pixels moved out the chromatic component after the adjustment of each pixel comprised and luminance component; Chromatic component after the adjustment of each pixel comprised in the block of pixels moved out and luminance component are adjusted to the chromatic component after finding adjustment and luminance component respectively, obtain the data after the adjustment of the block of pixels moved out;
Until adjusted block of pixels all in described original image, the target image after the process that is enhanced.
8. a video image processing device, is characterized in that, comprising:
Statistical module, for according to the luminance component of each pixel of original image and chromatic component, determines the average chrominance saturation of original image and average luminance contrast;
Control module, compare for the saturation of the average chrominance determined saturation and setting is strengthened thresholding, determine colourity saturation adjustment amount, and the mean flow rate contrast determined and contrast strengthen thresholding are compared, determine luminance contrast adjustment amount;
Mapping block, for the strength control coefficient according to the colourity saturation adjustment amount determined and luminance contrast adjustment amount and setting, determine colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, generate and comprise the mapping table that each pixel strengthens the chromatic component after adjusting and luminance component;
Adjusting module, for carrying out colourity and brightness adjustment process according to each pixel of described mapping table to described original image, the target image after the process that is enhanced.
9. device as claimed in claim 8, is characterized in that, described statistical module, specifically for:
According to two Chromaticity parameters U and V of the chromatic component of pixel each in described original image, calculate the colourity intensity value of each pixel respectively; Add up the colourity intensity value sum of all pixels in described original image; According to the pixel total quantity of adding up in the colourity intensity value sum of all pixels and described original image that obtain, determine average chrominance saturation;
According to the brightness histogram of described original image, add up the luma component values sum of all pixels in described original image; According to the pixel total quantity of adding up in the luma component values sum of all pixels and described original image that obtain, determine mean flow rate contrast.
10. device as claimed in claim 8, is characterized in that, described control module, specifically for:
Determine that the saturation enhancing thresholding of setting and the difference of average chrominance saturation are described saturation adjustment amount; And determine that the difference of contrast strengthen thresholding and described mean flow rate contrast is described luminance contrast adjustment amount.
11. devices as claimed in claim 8, is characterized in that, described mapping block, specifically for:
Determine that colourity saturation adjusted value is the product of described colourity saturation adjustment amount and described strength control coefficient; And determine that luminance contrast adjusted value is the product of described luminance contrast adjustment amount and described strength control coefficient.
12. devices as claimed in claim 8, is characterized in that, described mapping block, specifically for:
According to colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, determine the adjusted value of the chromatic component of each pixel and the adjusted value of luminance component respectively;
According to chromatic component and the luminance component of each pixel in the adjusted value of chromatic component of described each pixel and the adjusted value of luminance component and original image, generate the mapping table of the chromatic component after comprising adjustment and luminance component.
13. as arbitrary in claim 8-12 as described in device, it is characterized in that, also comprise:
Data-moving module, for according to described original image first address, in units of block of pixels, moves the data of each block of pixels of original image successively; And according to the first address of target image, by the data-moving of the block of pixels after adjustment to the corresponding stored position in target image, until adjusted block of pixels all in described original image, the target image after the process that is enhanced;
Described adjusting module, specifically for: the chromatic component after each pixel adjustment of the original image comprised in query mappings table and luminance component, find in the block of pixels moved out the chromatic component after the adjustment of each pixel comprised and luminance component; Chromatic component after the adjustment of each pixel comprised in the block of pixels moved out and luminance component are adjusted to the chromatic component after finding adjustment and luminance component respectively, obtain the data after the adjustment of the block of pixels moved out.
14. 1 kinds of video image processing apparatus, is characterized in that, comprising: CPU, memory and video image processing device; Wherein, video image processing device comprises: control unit, statistic unit, temporary storage location, map unit, data-moving unit and adjustment unit;
Described CPU, for the request processing data according to each unit comprised in video image processing device;
Data-moving unit, for moving the data of original image from memory, and restores in reservoir by the data-moving after process;
Described temporary storage location, for the temporary luminance component and the chromatic component that need each pixel of original image of statistics, and temporal data moves the data of the pixel of the pending adjustment that unit is moved;
Described control unit, moves unit moving data for controlling control data, controls the average chrominance saturation of statistic unit determination original image and average luminance contrast; The saturation of the average chrominance saturation determined and setting is strengthened thresholding compare, determine colourity saturation adjustment amount, and the mean flow rate contrast determined and contrast strengthen thresholding are compared, determine luminance contrast adjustment amount; Control map unit and generate mapping table; Control adjustment unit and carry out colourity and brightness adjustment process
Statistic unit, for according to the luminance component of each pixel of original image and chromatic component, determines the average chrominance saturation of original image and average luminance contrast;
Map unit, for the strength control coefficient according to the colourity saturation adjustment amount determined and luminance contrast adjustment amount and setting, determine colourity saturation adjusted value and the luminance contrast adjusted value of each pixel, generate and comprise the mapping table that each pixel strengthens the chromatic component after adjusting and luminance component;
Adjustment unit, for carrying out colourity and brightness adjustment process according to each pixel of described mapping table to described original image, the target image after the process that is enhanced.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110123609.4A CN102780889B (en) | 2011-05-13 | 2011-05-13 | Video image processing method, device and equipment |
| PCT/CN2011/085164 WO2012155525A1 (en) | 2011-05-13 | 2011-12-31 | Method, device and apparatus for processing video images |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110123609.4A CN102780889B (en) | 2011-05-13 | 2011-05-13 | Video image processing method, device and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102780889A CN102780889A (en) | 2012-11-14 |
| CN102780889B true CN102780889B (en) | 2015-04-01 |
Family
ID=47125632
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110123609.4A Active CN102780889B (en) | 2011-05-13 | 2011-05-13 | Video image processing method, device and equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102780889B (en) |
| WO (1) | WO2012155525A1 (en) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103841337B (en) * | 2012-11-23 | 2017-04-05 | 北京百度网讯科技有限公司 | The method and apparatus of BLC |
| GB201410635D0 (en) * | 2014-06-13 | 2014-07-30 | Univ Bangor | Improvements in and relating to the display of images |
| CN104883552B (en) * | 2015-05-22 | 2017-01-11 | 深圳市载德光电技术开发有限公司 | YUV (Luma and Chroma) coded format-based image adjusting method and system |
| CN105898252A (en) * | 2015-11-26 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Television color adjustment method and device |
| CN106993176A (en) * | 2016-01-20 | 2017-07-28 | 掌赢信息科技（上海）有限公司 | A kind of method and electronic equipment for adjusting luminance video |
| CN106531125B (en) * | 2017-01-04 | 2019-02-01 | 深圳创维－Rgb电子有限公司 | Method of adjustment, device and the television set of image display brightness |
| CN107038680B (en) * | 2017-03-14 | 2020-10-16 | 武汉斗鱼网络科技有限公司 | Self-adaptive illumination beautifying method and system |
| CN107025880B (en) * | 2017-04-14 | 2019-11-29 | 西安诺瓦星云科技股份有限公司 | Image display control method and device and display screen control system |
| CN107087119B (en) * | 2017-06-02 | 2020-06-26 | 奇酷互联网络科技（深圳）有限公司 | Method and device for adjusting exposure and electronic equipment |
| CN108711142B (en) * | 2018-05-22 | 2020-09-29 | 深圳市华星光电技术有限公司 | Image processing method and image processing apparatus |
| CN110858281B (en) * | 2018-08-22 | 2022-10-04 | 浙江宇视科技有限公司 | Image processing method, image processing device, electronic eye and storage medium |
| CN110175969B (en) * | 2019-05-29 | 2021-07-23 | Tcl华星光电技术有限公司 | Image processing method and image processing apparatus |
| CN111163350B (en) * | 2019-12-06 | 2022-03-01 | Oppo广东移动通信有限公司 | Image processing method, terminal and computer storage medium |
| CN112465729B (en) * | 2020-12-11 | 2022-07-08 | 四川长虹电器股份有限公司 | Method for dynamically adjusting image contrast based on television histogram |
| CN113763860B (en) * | 2021-09-14 | 2024-05-31 | 杭州海康消防科技有限公司 | Display color determining method, device, electronic equipment and storage medium |
| CN116095509B (en) * | 2021-11-05 | 2024-04-12 | 荣耀终端有限公司 | Method, device, electronic equipment and storage medium for generating video frame |
| CN115240589A (en) * | 2022-07-22 | 2022-10-25 | 卡莱特云科技股份有限公司 | Dynamic energy-saving method applied to LED screen, electronic equipment and display system |
| CN116824906B (en) * | 2023-08-29 | 2023-11-17 | 成都市巨多广告有限公司 | Parking lot guiding method and system with identification function |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1578438A (en) * | 2003-07-15 | 2005-02-09 | 三星电子株式会社 | Apparatus for image enhancement and method of using the same |
| CN1976480A (en) * | 2005-12-01 | 2007-06-06 | 联咏科技股份有限公司 | Apparatus for adjusting specific color attributes and method thereof |
| CN101340510A (en) * | 2008-08-07 | 2009-01-07 | 中兴通讯股份有限公司 | Method for video enhancement and apparatus thereof |
| CN101409769A (en) * | 2007-10-11 | 2009-04-15 | 奇景光电股份有限公司 | Digital image tone remapping method and apparatus |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4666274B2 (en) * | 2001-02-20 | 2011-04-06 | 日本電気株式会社 | Color image processing apparatus and method |
| JP2004118424A (en) * | 2002-09-25 | 2004-04-15 | Sony Corp | Motion detecting device, motion detecting method, motion detecting system and its program |
| CN101621702B (en) * | 2009-07-30 | 2011-08-24 | 北京海尔集成电路设计有限公司 | Method and device for automatically adjusting chroma and saturation |
-
2011
- 2011-05-13 CN CN201110123609.4A patent/CN102780889B/en active Active
- 2011-12-31 WO PCT/CN2011/085164 patent/WO2012155525A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1578438A (en) * | 2003-07-15 | 2005-02-09 | 三星电子株式会社 | Apparatus for image enhancement and method of using the same |
| CN1976480A (en) * | 2005-12-01 | 2007-06-06 | 联咏科技股份有限公司 | Apparatus for adjusting specific color attributes and method thereof |
| CN101409769A (en) * | 2007-10-11 | 2009-04-15 | 奇景光电股份有限公司 | Digital image tone remapping method and apparatus |
| CN101340510A (en) * | 2008-08-07 | 2009-01-07 | 中兴通讯股份有限公司 | Method for video enhancement and apparatus thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102780889A (en) | 2012-11-14 |
| WO2012155525A1 (en) | 2012-11-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102780889B (en) | Video image processing method, device and equipment | |
| CN109191395B (en) | Image contrast enhancement method, device, equipment and storage medium | |
| CN105719611B (en) | The show uniformity method of adjustment and device of liquid crystal display | |
| TWI573095B (en) | Image enhancement methods and systems using the same | |
| CN103617638B (en) | The method and device of image procossing | |
| US8781225B2 (en) | Automatic tone mapping method and image processing device | |
| TWI407777B (en) | Apparatus and method for feature-based dynamic contrast enhancement | |
| KR101998531B1 (en) | Real-time video enhancement methods, terminals, and non-transitory computer readable storage media | |
| CN104574495B (en) | A kind of image rendering method and device | |
| RU2011143140A (en) | METHOD AND DEVICE FOR CHANGING THE IMAGE BY USING A CAUTION CARD BASED ON COLOR FREQUENCY | |
| CN103714520A (en) | Digital video image enhancement achieving system and method based on FPGA | |
| CN107680056A (en) | A kind of image processing method and device | |
| CN102509272A (en) | Color image enhancement method based on color constancy | |
| CN103778900B (en) | A kind of image processing method and system | |
| CN105608677A (en) | Image skin color beautifying method and system under any lighting conditions | |
| CN111080557B (en) | Luminance equalization processing method and related device | |
| CN104883504A (en) | Method and device for opening HDR (high-dynamic range) function on intelligent terminal | |
| CN112311962A (en) | Video denoising method and device and computer readable storage medium | |
| CN106791758A (en) | The determination methods and device of natural light mixing colour temperature in a kind of image | |
| CN108510557A (en) | image tone mapping method and device | |
| CN109817170A (en) | Pixel compensation method, device and terminal device | |
| CN109686342A (en) | A kind of image processing method and device | |
| CN104994363A (en) | Clothes-based facial beautification method and device and smart terminal | |
| CN103702116A (en) | Wide dynamic compressing method and device for image | |
| CN106686320B (en) | A kind of tone mapping method based on number density equilibrium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20121114 Assignee: SHENZHEN ZTE MICROELECTRONICS TECHNOLOGY CO., LTD. Assignor: ZTE Corporation Contract record no.: 2015440020319 Denomination of invention: Video image processing method, device and equipment Granted publication date: 20150401 License type: Common License Record date: 20151123 |
|
| LICC | Enforcement, change and cancellation of record of contracts on the licence for exploitation of a patent or utility model |