WO2013139067A1 - Method and system for carrying out visual stereo perception enhancement on color digital image - Google Patents

Method and system for carrying out visual stereo perception enhancement on color digital image Download PDF

Info

Publication number
WO2013139067A1
WO2013139067A1 PCT/CN2012/074962 CN2012074962W WO2013139067A1 WO 2013139067 A1 WO2013139067 A1 WO 2013139067A1 CN 2012074962 W CN2012074962 W CN 2012074962W WO 2013139067 A1 WO2013139067 A1 WO 2013139067A1
Authority
WO
WIPO (PCT)
Prior art keywords
color
brightness
pixel
value
visual perception
Prior art date
Application number
PCT/CN2012/074962
Other languages
French (fr)
Chinese (zh)
Inventor
侯克杰
Original Assignee
Hou Kejie
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hou Kejie filed Critical Hou Kejie
Publication of WO2013139067A1 publication Critical patent/WO2013139067A1/en

Links

Classifications

    • G06T5/73
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/122Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/507Depth or shape recovery from shading

Definitions

  • the present invention relates to the field of digital image processing, and in particular to a method and system for visual stereoscopic enhancement of color digital images. Background technique
  • Vision is an important function of human understanding of the world. Vision includes "visual” and “sense”, which are called visual perception and visual perception. Visual sensation mainly understands the basic properties (such as brightness and color) of people's response to light (visible radiation) from the molecular point of view. It mainly involves physics and chemistry. Visual perception mainly discusses the way people react and react after receiving visual stimuli from the objective world. It studies how to visually form the appearance of people's space in the external world, so it has both psychological factors. Visual perception is a complex process.
  • the visual perception is divided into brightness perception, color perception, spatial perception and so on.
  • brightness depends on the intensity of the light
  • color depends on the wavelength of the light.
  • spatial characteristics have not yet been completely determined by the physical quantity.
  • the depth perception of a person's space scene can also be achieved to a certain extent by monocular vision.
  • monocular vision Some physical conditions of the stimuli themselves can also become clues to the depth of perception and the sense of three-dimensionality under appropriate application conditions. Some of these cues are generated by the characteristics of the imaging optics, such as scene size and distance, linear perspective, and the like.
  • visual perception due to changes in the light of the imaging environment such as the distribution of light and shadow, that is, the brightness of the object appears close, the gray object appears far; the color distribution, that is, the blue object appears far, the red and yellow objects appear close; Perspective, that is, the objects in the vicinity appear clear, and the objects in the distance are unclear.
  • the sharpening function of the program can significantly enhance the sharpness of the image.
  • the current version of the software lacks corresponding functions.
  • the program currently calculates the color difference between pixels by the RGB three primary color values of the image pixels. This method of enhancing the pixel color will reduce the visual perception saturation and the offset visual perception hue while improving the visual perception brightness of the color. The higher the sharpening intensity, the more obvious the visual perception of the hue deviation caused by this method. Therefore, the current method is also supposed to be and can be improved only for the purpose of increasing image sharpness.
  • the way in which adjacent pixels are selected is not related to the ambient light characteristics in the sharpened image.
  • the change in image sharpness cannot be closely related to depth perception.
  • the softening option before image sharpening is too simple, and the different content in the image cannot be selected for softening and blurring according to the need, thereby the image softening effect limits the sharpness improvement under certain conditions.
  • the extent, and not related to the depth perception of the image, is equally a pity.
  • the inventors of the present invention have proposed and completed the present invention in order to solve the above problems. It is an object of the present invention to provide a method for visual stereoscopic perception enhancement of color digital images.
  • a typical color digital image is a two-dimensional projection of a real scene in the visible light color space at the imaging plane. Since the actual color space of the imaging device is much smaller than the visible color space, the visual perceptual authenticity of the imaged two-dimensional image is also quite different from the perception of the real scene, including spatial depth perception and scene stereo perception. Therefore, the technical solution of the present invention extracts the monocular depth information in the image, and calculates the monocular depth information enhancement with the observation effect of the real scene. As a result, the visually perceived luminance value of the image pixel color is converted into a new value, and the spatial perception of the image perception and the stereoscopic effect of the scene are significantly enhanced.
  • the method of the present invention are "two color Epic TM" (SecondEposColor TM), referred to as “two-color verse TM” (SECr TM), primarily for the visual image to enhance a sense of depth perception and stereoscopic scene is adjusted for each pixel spatial visual perception Brightness value.
  • the amount of adjustment depends on various conditions, including: the color perception brightness value of the pixel itself, the projection of the incident light in the imaging plane in the real scene imaging environment, and the visual perception brightness value of the relevant adjacent pixel color in the incident direction of the light, The visually perceived color gray luminance equivalent value of the visually perceived hue of the pixel color of the color grayscale capability and the visually perceived color gray luminance equivalent value of the visual perceptual saturation.
  • each pixel color of the image maintains the visual perceptual brightness and the visual perceptual hue value while adjusting the visual perceptual brightness value, and the color visual perception brightness difference between the image pixels and the self brightness
  • the ratio is significantly enhanced, that is, the visual perception brightness difference contrast is significantly enhanced, and therefore, the visual perception of the image and the stereoscopic effect of the scene are significantly enhanced.
  • the method and system of the present invention can be used for natural scene imaging such as photography, videography, film, television, video games, or computer generated images, i.e., any image and device that combines colors of red, green, and blue primary colors.
  • the color visual perception brightness difference of the adjacent pixels is about 50% on average, and the variation range can be controlled by the set amplitude coefficient, and is also controlled by the set allowable range of the absolute value of the brightness change.
  • a large sensitivity range of the eye to brightness of 10- 6 - 10 7 cd / m 2 ( Hom [de] per square meter). But at any point in real life, the ratio of the maximum and minimum brightness perceived by the human eye rarely exceeds 100.
  • the color sRGB color space typically has a projected area of xy chromaticity plane in the CIExyY space that is approximately 35% of the projected area of the spectral trajectory, and is set to the image color space chromatic range diameter, R 2 For the spectral trace chromatic range diameter, the ratio of the two projected areas:
  • one of the image monocular depth information of the selected application is the difference in color perceived luminance between pixels. Because the brightness that people perceive from the surface of an object is basically determined by its relationship to the surrounding environment (especially the background). If two objects have similar brightness differences with their respective backgrounds, then they appear to have similar brightness. This choice also facilitates the application of normalized calculations for the dynamic range of the color space luminance.
  • the guiding significance of image dual perception authenticity for color digital image depth perception enhancement calculation is that, if the image is perceived as having three-dimensional authenticity, the image must be reconstructed carefully, and the useful characteristics of the natural field of view need to be simulated as much as possible.
  • the invention adopts the visual perception generated by the change of the imaging environment light described above, mainly based on the visual perceptual brightness of the color digital image, supplemented by the visual perception hue and saturation, and establishes various models to adjust the pixel color as the image monocular depth information.
  • Visually perceived brightness values for example:
  • Model 1 the model of the influence of incident ray on the stereo perception of the scene.
  • the illumination light of the real scene imaging environment is one of the important factors that form the three-dimensional sense of the scene and the spatial position perception between the scenes.
  • the change in the angle between the incident ray and the reflected light from the surface of the scene may indicate the surface shape of the illumination position.
  • the brightness of the surface perceived by the observer is related to the angle between the viewing angle and the reflected light. The smaller the angle, the brighter the feeling.
  • the change in brightness of the surface of the object forms a stereoscopic perception of the object, and the incident ray is the primary condition for the change in the brightness of the surface of the object.
  • Model 1 selects the relevant pixels based on the projection of the incident ray on the image plane, and selects the relevant pixels on the condition that the image pixels are adjacent in the incident direction and the neighbors on both sides. Up to three related pixels are selected to represent the parallel characteristics of the incident ray. Calculate the difference in color visual perception brightness of each pixel of the image and the three related pixels, and each difference is weighted by the respective coefficients set by the SECR algorithm to reflect the correlation, that is, the correlation between the surface brightness and the surface shape. The SECr algorithm also sets the actual utilization factor for the sum of the luminance differences to accommodate the need for image enhancement stereo perception of different characteristics. Applying Model 1, the intensity of incident light in the image looks significant Enhancement, the spatial and three-dimensional sense of the scene is also significantly enhanced.
  • Model 2 the model of the effect of pixel color visual perception of brightness values on spatial perception.
  • the visual perception produced by the illumination illumination of the illumination environment as described above relates to the brightness and sharpness of the scene, respectively, and the model 2 associates the two, that is, the luminance value of the image pixel is related to the sum of the luminance differences between the pixels calculated by the model 1.
  • the result of SECr algorithm is that the higher the pixel color brightness value is, the higher the ratio of the sum of the above brightness difference values is, the more the pixel color brightness value changes, when it is brighter than the relevant pixel
  • calculate the increase brightness which is calculated to reduce the brightness when it is darker than the relevant pixels.
  • Model 2 correlates the change in contrast between luminances of pixels to the brightness of one of the monocular depth cues.
  • the sharpness of the scene with relatively high luminance values in the image is increased, so the closer it appears, the farther it appears, the farther the image is.
  • the visual space perception of the medium scene is significantly enhanced.
  • the correlation is reversed under backlight conditions, with the result that the higher the brightness, the lower the sharpness and therefore the farther it is.
  • the image pixel having the brightness value set in the SECR algorithm applies the highest proportion of the sum of the brightness difference values, so that the sharpness of the scene is the highest and appears to be the closest, thereby respectively reaching the brightest
  • the ratio of the sum of the pixel-to-luminance differences in the darkest luminance interval is successively decreasing, so the brightest and darkest scenes in the image appear to be relatively far away.
  • Model 3 Pixel Color Visually perceives the amount of color gray in the brightness effect model.
  • L, C, and h of the CIELAB space represent color visual perception of brightness, saturation, and hue angle, respectively.
  • Previous studies have generally suggested that rod cells do not function under bright vision. According to a recent study, rod cells are still active at around 500 cd/m 2 , and it is believed that with the development of technology, the color vision model will be further improved.
  • the visually perceived brightness L value of the color image color is composed of two parts of perceived brightness, that is, neutral gray brightness and color gray brightness.
  • the neutral gray brightness range is approximately equivalent to the dark and full-range portions of the bright vision generated by the human eye rod response and the red-green-blue three-color cone response.
  • the color gray luminance range is the high-end portion of the bright vision generated by the red, green, and blue cone response, that is, the portion closer to the spectral light efficiency curve, and for the color digital image, it is the luminance portion above L Cmaxhl .
  • the range of the color gray color on the color planes of the respective colors is calculated differently, so in the model 3, the color phase surface color gray brightness range is normalized to calculate the result, as the visual perception color phase visual perception color gray brightness Equivalent value.
  • the technical solution of the present invention calculates a ratio of a visual color saturation saturation value of a pixel color in a color gray luminance range to a maximum saturation degree of a luminance sequence thereof, as a visually perceived color gray luminance equivalent value of visual perceptual saturation. .
  • the equation by which the equivalent value is multiplied by the ratio of the visually perceived color gray luminance value to the color gray luminance range, as the submodel 2 of the model 3, represents the contribution of the color gray luminance dominated by the perceived saturation in the visual perception of the image color.
  • Submodel 1 and submodel 2 of model 3 calculate the adjustment amount of the color gray luminance difference of the pixel color, and the neutral gray luminance difference adjustment amount of the pixel color calculated by the model 2 constitutes the image color visual space perception and the scene stereo perception to the real scene. Simulation.
  • the technical solution of the present invention further includes selectively softening the image-specific content.
  • Algorithm module uses a 5 X 5 pixel template centered on the target pixel, a Gaussian distribution weighted convolution averaging algorithm, to adjust the visual perception brightness parameter of the target pixel.
  • the adjustment amount is related to various conditions and settings, including: a threshold of visually perceived luminance difference between pixels set in the SECr algorithm; a neighboring pixel of the target pixel, that is, a neighboring pixel of the target pixel in the template (eight in total) has low brightness
  • the pixel convolution threshold at the threshold the outer circle pixels of the target pixel in the template (16 in total) the pixel convolution threshold whose brightness is lower than the threshold; the pixel color visual perception hue interval of the specific content set in the SECr algorithm; Pixel color visual perception saturation threshold; set the actual use ratio value of the pixel color visual perception brightness adjustment amount calculated above.
  • the Gaussian distribution weighting coefficients used by the template are adjusted based on the threshold setting of the SECr algorithm design based on the typical Gaussian distribution. It is one of the main technical characteristics of the present invention to perform softening convolution calculation using only the visually perceived luminance value of the color, and is one of the reasons that has significant advantages over other softening algorithms.
  • a method for visual stereoscopic perception enhancement of a color digital image in accordance with the present invention includes the following steps:
  • Al l (1- ⁇ 1) ⁇ [(90- ⁇ )/90]
  • Al_2 1- ⁇ 1- ⁇ 1_1
  • ct is the angle between the projection of the incident ray on the image and the perpendicular
  • a 1j represents the target pixel in the image, that is, the pixel that regulates the brightness
  • L Al , j represents the brightness of the pixel
  • the central pixel A 1j has a total of 8 pixels around, and the clockwise arrangement from the upper left corner is:
  • the incident light conditions are set to 8 kinds, that is, the incident light source is from the upper left, the upper right, the upper right, the right right, the lower right, the lower left, and the right left;
  • KL is the set control proportional coefficient
  • the value range is 0.0-3.0, typically 1.0-2.0.
  • the L Cmaxhl of the color plane of the color digital image device is normalized by the maximum value, and the color gray brightness equivalent D CAIx of the corresponding color phase surface is obtained .
  • Pixel color visual perception brightness is greater than L Cmaxh ⁇ ⁇ calculation brightness:
  • LT2i,j Lli,j+ ((LAij" LcmaxLl)/( 100- LcmaxLl) ⁇ DcAIx) ⁇ ⁇ 2
  • K T2 is the set control coefficient
  • the value range is 0.0-3.0, typically 1.0-2.0;
  • Pixel color visual perception brightness is greater than L Cmaxh ⁇ ⁇ pixel color visual perception saturation C Al , j color gray brightness equivalent D BAOx:
  • LT3i,j LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) ⁇ DBAOX) ⁇ ⁇ 3
  • K T3 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0.
  • the hue h, the saturation C of the pixel color, and the calculated L T3 ⁇ 4j or L j value are inversely transformed into the sRGB spaces R, G, and B values and normalized.
  • the method according to the invention further comprises the steps of selecting a color visual perceptual hue interval in the image to be softened and setting the relevant control coefficients:
  • L 1j represents the center pixel, that is, softened pixels
  • the following label 1j represents the pixel position on the template
  • i represents the column
  • j represents the row
  • the pixel weights are respectively set.
  • Li-2, j-23 ⁇ 4 2 Li-i, j-2 is 1, 1 ⁇ 2 is 2, L, Bu is 1, Li+2, j-23 ⁇ 4 2,
  • Li -2 , j - i is 1, Li - i, j - i is 4, Li, j - i is 4, L, ij - i is 4, Li + 2, j - i3 ⁇ 4 1,
  • L i-2 j is 2, Li-ij is 4, is 8, L 1+ is 4, Li+ 2 , j is 2.
  • Li-2, j+i3 ⁇ 4 1 Li-ij+i is 4, Lij+i is 4, LH-ij+i is 4, Li+2, j+i3 ⁇ 4 1,
  • L YU 3 ⁇ 4 value range 0-100, typically 2-6, the difference between the brightness of the template center pixel and the other pixel is less than L YU, then the pixel is the effective pixel;
  • a convolution threshold S N of effective pixels with pixels adjacent to the center pixel a range of values 0 - 32, typically 24-28, gradient 4, setting a convolution threshold S w of the effective pixels of the pixel spaced apart from the center pixel, value range 0 -24, typical 10-14, gradient 1 or 2, when the effective pixel convolution value of adjacent pixels is larger than Si ⁇ and the effective pixel convolution value of the spaced pixels is greater than S w , the template effective pixel convolution average is calculated as The luminance value of the center pixel L Jpi , j ;
  • B JX1 has a value range of 0.00-1, typically 0.10-0.30,
  • L TON 1 is the brightness value actually applied by the center pixel.
  • a system for performing visual stereoscopic enhancement according to the color digital image of the present invention includes:
  • a device color visual perception spatial color phase surface color boundary calculation module displaying a color digital image, including:
  • Color digital image pixel color RGB mode forward conversion and merge color phase surface and brightness sequence module including:
  • (2-1) A calculation unit that converts the color digital image pixel color RGB three primary color values into the brightness L, saturation C, and hue angle h value of the CIELAB space.
  • a color digital image selective softening calculation module comprising:
  • a color digital image pixel color brightness enhancement calculation module comprising:
  • ct is the angle between the projection of the incident ray on the image and the perpendicular
  • the incident light conditions are set to 8 kinds, that is, the incident light source is from the upper left, the upper right, the upper right, the right right, the lower right, the lower left, and the right left.
  • the difference in brightness between the target pixel and the related pixel ⁇ typically includes:
  • ALi,j ( L Ai ,j - LBi+ij-i ) X A1 + (L Ai ,j - L B ij-i) X Al—l + (L Ai ,j - L Bi+1 ,j) X Al_2
  • a 1j represents the target pixel in the image, that is, the pixel that regulates the brightness
  • L Al , j represents the brightness of the pixel
  • the central pixel A 1j has a total of 8 pixels around, and the clockwise arrangement from the upper left corner is:
  • the incident light conditions are set to 8 kinds, that is, the incident light source is from the upper left, the upper right, the upper right, the right right, the lower right, the lower left, and the right left;
  • K L is the set control proportional coefficient, the value is 1.0-2.0;
  • LT2i,j Lli,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) ⁇ DcAIx) ⁇ ⁇ 2
  • K T2 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0;
  • LT3i,j LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) DBAOX) ⁇ 3
  • the above K T3 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0.
  • a calculation module that inversely transforms the hue h, the saturation C of the pixel color, and the L T3 ⁇ 4j or L j value after the calculation control into the three primary color values of the sRGB spaces R, G, and B.
  • the device color visual perception spatial color phase surface color boundary data library is first completed by the device color visual perception spatial color phase surface color boundary calculation module in the system of the present invention, and the calculation includes:
  • the red, green and blue primary color values of the device color space are converted into CIELAB spaces L, C, and h values, and the red, green and blue primary color values of the device color space in the system of the present invention are converted into CIELAB space.
  • the L, C, and h value calculation units perform:
  • the reference color phase plane is represented by an integer of 0-359, and the h color value of the device color is rounded off and merged into the corresponding reference color phase plane, and the reference luminance sequence is represented by an integer of 0-100, rounded to the corresponding luminance sequence by the L value, and the color phase is extracted.
  • the maximum color saturation value C maxU of each luminance sequence is calculated as the color boundary of the color phase plane;
  • the color boundary corresponding to the luminance sequence interval is calculated by a standard linear interpolation algorithm to compensate for the maximum saturation C maxU of the original luminance sequence, which is not smoothed or padded.
  • Figure 1 shows the non-standard device color visual perception space example color phase surface all merged color coordinates
  • the middle gray line represents the merged brightness sequence algorithm
  • the lower gray line represents the linear interpolation to correct the corresponding brightness sequence maximum saturation ⁇ non-smooth Decrement and make up for missing calculation results
  • abscissa saturation C ordinate brightness L.
  • Figure 2-1 shows a flow diagram of a method for visual stereoscopic perception enhancement of a color digital image in accordance with a particular embodiment of the present invention, illustrating a device color visual perception spatial color phase surface color boundary calculation process.
  • FIG. 2-2 shows a flow chart of a method for visual stereoscopic perception enhancement of a color digital image in accordance with an embodiment of the present invention, illustrating a color digital image visual perception brightness control calculation flow.
  • Figure 3 shows the calculation of the softened convolution template and pixel weights.
  • a and b in Fig. 4 show the correlation between the angle of incident light and the brightness of the relevant pixel, respectively.
  • a indicates the pixel position
  • b indicates the relevant pixel when the light is incident on the upper left side
  • c indicates the relevant pixel when the light is incident on the upper right side.
  • Figure 6-1 Original image
  • Figure 6-2 Image processed by the method of the present invention.
  • Figure 7-1 Original image
  • Figure 7-2 Image processed by the method of the present invention.
  • Figure 8-1 shows a typical system flow for a computer program using the SECr algorithm.
  • Figure 8-2 shows the typical system flow of a TV using the SECr algorithm IP.
  • Figure 8-3 shows the typical system flow of a TV using the SECr algorithm ASIC.
  • FIG. 8-4 shows the typical system flow of an electronic device using the SECr algorithm ASIC.
  • the color digital image visual stereoscopic enhancement process of the present invention is implemented.
  • the database is completed by the device color visual perception spatial color phase surface color boundary calculation module in the system of the present invention, and the calculation includes: (1-1) Converting the red, green and blue primary color values of the device color space into CIELAB space LC and h values, and transforming the three color values of the device color space red, green and blue into CIELAB space LC and h value calculation units :
  • Electronic devices with image display functions are typically sRGB color space and D65 white field, sRGB space RGB three primary color products are available:
  • RGB numerical transformation CIEXYZ three-excited value required 3 X 3 matrix coefficient Use the RGB value of the three primary colors of the white field of the device and the CIEXYZ triple-excitation value forward transformation formula:
  • the 3 X 3 matrix coefficients are expressed as the product of the three primary color values and the luminance values:
  • the typical equipment consists of 8 colors of red, green and blue primary colors, that is, 2 3 x 8 total of 16777216 color scalars, which are successively transformed by the above calculation.
  • Non-standard equipment calculates the CIEXYZ triacal value when the white field and the maximum saturation of the three primary colors of red, green and blue:
  • the standard spectrophotometer is used to measure the white field triple excitability X w ' Y w ' and Z w according to the conventional specifications.
  • the tri-maximal values of the maximum saturation of the red, green and blue primary colors of the device are measured according to conventional specifications, ⁇ , ⁇ and ⁇ X g ', Y g ' and Z g ', X b ', Y b 'and z b ', and then calculate the CIEXYZ triple stimuli of the three primary colors:
  • the calculated white field CIEXYZ triple excitatory value is substituted for the nominal white field of the above device.
  • the CIEXYZ triplet value using the standard method described above, sequentially converts a total of 16,777,216 colors, G and B values into CIELAB space L, C and h values.
  • the reference color phase plane is represented by an integer of 0-359, and the h color value of the device color hue is rounded off and entered into the corresponding reference color phase plane.
  • the reference luminance sequence is represented by an integer of 0-100, and the color L value is rounded off and merged into the corresponding luminance sequence.
  • the maximum saturation value C maxU in each luma sequence of the color phase plane is extracted as the color boundary calculation data of the color phase plane.
  • the color boundary corresponding to the luma sequence interval is calculated by a standard linear interpolation algorithm, and the maximum saturation C maxU of the original luma sequence is non-smoothly decremented or the padding boundary data is missing.
  • the color phase coordinates and boundary calculations are shown in Figure 1.
  • the smoothing referred to in the above algorithm that is, the color luminance sequence is arranged from high to low, and its saturation C max L ⁇ J is in the above sequence and is greater than all the following sequences. If the saturation value is less than the smoothed calculation value, the calculated value is used instead, and the larger than the calculated value is unchanged.
  • the data is in the order of the first order color phase surface h sequence brightness sequence L Sorted, a total of 36,360 lines.
  • the calculation process of the above step (1) is shown in Figure 2-1.
  • the red, green and blue primary color values of the completed color digital image are converted into CIELAB space L, C and h values and merged into the corresponding color phase plane and brightness sequence, and the color digital image pixel color mode is forward-converted and the merged color phase is converted.
  • the face and brightness sequence modules are executed, and the calculations include:
  • Color digital image Pixel color RGB values are converted to CIELAB space L, C and h values, calculated by the color digital image pixel color RGB values converted to CIELAB space L, C and h values of the calculation unit:
  • step (1) Use the device nominal image to display the image or the white field and the corresponding parameters of the red, green and blue primary colors embedded in the image itself, and apply the standard algorithm recommended by CIE to convert the color represented by the red, green and blue primary colors of the image pixel into CIEXYZ
  • CIELAB space L, C and h values, the algorithm program and related parameters are the same as step (1).
  • the image displayed on the non-standard device needs to measure the CIEXYZ triple-excitation value of the white level of the computing device and the maximum saturation of the three primary colors of red, green and blue.
  • the algorithm program and related parameters are the same as steps (1).
  • the image color space is divided into 0-359 total 360 reference color phase planes, the h phase h value is rounded off and merged into the corresponding reference color phase plane, and the luminance phase range in the color phase plane is divided into 0-100 total 101 reference sequences,
  • the brightness L value is rounded off and merged into the corresponding brightness sequence, so that the pixel color can be called with the integer hue h and the brightness L, but the original 8-bit floating point data precision of h, L and C is kept unchanged, which is the guarantee for accurately calculating the brightness enhancement.
  • the softening algorithm of the present invention is mainly used for skin color, firstly selecting the skin color interval by color hue, and then distinguishing the skin color by the color saturation value in the interval, determining the effective pixel number and determining the calculation by the target pixel and the correlation pixel brightness difference threshold in the convolution template. Convolution average. Selective softening calculations include:
  • H cx Set the boundary H cx and H DX of the visual perception hue interval where the color digital image softening content is located, and the transition zone widths K HCX and K HDX of the outer edges of the interval, H cx is set to 90°, H DX is set 340° is suitable for most image softening needs. Both K HCX and K HDX are set to 10 for smooth transitions between softened content and soft content.
  • the pixel weight setting is mainly related to the distance from the center of the template, and the weight is set to:
  • Li-2, j-23 ⁇ 4 2 Li-i, j-2 is 1, 1 ⁇ 2 is 2, L, Bu is 1, Li+2, j-23 ⁇ 4 2,
  • Li -2 , j - i is 1, Li - i, j - i is 4, Li, j - i is 4, L, ij - i is 4, Li + 2, j - i3 ⁇ 4 1,
  • L i-2 j is 2, Li-ij is 4, is 8, L 1+ is 4, Li+ 2 , j is 2.
  • Li-2, j+i3 ⁇ 4 1 Li-ij+i is 4, Lij+i is 4, LH-ij+i is 4, Li+2, j+i3 ⁇ 4 1,
  • Li-2, j+23 ⁇ 4 2 Li-i, j+23 ⁇ 4 1, Li, j+ 2 is 2, LH - is 1, Li+ 2 , j+2 is 2
  • the invention mainly realizes the goal of softening the skin color of the person in the image by calculating the weighted average of the visual perception brightness of the pixels.
  • the color visual perception brightness difference threshold L Yl ⁇ between the pixels is extremely critical, and the setting is 3-5, which is suitable for most images. Requirements. If the difference between the brightness of the template center pixel and the other pixel is less than L YU , the pixel is regarded as a valid pixel, which is recorded as one of the basis for calculating the softening.
  • the color of the pixel larger than L YU is generally the content other than the skin color, and is recorded as the basis for not calculating the softening. one.
  • the result is that no more than two of the adjacent pixels 8 or more and the central pixel luminance difference is greater than the threshold L YU does not calculate the softening.
  • the convolution threshold S w of the effective pixels of the pixels spaced apart from the center pixel is set to 14, resulting in spaced pixels
  • the softening is not calculated when there are 5 or more of the 16 and the central pixel luminance difference is greater than the threshold L YU .
  • the brightness value setting changed by the softening calculation is reserved for the appropriate part, and B M is set to 0.15, which is suitable for most image needs.
  • L TON 1 is the brightness value actually applied by the center pixel.
  • (4-1) Determine the projection position of the incident light in the color digital image under the real scene imaging condition, set the incident light intensity equivalent Al of the target pixel, the value is 0.4-0.6, and the parallel light intensity equivalent of the symmetric position on both sides of the incident light is Al_l And Al_2, indicating the correlation between the pixel brightness of the location and the brightness of the destination pixel:
  • Al_l (1-A1) X [(90- ⁇ ) / 90]
  • Al_2 1- Al- AlJ
  • a 1 j represents the target pixel in the image, that is, the pixel that regulates the brightness
  • L Al , j represents the brightness of the pixel
  • Up to 8 pixels of B 1+1 and J+1 are related pixels, LBW ⁇ to L BL+1 , J+1 indicates the brightness of the corresponding pixel, and 8 kinds of incident light conditions are set, that is, the incident light source is from the upper left, the upper side, Top right, right right, bottom right, down, left bottom, and right left. The above is shown in Figure 5.
  • the image color brightness contrast adjustment amount is related to the color brightness, that is, the image sharpness improvement is related to the neutral gray brightness value of the color, and the depth of the scene in which the scene is different in the image is realized.
  • setting the adjustment of the correlation can change the depth perception of the image space and the stereoscopic perception of the scene to a certain extent. This is also one of the features of the present invention.
  • Liij LAi,j+ ALij X DLij X KL
  • KL is the set proportional coefficient, the value is 1.0-2.0.
  • L CMAXHL which displays the phase planes of the color digital image devices from 0° to 359° is normalized with the maximum value as the base, and the color gray luminance equivalent D CAIx of the phase planes of the respective colors is obtained.
  • D CAIx color gray luminance equivalent
  • 103 ° yellow D CAIx maximum is 1
  • 306 ° blue D CAIx minimum is 0.3331.
  • Pixel color visual perception brightness L Al , j is greater than L Cmaxh ⁇ ⁇ calculation brightness:
  • LT2i,j Lli,j+ ((LAij" LcmaxLl)/( 100- LcmaxLl) ⁇ DcAIx) ⁇ ⁇ 2
  • K T2 is the set control coefficient, the value is 1.0-2.0.
  • Pixel color visual perception brightness L Ald is greater than L Cmaxh ⁇ ⁇ pixel color visual perception saturation C Al , j color gray brightness equivalent D BAOx:
  • LT3i,j LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) DBAOX) ⁇ 3
  • K T3 is a regulation coefficient with a value range of 0.0-3.0, typically 1.0-2.0.
  • the image sharpness enhancement is further correlated with the color gray light brightness value of the color, thereby enhancing the spatial depth of the scene in which the scene is different in the image and enhancing the scene stereo.
  • the effect of feeling is also one of the features of the present invention.
  • the values of h, C, and L T3 ⁇ 4j or L j of the pixel color are inversely transformed into sRGB spaces R, G, and B values.
  • the image pixels are color saturated.
  • the hue h, and the luminance L T3 ⁇ 4j or L j values are calculated as the specifications 1, G and B values.
  • an image pixel color mode inverse transform and normalization module in the system of the present invention is invoked, and the calculation includes:
  • the image pixel color is forward transformed to the unchanging saturation.
  • the hue angle h value and the brightness obtained by the calculation enhancement 1 ⁇ or 1 ⁇ are calculated as the three primary colors of the device, red, green and blue.
  • This algorithm is the inverse of the above step (2), calculated by the pixel color CIELAB parameter
  • CIEXYZ triple excitatory value is the same as the forward calculation, by pixel color
  • the computer hard disk HD is used as a typical carrier for submitting the SECR algorithm, and the same function carrier also includes a CD, a DVD, a USB disk, etc., and is authorized to call the SECR algorithm by the network.
  • the SECr algorithm is called programmatically by the computer CPU + GPU and runs in RAM. Color digital images are stored on your computer's hard drive Called by the SECR algorithm program, processed by the SECR algorithm and then stored back to the hard disk.
  • the image data can be copied to a carrier such as a CD, a DVD, a USB flash drive, or another hard disk, or can be transmitted to a specified location through a network.
  • the SECr algorithm program can process single frame images and frame sequence images.
  • the single-frame image format can be an uncompressed format such as .tif or .bmp, or a compression format such as .jpg.
  • the frame sequence image format can be general. MOV, .AVI, etc., and can also use the dedicated I/O to process related format files. Watching the SECr algorithm in real time The number of displays that transform image effects can be configured as needed. The system is shown in Figure 8-1.
  • the R, G and B color gradation lookup tables used by the gamma correction module in IP can be adjusted according to the special gamma settings in the main chip of the TV.
  • the system is shown in Figure 8-2.
  • Apps using the FECr algorithm ASIC also include notebook computers, tablet computers, mobile phones, game consoles, LCD monitors, computer graphics cards, etc., as shown in Figure 8-4.

Abstract

The present invention relates to the technical field of digital image processing, especially relates to the method and system for carrying out visual stereo perception enhancement on a color digital image. The solution of the present invention is characterized by: extracting the monocular depth information in the image; taking an observation effect of real scenery as an object to simulate and calculate monocular depth information enhancement. As a result, a visual perception brightness value of an image pixel color is simulated and changed into a new value. A value of visual perception saturation and a value of hue are not changed. The visual perception space sense of the image and stereo perception of the scenery are substantially enhanced.

Description

对彩色数字图像进行视觉立体感知增强的方法及系统  Method and system for visual stereoscopic perception enhancement of color digital images
技术领域 Technical field
本发明涉及数字图像处理领域,具体涉及对彩色数字图像进行视觉立体感知 增强的方法及系统。 背景技术  The present invention relates to the field of digital image processing, and in particular to a method and system for visual stereoscopic enhancement of color digital images. Background technique
二十世纪中期以来,对人类视觉特性的研究取得了重要进展。视觉是人类了 解世界的一种重要功能。 视觉包括 "视"和 "觉 ", 称之视感觉和视知觉。 视感 觉主要是从分子的观点来理解人们对光 (可见辐射) 反应的基本性质 (如亮度、 颜色), 它主要涉及物理、 化学等。 视知觉主要论述人们从客观世界接受视觉剌 激后如何反应及反应所采用的方式。它研究如何通过视觉形成人们关于外在世界 空间的表象, 所以兼有心理因素。 视知觉是一个复杂过程, 在很多情况下, 只依 靠光投射到视网膜上形成的视网膜图像和人们已知的眼或神经系统的机制还难 以把全部知觉过程解释清楚。人们利用视觉所感知的客观事物具有多种特性,对 它们形成的光剌激, 人类的视觉系统会产生不同形式的反应,所以视知觉又被分 成亮度知觉、颜色知觉、 空间知觉等。研究已经确定了一些特性与剌激的物理量 相关, 如亮度依赖于光的强度, 颜色依赖于光的波长; 但也有些特性, 如空间特 性, 还未完整得到与物理量的确定对应关系。  Since the mid-20th century, important progress has been made in the study of human visual characteristics. Vision is an important function of human understanding of the world. Vision includes "visual" and "sense", which are called visual perception and visual perception. Visual sensation mainly understands the basic properties (such as brightness and color) of people's response to light (visible radiation) from the molecular point of view. It mainly involves physics and chemistry. Visual perception mainly discusses the way people react and react after receiving visual stimuli from the objective world. It studies how to visually form the appearance of people's space in the external world, so it has both psychological factors. Visual perception is a complex process. In many cases, it is difficult to explain the entire perceptual process by relying solely on the retinal images formed by light onto the retina and the known mechanisms of the eye or nervous system. The objective things that people use to visually have a variety of characteristics, the light that they form, the human visual system will produce different forms of response, so the visual perception is divided into brightness perception, color perception, spatial perception and so on. Studies have determined that some properties are related to the physical quantity of the stimulus. For example, the brightness depends on the intensity of the light, and the color depends on the wavelength of the light. However, some characteristics, such as spatial characteristics, have not yet been completely determined by the physical quantity.
视觉感知特性研究发现,人们在观察图像时会同时将图像感知为一个平面的 一部分和一个三维空间的一部分。这一基本的心理现象称为图像双重感知真实性 ( double perceptual reality of images ), 是一种空间知觉特性。 空间知觉的问题本 质是深度感知的问题。人类没有专门用来感知距离的器官,对空间的感知常常不 仅靠视力,还需要借助一些称为深度线索的外部条件和自身机体的内部条件来帮 助判断物体的空间位置。这些线索包括非视觉性深度线索、双目深度线索和单目 深度线索等。  Visual perception characteristics studies have found that when people observe an image, they simultaneously perceive the image as part of a plane and part of a three-dimensional space. This basic psychological phenomenon is called double perceptual reality of images and is a spatial perceptual property. The problem of spatial perception is the problem of deep perception. Humans do not have organs dedicated to sensing distance. The perception of space often depends not only on vision, but also on external conditions called depth cues and internal conditions of the body to help determine the spatial position of the object. These clues include non-visual depth cues, binocular depth cues, and monocular depth cues.
人对空间场景的深度感知主要依靠非视觉性深度线索和双目视觉实现。双眼 视差是产生立体知觉和深度知觉的主要原因之一。但目前对于已经由单镜头光学 系统成像的二维图像,发现其中真实的双目视觉深度线索, 并以单目深度线索的 方式增强显示在图像中的努力尚在进行中。  The depth perception of human space scenes relies mainly on non-visual depth cues and binocular vision. Both eyes Parallax is one of the main causes of stereo perception and depth perception. However, for two-dimensional images that have been imaged by a single-lens optical system, efforts to find true binocular visual depth cues and to enhance display in the image in the form of monocular depth cues are still in progress.
人对空间场景的深度感知也可在一定程度依靠单目视觉实现。在单目视觉中 剌激物本身的一些物理条件,在适当应用条件下也可以成为知觉深度和立体感的 线索。 这些线索中的部分是由成像光学系统特性产生的, 如, 景物大小和距离, 线性透视等。另外由于成像环境光线的变化产生的视知觉,如,光亮与阴影分布, 即明亮度物体显得近, 灰暗的物体显得远; 颜色分布, 即蓝色物体显得远, 红、 黄色物体显得近; 大气透视, 即近处物体显得清楚, 远处物体不清楚等。 如能对 这些线索进行量化和仿真计算, 对二维图像增强景物之间深度(空间)感知和物 体自身立体感知应该是很有帮助的,遗憾的是,此前对这些感知仅有定性的表述, 还未与相关物理量建立对应关系,还不能直接指导彩色数字图像增强立体感的计 算。 The depth perception of a person's space scene can also be achieved to a certain extent by monocular vision. In monocular vision Some physical conditions of the stimuli themselves can also become clues to the depth of perception and the sense of three-dimensionality under appropriate application conditions. Some of these cues are generated by the characteristics of the imaging optics, such as scene size and distance, linear perspective, and the like. In addition, visual perception due to changes in the light of the imaging environment, such as the distribution of light and shadow, that is, the brightness of the object appears close, the gray object appears far; the color distribution, that is, the blue object appears far, the red and yellow objects appear close; Perspective, that is, the objects in the vicinity appear clear, and the objects in the distance are unclear. If these clues can be quantified and simulated, it should be helpful to enhance the depth (space) perception between the scene and the stereo perception of the object itself. Unfortunately, there has been only a qualitative representation of these perceptions. The corresponding relationship between the physical quantity and the related physical quantity has not been established, and the calculation of the stereoscopic effect of the color digital image cannot be directly guided.
研究发现,增加图像的视觉感知清晰度可以在一定程度增强图像视觉感知立 体感。 一些计算机程序具有这种功能, 典型如 Adobe Photoshop CS4。 在滤镜 (Filter)的智能锐化(Smart Sharpen)选项, 可以计算图像的每一像素与相邻像 素的颜色差, 并将差值的一部分用来改变自身的颜色值,达到增加图像清晰度的 目的。 在此选项中, 可以设置相邻像素的范围 (Radius), 颜色差值的利用比例 ( Amount ) , 锐化前对像素进行预处理的方式 (Remove ) , 还可以对高光 (Highlight)和暗调(Shadow)的渐隐量(Fade Amount)、色调宽度(Tonal Width) 和范围 (Radius)进行选择设置。 业界普遍认为, 该程序的锐化功能能够显著增 强图像的清晰度。但是, 对于增强图像视觉深度感知的目标而言, 目前软件的版 本还缺乏相应的功能。 例如, 程序目前以图像像素的 RGB三原色数值计算像素 间颜色差值, 这种增强像素颜色的方法, 会在提高颜色的视觉感知亮度的同时, 相应降低视觉感知饱和度和偏移视觉感知色相,锐化强度越高这种方法造成的视 觉感知色调偏差就越明显。 因此, 仅就增加图像清晰度的目的而言, 目前的方法 也是应该并且能够改进的。另外, 相邻像素的选择方式, 未能与锐化图像中的环 境光线特性相关, 因此, 图像清晰度的改变不能与深度感知密切相关, 这是非常 可惜的。还有, 对图像锐化前的柔化处理选项还过于简单, 不能根据需要而选择 图像中不同内容进行柔化模糊处理, 由此, 图像的柔化效果在一定条件下限制了 清晰度提升的程度, 并且不能与图像的深度感知相关, 同样非常可惜。  The study found that increasing the visual perceptual clarity of the image can enhance the visual perception of the image to a certain extent. Some computer programs have this capability, typically such as Adobe Photoshop CS4. In the Smart Sharpen option of the Filter, you can calculate the color difference between each pixel of the image and the adjacent pixels, and use a part of the difference to change the color value of the image to increase the image clarity. the goal of. In this option, you can set the range of adjacent pixels (Radius), the ratio of the color difference (Amount), the way to pre-process the pixels before sharpening (Remove), and also for highlights and shadows. (Shadow) Fade Amount, Tonal Width, and Radius are selected. It is widely believed in the industry that the sharpening function of the program can significantly enhance the sharpness of the image. However, for the purpose of enhancing the visual depth perception of images, the current version of the software lacks corresponding functions. For example, the program currently calculates the color difference between pixels by the RGB three primary color values of the image pixels. This method of enhancing the pixel color will reduce the visual perception saturation and the offset visual perception hue while improving the visual perception brightness of the color. The higher the sharpening intensity, the more obvious the visual perception of the hue deviation caused by this method. Therefore, the current method is also supposed to be and can be improved only for the purpose of increasing image sharpness. In addition, the way in which adjacent pixels are selected is not related to the ambient light characteristics in the sharpened image. Therefore, it is a pity that the change in image sharpness cannot be closely related to depth perception. Also, the softening option before image sharpening is too simple, and the different content in the image cannot be selected for softening and blurring according to the need, thereby the image softening effect limits the sharpness improvement under certain conditions. The extent, and not related to the depth perception of the image, is equally a pity.
发明内容 Summary of the invention
为了解决上述问题本发明的发明人提出并完成了本发明。 本发明的目的是提供对彩色数字图像进行视觉立体感知增强的方法。 The inventors of the present invention have proposed and completed the present invention in order to solve the above problems. It is an object of the present invention to provide a method for visual stereoscopic perception enhancement of color digital images.
本发明的再一目的是提供对彩色数字图像进行视觉立体感知增强的系统。 典型彩色数字图像是可见光颜色空间中的真实景物在成像平面的二维投影。 由于成像设备的实际颜色空间相比可见光颜色空间小很多,因此成像的二维图像 的视觉感知真实性与对真实景物的感知相比也相差了很多,其中就包括空间深度 感知和景物立体感知。 因此, 本发明的技术方案提取图像中的单目深度信息, 并 以真实景物的观察效果为目标计算单目深度信息增强。结果, 图像像素颜色的视 觉感知亮度值变换为新值, 图像视觉感知的空间感和景物的立体感显著增强。  It is yet another object of the present invention to provide a system for visual stereoscopic perception enhancement of color digital images. A typical color digital image is a two-dimensional projection of a real scene in the visible light color space at the imaging plane. Since the actual color space of the imaging device is much smaller than the visible color space, the visual perceptual authenticity of the imaged two-dimensional image is also quite different from the perception of the real scene, including spatial depth perception and scene stereo perception. Therefore, the technical solution of the present invention extracts the monocular depth information in the image, and calculates the monocular depth information enhancement with the observation effect of the real scene. As a result, the visually perceived luminance value of the image pixel color is converted into a new value, and the spatial perception of the image perception and the stereoscopic effect of the scene are significantly enhanced.
本发明的方法属于 "史诗颜色二™" ( SecondEposColor™), 简称 "诗色 二 TM" ( SECr™), 主要是为增强图像视觉感知空间深度感和景物立体感而调整 每一像素的视觉感知亮度数值。调整量取决于多种条件, 其中包括, 像素自身的 颜色视觉感知亮度值, 真实景物成像环境中入射光线在成像平面的投影,在光线 入射方向上的相关相邻像素颜色视觉感知亮度值,具有彩色灰度能力的像素颜色 的视觉感知色相的视觉感知彩色灰亮度当量值以及视觉感知饱和度的视觉感知 彩色灰亮度当量值等。根据本发明的方法, 图像的每一像素颜色在调整了视觉感 知亮度值的同时,保持了视觉感知饱和度和视觉感知色相值不变, 图像像素之间 的颜色视觉感知亮度差与自身亮度成比例显著增强,即视觉感知亮度差对比度显 著增强, 因此, 图像的视觉感知空间感和景物立体感显著增强。本发明的方法和 系统可用于摄影、 摄像、 电影、 电视、 视频游戏等自然景物成像或由计算机生成 的图像, 即任何由红、 绿和蓝三原色合成颜色的图像及设备。 The method of the present invention are "two color Epic ™" (SecondEposColor ™), referred to as "two-color verse TM" (SECr ™), primarily for the visual image to enhance a sense of depth perception and stereoscopic scene is adjusted for each pixel spatial visual perception Brightness value. The amount of adjustment depends on various conditions, including: the color perception brightness value of the pixel itself, the projection of the incident light in the imaging plane in the real scene imaging environment, and the visual perception brightness value of the relevant adjacent pixel color in the incident direction of the light, The visually perceived color gray luminance equivalent value of the visually perceived hue of the pixel color of the color grayscale capability and the visually perceived color gray luminance equivalent value of the visual perceptual saturation. According to the method of the present invention, each pixel color of the image maintains the visual perceptual brightness and the visual perceptual hue value while adjusting the visual perceptual brightness value, and the color visual perception brightness difference between the image pixels and the self brightness The ratio is significantly enhanced, that is, the visual perception brightness difference contrast is significantly enhanced, and therefore, the visual perception of the image and the stereoscopic effect of the scene are significantly enhanced. The method and system of the present invention can be used for natural scene imaging such as photography, videography, film, television, video games, or computer generated images, i.e., any image and device that combines colors of red, green, and blue primary colors.
对于典型由红、绿和蓝三原色合成颜色的数字图像, 根据本发明的方法, 经 调整每一像素颜色的视觉感知亮度值后,由检查原始图像对比调整后图像的亮度 值,可以看出相邻像素的颜色视觉感知亮度差对比度变化幅度平均约为 50%,变 化幅度可以由设置的幅度系数调控,同时也受到设置的亮度变化绝对值允许范围 的控制。 据研究报告, 眼睛对亮度敏感范围很大, 为 10—6— 107cd/m2 (坎 [德拉] 每平方米)。 但在实际生活中的任何时刻, 人眼所感受到的最大和最小亮度之比 很少超过 100。 这个最小和最大亮度范围在光亮的房间中为 1 100 cd/m2, 在室 外为 10— 1000 cd/m2, 在晚上为 0.01— 1 cd/m2。 因此, 根据本发明的方法对可见 光颜色空间和彩色图像颜色空间的视觉感知颜色亮度均进行归一化计算,使用各 自空间最大亮度为基数, 同样线性变换各自的亮度参数到 0— 100范围。 在此条 件下,根据本发明的技术方案,对以上二空间使用相同的颜色视觉感知模式表述 亮度, 以图像颜色亮度的动态范围记录可见光颜色亮度动态范围中颜色亮度变 化。 假定颜色空间是圆形, 已知彩色数字图像典型 sRGB颜色空间在 CIExyY空间 的 xy色品平面的投影面积大约相当于光谱轨迹投影面积的 35%,设 为图像颜色 空间色品范围直径, R2为光谱轨迹色品范围直径, 表示两投影面积比例: For a digital image that is typically synthesized from three primary colors of red, green, and blue, according to the method of the present invention, after adjusting the visually perceived luminance value of each pixel color, it can be seen by checking the original image to compare the brightness values of the adjusted image. The color visual perception brightness difference of the adjacent pixels is about 50% on average, and the variation range can be controlled by the set amplitude coefficient, and is also controlled by the set allowable range of the absolute value of the brightness change. According to studies, a large sensitivity range of the eye to brightness, of 10- 6 - 10 7 cd / m 2 ( Hom [de] per square meter). But at any point in real life, the ratio of the maximum and minimum brightness perceived by the human eye rarely exceeds 100. The minimum and maximum brightness range in a bright room for 1 100 cd / m 2, outside of 10- 1000 cd / m 2, in the evening of 0.01- 1 cd / m 2. Therefore, according to the method of the present invention, the visually perceived color brightness of the visible light color space and the color image color space are normalized, and the respective brightness parameters of the respective spaces are used as the base, and the respective brightness parameters are linearly transformed to the 0-100 range. Under this condition, according to the technical solution of the present invention, the same color visual perception mode is used for the above two spaces. Brightness, which records the change in color brightness in the dynamic range of the visible light color brightness in the dynamic range of the image color brightness. Assuming that the color space is circular, it is known that the color sRGB color space typically has a projected area of xy chromaticity plane in the CIExyY space that is approximately 35% of the projected area of the spectral trajectory, and is set to the image color space chromatic range diameter, R 2 For the spectral trace chromatic range diameter, the ratio of the two projected areas:
(Ri/2)2 X π = 0.35 X (R2/2)2 X π, 得到 R尸 0.59R2, 在圆形颜色空间情况下, 两 空间色品的动态范围比例与亮度动态范围比例相同, 因此可假定 sRGB颜色空间 的图像颜色视觉感知亮度动态范围大体相当于可见光颜色的 59%。 SECr算法计 算典型图像相邻像素的颜色视觉感知亮度差变化幅度平均 50%的情况下,已经显 著接近可见光颜色空间视觉感知亮度差对比度特性,因此对图像的视觉空间感知 和景物立体感知可以显著接近对真实环境的空间感知和真实景物的立体感知。 (Ri/2) 2 X π = 0.35 X (R 2 /2) 2 X π, get R corpse 0.59R 2 , in the case of a circular color space, the dynamic range ratio of the two spatial chromaticities is the same as the dynamic range of the brightness Therefore, it can be assumed that the image color of the sRGB color space has a visually perceived brightness dynamic range that is roughly equivalent to 59% of the visible light color. When the SECr algorithm calculates the average 50% change in the color perception brightness difference of the adjacent pixels of a typical image, it has significantly close to the visible light color space visual perception brightness difference contrast characteristics, so the visual spatial perception of the image and the stereoscopic perception of the scene can be significantly close. Spatial perception of the real environment and stereo perception of real scenes.
根据本发明的技术方案,选择应用的图像单目深度信息之一是像素间颜色视 觉感知亮度的差值。因为人们从物体表面感知的亮度基本是由它与周围环境(特 别是背景)的关系所决定的。如果两个物体与它们各自背景有相似的亮度差, 那 么它们看起来就有相似的亮度。这一选择也有利于应用颜色空间亮度动态范围的 归一化计算结果。  According to the technical solution of the present invention, one of the image monocular depth information of the selected application is the difference in color perceived luminance between pixels. Because the brightness that people perceive from the surface of an object is basically determined by its relationship to the surrounding environment (especially the background). If two objects have similar brightness differences with their respective backgrounds, then they appear to have similar brightness. This choice also facilitates the application of normalized calculations for the dynamic range of the color space luminance.
如上所述,图像双重感知真实性对于彩色数字图像深度感知增强计算的指导 意义在于, 如将图像感知为具备三维真实性, 必须仔细重构图像, 需要尽可能模 仿自然视域的有用特性。 本发明将以上描述的成像环境光线变化产生的视知觉, 以彩色数字图像的视觉感知亮度为主,视觉感知色相和饱和度为辅, 建立多种模 型, 作为图像单目深度信息来调控像素颜色视觉感知亮度值, 例如:  As mentioned above, the guiding significance of image dual perception authenticity for color digital image depth perception enhancement calculation is that, if the image is perceived as having three-dimensional authenticity, the image must be reconstructed carefully, and the useful characteristics of the natural field of view need to be simulated as much as possible. The invention adopts the visual perception generated by the change of the imaging environment light described above, mainly based on the visual perceptual brightness of the color digital image, supplemented by the visual perception hue and saturation, and establishes various models to adjust the pixel color as the image monocular depth information. Visually perceived brightness values, for example:
模型 1, 入射光线对景物的立体感知的影响模型。 真实景物成像环境的照射 光线, 是形成景物立体感和景物间空间位置感知的重要因素之一。入射光线和从 景物表面反射光线夹角的变化可以表示照射位置的表面形状。观察者感知的景物 表面亮度与观察视角和反射光线夹角相关,夹角越小感觉越亮。物体表面的亮度 变化形成对物体的立体感知, 而入射光线是形成物体表面亮度变化的主要条件。 模型 1以入射光线在图像平面的投影为基准,以图像像素在入射方向相邻和两侧 边沿近邻为条件选择相关像素, 最多选择三个相关像素表示入射光线的平行特 性。计算图像每一像素分别与此三个相关像素的颜色视觉感知亮度差,每一差值 再由 SECr算法设置的各自的系数加权以体现其相关度, 即体现表面亮度与表面 形状的相关度。 SECr算法还设置对亮度差值之和的实际利用系数, 以适应不同 特性的图像增强立体感知的需要。 应用模型 1, 图像中入射光线强度看起来显著 增强, 景物的空间感和立体感也随之显著增强。 Model 1, the model of the influence of incident ray on the stereo perception of the scene. The illumination light of the real scene imaging environment is one of the important factors that form the three-dimensional sense of the scene and the spatial position perception between the scenes. The change in the angle between the incident ray and the reflected light from the surface of the scene may indicate the surface shape of the illumination position. The brightness of the surface perceived by the observer is related to the angle between the viewing angle and the reflected light. The smaller the angle, the brighter the feeling. The change in brightness of the surface of the object forms a stereoscopic perception of the object, and the incident ray is the primary condition for the change in the brightness of the surface of the object. Model 1 selects the relevant pixels based on the projection of the incident ray on the image plane, and selects the relevant pixels on the condition that the image pixels are adjacent in the incident direction and the neighbors on both sides. Up to three related pixels are selected to represent the parallel characteristics of the incident ray. Calculate the difference in color visual perception brightness of each pixel of the image and the three related pixels, and each difference is weighted by the respective coefficients set by the SECR algorithm to reflect the correlation, that is, the correlation between the surface brightness and the surface shape. The SECr algorithm also sets the actual utilization factor for the sum of the luminance differences to accommodate the need for image enhancement stereo perception of different characteristics. Applying Model 1, the intensity of incident light in the image looks significant Enhancement, the spatial and three-dimensional sense of the scene is also significantly enhanced.
模型 2, 像素颜色视觉感知亮度值对空间感知的影响模型。 如上描述的成像 环境照明光线产生的视知觉, 分别涉及景物的亮度和清晰度,模型 2将此二者关 联, 即将图像像素的亮度值与模型 1计算的像素间亮度差值之和相关。在照明光 线与观察同向入射条件下, SECr算法结果是, 像素颜色亮度值越高, 则应用以 上亮度差值之和的比例越高,使像素颜色亮度值改变越多, 当比相关像素亮则计 算增加亮度, 比相关像素暗则计算降低亮度。模型 2将像素间亮度差对比度的改 变相关于单目深度线索之一的像素亮度,图像中亮度值相对较高的景物清晰度提 升较多, 因此就显得越近, 反之就显得越远, 图像中景物的视觉空间感知显著增 强。在逆光条件下的相关性正好相反, 结果是亮度越高清晰度越低因此就显得越 远。 在照明光线近似垂直入射的条件下, 具有在 SECr算法中设置的亮度值的图 像像素应用了亮度差值之和的最高比例量, 因此景物的清晰度最高而显得最近, 由此分别到最亮和最暗的亮度区间中像素对亮度差值之和的应用比例依次递减, 因此图像中最亮和最暗的景物看起来都显得相对较远。  Model 2, the model of the effect of pixel color visual perception of brightness values on spatial perception. The visual perception produced by the illumination illumination of the illumination environment as described above relates to the brightness and sharpness of the scene, respectively, and the model 2 associates the two, that is, the luminance value of the image pixel is related to the sum of the luminance differences between the pixels calculated by the model 1. Under the condition of illumination light and observation of the same direction of incidence, the result of SECr algorithm is that the higher the pixel color brightness value is, the higher the ratio of the sum of the above brightness difference values is, the more the pixel color brightness value changes, when it is brighter than the relevant pixel Then calculate the increase brightness, which is calculated to reduce the brightness when it is darker than the relevant pixels. Model 2 correlates the change in contrast between luminances of pixels to the brightness of one of the monocular depth cues. The sharpness of the scene with relatively high luminance values in the image is increased, so the closer it appears, the farther it appears, the farther the image is. The visual space perception of the medium scene is significantly enhanced. The correlation is reversed under backlight conditions, with the result that the higher the brightness, the lower the sharpness and therefore the farther it is. Under the condition that the illumination light is approximately perpendicular to the incident, the image pixel having the brightness value set in the SECR algorithm applies the highest proportion of the sum of the brightness difference values, so that the sharpness of the scene is the highest and appears to be the closest, thereby respectively reaching the brightest The ratio of the sum of the pixel-to-luminance differences in the darkest luminance interval is successively decreasing, so the brightest and darkest scenes in the image appear to be relatively far away.
模型 3, 像素颜色视觉感知亮度中的彩色灰度量影响模型。 如上所述, SECr 算法中以 CIELAB空间的 L、 C和 h分别表示颜色视觉感知亮度、饱和度和色相角。 以前研究一般认为在明视觉下视杆细胞不起作用。最近的研究报告,视杆细胞在 500cd/m2左右仍有活动, 相信随着科技的发展, 颜色视觉模型将会进一步完善。 本发明的技术方案,彩色图像颜色的视觉感知亮度 L值, 由两部分感知亮度组成, 即中性灰亮度和彩色灰亮度。 中性灰亮度范围大约相当于由人眼视杆细胞(rod) 响应生成的暗视觉全部和由红绿蓝三色视锥细胞(cone)响应生成的明视觉的中、 低区间部分。彩色灰亮度范围是红绿蓝三色视锥细胞响应生成的明视觉的高端部 分, 即比较靠近光谱光视效率曲线的部分, 对于彩色数字图像而言, 其为 LCmaxhl 以上亮度部分。根据本发明的技术方案计算出各色相位面上彩色灰亮度范围是不 同的, 所以在模型 3中, 利用色相位面彩色灰亮度范围归一化计算结果, 作为视 觉感知色相的视觉感知彩色灰亮度当量值。以像素颜色彩色灰亮度值与彩色灰亮 度范围的比值乘以上述彩色灰亮度当量值的方程式, 作为模型 3的子模型 1, 表 示图像颜色视觉感知亮度中由感知色相主导的彩色灰亮度贡献份额,实现上述的 成像环境光线变化产生的视知觉中的颜色分布特性, 即蓝色物体显得远, 红、黄 色物体显得近的定性描述转换为量化描述。 Model 3, Pixel Color Visually perceives the amount of color gray in the brightness effect model. As described above, in the SECr algorithm, L, C, and h of the CIELAB space represent color visual perception of brightness, saturation, and hue angle, respectively. Previous studies have generally suggested that rod cells do not function under bright vision. According to a recent study, rod cells are still active at around 500 cd/m 2 , and it is believed that with the development of technology, the color vision model will be further improved. According to the technical solution of the present invention, the visually perceived brightness L value of the color image color is composed of two parts of perceived brightness, that is, neutral gray brightness and color gray brightness. The neutral gray brightness range is approximately equivalent to the dark and full-range portions of the bright vision generated by the human eye rod response and the red-green-blue three-color cone response. The color gray luminance range is the high-end portion of the bright vision generated by the red, green, and blue cone response, that is, the portion closer to the spectral light efficiency curve, and for the color digital image, it is the luminance portion above L Cmaxhl . According to the technical solution of the present invention, the range of the color gray color on the color planes of the respective colors is calculated differently, so in the model 3, the color phase surface color gray brightness range is normalized to calculate the result, as the visual perception color phase visual perception color gray brightness Equivalent value. An equation in which the ratio of the color gray luminance value of the pixel color to the color gray luminance range is multiplied by the color gray luminance equivalent value, as the submodel 1 of the model 3, represents the color gray luminance contribution dominated by the perceived hue in the visual perception brightness of the image color. The share, the color distribution characteristic in the visual perception produced by the above-mentioned imaging environment light change, that is, the blue object appears far, and the qualitative description of the red and yellow objects appearing is converted into a quantitative description.
用 CIE (International Commission on Lumination国际照明委员会)推荐的 标准方法将孟赛尔新标系统颜色样本的 CIE xyY参数转换为 CIELAB空间色相 h、 亮度 L和饱和度 C数值, 可见同一亮度序列中样本颜色饱和度值越高颜色看 起来显得越亮, 虽然它们的视觉感知亮度 L值是相同的。 因此, 对于彩色数字 图像,本发明的技术方案计算彩色灰亮度范围中的像素颜色视觉感知饱和度值与 其所在亮度序列最大饱和度之比,作为视觉感知饱和度的视觉感知彩色灰亮度当 量值。 以此当量值乘以其视觉感知彩色灰亮度值与彩色灰亮度范围之比的方程 式, 作为模型 3的子模型 2, 表示图像颜色视觉感知亮度中由感知饱和度主导的 彩色灰亮度的贡献份额,实现上述的成像环境光线变化产生的视知觉中的光亮与 阴影分布特性, 即一般明亮的物体显得近, 灰暗的物体显得远的定性描述转换为 量化描述。 Recommended by CIE (International Commission on Lumination International Lighting Commission) The standard method converts the CIE xyY parameter of the Munsell new standard system color sample to the CIELAB spatial hue h, brightness L and saturation C values. It can be seen that the higher the sample color saturation value in the same brightness sequence, the brighter the color appears. Their visual perception brightness L values are the same. Therefore, for a color digital image, the technical solution of the present invention calculates a ratio of a visual color saturation saturation value of a pixel color in a color gray luminance range to a maximum saturation degree of a luminance sequence thereof, as a visually perceived color gray luminance equivalent value of visual perceptual saturation. . The equation by which the equivalent value is multiplied by the ratio of the visually perceived color gray luminance value to the color gray luminance range, as the submodel 2 of the model 3, represents the contribution of the color gray luminance dominated by the perceived saturation in the visual perception of the image color. The share, the light and shadow distribution characteristics in the visual perception produced by the above-mentioned imaging environment light changes, that is, the generally bright objects appear close, and the gray objects appear far qualitative descriptions converted into quantitative descriptions.
模型 3的子模型 1和子模型 2计算像素颜色的彩色灰亮度差的调整量,与模 型 2 计算的像素颜色的中性灰亮度差调整量共同构成图像颜色视觉空间感知和 景物立体感知对真实景物的仿真。  Submodel 1 and submodel 2 of model 3 calculate the adjustment amount of the color gray luminance difference of the pixel color, and the neutral gray luminance difference adjustment amount of the pixel color calculated by the model 2 constitutes the image color visual space perception and the scene stereo perception to the real scene. Simulation.
通过本发明的技术方案,图像视觉感知清晰度和立体感同时显著增强。但是, 实际部分图像内容不需要显著清晰, 例如对于以人像为主要内容的图像, 毛孔、 汗毛等显著清晰可能产生相反效果,因此本发明的技术方案还包括对图像特定内 容进行选择性柔化的算法模块。 柔化计算使用以目标像素为中心的 5 X 5像素模 板, 类高斯分布加权的卷积平均算法, 调整目标像素视觉感知亮度参数。调整量 与多种条件和设置相关, 包括: SECr算法中设定的像素之间视觉感知亮度差的 阈值; 目标像素的近邻像素, 即模板中目标像素的邻圈像素(共 8个)亮度低于 阈值的像素卷积阈值; 模板中目标像素的外圈像素 (共 16个) 亮度低于阈值的 像素卷积阈值; SECr算法中设定的特定内容的像素颜色视觉感知色相区间; 设 定的像素颜色视觉感知饱和度阈值;设定的对以上计算的的像素颜色视觉感知亮 度调整量的实际使用比例值等。模板采用的类高斯分布加权系数, 是在典型高斯 分布的基础上根据 SECr算法设计使用的阈值设置而调整设置的。 仅使用颜色的 视觉感知亮度值进行柔化卷积计算, 是本发明的主要技术特性, 也是相比其它柔 化算法具有显著优势的原因之一。  With the technical solution of the present invention, the visual perception of the image and the stereoscopic effect are simultaneously significantly enhanced. However, the actual partial image content does not need to be significantly clear. For example, for a portrait-based image, the sharpness of the pores, the hair, and the like may have the opposite effect. Therefore, the technical solution of the present invention further includes selectively softening the image-specific content. Algorithm module. The softening calculation uses a 5 X 5 pixel template centered on the target pixel, a Gaussian distribution weighted convolution averaging algorithm, to adjust the visual perception brightness parameter of the target pixel. The adjustment amount is related to various conditions and settings, including: a threshold of visually perceived luminance difference between pixels set in the SECr algorithm; a neighboring pixel of the target pixel, that is, a neighboring pixel of the target pixel in the template (eight in total) has low brightness The pixel convolution threshold at the threshold; the outer circle pixels of the target pixel in the template (16 in total) the pixel convolution threshold whose brightness is lower than the threshold; the pixel color visual perception hue interval of the specific content set in the SECr algorithm; Pixel color visual perception saturation threshold; set the actual use ratio value of the pixel color visual perception brightness adjustment amount calculated above. The Gaussian distribution weighting coefficients used by the template are adjusted based on the threshold setting of the SECr algorithm design based on the typical Gaussian distribution. It is one of the main technical characteristics of the present invention to perform softening convolution calculation using only the visually perceived luminance value of the color, and is one of the reasons that has significant advantages over other softening algorithms.
根据本发明的对彩色数字图像进行视觉立体感知增强的方法包括以下步骤: A method for visual stereoscopic perception enhancement of a color digital image in accordance with the present invention includes the following steps:
( 1 ) 计算显示彩色数字图像的设备的视觉感知空间的 360个色相位面的颜 色边界, 提取边界上饱和度 CmaxU和最大饱和度 Cmaxhl及其亮度 LCmaxhl ; (1) calculating the color boundary of 360 color phase planes of the visual perceptual space of the device displaying the color digital image, extracting the saturation C maxU and the maximum saturation C maxhl and its brightness L Cmaxhl on the boundary;
(2)正向变换彩色数字图像像素颜色 R、 G和 B数值为 CIELAB空间的 L、 C和 h数值, 其中, h为色相角, L为亮度、 C为饱和度; (2) Forward-converted color digital image pixel color R, G, and B values are L of CIELAB space, C and h values, where h is the hue angle, L is the brightness, and C is the saturation;
(3) 确定真实景物成像条件下的入射光线在彩色数字图像中的投影位置, 设置目的像素的入射光线强度当量 Al, 数值范围 0.0-1, 典型 0.4-0.6, 入射光线 两边对称位置的并行光线强度当量 Al_l和 Al_2, 分别表示该位置像素亮度与 目的像素亮度的相关性:  (3) Determine the projection position of the incident light in the color digital image under the real scene imaging condition, set the incident light intensity equivalent Al of the target pixel, the numerical range is 0.0-1, typically 0.4-0.6, and the parallel rays of the symmetric position on both sides of the incident light The intensity equivalents Al_l and Al_2 represent the correlation between the brightness of the pixel at the location and the brightness of the target pixel, respectively:
Al l =(1-Α1)Χ[(90-α)/90]  Al l =(1-Α1)Χ[(90-α)/90]
Al_2= 1-Α1-Α1_1  Al_2= 1-Α1-Α1_1
其中, ct为入射光线在图像上的投影与垂线的夹角;  Where ct is the angle between the projection of the incident ray on the image and the perpendicular;
(4) 计算目的像素与相关像素间的亮度差值 ΔΙ^, 在目的像素的入射光线 及其两边对称方向选择的像素为相关像素, 计算它们与目的像素间的亮度差 A ), 典型包括: (4) Calculating the luminance difference ΔΙ^ between the target pixel and the related pixel, and the pixel selected in the incident ray of the target pixel and the symmetric direction of both sides thereof are related pixels, and the luminance difference A ) between the target pixel and the target pixel is calculated, and typically includes:
左上方入射光线条件下计算:  Calculated under the incident light conditions at the upper left:
ALij= ( LAij - LBi-ij-i ) XA1 + (LAi,j - LBij-i) X Al—l + (LAi,j - LBi-1,j) X Al_2 正上方入射光线条件下计算: ALij= ( L Ai j - LBi-ij-i ) XA1 + (L Ai ,j - L B ij-i) X Al—l + (L Ai ,j - L Bi-1 ,j) X Al_2 incident directly above Calculated under lighting conditions:
ALi,j= ( LAi,j - LBij-i ) XA1 + (LAi,j - LBi-1,j) X Al_l + (LAi,j - LBi+1,j) X Al_2 右上方入射光线条件下计算: ALi,j= ( L Ai ,j - L B ij-i ) XA1 + (L Ai ,j - L Bi-1 ,j) X Al_l + (L Ai ,j - L Bi+1 ,j) X Al_2 upper right Calculated under square incident light conditions:
ALi,j= ( LAi,j - LBi+ij-i ) XA1 + (LAi,j - LBij-i) X Al—l + (LAi,j - LBi+1,j) X Al_2 其中, A1j表示图像中目的像素, 即调控亮度的像素, LAl,j表示该像素亮度; 中心像素 A1j四周共 8个像素, 自左上角顺时针排列分别为: ALi,j= ( L Ai ,j - LBi+ij-i ) XA1 + (L Ai ,j - L B ij-i) X Al—l + (L Ai ,j - L Bi+1 ,j) X Al_2 Among them, A 1j represents the target pixel in the image, that is, the pixel that regulates the brightness, L Al , j represents the brightness of the pixel; the central pixel A 1j has a total of 8 pixels around, and the clockwise arrangement from the upper left corner is:
Bi-i,j-i, Bij_i , Bi+ij_i, Bi+ij, Bi+ij+i, Bij+i , Bi_ij+i, Bi_ij,  Bi-i,j-i, Bij_i, Bi+ij_i, Bi+ij, Bi+ij+i, Bij+i, Bi_ij+i, Bi_ij,
至 LB^表示相应像素亮度,  To LB^ indicates the corresponding pixel brightness,
入射光线条件设定 8种, 即入射光源自左上、 正上、 右上、 正右、 右下、 正 下、 左下和正左;  The incident light conditions are set to 8 kinds, that is, the incident light source is from the upper left, the upper right, the upper right, the right right, the lower right, the lower right, the lower left, and the right left;
(5) 计算像素颜色视觉感知亮度表现的景物空间感知当量 D j (5) Calculating the visual space perception equivalent of the pixel color visual perception brightness Dj
(5-1) 与观察同向光照条件下,  (5-1) Under observation of the same direction illumination,
DLlJ = (LAlJ/100) D LlJ = (L AlJ /100)
(5-2) 与观察逆向光照条件下,  (5-2) and under the condition of observing reverse illumination,
DLlJ = (l-LAl0/100) D LlJ = (lL Al0 /100)
(5-3) 与观察近似垂直光照条件下,  (5-3) Under observation of approximate vertical illumination conditions,
设置 LZH为目标亮度,即获得最高视觉感知清晰度的亮度值,数值范围 50-95, 典型 75-85, 如果 LAl,」 > LZH, DLlJ = (100-LAlJ) /(100- LZH) Set L ZH to the target brightness, which is the brightness value for the highest visual perception resolution, with a range of values from 50 to 95, typically 75-85. If L Al ,"> L ZH , D LlJ = (100-L AlJ ) / (100- L ZH )
如果 LAij < LZH' Duj = LAIJ /LZH °  If LAij < LZH' Duj = LAIJ / LZH °
( 6 ) 计算像素颜色视觉感知亮度调控后亮度 L j (6) Calculate the pixel color visual perception brightness control brightness L j
LTIJ = LAi,j+ ALij X Duj KL  LTIJ = LAi,j+ ALij X Duj KL
其中, KL为设置的调控比例系数, 数值范围 0.0—3.0, 典型 1.0-2.0。  Among them, KL is the set control proportional coefficient, the value range is 0.0-3.0, typically 1.0-2.0.
( 7 ) 计算像素颜色视觉感知亮度的彩色灰亮度当量,  (7) Calculating the color gray brightness equivalent of the pixel color visual perception brightness,
( 7-1 ) 计算像素颜色视觉感知色相的彩色灰亮度当量 DCAIx和调控后亮度( 7-1 ) Calculating the color gray brightness equivalent D CAIx and the adjusted brightness of the pixel color visual perception hue
LT¾j, L T 3⁄4j,
对显示彩色数字图像设备 0° -359° 各色相位面的 LCmaxhl以其中最大值为基 数进行归一化计算, 得到相应色相位面的彩色灰亮度当量 DCAIxThe L Cmaxhl of the color plane of the color digital image device is normalized by the maximum value, and the color gray brightness equivalent D CAIx of the corresponding color phase surface is obtained .
像素颜色视觉感知亮度大于 LCmaxh^ †算调控亮度: Pixel color visual perception brightness is greater than L Cmaxh ^ 调控 calculation brightness:
LT2i,j = Lli,j+ ((LAij" LcmaxLl)/( 100- LcmaxLl) ^ DcAIx) ^ Κχ2  LT2i,j = Lli,j+ ((LAij" LcmaxLl)/( 100- LcmaxLl) ^ DcAIx) ^ Κχ2
其中, KT2为设置的调控系数, 数值范围 0.0-3.0, 典型 1.0-2.0; Where K T2 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0;
( 7-2 )计算像素颜色视觉感知饱和度的彩色灰亮度当量 DBAOx和调控后亮度( 7-2 ) Calculate the color gray brightness equivalent D BAOx of the pixel color visual perception saturation and the adjusted brightness
LT3i,j L T3i,j
像素颜色视觉感知亮度大于 LCmaxh^ †算像素颜色视觉感知饱和度 CAl,j的彩 色灰亮度当量 DBAOx: Pixel color visual perception brightness is greater than L Cmaxh ^ 像素 pixel color visual perception saturation C Al , j color gray brightness equivalent D BAOx:
DBAOX= ( CAij CmaxLl ) DBAOX = ( CAij C max Ll )
计算调整后亮度:  Calculate the adjusted brightness:
LT3i,j = LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) ^ DBAOX) ^ Κχ3  LT3i,j = LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) ^ DBAOX) ^ Κχ3
其中, KT3为设置的调控系数, 数值范围 0.0-3.0, 典型 1.0-2.0。 Among them, K T3 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0.
( 8) 将像素颜色的色相 h、 饱和度 C和计算调控后的 LT¾j 或 L j数值逆向变 换为 sRGB空间 R、 G和 B数值和规范化。 (8) The hue h, the saturation C of the pixel color, and the calculated L T3⁄4j or L j value are inversely transformed into the sRGB spaces R, G, and B values and normalized.
根据本发明的方法还包括选择图像中需柔化内容的颜色视觉感知色相区间 和设置相关调控系数的步骤:  The method according to the invention further comprises the steps of selecting a color visual perceptual hue interval in the image to be softened and setting the relevant control coefficients:
1.1 设置彩色数字图像柔化内容所在视觉感知色相区间的高端边界 HCX和低 端边界 HDX, 及区间两边外沿的过渡区宽度 KHCX和 KHDX, HCX和 HDX数值范围 0-359° , KHCX和 KHDX数值范围 0-20, 典型 10, 色相区间的高端过渡区的外沿色 相值: HWGX=HGX+KHGX, 低端: HWDX=HDX-KHDX, 1.1 Set the high-end boundary H CX and the low-end boundary H DX of the visual perception hue interval of the color digital image softening content, and the transition zone width K HCX and K HDX of the outer edges of the interval, H CX and H DX value range 0-359 ° , K HCX and K HDX values range 0-20, typical 10, the outer edge hue value of the high-end transition zone of the hue interval: HWGX = HGX+KHGX, low end: HWDX = HDX-KHDX,
只对指定色相区间内的颜色保留规范柔化计算结果,对过渡区内颜色因计算 柔化得到的视觉感知亮度调整量,从色相区间边界到外边沿计算调整量平滑变化 到。; Only the color softening calculation result is retained for the color in the specified hue interval, and the visual perception brightness adjustment amount obtained by calculating the softening in the transition region is smoothly changed from the hue interval boundary to the outer edge calculation adjustment amount. To. ;
1.2 设置颜色视觉感知饱和度比例高限阈值 CCAOX和高端过渡区宽度系数 BIcxi , CGAOX数值范围 0.40-0.80, 典型 0.60-0.70, BIcx^值范围 0.00— 1, 典型 0.10, 1.2 Set color visual perception saturation ratio high threshold C CAOX and high-end transition zone width coefficient BIcxi, C GAOX value range 0.40-0.80, typical 0.60-0.70, BI cx ^ value range 0.00-1, typical 0.10,
只对以上指定色相区间内并且饱和度比例值在阈值 CCAOX以下的颜色保留规 范柔化计算结果, 对饱和度比例在 CCAOX到 CCAOX + BICX1的颜色因计算柔化得到 的视觉感知亮度调整量, 从 CCAOX到 CCAOX+ BIcxl计算调整量平滑变化到 0; Only for the color specified in the above specified hue interval and the saturation ratio value below the threshold C CAOX , the softening calculation result is obtained, and the color ratio of the saturation ratio in the C CAOX to C CAOX + BI CX1 is calculated by the softening of the visual perception. Adjustment amount, from C CAOX to C CAOX + BI cxl calculation adjustment amount smoothly changes to 0;
1.3 设置柔化卷积模板及相关像素权重,  1.3 Set the softening convolution template and related pixel weights,
以柔化像素为中心的 5 X 5像素作为柔化卷积模板, L1j表示中心像素, 即柔 化像素, 以下标 1j表示模板上像素位置, i表示列, j表示行,像素权重分别设置为: 5 × 5 pixels centered on the softened pixel as a softening convolution template, L 1j represents the center pixel, that is, softened pixels, the following label 1j represents the pixel position on the template, i represents the column, j represents the row, and the pixel weights are respectively set. for:
Li-2,j-2¾ 2, Li—i,j-2为 1, 1^2为 2, L,卜 为 1, Li+2,j-2¾ 2, Li-2, j-23⁄4 2, Li-i, j-2 is 1, 1^ 2 is 2, L, Bu is 1, Li+2, j-23⁄4 2,
Li-2,j—i为 1, Li—i,j—i为 4, Li,j—i为 4, L,卜 ij-i为 4, Li+2,j-i¾ 1, Li -2 , j - i is 1, Li - i, j - i is 4, Li, j - i is 4, L, ij - i is 4, Li + 2, j - i3⁄4 1,
Li-2j为 2, Li-ij为 4, 为 8, L1+ 为4, Li+2,j为 2, L i-2 j is 2, Li-ij is 4, is 8, L 1+ is 4, Li+ 2 , j is 2.
Li-2,j+i¾ 1, Li—ij+i为 4, Lij+i为 4, LH -ij+i为 4, Li+2,j+i¾ 1,  Li-2, j+i3⁄4 1, Li-ij+i is 4, Lij+i is 4, LH-ij+i is 4, Li+2, j+i3⁄4 1,
Li-2,j+2¾ 2, Li-i,j+2¾ 1, Li,j+2为 2, LH - 为 1, Li+2,j+2为 2; Li-2, j+23⁄4 2, Li-i, j+23⁄4 1, Li, j+ 2 is 2, LH - is 1, Li+ 2 , j+2 is 2;
1.4 设置模板上相关像素间颜色视觉感知亮度差阈值 LYU1.4 Set the color perception visual brightness difference threshold L YU between the relevant pixels on the template.
LYU¾值范围 0-100,典型 2-6,模板中心像素与另外像素的亮度差小于 LYU则 记该像素为有效像素; L YU 3⁄4 value range 0-100, typically 2-6, the difference between the brightness of the template center pixel and the other pixel is less than L YU, then the pixel is the effective pixel;
1.5
Figure imgf000011_0001
1.5
Figure imgf000011_0001
设置与中心像素相邻像素的有效像素的卷积阈值 SN, 数值范围 0— 32, 典型 24-28, 梯度 4, 设置与中心像素相隔像素的有效像素的卷积阈值 Sw, 数值范围 0-24, 典型 10-14, 梯度 1或 2, 当相邻像素的有效像素卷积值大于 Si^^且相隔 像素的有效像素卷积值大于 Sw, 则计算模板有效像素卷积平均值作为中心像素 的亮度值 LJpi,j ; Setting a convolution threshold S N of effective pixels with pixels adjacent to the center pixel, a range of values 0 - 32, typically 24-28, gradient 4, setting a convolution threshold S w of the effective pixels of the pixel spaced apart from the center pixel, value range 0 -24, typical 10-14, gradient 1 or 2, when the effective pixel convolution value of adjacent pixels is larger than Si^^ and the effective pixel convolution value of the spaced pixels is greater than S w , the template effective pixel convolution average is calculated as The luminance value of the center pixel L Jpi , j ;
1.6 设置像素视觉感知亮度调整量实际应用的比例系数 BJX11.6 Setting the Pixel Vision Sensing Brightness Adjustment The practical application of the scale factor B JX1 ,
BJX1数值范围 0.00-1, 典型 0.10-0.30,B JX1 has a value range of 0.00-1, typically 0.10-0.30,
Figure imgf000011_0002
BJXI
Figure imgf000011_0002
BJXI
其中, LTON 1为中心像素实际应用的亮度值。 根据本发明的彩色数字图像进行视觉立体感知增强的系统包括: Among them, L TON 1 is the brightness value actually applied by the center pixel. A system for performing visual stereoscopic enhancement according to the color digital image of the present invention includes:
(1)显示彩色数字图像的设备颜色视觉感知空间色相位面颜色边界计算模 块, 包括:  (1) A device color visual perception spatial color phase surface color boundary calculation module displaying a color digital image, including:
(1-1)设备颜色空间的红、绿和蓝三原色值变换为 CIELAB空间 L、 C禾卩 h值 计算单元;  (1-1) The red, green and blue primary color values of the device color space are converted into CIELAB space L, C and h value calculation unit;
(1-2)设备颜色视觉感知空间色相位面颜色边界提取单元;  (1-2) device color visual perception spatial color phase surface color boundary extraction unit;
(1-3)色相位面颜色边界 CmaxU平滑单元。 (1-3) Color phase plane color boundary C maxU smoothing unit.
(2)彩色数字图像像素颜色 RGB模式正向转换及归并色相位面和亮度序列模 块, 包括:  (2) Color digital image pixel color RGB mode forward conversion and merge color phase surface and brightness sequence module, including:
(2-1)将彩色数字图像像素颜色 RGB三原色值转换为 CIELAB空间的亮度 L、 饱和度 C和色相角 h值的计算单元。  (2-1) A calculation unit that converts the color digital image pixel color RGB three primary color values into the brightness L, saturation C, and hue angle h value of the CIELAB space.
(2-2)像素颜色色相位面和亮度序列归并单元, 将图像颜色空间划分为 360 个基准色相位面, 以色相 h值四舍五入归并进入相应基准色相位面,将色相位面 中亮度 L范围划分为 101个基准序列, 以亮度 L值四舍五入归并进入相应亮度 序列。  (2-2) Pixel color phase plane and brightness sequence merging unit, dividing the image color space into 360 reference color phase planes, rounding the h phase h value into the corresponding reference color phase plane, and setting the luminance L range in the color phase plane Divided into 101 reference sequences, rounded up to the corresponding brightness sequence with the brightness L value rounded off.
(3)彩色数字图像选择性柔化计算模块, 包括:  (3) A color digital image selective softening calculation module, comprising:
(3-1)柔化内容初选单元, 读取系统中设置的柔化颜色的色相区间边界 Hcx和 HDX以及区间两边外沿的过渡区宽度 KHCX和 KHDX,读取设置的柔化颜色的饱和度 比例高限阈值 CCAOX和高端过渡区宽度系数 BICX1,将符合条件的像素颜色导入柔 化计算精选单元; (3-1) Softening the content primary unit, reading the hue interval boundaries H cx and H DX of the softening color set in the system and the transition zone widths K HCX and K HDX of the outer edges of the interval, reading the setting softness The saturation ratio high threshold C CAOX and the high-end transition width coefficient BI CX1 of the color are introduced into the softening calculation unit;
(3-2)柔化内容精选和计算单元,读取系统中设置的卷积模板相关像素间亮度 差阈值 LYU, 读取有效像素卷积阈值 Si^¾Sw, 应用系统中设置的柔化模板和像素 加权, 对符合条件的像素计算柔化亮度 LIpi,j并导入柔化应用计算单元; (3-2) Softening the content selection and calculation unit, reading the convolution template-related inter-pixel luminance difference threshold L YU set in the system, reading the effective pixel convolution threshold Si^3⁄4S w , the softness set in the application system Template and pixel weighting, calculate the softening brightness L Ipi , j for the qualified pixels and import it into the softening application computing unit;
(3-3)柔化亮度应用计算单元,读取系统中设置的亮度调整量实际应用比例系 数 Bm, 将计算调整后的亮度值 LTON 1代替像素原有亮度值 LAl,j。 (3-3) Softening brightness application calculation unit, reading the brightness adjustment amount set in the system, actually applying the proportional coefficient B m , and calculating the adjusted brightness value L TON 1 instead of the original brightness value L Al , j of the pixel.
(4)彩色数字图像像素颜色亮度增强计算模块, 包括:  (4) A color digital image pixel color brightness enhancement calculation module, comprising:
(4-1)设置实际景物成像环境中入射光线在图像上投影及与目的像素亮度相 关像素作用当量计算单元,  (4-1) setting the pixel equivalent projection unit for the projection of incident light on the image and the brightness of the target pixel in the actual scene imaging environment,
设置目的像素的入射光线强度当量 Al, 数值 0.4-0.6, 入射光线两边对称位 置的并行光线强度当量 Al_l和 Al_2,  Set the incident light intensity equivalent of the destination pixel, Al, value 0.4-0.6, parallel light intensity equivalents Al_l and Al_2, symmetrically located on both sides of the incident light.
Al l = (1-Α1) Χ [(90-α) / 90] Al_2 = 1- A1- A1_1 Al l = (1-Α1) Χ [(90-α) / 90] Al_2 = 1- A1- A1_1
其中, ct为入射光线在图像上的投影与垂线的夹角;  Where ct is the angle between the projection of the incident ray on the image and the perpendicular;
(4-2)目的像素与相关像素间的亮度差值 ΔΙ^计算单元,  (4-2) Difference in luminance between the target pixel and the associated pixel ΔΙ^ calculation unit,
入射光线条件设定 8种, 即入射光源自左上、 正上、 右上、 正右、 右下、 正 下、 左下和正左, 目的像素与相关像素间的亮度差值 ΔΙ^典型包括:  The incident light conditions are set to 8 kinds, that is, the incident light source is from the upper left, the upper right, the upper right, the right right, the lower right, the lower right, the lower left, and the right left. The difference in brightness between the target pixel and the related pixel ΔΙ^ typically includes:
左上方入射光线条件下计算:  Calculated under the incident light conditions at the upper left:
ALij= ( LAij - LBi-ij-i ) X A1 + (LAi,j - LBij-i) X Al—l + (LAi,j - LBi-1,j) X Al_2 正上方入射光线条件下计算: ALij= ( L Ai j - LBi-ij-i ) X A1 + (L Ai ,j - L B ij-i) X Al—l + (L Ai ,j - L Bi-1 ,j) X Al_2 directly above Calculated under incident light conditions:
ALi,j= ( LAi,j - LBij-i ) X A1 + (LAi,j - LBi-1,j) X Al_l + (LAi,j - LBi+1,j) X Al_2 右上方入射光线条件下计算: ALi,j= ( L Ai ,j - L B ij-i ) X A1 + (L Ai ,j - L Bi-1 ,j) X Al_l + (L Ai ,j - L Bi+1 ,j) X Al_2 Calculated in the upper right incident light condition:
ALi,j= ( LAi,j - LBi+ij-i ) X A1 + (LAi,j - LBij-i) X Al—l + (LAi,j - LBi+1,j) X Al_2 其中, A1j表示图像中目的像素, 即调控亮度的像素, LAl,j表示该像素亮度; 中心像素 A1j四周共 8个像素, 自左上角顺时针排列分别为: ALi,j= ( L Ai ,j - LBi+ij-i ) X A1 + (L Ai ,j - L B ij-i) X Al—l + (L Ai ,j - L Bi+1 ,j) X Al_2 where A 1j represents the target pixel in the image, that is, the pixel that regulates the brightness, L Al , j represents the brightness of the pixel; the central pixel A 1j has a total of 8 pixels around, and the clockwise arrangement from the upper left corner is:
Bi-i,j-i, Bij_i , Bi+ij_i , Bi+ij, Bi+ij+i , Bij+i , Bi_ij+i , Bi_ij,  Bi-i,j-i, Bij_i , Bi+ij_i , Bi+ij, Bi+ij+i , Bij+i , Bi_ij+i , Bi_ij,
至 LB^表示相应像素亮度,  To LB^ indicates the corresponding pixel brightness,
入射光线条件设定 8种, 即入射光源自左上、 正上、 右上、 正右、 右下、 正 下、 左下和正左;  The incident light conditions are set to 8 kinds, that is, the incident light source is from the upper left, the upper right, the upper right, the right right, the lower right, the lower right, the lower left, and the right left;
(4-3)像素颜色视觉感知亮度表现的景物空间感知当量 D j计算单元, 在与观察同向光照条件下: (4-3) Pixel color visual perception of brightness performance of the scene space perceptual equivalent D j calculation unit, under the same direction of observation:
DLlJ = (LAlJ / 100) D LlJ = (L AlJ / 100)
在与观察逆向光照条件下:  Under and under the condition of observing reverse illumination:
DLlJ = (l- LAl0 / 100) D LlJ = (l- L Al0 / 100)
在与观察近似垂直光照条件下:  Under conditions of observation and vertical illumination:
设置 LZH为目标亮度, 即获得最高视觉感知清晰度的亮度值, 数值 75-85, 如果 LAl,」 > LZH, DLlJ = (100-LAlJ) /(100- LZH) Set L ZH to the target brightness, ie the brightness value for the highest visual perception resolution, value 75-85, if L Al , >> L ZH , D LlJ = (100-L AlJ ) / (100- L ZH )
如果 LAij < LZH' Duj = LAIJ /LZH;  If LAij < LZH' Duj = LAIJ / LZH;
(4-4)像素颜色视觉感知亮度调控后亮度 L j计算单元, (4-4) pixel color visual perception brightness control brightness L j calculation unit,
= LAij+ ALij X Duj X KL  = LAij+ ALij X Duj X KL
以上, KL为设置的调控比例系数, 数值 1.0-2.0; Above, K L is the set control proportional coefficient, the value is 1.0-2.0;
(4-5)像素颜色视觉感知色相的彩色灰亮度当量 DCAIx和调控后亮度 LT¾j计算 单元, 读取图像设备 0° -359° 各色相位面的 LCmaxhl, 以其中最大值为基数进行归 一化, 计算结果为相应相位面的彩色灰亮度当量 DCAIx(4-5) pixel color visual perception hue color gray brightness equivalent D CAIx and adjusted brightness L T3⁄4j calculation unit, Read the image device 0° -359° L Cmaxhl of each color phase plane, normalize with the maximum value as the base, and calculate the color gray brightness equivalent D CAIx of the corresponding phase surface.
比较像素颜色视觉感知亮度 LAld大于 LCmaxhl时计算调控亮度: Compare the pixel color visual perception brightness L Ald is greater than L Cmaxhl to calculate the control brightness:
LT2i,j = Lli,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) ^ DcAIx) ^ Κχ2  LT2i,j = Lli,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) ^ DcAIx) ^ Κχ2
以上 KT2为设置的调控系数, 数值范围 0.0-3.0, 典型 1.0-2.0; The above K T2 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0;
(4-6)像素颜色视觉感知饱和度的彩色灰亮度当量 DBAOx和调控后亮度 LT¾j计 算单元, (4-6) color gray brightness equivalent D BAOx and adjusted brightness L T3⁄4j calculation unit of pixel color visual perception saturation,
比较像素颜色视觉感知亮度 LAld大于 LCmaxhl时计算像素颜色视觉感知饱和度 CAl,j的彩色灰亮度当量 DBAOx: Comparing pixel color visual perception brightness L Ald is greater than L Cmaxhl when calculating pixel color visual perception saturation C Al , j color gray brightness equivalent D BAOx:
DBAOx= ( CAij CmaxLl DBAOx = ( CAij CmaxLl
计算调整后亮度:  Calculate the adjusted brightness:
LT3i,j = LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) DBAOX) Κτ3  LT3i,j = LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) DBAOX) Κτ3
以上 KT3为设置的调控系数, 数值范围 0.0-3.0, 典型 1.0-2.0。 The above K T3 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0.
(5) 将像素颜色的色相 h、饱和度 C和计算调控后的 LT¾j 或 L j数值逆向变换 为 sRGB空间 R、 G和 B三原色数值的计算模块。 (5) A calculation module that inversely transforms the hue h, the saturation C of the pixel color, and the L T3⁄4j or L j value after the calculation control into the three primary color values of the sRGB spaces R, G, and B.
作为本发明的优选技术方案,设备颜色视觉感知空间色相位面颜色边界数据 库先经由本发明系统中的设备颜色视觉感知空间色相位面颜色边界计算模块完 成, 计算包括:  As a preferred technical solution of the present invention, the device color visual perception spatial color phase surface color boundary data library is first completed by the device color visual perception spatial color phase surface color boundary calculation module in the system of the present invention, and the calculation includes:
(1-1)设备颜色空间的红、绿和蓝三原色值变换为 CIELAB空间 L、 C禾卩 h值 的计算, 由本发明系统中的设备颜色空间的红、 绿和蓝三原色值变换为 CIELAB 空间 L、 C和 h值计算单元执行:  (1-1) The red, green and blue primary color values of the device color space are converted into CIELAB spaces L, C, and h values, and the red, green and blue primary color values of the device color space in the system of the present invention are converted into CIELAB space. The L, C, and h value calculation units perform:
(1-2)设备颜色视觉感知空间色相位面颜色边界计算,由设备颜色视觉感知空 间色相位面颜色边界提取单元执行:  (1-2) Device color visual perception spatial color phase surface color boundary calculation, performed by the device color visual perception spatial color phase surface color boundary extraction unit:
以 0-359整数表示基准色相位面, 以设备颜色色相 h值四舍五入归并进入相 应基准色相位面, 并以 0-100整数表示基准亮度序列, 以 L值四舍五入归并进入 相应亮度序列, 提取色相位面各亮度序列颜色最大饱和度值 CmaxU, 作为该色相 位面的颜色边界计算数据; The reference color phase plane is represented by an integer of 0-359, and the h color value of the device color is rounded off and merged into the corresponding reference color phase plane, and the reference luminance sequence is represented by an integer of 0-100, rounded to the corresponding luminance sequence by the L value, and the color phase is extracted. The maximum color saturation value C maxU of each luminance sequence is calculated as the color boundary of the color phase plane;
(1-3)色相位面颜色边界平滑计算,由色相位面颜色边界 ^^^^平滑单元执行: 提取色相位面中最大饱和度值 Cmaxhl具有的亮度 LCmaxhl到最低亮度 L=0 的亮度序 列区间所对应的颜色边界, 以标准线性插值算法计算平滑边界, 弥补原亮度序列 的最大饱和度 CmaxU非平滑递减或填补缺失。 计算得到的颜色边界 CmaxU以及由 亮度 LCmaxhl L=100 的亮度序列区间对应的颜色边界 CmaxU, 表示该色相位面的 应用颜色边界。 附图说明 (1-3) Color phase surface color boundary smoothing calculation, performed by the color phase surface color boundary ^^^^ smoothing unit: extracting the maximum saturation value C maxhl of the color phase plane having the brightness L Cmaxhl to the lowest brightness L=0 The color boundary corresponding to the luminance sequence interval is calculated by a standard linear interpolation algorithm to compensate for the maximum saturation C maxU of the original luminance sequence, which is not smoothed or padded. Calculated color boundary C maxU and The color boundary C maxU corresponding to the luminance sequence interval of the luminance L Cmaxhl L=100 indicates the applied color boundary of the color phase plane. DRAWINGS
图 1显示了非标设备颜色视觉感知空间示例色相位面全部归并颜色坐标,中 部灰线表示归并亮度序列算法,下部灰线表示以线性插值纠正相应亮度序列最大 饱和度 ^^^^的非平滑递减及弥补缺失计算结果,横坐标饱和度 C,纵坐标亮度 L。  Figure 1 shows the non-standard device color visual perception space example color phase surface all merged color coordinates, the middle gray line represents the merged brightness sequence algorithm, the lower gray line represents the linear interpolation to correct the corresponding brightness sequence maximum saturation ^^^^ non-smooth Decrement and make up for missing calculation results, abscissa saturation C, ordinate brightness L.
图 2- 1显示了根据本发明的具体实施例的对彩色数字图像进行视觉立体感知 增强的方法的流程图, 说明了设备颜色视觉感知空间色相位面颜色边界计算流 程。  Figure 2-1 shows a flow diagram of a method for visual stereoscopic perception enhancement of a color digital image in accordance with a particular embodiment of the present invention, illustrating a device color visual perception spatial color phase surface color boundary calculation process.
图 2-2显示了根据本发明的具体实施例的对彩色数字图像进行视觉立体感知 增强的方法的流程图, 说明了彩色数字图像视觉感知亮度调控计算流程。  2-2 shows a flow chart of a method for visual stereoscopic perception enhancement of a color digital image in accordance with an embodiment of the present invention, illustrating a color digital image visual perception brightness control calculation flow.
图 3 为计算柔化卷积模板和像素权重。  Figure 3 shows the calculation of the softened convolution template and pixel weights.
图 4中的 a、 b分别显示了入射光线角度及相关像素亮度的相关性。  A and b in Fig. 4 show the correlation between the angle of incident light and the brightness of the relevant pixel, respectively.
图 5, a标示像素位置, b标示左上方入射光线时的相关像素, c标示右上 方入射光线时的相关像素。  Figure 5, a indicates the pixel position, b indicates the relevant pixel when the light is incident on the upper left side, and c indicates the relevant pixel when the light is incident on the upper right side.
图 6-1原稿图像, 图 6-2经本发明的方法处理后图像。  Figure 6-1 Original image, Figure 6-2 Image processed by the method of the present invention.
图 7-1原稿图像, 图 7-2经本发明的方法处理后图像。  Figure 7-1 Original image, Figure 7-2 Image processed by the method of the present invention.
图 8-1使用 SECr算法计算机程序的典型系统流程。  Figure 8-1 shows a typical system flow for a computer program using the SECr algorithm.
图 8-2使用 SECr算法 IP的电视机典型系统流程。  Figure 8-2 shows the typical system flow of a TV using the SECr algorithm IP.
图 8-3使用 SECr算法 ASIC的电视机典型系统流程。  Figure 8-3 shows the typical system flow of a TV using the SECr algorithm ASIC.
图 8-4使用 SECr算法 ASIC的电子设备典型系统流程。  Figure 8-4 shows the typical system flow of an electronic device using the SECr algorithm ASIC.
具体实施方式 detailed description
实施例 1  Example 1
实施本发明的彩色数字图像视觉立体感知增强流程。  The color digital image visual stereoscopic enhancement process of the present invention is implemented.
(1)计算显示彩色数字图像的设备颜色视觉感知空间色相位面颜色边界数据 库。  (1) Calculate a device color visual perception spatial color phase surface color boundary data database displaying a color digital image.
数据库经由本发明的系统中设备颜色视觉感知空间色相位面颜色边界计算 模块运算完成, 计算包括: (1-1)将设备颜色空间的红、 绿和蓝三原色值变换为 CIELAB空间 L C和 h 值的计算, 由设备颜色空间红、 绿和蓝三原色值变换为 CIELAB空间 L C和 h 值计算单元执行: The database is completed by the device color visual perception spatial color phase surface color boundary calculation module in the system of the present invention, and the calculation includes: (1-1) Converting the red, green and blue primary color values of the device color space into CIELAB space LC and h values, and transforming the three color values of the device color space red, green and blue into CIELAB space LC and h value calculation units :
具有图像显示功能的电子设备典型为 sRGB颜色空间和 D65白场, sRGB空 间 RGB三原色色品查阅: Electronic devices with image display functions are typically sRGB color space and D65 white field, sRGB space RGB three primary color products are available:
Figure imgf000016_0001
yg,max=0.60 Xb,max=0.15
Figure imgf000016_0001
y g , max =0.60 X b , max =0.15
D65白场 CIEXYZ三剌激值查阅:  D65 white field CIEXYZ three 剌 值 value:
Xw=0.950456 Yw=l Zw=l .089058 X w =0.950456 Y w =l Z w =l .089058
由以上参数计算颜色 RGB数值变换 CIEXYZ三剌激值所需 3 X 3矩阵系数: 利用设备白场三原色的 RGB值和 CIEXYZ三剌激值正向变换公式: Calculate the color from the above parameters RGB numerical transformation CIEXYZ three-excited value required 3 X 3 matrix coefficient: Use the RGB value of the three primary colors of the white field of the device and the CIEXYZ triple-excitation value forward transformation formula:
0.9505 Xr,max Xg,max Xb, 0.9505 Xr,max Xg,max Xb,
1 .0000 = Yr,max Yg,max Yb,  1 .0000 = Yr,max Yg,max Yb,
1 .0891 Zr,max Zg,max Zb,  1 .0891 Zr,max Zg,max Zb,
将 3 X 3矩阵系数表示为三原色色品值与亮度值的乘积形式:  The 3 X 3 matrix coefficients are expressed as the product of the three primary color values and the luminance values:
0.9505— (Χτ,π iax/yr, max) Yr, max (Xg^ aax/y"g, max) Yg, max (Xb, nax/yb,max)Yb, max T0.9505—(Χτ,π iax/yr, max) Yr, max ( X g^ aax/y"g, max) Yg, max (Xb, nax/yb,max)Yb, max T
1 .0000 = Yr, max Yg, max Yb, max 11 .0000 = Yr, max Y g , max Yb, max 1
1 .0891 (Zr,n iax/yr, max) Yr, max (Zg,n aax/y"g, max) Yg, max (Zb, nax/yb, max)Yb, max 1 由以上方程计算得到 RGB三原色最大饱和度时的亮度值: 1 .0891 (Zr, n iax/yr, max) Yr, max (Zg, n aax/y"g, max) Yg, max (Zb, nax/yb, max) Yb, max 1 Calculated by the above equation RGB Luminance values at maximum saturation of the three primary colors:
ΥΓ, =0.2126 Yg, =0.7152 Yb, =0.0722 Υ Γ , =0.2126 Y g , =0.7152 Y b , =0.0722
应用以上结果计算得到矩阵 3 X 3系数:
Figure imgf000016_0002
Apply the above results to calculate the matrix 3 X 3 coefficients:
Figure imgf000016_0002
应用以上矩阵系数计算设备颜色 RGB三原色值到 CIEXYZ空间 X Y和 Z 三剌激值的变换,再应用 D65白场三剌激值计算颜色 XYZ值到 CIELAB空间 L C和 h值变换。  Apply the above matrix coefficients to calculate the color of the device RGB three primary colors to the CIEXYZ space X Y and Z three-excited value transformation, and then apply the D65 white field three-excited value to calculate the color XYZ value to the CIELAB space L C and h value transformation.
典型设备由红、 绿和蓝三原色每种 8位合成颜色, 即 23 x 8共 16777216种颜 色标量, 依次由以上计算完成变换。 The typical equipment consists of 8 colors of red, green and blue primary colors, that is, 2 3 x 8 total of 16777216 color scalars, which are successively transformed by the above calculation.
非标设备计算白场和红、 绿和蓝三原色最大饱和度时的 CIEXYZ三剌激值: 使用标准分光光度仪, 按照常规规范测量设备白场三剌激值 Xw' Yw '和 Zw' 计算白场归一化系数 K1 : Ki = 100 / YW' Non-standard equipment calculates the CIEXYZ triacal value when the white field and the maximum saturation of the three primary colors of red, green and blue: The standard spectrophotometer is used to measure the white field triple excitability X w ' Y w ' and Z w according to the conventional specifications. ' Calculate the white field normalization coefficient K 1 : Ki = 100 / Y W '
计算设备白场的 CIEXYZ三剌激值:  Calculate the CIEXYZ triple excitation value of the white field of the equipment:
XW=XW, X Ki , YW=YW, X Ki , ZW=ZW, X Ki X W =X W , X Ki , Y W =Y W , X Ki , Z W =Z W , X Ki
使用标准分光光度仪, 按照常规规范分别测量设备红、绿和蓝三原色最大饱 和度条件下的三剌激值, Χ 、 Υ 和 ΖΛ Xg'、 Yg'和 Zg', Xb'、 Yb'和 zb', 再分 别计算三原色的 CIEXYZ三剌激值:Using a standard spectrophotometer, the tri-maximal values of the maximum saturation of the red, green and blue primary colors of the device are measured according to conventional specifications, Χ, Υ and ΖΛ X g ', Y g ' and Z g ', X b ', Y b 'and z b ', and then calculate the CIEXYZ triple stimuli of the three primary colors:
Figure imgf000017_0001
X K , Zr,max=Zr, X Κ
Figure imgf000017_0001
XK , Z r , max = Z r , X Κ
Xg,max— Xg X Kj , Yg,max— Yg X Kj , Zg,max― Zg X Ki Xg,max— Xg X Kj , Yg,max— Yg X Kj , Zg, ma x― Zg X Ki
,max= , X Ki , Yb,max=Yb, X Ki , Zb,max=Zb, K ,max= , X Ki , Yb,max = Yb, X Ki , Zb, max =Zb, K
用以上计算得到的三原色最大饱和度时 CIEXYZ三剌激值, 替代以上所述 标准方法中的 3 X 3矩阵系数, 以计算得到的白场 CIEXYZ三剌激值替代以上所 述设备标称白场 CIEXYZ三剌激值,应用以上所述标准方法,依次将共 16777216 种颜色的 、 G和 B数值变换为 CIELAB空间 L、 C和 h数值。  Using the CIEXYZ triple excitability value of the maximum saturation of the three primary colors obtained above, instead of the 3 X 3 matrix coefficient in the above standard method, the calculated white field CIEXYZ triple excitatory value is substituted for the nominal white field of the above device. The CIEXYZ triplet value, using the standard method described above, sequentially converts a total of 16,777,216 colors, G and B values into CIELAB space L, C and h values.
(1-2)设备颜色视觉感知空间色相位面颜色边界的计算,由设备颜色视觉感知 空间色相位面颜色边界提取单元执行:  (1-2) Equipment color visual perception spatial color phase surface color boundary calculation, performed by device color visual perception spatial color phase surface color boundary extraction unit:
以 0-359整数表示基准色相位面, 以设备颜色色相 h值四舍五入归并进入相 应基准色相位面, 以 0-100整数表示基准亮度序列, 以颜色 L值四舍五入归并进 入相应亮度序列。 提取色相位面各亮度序列中最大饱和度值 CmaxU, 作为该色相 位面的颜色边界计算数据。 The reference color phase plane is represented by an integer of 0-359, and the h color value of the device color hue is rounded off and entered into the corresponding reference color phase plane. The reference luminance sequence is represented by an integer of 0-100, and the color L value is rounded off and merged into the corresponding luminance sequence. The maximum saturation value C maxU in each luma sequence of the color phase plane is extracted as the color boundary calculation data of the color phase plane.
(1-3)色相位面颜色边界平滑计算,由色相位面颜色边界 ^^^^平滑单元执行: 提取色相位面中最大饱和度值 Cmaxhl具有的亮度 LCmaxhl到最低亮度 L=0 的亮 度序列区间所对应的颜色边界, 以标准线性插值算法计算平滑边界,修整原亮度 序列的最大饱和度 CmaxU非平滑递减或填补边界数据缺失。 计算得到的此部分颜 色边界 CmaxU连同由亮度 LCmaxh 」L=100的亮度序列区间对应的颜色边界 CmaxU, 表示该色相位面的最终应用颜色边界。 色相位面颜色坐标及边界计算如图 1 所 示。 (1-3) Color phase surface color boundary smoothing calculation, performed by the color phase surface color boundary ^^^^ smoothing unit: extracting the maximum saturation value C maxhl of the color phase plane having the brightness L Cmaxhl to the lowest brightness L=0 The color boundary corresponding to the luma sequence interval is calculated by a standard linear interpolation algorithm, and the maximum saturation C maxU of the original luma sequence is non-smoothly decremented or the padding boundary data is missing. The calculated partial color boundary C maxU together with the color boundary C maxU corresponding to the luminance sequence interval of the luminance L Cmaxh ′ L=100 represents the final applied color boundary of the color phase plane. The color phase coordinates and boundary calculations are shown in Figure 1.
以上算法中所称的平滑, 即颜色亮度序列由高到低排列, 其饱和度 CmaxL^J、 于以上序列且大于以下所有序列。饱和度值小于平滑计算值则改用计算值, 大于 计算值则不变。 The smoothing referred to in the above algorithm, that is, the color luminance sequence is arranged from high to low, and its saturation C max L^J is in the above sequence and is greater than all the following sequences. If the saturation value is less than the smoothed calculation value, the calculated value is used instead, and the larger than the calculated value is unchanged.
将以上计算结果存储为数据库。 数据按照首序色相位面 h次序亮度序列 L 排序, 共 36360行。 以上步骤 (1)计算流程如图 2-1所示。 Store the above calculation results as a database. The data is in the order of the first order color phase surface h sequence brightness sequence L Sorted, a total of 36,360 lines. The calculation process of the above step (1) is shown in Figure 2-1.
(2)完成彩色数字图像的红、 绿和蓝三原色值转换为 CIELAB空间 L、 C和 h 值并归并入相应色相位面及亮度序列,由彩色数字图像像素颜色模式正向转换以 及归并色相位面和亮度序列模块执行, 计算包括:  (2) The red, green and blue primary color values of the completed color digital image are converted into CIELAB space L, C and h values and merged into the corresponding color phase plane and brightness sequence, and the color digital image pixel color mode is forward-converted and the merged color phase is converted. The face and brightness sequence modules are executed, and the calculations include:
(2-1)彩色数字图像像素颜色 RGB值转换为 CIELAB空间的 L、 C和 h值的 计算, 由彩色数字图像像素颜色 RGB值转换为 CIELAB空间的 L、 C和 h值的 计算单元执行:  (2-1) Color digital image Pixel color RGB values are converted to CIELAB space L, C and h values, calculated by the color digital image pixel color RGB values converted to CIELAB space L, C and h values of the calculation unit:
使用显示图像的设备标称或图像本身嵌入的白场和红、绿和蓝三原色相应参 数, 应用 CIE 推荐的标准算法, 将图像像素的红、 绿和蓝三原色表示的颜色转 换为 CIEXYZ三剌激值及 CIELAB空间 L、 C和 h值,算法程序及相关参数与步 骤 (1)相同。  Use the device nominal image to display the image or the white field and the corresponding parameters of the red, green and blue primary colors embedded in the image itself, and apply the standard algorithm recommended by CIE to convert the color represented by the red, green and blue primary colors of the image pixel into CIEXYZ The value and the CIELAB space L, C and h values, the algorithm program and related parameters are the same as step (1).
非标设备上显示图像需测量计算设备白场和红、绿和蓝三原色最大饱和度时 的 CIEXYZ三剌激值, 算法程序及相关参数与步骤 (1)相同。  The image displayed on the non-standard device needs to measure the CIEXYZ triple-excitation value of the white level of the computing device and the maximum saturation of the three primary colors of red, green and blue. The algorithm program and related parameters are the same as steps (1).
(2-2)像素颜色色相位面和亮度序列归并计算,由像素颜色色相位面和亮度序 列归并单元执行:  (2-2) Pixel color phase plane and luminance sequence merge calculation, performed by pixel color phase plane and luminance sequence merge unit:
将图像颜色空间划分为 0-359共 360个基准色相位面, 以色相 h值四舍五入 归并进入相应基准色相位面,将色相位面中亮度 L范围划分为 0-100共 101个基 准序列, 以亮度 L值四舍五入归并进入相应亮度序列, 使像素颜色可用整数色 相 h和亮度 L调用, 但是仍保持 h、 L和 C原有的 8位浮点数据精度不变, 这是 精确计算亮度增强的保证之一, 同时也是保持 h、 L和 C数值逆向变换为 RGB 数值的精度要求。  The image color space is divided into 0-359 total 360 reference color phase planes, the h phase h value is rounded off and merged into the corresponding reference color phase plane, and the luminance phase range in the color phase plane is divided into 0-100 total 101 reference sequences, The brightness L value is rounded off and merged into the corresponding brightness sequence, so that the pixel color can be called with the integer hue h and the brightness L, but the original 8-bit floating point data precision of h, L and C is kept unchanged, which is the guarantee for accurately calculating the brightness enhancement. One, also the accuracy requirement to keep the h, L, and C values inversely transformed into RGB values.
(3)选择性计算图像中相关内容颜色柔化。  (3) Selectively calculate the color of the relevant content in the image.
本发明的柔化算法主要用于肤色, 首先以颜色色相选择肤色区间, 再以区间 中颜色饱和度值区分肤色,以目标像素与卷积模板中相关像素亮度差阈值判断有 效像素数量并确定计算卷积平均值。 选择性柔化计算包括:  The softening algorithm of the present invention is mainly used for skin color, firstly selecting the skin color interval by color hue, and then distinguishing the skin color by the color saturation value in the interval, determining the effective pixel number and determining the calculation by the target pixel and the correlation pixel brightness difference threshold in the convolution template. Convolution average. Selective softening calculations include:
(3-1)设置彩色数字图像柔化内容所在视觉感知色相区间的边界 Hcx和 HDX, 以及区间两边外沿的过渡区宽度 KHCX和 KHDX, Hcx设为 90° , HDX设为 340° 可适合多数图像柔化需要。 KHCX和 KHDX均设为 10, 可实现柔化内容与不需柔化 内容间亮度平滑变化。色相区间的高端过渡区的外沿色相值: Hwcx=90° +10° , 低端: HWDX=340° -10° 。 (3-1) Set the boundary H cx and H DX of the visual perception hue interval where the color digital image softening content is located, and the transition zone widths K HCX and K HDX of the outer edges of the interval, H cx is set to 90°, H DX is set 340° is suitable for most image softening needs. Both K HCX and K HDX are set to 10 for smooth transitions between softened content and soft content. The outer edge hue value of the high-end transition zone of the hue interval: H wcx =90° +10° , low end: H WDX =340° -10°.
只对 h≤90° 或11≥340° 色相位面内的颜色保留规范柔化卷积计算结果 LJpi,i, 过渡区 90° -100° 色相位面颜色中由计算柔化得到的视觉感知亮度调整量, 从 90° 到 100° 计算调整量平滑变化到 0。 340° 到 330° 色相位面同样计算亮度调 整量平滑变化。 Only for h ≤ 90 ° or 11 ≥ 340 ° color phase in the color retention specification softening convolution calculation result L Jpi , i, Transition zone 90° -100° The color perception of the color phase surface color is calculated by the softening of the visual perception. From 90° to 100°, the adjustment amount is smoothly changed to 0. The 340° to 330° color phase plane also calculates a smooth change in the brightness adjustment amount.
(3-2) 设置颜色视觉感知饱和度比例高限阈值 CCAOX和高端过渡区宽度系数 BIcxi , CGAOX设为 0.70, 可包括多数肤色颜色, BICX1设为 0.10, 可基本实现柔 化内容平滑过渡。 (3-2) Set the color visual perception saturation ratio high threshold C CAOX and the high-end transition width coefficient BIcxi, C GAOX to 0.70, which can include most skin color, BI CX1 is set to 0.10, which can basically achieve softening content smoothing transition.
只对以上指定色相区间内并且饱和度比例值在 0.7以下的颜色保留规范柔化 卷积计算结果 LIpi,j, 对饱和度比例在 0.7到 0.8的颜色计算柔化得到的视觉感知 亮度调整量, 从 0.7到 0.8计算调整量平滑变化到 0。 Only for the color specified in the above specified hue interval and the saturation ratio value is below 0.7, the specification softening convolution calculation result L Ipi ,j, and the visual perception brightness adjustment amount obtained by softening the color with a saturation ratio of 0.7 to 0.8 From 0.7 to 0.8, the adjustment amount is smoothly changed to 0.
(3-3) 设置柔化卷积模板及相关像素权重,  (3-3) Set the softening convolution template and associated pixel weights,
设置以柔化像素为中心的 5 X 5像素作为柔化计算模板, L1j表示中心像素, 以下标 1j表示模板上像素位置, i表示列, j表示行。像素权重设置主要与其距模板 中心距离相关, 权重设置为: Set 5 × 5 pixels centered on the softened pixel as the softening calculation template, L 1j represents the center pixel, and the following label 1j represents the pixel position on the template, i represents the column, and j represents the row. The pixel weight setting is mainly related to the distance from the center of the template, and the weight is set to:
Li-2,j-2¾ 2, Li—i,j-2为 1, 1^2为 2, L,卜 为 1, Li+2,j-2¾ 2, Li-2, j-23⁄4 2, Li-i, j-2 is 1, 1^ 2 is 2, L, Bu is 1, Li+2, j-23⁄4 2,
Li-2,j—i为 1, Li—i,j—i为 4, Li,j—i为 4, L,卜 ij-i为 4, Li+2,j-i¾ 1, Li -2 , j - i is 1, Li - i, j - i is 4, Li, j - i is 4, L, ij - i is 4, Li + 2, j - i3⁄4 1,
Li-2j为 2, Li-ij为 4, 为 8, L1+ 为4, Li+2,j为 2, L i-2 j is 2, Li-ij is 4, is 8, L 1+ is 4, Li+ 2 , j is 2.
Li-2,j+i¾ 1, Li—ij+i为 4, Lij+i为 4, LH -ij+i为 4, Li+2,j+i¾ 1,  Li-2, j+i3⁄4 1, Li-ij+i is 4, Lij+i is 4, LH-ij+i is 4, Li+2, j+i3⁄4 1,
Li-2,j+2¾ 2, Li-i,j+2¾ 1, Li,j+2为 2, LH - 为 1, Li+2,j+2为 2 Li-2, j+23⁄4 2, Li-i, j+23⁄4 1, Li, j+ 2 is 2, LH - is 1, Li+ 2 , j+2 is 2
以上如图 3所示。  The above is shown in Figure 3.
(3-4) 设置模板上相关像素间颜色视觉感知亮度差阈值 LYU (3-4) Set the visual perception brightness difference threshold L YU between related pixels on the template
本发明主要以计算像素间颜色视觉感知亮度的加权平均实现柔化图像中人 物肤色的目标, 像素间颜色视觉感知亮度差阈值 LYl^ 置极为关键, 设为 3-5可 适合大多数图像柔化的要求。 模板中心像素与另外像素的亮度差小于 LYU则记该 像素为有效像素, 记为计算柔化的根据之一, 大于 LYU的像素颜色一般为肤色以 外内容, 记为不计算柔化的根据之一。 The invention mainly realizes the goal of softening the skin color of the person in the image by calculating the weighted average of the visual perception brightness of the pixels. The color visual perception brightness difference threshold L Yl ^ between the pixels is extremely critical, and the setting is 3-5, which is suitable for most images. Requirements. If the difference between the brightness of the template center pixel and the other pixel is less than L YU , the pixel is regarded as a valid pixel, which is recorded as one of the basis for calculating the softening. The color of the pixel larger than L YU is generally the content other than the skin color, and is recorded as the basis for not calculating the softening. one.
(3-5) 设置模板上有效像素卷积阈值 Si^¾Sw和计算柔化(3-5) Set the effective pixel convolution threshold on the template Si^3⁄4S w and calculate the softening
Figure imgf000019_0001
28,结果为相邻像素 8 个当中有两个及以上与中心像素亮度差大于阈值 LYU就不计算柔化。
Figure imgf000019_0001
28, the result is that no more than two of the adjacent pixels 8 or more and the central pixel luminance difference is greater than the threshold L YU does not calculate the softening.
设置与中心像素相隔像素的有效像素的卷积阈值 Sw为 14, 结果为相隔像素 16个当中有 5个及以上与中心像素亮度差大于阈值 LYU就不计算柔化。 The convolution threshold S w of the effective pixels of the pixels spaced apart from the center pixel is set to 14, resulting in spaced pixels The softening is not calculated when there are 5 or more of the 16 and the central pixel luminance difference is greater than the threshold L YU .
计算模板上有效像素加权之和, 即卷积计算, 如结果大于 Si^¾Sw, 则计算 卷积的有效像素平均值作为中心像素柔化后的亮度值 LIpi,j。设置阈值 Si^¾Sw, 可 适当区分肤色面积之上的其他图像内容使之免于柔化, 例如眉毛、 睫毛、头发和 服饰等。 Calculate the sum of the effective pixel weights on the template, that is, the convolution calculation. If the result is greater than Si^3⁄4S w , calculate the effective pixel average of the convolution as the luminance value L Ipi ,j after the center pixel is softened. Set the threshold Si^3⁄4S w to properly distinguish other image content above the skin area from softening, such as eyebrows, eyelashes, hair, and clothing.
(3-6) 设置像素视觉感知亮度调整量实际应用的比例系数 ^。  (3-6) Set the scale factor ^ of the practical application of the pixel visual perception brightness adjustment amount.
为避免肤色经柔化计算后过于平滑而显得虚假,对经柔化计算改变的亮度值 设置保留适当部分, BM设为 0.15可适合大多数图像需要。 In order to prevent the skin color from being too smooth after the softening calculation and appear false, the brightness value setting changed by the softening calculation is reserved for the appropriate part, and B M is set to 0.15, which is suitable for most image needs.
LYONGj,i= Ljpij j + ( LAIJ -Ljpij ) X 0.15 LYONGj,i = Ljpij j + ( LAIJ -Ljpij ) X 0.15
其中, LTON 1为中心像素实际应用的亮度值。 Among them, L TON 1 is the brightness value actually applied by the center pixel.
(4)计算图像像素颜色视觉感知亮度增强。  (4) Calculate image pixel color visual perception brightness enhancement.
(4-1)确定真实景物成像条件下的入射光线在彩色数字图像中的投影位置,设 置目的像素的入射光线强度当量 Al, 数值 0.4-0.6, 入射光线两边对称位置的并 行光线强度当量为 Al_l和 Al_2, 表示该位置像素亮度与目的像素亮度的相关 性:  (4-1) Determine the projection position of the incident light in the color digital image under the real scene imaging condition, set the incident light intensity equivalent Al of the target pixel, the value is 0.4-0.6, and the parallel light intensity equivalent of the symmetric position on both sides of the incident light is Al_l And Al_2, indicating the correlation between the pixel brightness of the location and the brightness of the destination pixel:
Al_l = (1-A1) X [(90-α) / 90]  Al_l = (1-A1) X [(90-α) / 90]
Al_2 = 1- Al- AlJ  Al_2 = 1- Al- AlJ
其中, ct为入射光线在图像上的投影与垂线的夹角。 以上如图 4所示。 将图像颜色视觉感知亮度增强与真实景物成像环境的入射光线特性相关,是 本技术发明的特点之一。  Where ct is the angle between the projection of the incident ray on the image and the perpendicular. The above is shown in Figure 4. It is one of the features of the present invention to correlate image color perception brightness enhancement with incident light characteristics of a real scene imaging environment.
(4-2)计算目的像素与相关像素间的亮度差值 ΔΙ^, 相关像素即目的像素入射 光方向相邻像素及其两边对称方向近邻像素, 计算它们与目的像素间的亮度差 ALlj ; 典型条件包括: (4-2) Calculating the luminance difference ΔΙ^ between the target pixel and the related pixel, the relevant pixel, that is, the adjacent pixel in the incident light direction of the target pixel and the neighboring pixels in the symmetric direction of both sides, and calculating the luminance difference AL lj between them and the target pixel ; Typical conditions include:
左上方入射光线条件下计算:  Calculated under the incident light conditions at the upper left:
ALi,j= ( LAi,j - LBi-ij-i ) X A1 + (LAi,j - LBij-i) X Al—l + (LAi,j - LBi-1,j) X Al_2 正上方入射光线条件下计算: ALi,j= ( L Ai ,j - LBi-ij-i ) X A1 + (L Ai ,j - L B ij-i) X Al—l + (L Ai ,j - L Bi-1 ,j) X Al_2 is calculated directly under incident light conditions:
ALi,j= ( LAi,j - LBij-i ) X A1 + (LAi,j - LBi-1,j) X Al—l + (LAi,j - LBi+1,j) X Al_2 右上方入射光线条件下计算: ALi,j= ( L Ai ,j - L B ij-i ) X A1 + (L Ai ,j - L Bi-1 ,j) X Al—l + (L Ai ,j - L Bi+1 ,j) X Al_2 is calculated under incident light conditions at the upper right:
ALi,j= ( LAi,j - LBi+ij-i ) X A1 + (LAi,j - LBij-i) X Al—l + (LAi,j - LBi+1,j) X Al_2 以上, A1 j表示图像中目的像素, 即调控亮度的像素, LAl,j表示该像素亮度; 至 B1+1,J+1共 8个像素为相关像素, LBW^至 LBL+1,J+1表示相应像素亮度, 入射光线条件设定 8种, 即入射光源自左上、 正上、 右上、 正右、 右下、 正 下、 左下和正左。 以上如图 5所示。 ALi,j= ( L Ai ,j - LBi+ij-i ) X A1 + (L Ai ,j - L B ij-i) X Al—l + (L Ai ,j - L Bi+1 ,j) X Above Al_2, A 1 j represents the target pixel in the image, that is, the pixel that regulates the brightness, and L Al , j represents the brightness of the pixel; Up to 8 pixels of B 1+1 and J+1 are related pixels, LBW^ to L BL+1 , J+1 indicates the brightness of the corresponding pixel, and 8 kinds of incident light conditions are set, that is, the incident light source is from the upper left, the upper side, Top right, right right, bottom right, down, left bottom, and right left. The above is shown in Figure 5.
(4-3)计算像素颜色视觉感知亮度表现的景物空间感知当量 DLX (4-3) Calculating the visual space perception equivalent of the pixel color visual perception brightness DL X
(4-3-1)与观察同向光照条件下:  (4-3-1) and observation of the same direction of illumination:
DLlJ = (LALJ / 100) D LlJ = (L ALJ / 100)
(4-3-2)与观察逆向光照条件下:  (4-3-2) and under observation of reverse illumination conditions:
DLlJ = (l- LAL0 / 100) D LlJ = (l- L AL0 / 100)
(4-3-3)与观察近似垂直光照条件下:  (4-3-3) and observed under approximate vertical lighting conditions:
设置 LZH为目标亮度, 即获得最高视觉感知清晰度的亮度值, 数值 75-85, 适 合多数图像需要。 Set L ZH to the target brightness, which is the brightness value for the highest visual perception resolution, with a value of 75-85, suitable for most image needs.
如果 LAL,」 > LZH, DLlJ = (100-LALJ) /(100- LZH) If L AL ,"> L ZH , D LlJ = (100-L ALJ ) / (100- L ZH )
如果 LAij < LzH' DLij = LAij /LZH  If LAij < LzH' DLij = LAij /LZH
在准确设置入射光源条件下, 将图像颜色亮度对比度调控量与颜色亮度相 关, 即图像清晰度提升与颜色的中性灰亮度值量化相关, 实现以图像中景物清晰 度不同表现景物所处空间深度不同及增强景物立体感的目的,设置对相关性的调 整, 可在一定程度改变对图像空间深度感知和景物立体感知。这也是本技术发明 的特点之一。  Under the condition of accurately setting the incident light source, the image color brightness contrast adjustment amount is related to the color brightness, that is, the image sharpness improvement is related to the neutral gray brightness value of the color, and the depth of the scene in which the scene is different in the image is realized. Differently and to enhance the stereoscopic effect of the scene, setting the adjustment of the correlation can change the depth perception of the image space and the stereoscopic perception of the scene to a certain extent. This is also one of the features of the present invention.
(4-4)计算像素颜色视觉感知亮度调控后亮度 LTX(4-4) Calculate the pixel color visual perception brightness control brightness L TX ,
Liij = LAi,j+ ALij X DLij X KL  Liij = LAi,j+ ALij X DLij X KL
其中, KL为设置的调控比例系数, 数值 1.0-2.0。  Among them, KL is the set proportional coefficient, the value is 1.0-2.0.
(4-5)计算像素颜色视觉感知亮度的彩色灰亮度当量  (4-5) Calculating the color gray brightness equivalent of the pixel color visual perception brightness
(4-5-1)计算像素颜色视觉感知色相的彩色灰亮度当量 DCAIx和调控后亮度 LT¾j, (4-5-1) Calculate the color gray brightness equivalent D CAIx and the adjusted brightness L T 3⁄4j of the pixel color visual perception hue,
对显示彩色数字图像设备 0° -359° 各色相位面的 LCMAXHL以其中最大值为基 数进行归一化,得到各色相位面的彩色灰亮度当量 DCAIx。对于 sRGB颜色空间 D65 白场的颜色, 103 ° 黄色 DCAIx最大为 1, 306° 蓝色 DCAIx最小为 0.3331。 L CMAXHL which displays the phase planes of the color digital image devices from 0° to 359° is normalized with the maximum value as the base, and the color gray luminance equivalent D CAIx of the phase planes of the respective colors is obtained. For the sRGB color space D65 white field color, 103 ° yellow D CAIx maximum is 1, 306 ° blue D CAIx minimum is 0.3331.
像素颜色视觉感知亮度 LAl,j大于 LCmaxh^ †算调控亮度: Pixel color visual perception brightness L Al , j is greater than L Cmaxh ^ 调控 calculation brightness:
LT2i,j = Lli,j+ ((LAij" LcmaxLl)/( 100- LcmaxLl) ^ DcAIx) ^ Κχ2  LT2i,j = Lli,j+ ((LAij" LcmaxLl)/( 100- LcmaxLl) ^ DcAIx) ^ Κχ2
其中, KT2为设置的调控系数, 数值 1.0-2.0。 Among them, K T2 is the set control coefficient, the value is 1.0-2.0.
(4-5-2)计算像素颜色视觉感知饱和度的彩色灰亮度当量 DBAOx和调控后亮度 LT3i,j ' (4-5-2) Calculate the color gray brightness equivalent D BAOx and the adjusted brightness of the pixel color visual perception saturation L T3i,j '
像素颜色视觉感知亮度 LAld大于 LCmaxh^ †算像素颜色视觉感知饱和度 CAl,j 的彩色灰亮度当量 DBAOx: Pixel color visual perception brightness L Ald is greater than L Cmaxh ^ 像素 pixel color visual perception saturation C Al , j color gray brightness equivalent D BAOx:
DBAOx= ( CAij CmaxLl ) DBAOx = ( CAij CmaxLl )
计算调整后亮度:  Calculate the adjusted brightness:
LT3i,j = LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) DBAOX) Κτ3  LT3i,j = LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) DBAOX) Κτ3
其中, KT3为调控系数, 数值范围 0.0-3.0, 典型 1.0-2.0。 Among them, K T3 is a regulation coefficient with a value range of 0.0-3.0, typically 1.0-2.0.
在以上对颜色中性灰亮度增强的基础上,进一步将图像清晰度提升与颜色的 彩色灰亮度值量化相关,进而加强了以图像中景物清晰度不同表现景物所处空间 深度不同及增强景物立体感的效果。 这也是本技术发明的特点之一。  On the basis of the above enhancement of the color neutral gray brightness, the image sharpness enhancement is further correlated with the color gray light brightness value of the color, thereby enhancing the spatial depth of the scene in which the scene is different in the image and enhancing the scene stereo. The effect of feeling. This is also one of the features of the present invention.
(5)将像素颜色的 h、 C和 LT¾j 或 L j数值逆向变换为 sRGB空间 R、 G和 B数值。 根据本发明的具体实施方式, 将图像像素颜色饱和度。、色相 h、和亮度 LT¾j 或 L j数值计算为规范1、 G和 B值。 根据本发明的优选技术方案, 调用本发明的 系统中的图像像素颜色模式逆向变换及规范化模块, 计算包括: (5) The values of h, C, and L T3⁄4j or L j of the pixel color are inversely transformed into sRGB spaces R, G, and B values. According to a particular embodiment of the invention, the image pixels are color saturated. The hue h, and the luminance L T3⁄4j or L j values are calculated as the specifications 1, G and B values. According to a preferred technical solution of the present invention, an image pixel color mode inverse transform and normalization module in the system of the present invention is invoked, and the calculation includes:
使用 CIE推荐的标准方法, 以图像像素颜色正向变换得到且未改变的的饱和 度。、 色相角 h值以及经计算增强后得到的亮度 1^ 或1^,」数值计算为设备的红、 绿和蓝三原色值。 此算法为以上步骤 (2)的逆运算, 由像素颜色 CIELAB参数计算 Using the standard method recommended by the CIE, the image pixel color is forward transformed to the unchanging saturation. The hue angle h value and the brightness obtained by the calculation enhancement 1^ or 1^," are calculated as the three primary colors of the device, red, green and blue. This algorithm is the inverse of the above step (2), calculated by the pixel color CIELAB parameter
CIEXYZ三剌激值所需白场 CIEXYZ三剌激值与正向计算相同, 由像素颜色The white field required for CIEXYZ triple excitatory value CIEXYZ triple excitatory value is the same as the forward calculation, by pixel color
CIEXYZ三剌激值计算 RGB值所需 3 X 3矩阵系数由以上步骤 (2)所用矩阵 3 X 3系 数求逆获得: CIEXYZ triacal value calculation RGB value required 3 X 3 matrix coefficient is obtained by inverting the matrix 3 X 3 system number used in the above step (2):
- 3. 2406 - 0. 9689 0. 0557 - - 1. 5372 1. 8758 - 0. 2040  - 3. 2406 - 0. 9689 0. 0557 - - 1. 5372 1. 8758 - 0. 2040
- 0. 4986 0. 0415 1. 0570 分别对计算得到的 R、 G和 B值取整, 并对大于 255的数值规范化为 255, 对小于 0的数值规范化为 0。 实施例 2使用本发明的 SECr算法的典型系统  - 0. 4986 0. 0415 1. 0570 The calculated R, G and B values are rounded, respectively, and the value greater than 255 is normalized to 255, and the value less than 0 is normalized to 0. Embodiment 2 A typical system using the SECr algorithm of the present invention
(1)使用 SECr算法计算机程序的典型系统流程  (1) Typical system flow of computer program using SECr algorithm
以计算机硬盘 HD作为提交 SECr算法的典型载体, 同样功能的载体还包括 CD、 DVD, U盘等, 以及经授权由网络调用 SECr算法。 SECr算法以程序方式 由计算机 CPU+GPU调用, 在 RAM中运行。 彩色数字图像存储在计算机硬盘中 由 SECr算法程序调用, 经 SECr算法处理后再储存回硬盘中。 图像数据可以拷 贝在 CD、 DVD, U盘等载体和另外硬盘中, 也可以通过网络传输至指定位置。 The computer hard disk HD is used as a typical carrier for submitting the SECR algorithm, and the same function carrier also includes a CD, a DVD, a USB disk, etc., and is authorized to call the SECR algorithm by the network. The SECr algorithm is called programmatically by the computer CPU + GPU and runs in RAM. Color digital images are stored on your computer's hard drive Called by the SECR algorithm program, processed by the SECR algorithm and then stored back to the hard disk. The image data can be copied to a carrier such as a CD, a DVD, a USB flash drive, or another hard disk, or can be transmitted to a specified location through a network.
SECr 算法程序可以处理单帧图像和帧序列图像。 单帧图像格式可 是. tif、 .bmp等未压缩格式, 也可是 .jpg等压缩格式。 帧序列图像格式可是通 用. MOV、 .AVI等, 也可使用专用 I/O处理相关格式文件。 实时观看 SECr算法 变换图像效果的显示器数量可以按需配置。 系统如图 8-1所示。  The SECr algorithm program can process single frame images and frame sequence images. The single-frame image format can be an uncompressed format such as .tif or .bmp, or a compression format such as .jpg. The frame sequence image format can be general. MOV, .AVI, etc., and can also use the dedicated I/O to process related format files. Watching the SECr algorithm in real time The number of displays that transform image effects can be configured as needed. The system is shown in Figure 8-1.
(2) 使用 SECr算法 IP的典型系统流程  (2) Typical system flow using the SECr algorithm IP
以电视机主芯片作为 SECr算法 IP的典型应用, IP中 gamma校正模块使用 的 R、 G和 B各色阶查找表可根据电视机主芯片中特殊 gamma设置进行调整。 系统如图 8-2所示。  Using the TV main chip as the typical application of the SECr algorithm IP, the R, G and B color gradation lookup tables used by the gamma correction module in IP can be adjusted according to the special gamma settings in the main chip of the TV. The system is shown in Figure 8-2.
(3) 使用 SECr算法 ASIC的电视机典型系统流程  (3) Typical system flow of TV using SECr algorithm ASIC
以电视机作为 SECr算法 ASIC的典型应用, 设置与电视机匹配的 I/O获取 视频图像颜色 RGB数据。 系统如图 8-3所示。  Using a TV as a typical application of the SECr algorithm ASIC, set the I/O matching video image to obtain the video image color RGB data. The system is shown in Figure 8-3.
(4) 使用 SECr算法 ASIC的电子设备典型系统流程  (4) Typical system flow of electronic equipment using SECr algorithm ASIC
应用 FECr算法 ASIC的设备还包括笔记本电脑、平板电脑、手机、游戏机、 LCD显示器、 计算机显卡等, 系统如图 8-4所示。  Applications using the FECr algorithm ASIC also include notebook computers, tablet computers, mobile phones, game consoles, LCD monitors, computer graphics cards, etc., as shown in Figure 8-4.
以上具体实施例仅用于说明本发明的技术方案而非限制,尽管参照上述实施 例详细描述了本发明,本领域的普通技术人员应当理解,对本发明的技术方案进 行修改或等同替换, 都不脱离本发明的技术方案的实质和保护范围, 其均应涵盖 在本发明的权利要求范围内。  The above specific embodiments are only used to illustrate the technical solutions of the present invention and are not intended to be limiting, and the present invention will be described in detail with reference to the above embodiments, and those skilled in the art should understand that the technical solutions of the present invention are modified or equivalently replaced. The spirit and scope of the technical solutions of the present invention are intended to be within the scope of the appended claims.

Claims

权利要求 Rights request
1、 对彩色数字图像进行视觉立体感知增强的方法, 其特征在于, 所述方法 包括以下步骤:  A method for performing visual stereoscopic enhancement on a color digital image, the method comprising the steps of:
(1) 计算显示彩色数字图像的设备的视觉感知空间的 360个色相位面的颜 色边界, 提取边界上饱和度 CmaxU和最大饱和度 Cmaxhl及其亮度 LCmaxhl; (1) calculating the color boundary of 360 color phase planes of the visual perceptual space of the device displaying the color digital image, extracting the saturation C maxU and the maximum saturation C maxhl on the boundary and its brightness L Cmaxhl;
(2)正向变换彩色数字图像像素颜色 R、 G和 B数值为 CIELAB空间的 L、 C和 h数值, 其中, h为色相角, L为亮度、 C为饱和度;  (2) Forward-converted color digital image pixel color R, G, and B values are the L, C, and h values of CIELAB space, where h is the hue angle, L is the brightness, and C is the saturation;
(3) 确定真实景物成像条件下的入射光线在彩色数字图像中的投影位置, 设置目的像素的入射光线强度当量 Al, 数值范围 0.0-1, 典型 0.4-0.6, 入射光线 两边对称位置的并行光线强度当量为 Al_l和 Al_2, 表示该位置像素亮度与目 的像素亮度的相关性:  (3) Determine the projection position of the incident light in the color digital image under the real scene imaging condition, set the incident light intensity equivalent Al of the target pixel, the numerical range is 0.0-1, typically 0.4-0.6, and the parallel rays of the symmetric position on both sides of the incident light The intensity equivalents are Al_l and Al_2, which indicate the correlation between the pixel brightness at that location and the brightness of the destination pixel:
Al l =(1-Α1)Χ[(90-α)/90]  Al l =(1-Α1)Χ[(90-α)/90]
Al_2= 1-Al-AlJ  Al_2= 1-Al-AlJ
其中, ct为入射光线在图像上的投影与垂线的夹角;  Where ct is the angle between the projection of the incident ray on the image and the perpendicular;
(4) 计算目的像素与相关像素间的亮度差值 ΔΙ^, 相关像素即目的像素入 射光方向相邻像素及其两边对称方向近邻像素,计算它们与目的像素间的亮度差 Δ ,  (4) Calculate the luminance difference ΔΙ^ between the target pixel and the related pixel, and the relevant pixel, that is, the adjacent pixel in the direction of the light incident and the neighboring pixels in the symmetric direction of both sides, calculate the luminance difference Δ between them and the target pixel.
左上方入射光线条件下计算:  Calculated under the incident light conditions at the upper left:
ALij=(LAij - LBi-ij-i) XA1 + (LAi,j - LBij-i) X A1—1 + (LAi,j - LBi-1,j) X Al_2 正上方入射光线条件下计算: AL i j=(L A ij - LBi-ij-i) XA1 + (L Ai ,j - L B ij-i) X A1—1 + (L Ai ,j - L Bi-1 ,j) X Al_2 Positive Calculated under the incident light above:
ALij=(LAij - LBij-i) XA1 + (LAi,j - LBi-1,j) X Al_l + (LAi,j - LBi+ij) Al_2 右上方入射光线条件下计算: AL i j=(L A ij - L B ij-i) XA1 + (L Ai ,j - L Bi-1 ,j) X Al_l + (L Ai ,j - L Bi+ ij) Al_2 Under the right upper incident light condition Calculation:
ALij=(LAij - LBi+ij-i) XA1 + (LAij - LBij-i) X Al_l + (LAi,j - LBi+ij) Al_2 其中, A1j表示图像中目的像素, 即调控亮度的像素, LAl,j表示该像素亮度; 中心像素 A1j四周共 8个像素, 自左上角顺时针排列分别为: AL i j=(L A ij - LBi+ij-i) XA1 + (L A ij - L B ij-i) X Al_l + (L Ai ,j - L Bi+ ij) Al_2 where A 1j represents the purpose in the image Pixels, that is, pixels that regulate brightness, L Al , j represent the brightness of the pixel; a total of 8 pixels around the center pixel A 1j , clockwise from the upper left corner are:
Bi-i,j-i, Bij_i , Bi+ij_i, Bi+ij, Bi+ij+i, Bij+i , Bi_ij+i, Bi_ij,  Bi-i,j-i, Bij_i, Bi+ij_i, Bi+ij, Bi+ij+i, Bij+i, Bi_ij+i, Bi_ij,
至 LB^表示相应像素亮度,  To LB^ indicates the corresponding pixel brightness,
入射光线条件设定 8种, 与上述像素位置相关, 即入射光源自左上、 正上、 右上、 正右、 右下、 正下、 左下和正左;  There are 8 kinds of incident light conditions, which are related to the above pixel positions, that is, the incident light source is from the upper left, the upper right, the upper right, the right right, the lower right, the lower right, the lower left and the right left;
(5) 计算像素颜色视觉感知亮度表现的景物空间感知当量 D j (5) Calculating the visual space perception equivalent of the pixel color visual perception brightness Dj
(5-1) 与观察同向光照条件下: DLlJ = (LAlJ / 100) (5-1) Under the same illumination conditions as observation: D LlJ = (L AlJ / 100)
(5-2) 与观察逆向光照条件下:  (5-2) Under observation of reverse illumination conditions:
DLlJ = (l- LAl0 / 100) D LlJ = (l- L Al0 / 100)
(5-3 ) 与观察近似垂直光照条件下:  (5-3) Under observation of approximate vertical illumination conditions:
设置 LZH为目标亮度, 即获得最高视觉感知清晰度的像素亮度值, 数值范围 50-95, 典型 75-85, Set L ZH to the target brightness, which is the pixel brightness value for the highest visual perception resolution, with a range of 50-95, typically 75-85.
如果 LAl,」 > LZH, DLlJ = (100-LAlJ) /(100- LZH) If L Al ,"> L ZH , D LlJ = (100-L AlJ ) / (100- L ZH )
如果 LAij < LZH' Duj = LAij /LZH;  If LAij < LZH' Duj = LAij / LZH;
(6) 计算像素颜色视觉感知亮度调控后亮度 LTl,j, (6) Calculate the brightness of the pixel color visual perception brightness control L Tl ,j,
LTIJ = LAi,j+ ALij X Du,j KL  LTIJ = LAi,j+ ALij X Du,j KL
其中, KL为设置的调控比例系数, 数值范围 0.0—3.0, 典型 1.0-2.0;  Where KL is the set regulation factor, the value range is 0.0-3.0, typically 1.0-2.0;
(7) 计算像素颜色视觉感知亮度的彩色灰亮度当量,  (7) Calculate the color gray brightness equivalent of the pixel color visual perception brightness,
( 7-1 ) 计算像素颜色视觉感知色相的彩色灰亮度当量 DCAIx和调控后亮度( 7-1 ) Calculating the color gray brightness equivalent D CAIx and the adjusted brightness of the pixel color visual perception hue
LT¾j, L T 3⁄4j,
对显示彩色数字图像设备 0° -359° 各色相位面的 LCmaxhl以其中最大值为基 数进行归一化计算, 得到各色相位面的彩色灰亮度当量 DCAIxThe L Cmaxhl of the color surface of the color digital image device is normalized by the maximum value, and the color gray brightness equivalent D CAIx of each color phase surface is obtained .
像素颜色视觉感知亮度 LAl,j大于 LCmaxh 」计算调控后亮度: Pixel color visual perception brightness L Al , j is greater than L Cmaxh ” Calculated brightness after adjustment:
LT2i,j = Lli,j+ ((LAij" LcmaxLl)/( 100- LcmaxLl) ^ DcAIx) ^ Κχ2  LT2i,j = Lli,j+ ((LAij" LcmaxLl)/( 100- LcmaxLl) ^ DcAIx) ^ Κχ2
其中, KT2为设置的调控系数, 数值范围 0.0-3.0, 典型 1.0-2.0, Where K T2 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0,
(7-2)计算像素颜色视觉感知饱和度的彩色灰亮度当量 DBAOx和调控后亮度(7-2) Calculate the color gray brightness equivalent D BAOx and the adjusted brightness of the pixel color visual perception saturation
LT3i,j' L T3i,j'
像素颜色视觉感知亮度 LAld大于 LCmaxh^ †算像素颜色视觉感知饱和度 CAl,j 的彩色灰亮度当量 DBAOx: Pixel color visual perception brightness L Ald is greater than L Cmaxh ^ 像素 pixel color visual perception saturation C Al , j color gray brightness equivalent D BAOx:
DBAOx= ( CAij CmaxLl ) DBAOx = ( CAij CmaxLl )
计算调整后亮度:  Calculate the adjusted brightness:
LT3i,j = LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) ^ DBAOX) ^ Κχ3  LT3i,j = LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) ^ DBAOX) ^ Κχ3
其中, KT3为设置的调控系数, 数值范围 0.0-3.0, 典型 1.0-2.0; Where K T3 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0;
( 8) 将像素颜色的色相 h、 饱和度 C和计算调控后亮度 LT¾j 或 L j数值逆向 变换为 sRGB空间 R、 G和 B数值并规范化。 (8) The hue h, the saturation C, and the calculated adjusted luminance L T3⁄4j or L j values of the pixel color are inversely transformed into the sRGB spaces R, G, and B values and normalized.
2、 根据权利要求 1所述的方法, 其特征在于, 设备颜色视觉感知空间色相 位面颜色边界及其上饱和度值, 通过以下方法获得: 2. The method according to claim 1, wherein the device color visually perceives the spatial color phase surface color boundary and the upper saturation value thereof, and is obtained by the following method:
2.1对使用红、 绿和蓝三原色显示彩色数字图像的设备, 使用设备标称的白 场和红、 绿和蓝三原色规定参数, 应用 CIE推荐的标准方法, 将设备红、 绿和 蓝三原色合成的全部颜色, 转换为 CIEXYZ三剌激值及 CIELAB空间 L C和 h 值, 包括: 2.1 For equipment that displays color digital images using the three primary colors of red, green and blue, use the nominal white field and red, green and blue primary color parameters, and use the standard method recommended by CIE to synthesize the three primary colors of red, green and blue. All colors, converted to CIEXYZ triple stimuli and CIELAB space LC and h values, including:
以 sRGB空间 RGB三原色色品以及 D65白场 CIEXYZ三剌激值计算 RGB 三原色最大饱和度时亮度:  Calculate the maximum saturation of RGB three primary colors with sRGB space RGB three primary colors and D65 white field CIEXYZ triple value:
ΥΓ, =0.2126 Yg, =0.7152 Yb, =0.0722 Υ Γ , =0.2126 Y g , =0.7152 Y b , =0.0722
应用以上结果计算颜色 RGB数值转换为 CIEXYZ三剌激值所需的 3 X 3矩 阵系数:
Figure imgf000026_0001
Apply the above results to calculate the 3 X 3 matrix coefficients required to convert the color RGB values into CIEXYZ triple excitons:
Figure imgf000026_0001
2.2非标设备需计算设备白场和红、 绿和蓝三原色最大饱和度时的 CIEXYZ 三剌激值:  2.2 Non-standard equipment shall calculate the CIEXYZ triple-excitation value when the equipment is white field and the maximum saturation of the three primary colors of red, green and blue:
2.2.1 使用标准分光光度仪, 按照常规规范测量设备白场三剌激值 Xw' Yw' 和 Zw', 计算白场归一化系数 K1 : 2.2.1 Using a standard spectrophotometer, measure the white field triple excitability values X w ' Y w ' and Z w ' according to the conventional specifications, and calculate the white field normalization coefficient K 1 :
Ki = 100 / YW' Ki = 100 / Y W '
计算设备白场的 CIEXYZ三剌激值: Calculate the CIEXYZ triple excitation value of the white field of the equipment:
Figure imgf000026_0002
Figure imgf000026_0002
2.2.2 使用标准分光光度仪, 按照常规规范分别测量设备红、 绿和蓝三原色 最大饱和度条件下的三剌激值, Χ Υ 和 ΖΛ Xg' Yg'和 Zg' Xb' Yb'和 zb' 再分别计算三原色的 CIE XYZ三剌激值:2.2.2 Using a standard spectrophotometer, measure the three stimuli values of the maximum saturation of the red, green and blue primary colors according to the conventional specifications, Χ Υ and ΖΛ X g ' Y g ' and Z g ' X b ' Y b 'and z b ' then calculate the CIE XYZ triple stimuli of the three primary colors separately:
Figure imgf000026_0003
Figure imgf000026_0003
Xg,max— Xg X Kj Yg,max— Yg X Kj Zg max― Zg X KiXg,max— Xg X Kj Yg,max— Yg X Kj Zg ma x― Zg X Ki
max= X Ki Yb,max=Yb X K Zb,max=Zb X K Max= X Ki Yb,max = Yb XK Zb, max =Zb XK
2.3 用以上计算得到的三原色 CIEXYZ三剌激值, 替代步骤 2.1所述标准方 法中的 3 X 3矩阵系数, 将颜色 RGB值转换为 CIEXYZ三剌激值, 以计算得到 的白场 CIEXYZ三剌激值替代步骤 2.1所述设备标称白场 CIEXYZ三剌激值,将 颜色 CIEXYZ三剌激值计算为 CIELAB空间 L C和 h数值;  2.3 Using the three primary color CIEXYZ triple enthalpy values obtained above, instead of the 3 X 3 matrix coefficients in the standard method described in step 2.1, convert the color RGB values into CIEXYZ triple stimuli values to calculate the white field CIEXYZ triple stimuli The value replaces the device nominal white field CIEXYZ triple excitability value in step 2.1, and calculates the color CIEXYZ triple excitability value as CIELAB space LC and h value;
2.4将计算得到的设备空间全部颜色 L C和 h数值, 以色相 h值四舍五入 归并进入相应基准色相位面, 再以亮度 L值四舍五入归并进入相应亮度序列;2.4 Calculate the total color LC and h values of the device space, round off the h phase h value Merging into the corresponding reference color phase plane, and then rounding up to the corresponding brightness sequence with the brightness L value;
2.5 以色相位面中全部亮度序列各自最大饱和度 CmaxU数值表示色相位面的 颜色边界, 并对从色相位面的最大饱和度值 Cmaxhl具有的亮度 LCmaxhl到最低亮度 L=0的亮度序列区间所对应的颜色边界, 以标准线性插值方法纠正其中。 ^^的 非平滑递减或填补边界数据缺失, 以计算得到的 CmaxU作为应用颜色边界。 2.5 The maximum saturation C maxU value of all luminance sequences in the color phase plane indicates the color boundary of the color phase plane, and the brightness from the maximum saturation value C maxhl of the color phase plane to the brightness L Cmaxhl to the lowest brightness L=0 The color boundary corresponding to the sequence interval is corrected by the standard linear interpolation method. The non-smooth diminishing or padding boundary data of ^^ is missing, and the calculated C maxU is taken as the applied color boundary.
3、 根据权利要求 1所述的方法, 其特征在于, 彩色数字图像像素颜色1 G和 B数值变换为在 CIELAB空间的 L C和 h参数, 通过以下方法获得: 3. The method according to claim 1, wherein the color digital image pixel color 1 G and B values are converted into L C and h parameters in the CIELAB space, obtained by:
3.1使用设备或图像标称的白场和 、 G和 B三原色规定参数, 应用 CIE推 荐的标准方法, 将图像像素 RGB三原色值计算为 CIEXYZ三剌激值及 CIELAB 空间 L C禾卩 h值, 包括: 3.1 Using the equipment or image nominal white field and G and B three primary color parameters, using the standard method recommended by CIE, the image pixel RGB three primary color values are calculated as CIEXYZ triple excitation value and CIELAB space LC and h value, including:
以 sRGB空间 RGB三原色色品以及 D65白场 CIEXYZ三剌激值计算 RGB 三原色最大饱和度时亮度值:  Calculate the brightness value of RGB three primary colors with maximum saturation in sRGB space RGB three primary colors and D65 white field CIEXYZ triple value:
ΥΓ, =0.2126 Yg, =0.7152 Yb, =0.0722 Υ Γ , =0.2126 Y g , =0.7152 Y b , =0.0722
应用以上结果计算颜色 RGB数值转换为 CIEXYZ三剌激值所需的 3 X 3矩 阵系数:
Figure imgf000027_0001
Apply the above results to calculate the 3 X 3 matrix coefficients required to convert the color RGB values into CIEXYZ triple excitons:
Figure imgf000027_0001
3.2非标设备上显示图像需计算设备白场和 R G和 B三原色最大饱和度时 的 CIEXYZ三剌激值:  3.2 Displaying images on non-standard equipment It is necessary to calculate the CIEXYZ triple-excitation value when the white field of the equipment and the maximum saturation of the three primary colors of R G and B are:
3.2.1 使用标准分光光度仪, 按照常规规范测量设备白场三剌激值 Xw' Yw' 和 zw', 计算白场归一化系数 κ1 : 3.2.1 Using a standard spectrophotometer, measure the white field triple excitability values X w ' Y w ' and z w ' according to the conventional specifications, and calculate the white field normalization coefficient κ 1 :
Ki = 100 / YW' Ki = 100 / Y W '
计算设备白场的 CIEXYZ三剌激值: Calculate the CIEXYZ triple excitation value of the white field of the equipment:
Figure imgf000027_0002
Figure imgf000027_0002
3.2.2 使用标准分光光度仪, 按照常规规范分别测量设备 RGB三原色最大饱 和度条件下的三剌激值: X Y 和 ΖΛ Xg' Yg'和 Zg' Xb' Yb'和 Zb'然后分 别计算三原色的 CIEXYZ三剌激值:3.2.2 Using a standard spectrophotometer, measure the three stimuli values of the maximum saturation of the RGB three primary colors of the device according to the conventional specifications: XY and ΖΛ X g ' Y g ' and Z g ' X b ' Y b ' and Z b 'Then calculate the CIEXYZ triple stimuli of the three primary colors separately:
Figure imgf000027_0003
Figure imgf000027_0003
Xg,max— Xg X Kj Yg,max— Yg X Kj Zg max― Zg X Ki
Figure imgf000028_0001
X Kl Yb,max=Yb ' X Kl Zb,max=Zb ' X Ki ,
Xg,max— Xg X Kj Yg,max— Yg X Kj Zg ma x― Zg X Ki
Figure imgf000028_0001
X Kl Yb,max = Yb ' X Kl Zb, max =Zb ' X Ki ,
3.3 用以上计算得到的三原色最大饱和度时 CIEXYZ三剌激值, 替代步骤 3.1所述标准方法中的 3 X 3矩阵系数, 用计算得到的白场 CIEXYZ三剌激值替 代步骤 3.1 所述设备标称白场 CIEXYZ三剌激值, 将颜色 RGB值分步计算为 CIELAB空间 L、 C和 h数值。  3.3 Using the CIEXYZ triple excitability value of the maximum saturation of the three primary colors obtained above, replacing the 3 X 3 matrix coefficient in the standard method described in step 3.1, using the calculated white field CIEXYZ triple excitatory value instead of the device standard described in step 3.1 The white field CIEXYZ triple value is calculated, and the color RGB value is calculated step by step into the CIELAB space L, C and h values.
4、 根据权利要求 1所述的方法, 其特征在于, 所述方法包括选择图像中需 柔化内容的颜色视觉感知色相区间和设置相关调控系数的步骤:  4. The method according to claim 1, wherein the method comprises the steps of selecting a color visual perception hue interval of the content to be softened in the image and setting the relevant control coefficient:
4.1 设置彩色数字图像柔化内容所在视觉感知色相区间的高端边界 Hcx和低 端边界 HDX, 及区间两边外沿的过渡区宽度 KHCX和 KHDX, Hcx和 HDX数值范围 0-359° , KHCX和 KHDX数值范围 0-20, 典型 10, 色相区间的高端过渡区的外沿色 相值: HWGX=HGX+KHGX, 低端: HWDX=HDX-KHDX, 4.1 Set the high-end boundary H cx and the low-end boundary H DX of the visual perception hue interval of the color digital image softening content, and the transition zone widths K HCX and K HDX of the outer edges of the interval, H cx and H DX value range 0-359 ° , K HCX and K HDX values range 0-20, typical 10, the outer edge hue value of the high-end transition zone of the hue interval: HWGX = HGX+KHGX, low end: HWDX = HDX-KHDX,
只对指定色相区间内的颜色保留规范柔化计算结果,对过渡区内颜色因计算 柔化得到的视觉感知亮度调整量,从色相区间边界到外边沿计算调整量平滑变化 到。;  Only the color softening calculation result is retained for the color in the specified hue interval, and the visual perception brightness adjustment amount obtained by the softening of the color in the transition region is smoothly changed from the hue interval boundary to the outer edge calculation adjustment amount. ;
4.2 设置颜色视觉感知饱和度比例高限阈值 CCAOX和高端过渡区宽度系数 BIcxi , CGAOX数值范围 0.40-0.80, 典型 0.60-0.70, BIcx^值范围 0.00— 1, 典型 0.10, 4.2 Set color visual perception saturation ratio high limit threshold C CAOX and high-end transition zone width coefficient BIcxi, C GAOX value range 0.40-0.80, typical 0.60-0.70, BI cx ^ value range 0.00-1, typical 0.10,
只对以上指定色相区间内并且饱和度比例值在阈值 CCAOX以下的颜色保留规 范柔化计算结果, 对饱和度比例在 CCAOX到 CCAOX + BICX1的颜色因计算柔化得到 的视觉感知亮度调整量, 从 CCAOX到 CCAOX+ BIcxl计算调整量平滑变化到 0; Only for the color specified in the above specified hue interval and the saturation ratio value below the threshold C CAOX , the softening calculation result is obtained, and the color ratio of the saturation ratio in the C CAOX to C CAOX + BI CX1 is calculated by the softening of the visual perception. Adjustment amount, from C CAOX to C CAOX + BI cxl calculation adjustment amount smoothly changes to 0;
4.3 设置柔化卷积模板及相关像素权重,  4.3 Set the softening convolution template and related pixel weights,
以柔化像素为中心的 5 X 5像素作为柔化卷积模板, L1j表示中心像素, 即柔 化像素, 以下标 1j表示模板上像素位置, i表示列, j表示行,像素权重分别设置为: 5 × 5 pixels centered on the softened pixel as a softening convolution template, L 1j represents the center pixel, that is, softened pixels, the following label 1j represents the pixel position on the template, i represents the column, j represents the row, and the pixel weights are respectively set. for:
Li-2,j-2¾ 2, Li—i,j-2为 1, 1^2为 2, L, H,j-2¾ 1, Li+2,j-2为 2 , Li-2, j-23⁄4 2, Li-i, j-2 is 1, 1^ 2 is 2, L, H, j-23⁄4 1, Li+ 2 , j -2 is 2
Li-2,j—i为 1, Li—i,j—i为 4, Li,j—i为 4, L, hij-i为 4, Li+2,j-i¾ 1, Li -2 , j - i is 1, Li - i, j - i is 4, Li, j - i is 4, L, hij - i is 4, Li + 2, j - i3⁄4 1,
Li-2j为 2, Li-i j为 4, 为 8, L1+ 为4, Li+2,j为 2 , L i-2 j is 2, Li-i j is 4, is 8, L 1+ is 4, Li+ 2 , j is 2
为 1, Li—ij+i为 4, Lij+i为 4, LH -ij+i为 4, Li+2,j+i¾ 1,  1, Li-ij+i is 4, Lij+i is 4, LH-ij+i is 4, Li+2, j+i3⁄4 1,
Li-2,j+2¾ 2 , Li-i,j+2¾ 1, Li,j+2为 2 , LH - 为 1, Li+2,j+2为 2; Li-2, j+23⁄4 2 , Li-i, j+23⁄4 1, Li, j+ 2 is 2, LH - is 1, Li+ 2 , j+2 is 2;
4.4 设置模板上相关像素间颜色视觉感知亮度差阈值 L LYU¾值范围 0-100,典型 2-6,模板中心像素与另外像素的亮度差小于 LYU则 记该像素为有效像素; 4.4 Set the color perception visual brightness difference threshold L between related pixels on the template L YU 3⁄4 value range 0-100, typically 2-6, the difference between the brightness of the template center pixel and the other pixel is less than L YU, then the pixel is the effective pixel;
4.5
Figure imgf000029_0001
4.5
Figure imgf000029_0001
设置与中心像素相邻像素的有效像素的卷积阈值 SN, 数值范围 0— 32, 典型 24-28, 梯度 4, 设置与中心像素相隔像素的有效像素的卷积阈值 Sw, 数值范围 0-24, 典型 10-14, 梯度 1或 2, 当相邻像素的有效像素卷积值大于 Si^^且相隔 像素的有效像素卷积值大于 Sw, 则计算模板有效像素卷积平均值作为中心像素 的亮度值 LJpi,j ; Setting a convolution threshold S N of effective pixels with pixels adjacent to the center pixel, a range of values 0 - 32, typically 24-28, gradient 4, setting a convolution threshold S w of the effective pixels of the pixel spaced apart from the center pixel, value range 0 -24, typical 10-14, gradient 1 or 2, when the effective pixel convolution value of adjacent pixels is larger than Si^^ and the effective pixel convolution value of the spaced pixels is greater than S w , the template effective pixel convolution average is calculated as The luminance value of the center pixel L Jpi , j ;
4.6 设置像素视觉感知亮度调整量实际应用的比例系数 BJX14.6 Set the pixel visual perception brightness adjustment amount of the actual application of the scale factor B JX1 ,
BJX1数值范围 0.00-1, 典型 0.10-0.30,B JX1 has a value range of 0.00-1, typically 0.10-0.30,
Figure imgf000029_0002
BJXI
Figure imgf000029_0002
BJXI
其中, LTON 1为中心像素实际应用的亮度值。 Among them, L TON 1 is the brightness value actually applied by the center pixel.
5、 对彩色数字图像进行视觉立体感知增强的系统, 其特征在于, 所述系统 包括:  5. A system for visual stereoscopic perception enhancement of a color digital image, wherein the system comprises:
(1)显示彩色数字图像的设备颜色视觉感知空间色相位面颜色边界计算模 块, 包括:  (1) A device color visual perception spatial color phase surface color boundary calculation module displaying a color digital image, including:
(1-1)设备颜色空间的红、绿和蓝三原色值变换为 CIELAB空间 L、 C禾卩 h值 计算单元;  (1-1) The red, green and blue primary color values of the device color space are converted into CIELAB space L, C and h value calculation unit;
(1-2)设备颜色视觉感知空间色相位面颜色边界提取单元, 以设备颜色色相 h 值四舍五入归并进入相应基准色相位面, 以亮度 L值四舍五入归并进入相应亮度 序列, 提取色相位面各亮度序列颜色的最大饱和度值 CmaxU, 作为该色相位面的 颜色边界计算基础数据; (1-2) device color visual perception spatial color phase surface color boundary extraction unit, rounding up the device color hue h value into the corresponding reference color phase surface, rounding up the brightness L value and entering the corresponding brightness sequence, extracting the color phase surface brightness The maximum saturation value C maxU of the sequence color, the basic data is calculated as the color boundary of the color phase plane;
(1-3)色相位面颜色边界 ^^^^平滑单元,选择色相位面的最大饱和度值 Cmaxhl 具有的亮度 LCmaxhl到最低亮度 L=0 的亮度序列区间所对应的颜色边界 CmaxU, 以 标准线性插值算法计算平滑边界, 弥补 CmaxU非平滑递减或填补边界数据缺失, 计算得到的颜色边界以及由亮度 LCmaxhl L=100 的亮度序列区间对应的颜色边 界, 表示该色相位面的应用颜色边界 CmaxU ; (1-3) Color phase surface color boundary ^^^^ Smoothing unit, selecting the maximum saturation value C maxhl of the color phase surface, the color boundary C maxU corresponding to the brightness sequence interval from the brightness L Cmaxhl to the lowest brightness L=0 Calculate the smoothing boundary by the standard linear interpolation algorithm, make up for the C maxU non-smooth decreasing or the missing boundary data missing, calculate the color boundary and the color boundary corresponding to the brightness sequence interval of the brightness L Cmaxhl L=100, indicating the color phase surface Apply color boundary C maxU ;
(2)彩色数字图像像素颜色 RGB模式正向转换及归并色相位面和亮度序列模 块, 包括:  (2) Color digital image pixel color RGB mode forward conversion and merge color phase surface and brightness sequence module, including:
(2-1)将彩色数字图像像素颜色 RGB值转换为 CIELAB空间的 L、 C和 h值 的计算单元, 其中, h为色相角, L为亮度、 C为饱和度; (2-1) Convert color digital image pixel color RGB values to L, C, and h values of CIELAB space a calculation unit, where h is a hue angle, L is a brightness, and C is a saturation;
(2-2)像素颜色色相位面和亮度序列归并单元, 将图像颜色空间划分为 360 个基准色相位面, 以色相 h值四舍五入归并进入相应基准色相位面,将色相位面 中亮度 L范围划分为 101个基准序列, 以亮度 L值四舍五入归并进入相应亮度 序列;  (2-2) Pixel color phase plane and brightness sequence merging unit, dividing the image color space into 360 reference color phase planes, rounding the h phase h value into the corresponding reference color phase plane, and setting the luminance L range in the color phase plane Divided into 101 reference sequences, rounded up to the corresponding brightness sequence with the brightness L value rounded off;
(3)彩色数字图像选择性柔化计算模块, 包括:  (3) A color digital image selective softening calculation module, comprising:
(3-1)柔化内容初选单元, 读取系统中设置的柔化颜色的色相区间边界 Hcx和 HDX以及区间两边外沿的过渡区宽度 KHCX和 KHDX,读取设置的柔化颜色的饱和度 比例高限阈值 CCAOX和高端过渡区宽度系数 BICX1,将符合条件的像素颜色导入柔 化计算精选单元; (3-1) Softening the content primary unit, reading the hue interval boundaries H cx and H DX of the softening color set in the system and the transition zone widths K HCX and K HDX of the outer edges of the interval, reading the setting softness The saturation ratio high threshold C CAOX and the high-end transition width coefficient BI CX1 of the color are introduced into the softening calculation unit;
(3-2)柔化内容精选和计算单元,读取系统中设置的卷积模板及相关像素间亮 度差阈值 LYU, 读取有效像素卷积阈值 Si^¾Sw, 应用系统中设置的柔化模板和像 素加权, 对符合条件的像素计算柔化亮度 LIpi,j并导入柔化应用计算单元; (3-2) Softening the content selection and calculation unit, reading the convolution template set in the system and the correlation luminance difference threshold L YU between the pixels, reading the effective pixel convolution threshold Si^3⁄4S w , set in the application system Softening the template and pixel weighting, calculating the softening brightness L Ipi , j for the eligible pixels and importing into the softening application computing unit;
(3-3)柔化亮度应用计算单元,读取系统中设置的亮度调整量实际应用比例系 数 Bm, 将计算调整后的亮度值 LTON 1代替像素原有亮度值 LAl,j ; (3-3) Softening brightness application calculation unit, reading the brightness adjustment amount set in the system, actually applying the proportional coefficient B m , and calculating the adjusted brightness value L TON 1 instead of the original brightness value L Al , j of the pixel ;
(4)彩色数字图像像素颜色亮度增强计算模块, 包括:  (4) A color digital image pixel color brightness enhancement calculation module, comprising:
(4-1)设置真实景物成像环境中入射光线在图像上投影角度及与目的像素亮 度相关像素作用当量计算单元,  (4-1) setting the projection angle of the incident light on the image in the real scene imaging environment and the pixel equivalent equivalent calculation unit related to the target pixel brightness,
设置目的像素的入射光线强度当量 Al, 数值 0.4-0.6, 入射光线两边对称位 置的并行光线强度当量 Al_l和 Al_2:  Set the incident light intensity equivalent of the destination pixel Al, the value is 0.4-0.6, and the parallel light intensity equivalents of the symmetric symmetry of the incident ray are Al_l and Al_2:
Al l = (1-Α1) Χ [(90-α) / 90]  Al l = (1-Α1) Χ [(90-α) / 90]
Al_2 = 1- Al- AlJ  Al_2 = 1- Al- AlJ
以上, ct为设置的入射光线在图像上的投影与垂线的夹角;  Above, ct is the angle between the projection of the incident ray on the image and the perpendicular;
(4-2)目的像素与相关像素间的亮度差值 ΔΙ^计算单元,  (4-2) Difference in luminance between the target pixel and the associated pixel ΔΙ^ calculation unit,
入射光线条件设定 8种, 即入射光源自左上、 正上、 右上、 正右、 右下、 正 下、 左下和正左, 目的像素与相关像素间的亮度差值典型包括:  The incident light conditions are set to 8 kinds, that is, the incident light source is from the upper left, the upper right, the upper right, the right right, the lower right, the lower right, the lower left, and the right left. The difference in brightness between the target pixel and the related pixel typically includes:
左上方入射光线条件下计算:  Calculated under the incident light conditions at the upper left:
ALij=(LAij - LBi-ij-i) X A1 + (LAi,j - LBij-i) X A1—1 + (LAi,j - LBi-1,j) X Al_2 正上方入射光线条件下计算: AL i j=(L A ij - LBi-ij-i) X A1 + (L Ai ,j - L B ij-i) X A1—1 + (L Ai ,j - L Bi-1 ,j) X Al_2 Calculated under incident light conditions directly above:
ALij=(LAij - LBij-i) X A1 + (LAi,j - LBi-1,j) X Al_l + (LAi,j - LBi+1,j) X Al_2 右上方入射光线条件下计算: AL i j=(L A ij - L B ij-i) X A1 + (L Ai ,j - L Bi-1 ,j) X Al_l + (L Ai ,j - L Bi+1 ,j) X Al_2 Calculated in the upper right incident light condition:
ALij=(LAij - LBi+ij-i) X A1 + (LAij - LBij-i) X Al_l + (LAi,j - LBi+ij) Al_2 其中, A1j表示图像中目的像素, 即调控亮度的像素, LAl,j表示该像素亮度; 中心像素 A1j四周共 8个像素, 自左上角顺时针排列分别为: AL i j=(L A ij - LBi+ij-i) X A1 + (L A ij - L B ij-i) X Al_l + (L Ai ,j - L Bi+ ij) Al_2 where A 1j represents an image The destination pixel, that is, the pixel that regulates the brightness, L Al , j indicates the brightness of the pixel; the central pixel A 1j has a total of 8 pixels around, and the clockwise arrangement from the upper left corner is:
Bi-i,j-i, Bij_i , Bi+ij_i , Bi+ij, Bi+ij+i , Bij+i , Bi_ij+i , Bi_ij,  Bi-i,j-i, Bij_i , Bi+ij_i , Bi+ij, Bi+ij+i , Bij+i , Bi_ij+i , Bi_ij,
至 LB^表示相应像素亮度,  To LB^ indicates the corresponding pixel brightness,
入射光线条件设定 8种, 即入射光源自左上、 正上、 右上、 正右、 右下、 正 下、 左下和正左;  The incident light conditions are set to 8 kinds, that is, the incident light source is from the upper left, the upper right, the upper right, the right right, the lower right, the lower right, the lower left, and the right left;
(4-3)像素颜色视觉感知亮度表现的景物空间感知当量 D j计算单元, 在与观察同向光照条件下: (4-3) Pixel color visual perception of brightness performance of the scene space perceptual equivalent D j calculation unit, under the same direction of observation:
DLlJ = (LAlJ / 100) D LlJ = (L AlJ / 100)
在与观察逆向光照条件下:  Under and under the condition of observing reverse illumination:
DLlJ = (l- LAl0 / 100) D LlJ = (l- L Al0 / 100)
在与观察近似垂直光照条件下:  Under conditions of observation and vertical illumination:
设置 LZH为目标亮度, 即获得最高视觉感知清晰度的亮度值, 数值 75-85, 如果 LAl,」 > LZH, DLlJ = (100-LAlJ) /(100- LZH) Set L ZH to the target brightness, ie the brightness value for the highest visual perception resolution, value 75-85, if L Al , >> L ZH , D LlJ = (100-L AlJ ) / (100- L ZH )
如果 LAij < LZH' Duj = LAij /LZH;  If LAij < LZH' Duj = LAij / LZH;
(4-4)像素颜色视觉感知亮度调控后亮度 L j计算单元, (4-4) pixel color visual perception brightness control brightness L j calculation unit,
Liij = LAi,j+ ALij X DLij X KL  Liij = LAi,j+ ALij X DLij X KL
其中, KL为设置的调控比例系数, 数值 1.0-2.0;  Where KL is the set regulation factor, the value is 1.0-2.0;
(4-5)像素颜色视觉感知色相的彩色灰亮度当量 DCAIx和调控后亮度 LT¾j计算 单元, (4-5) pixel color visual perception hue color gray brightness equivalent D CAIx and adjusted brightness L T3⁄4j calculation unit,
读取图像设备 0° -359° 各色相位面的 LCmaxhl, 以其中最大值为基数进行归 一化计算, 结果为相应相位面的彩色灰亮度当量 DCAIxRead the image device 0° -359° L Cmaxhl of each color phase plane, and normalize the calculation with the maximum value as the base. The result is the color gray brightness equivalent D CAIx of the corresponding phase plane.
比较像素颜色视觉感知亮度 LAld大于 LCmaxhl时计算调控后亮度: Compare the pixel color visual perception brightness L Ald is greater than L Cmaxhl to calculate the adjusted brightness:
LT2i,j = Lli,j+ ((LAij" LcmaxLl)/( 100- LcmaxLl) ^ DcAIx) ^ Κχ2  LT2i,j = Lli,j+ ((LAij" LcmaxLl)/( 100- LcmaxLl) ^ DcAIx) ^ Κχ2
其中, KT2为设置的调控系数, 数值范围 0.0-3.0, 典型 1.0-2.0, DCAIx为像素 颜色所在色相位面的相应数据; Where K T2 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0, and D CAIx is the corresponding data of the color phase plane of the pixel color;
(4-6)像素颜色视觉感知饱和度的彩色灰亮度当量 DBAOx和调控后亮度 LT¾j计 算单元, (4-6) color gray brightness equivalent D BAOx and adjusted brightness L T3⁄4j calculation unit of pixel color visual perception saturation,
比较像素颜色视觉感知亮度 LAl,j大于 LCmaxhl时计算像素颜色视觉感知饱和度 CAl,j的彩色灰亮度当量 DBAOX: Comparing pixel color visual perception brightness L Al , j is greater than L Cmaxhl to calculate pixel color visual perception saturation C Al , j color gray brightness equivalent D BAOX:
DBAOx= ( CAij CmaxLl ) DBAOx = ( CAij CmaxLl )
cmaxU为像素颜色所在色相位面亮度序列的最大饱和度数据, 计算调整后亮 度: c maxU is the maximum saturation data of the color phase surface brightness sequence of the pixel color, and the adjusted brightness is calculated:
LT3i,j = LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) ^ DBAOX) ^ Κχ3  LT3i,j = LT2i,j+ ((LAij- LcmaxLl)/( 100- LcmaxLl) ^ DBAOX) ^ Κχ3
其中, KT3为设置的调控系数, 数值范围 0.0-3.0, 典型 1.0-2.0; Where K T3 is the set control coefficient, the value range is 0.0-3.0, typically 1.0-2.0;
(5) 将像素颜色的色相 h、饱和度 C和计算调整后的亮度 LT¾j 或 L j数值逆向 变换为 sRGB空间 R、 G和 B数值及规范化的计算模块。 (5) The hue h, the saturation C of the pixel color, and the calculated adjusted brightness L T3⁄4j or L j are inversely transformed into the sRGB space R, G, and B values and the normalized calculation module.
PCT/CN2012/074962 2012-03-22 2012-05-02 Method and system for carrying out visual stereo perception enhancement on color digital image WO2013139067A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210078513.5 2012-03-22
CN201210078513.5A CN102663741B (en) 2012-03-22 2012-03-22 Method for carrying out visual stereo perception enhancement on color digit image and system thereof

Publications (1)

Publication Number Publication Date
WO2013139067A1 true WO2013139067A1 (en) 2013-09-26

Family

ID=46773219

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/074962 WO2013139067A1 (en) 2012-03-22 2012-05-02 Method and system for carrying out visual stereo perception enhancement on color digital image

Country Status (2)

Country Link
CN (1) CN102663741B (en)
WO (1) WO2013139067A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107481279A (en) * 2017-05-18 2017-12-15 华中科技大学 A kind of monocular video depth map computational methods
CN113885830A (en) * 2021-10-25 2022-01-04 北京字跳网络技术有限公司 Sound effect display method and terminal equipment
CN114240802A (en) * 2021-12-24 2022-03-25 西安交通大学 Visual perception method and system based on biological neuron network and stochastic resonance

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103400351B (en) * 2013-07-30 2015-12-23 武汉大学 Low light based on KINECT depth map shines image enchancing method and system
CN107205143A (en) * 2016-03-17 2017-09-26 深圳超多维光电子有限公司 A kind of method and device for adjusting stereo-picture
CN106408617B (en) * 2016-08-26 2020-03-31 珠海金山网络游戏科技有限公司 Interactive single image material obtaining system and method based on YUV color space
CN107659777B (en) * 2017-10-13 2020-05-22 深圳市易瞳科技有限公司 Automatic exposure method and device
CN108831528A (en) * 2018-06-08 2018-11-16 福州大学 A kind of full color vision replacement device based on electric touch
US10630953B2 (en) * 2018-07-12 2020-04-21 Sharp Kabushiki Kaisha Characterization system for evaluating characteristics of display device
CN110837522B (en) * 2019-11-11 2020-09-22 广州玖富网络科技有限公司 To-be-purchased product display method and display platform based on big data analysis
CN112465033B (en) * 2020-11-30 2021-08-03 哈尔滨市科佳通用机电股份有限公司 Brake pad cotter pin loss detection method, system and device based on deep learning

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101088277A (en) * 2004-12-01 2007-12-12 皇家飞利浦电子股份有限公司 Method of electronic color image saturation processing
WO2011028626A2 (en) * 2009-09-01 2011-03-10 Entertainment Experience Llc Method for producing a color image and imaging device employing same
CN102385845A (en) * 2010-09-01 2012-03-21 索尼公司 Driving method for image display apparatus

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1934945A4 (en) * 2005-10-11 2016-01-20 Apple Inc Method and system for object reconstruction
WO2009004527A2 (en) * 2007-07-03 2009-01-08 Koninklijke Philips Electronics N.V. Computing a depth map
US20110157229A1 (en) * 2008-08-29 2011-06-30 Zefeng Ni View synthesis with heuristic view blending
CN101651772B (en) * 2009-09-11 2011-03-16 宁波大学 Method for extracting video interested region based on visual attention
CN101872479B (en) * 2010-06-09 2012-05-09 宁波大学 Three-dimensional image objective quality evaluation method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101088277A (en) * 2004-12-01 2007-12-12 皇家飞利浦电子股份有限公司 Method of electronic color image saturation processing
WO2011028626A2 (en) * 2009-09-01 2011-03-10 Entertainment Experience Llc Method for producing a color image and imaging device employing same
CN102385845A (en) * 2010-09-01 2012-03-21 索尼公司 Driving method for image display apparatus

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107481279A (en) * 2017-05-18 2017-12-15 华中科技大学 A kind of monocular video depth map computational methods
CN107481279B (en) * 2017-05-18 2020-07-07 华中科技大学 Monocular video depth map calculation method
CN113885830A (en) * 2021-10-25 2022-01-04 北京字跳网络技术有限公司 Sound effect display method and terminal equipment
CN114240802A (en) * 2021-12-24 2022-03-25 西安交通大学 Visual perception method and system based on biological neuron network and stochastic resonance
CN114240802B (en) * 2021-12-24 2023-08-01 西安交通大学 Visual perception method and system based on biological neuron network and stochastic resonance

Also Published As

Publication number Publication date
CN102663741A (en) 2012-09-12
CN102663741B (en) 2014-09-24

Similar Documents

Publication Publication Date Title
WO2013139067A1 (en) Method and system for carrying out visual stereo perception enhancement on color digital image
US8538147B2 (en) Methods and appartuses for restoring color and enhancing electronic images
EP3566203B1 (en) Perceptually preserving scene-referred contrasts and chromaticities
Kuang et al. Evaluating HDR rendering algorithms
TW201737238A (en) Method and apparatus for reducing myopiagenic effect of electronic displays
US8902328B2 (en) Method of selecting a subset from an image set for generating high dynamic range image
WO2013131311A1 (en) Method and system for carrying out vision perception high-fidelity transformation on color digital image
KR102369148B1 (en) Image capture method and system
US20170154437A1 (en) Image processing apparatus for performing smoothing on human face area
CN109686342B (en) Image processing method and device
US20170337712A1 (en) Image processing apparatus, image processing method, and storage medium
US11051376B2 (en) Lighting method and system to improve the perspective colour perception of an image observed by a user
Zhong et al. DiCE: dichoptic contrast enhancement for VR and stereo displays
CN102629967A (en) Correction method for non-uniform illumination of copying device
Park et al. 79‐2: Hyperrealism in full ultra high‐definition 8K display
KR20170098235A (en) A method, apparatus and system for reducing crosstalk of auto stereoscopic displays
CN109300186A (en) Image processing method and device, storage medium, electronic equipment
CN106686320B (en) A kind of tone mapping method based on number density equilibrium
JP2015097049A (en) Image processor and image processing method
KR101488647B1 (en) Virtual illumination of operating method and apparatus for mobile terminal
JP2017212720A (en) Image processing apparatus, image processing method, and program
JP2002010283A (en) Display method and processor for face image
US8698832B1 (en) Perceptual detail and acutance enhancement for digital images
KR101119941B1 (en) Apparatus and method for improving quality of picture in the stereoscopic
EP3942790B1 (en) Camera color image processing

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12871923

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12871923

Country of ref document: EP

Kind code of ref document: A1