CN115457920A - Image processing method, device and equipment - Google Patents

Image processing method, device and equipment Download PDF

Info

Publication number
CN115457920A
CN115457920A CN202211102784.XA CN202211102784A CN115457920A CN 115457920 A CN115457920 A CN 115457920A CN 202211102784 A CN202211102784 A CN 202211102784A CN 115457920 A CN115457920 A CN 115457920A
Authority
CN
China
Prior art keywords
image
pixel
brightness
saturation
lightness
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211102784.XA
Other languages
Chinese (zh)
Inventor
袁汝俊
沈珈立
罗小伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Spreadtrum Communications Shanghai Co Ltd
Original Assignee
Spreadtrum Communications Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Spreadtrum Communications Shanghai Co Ltd filed Critical Spreadtrum Communications Shanghai Co Ltd
Priority to CN202211102784.XA priority Critical patent/CN115457920A/en
Publication of CN115457920A publication Critical patent/CN115457920A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/10Intensity circuits
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/2003Display of colours
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39Control of the bit-mapped memory
    • G09G5/399Control of the bit-mapped memory using two or more bit-mapped memories, the operations of which are switched in time, e.g. ping-pong buffers

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

The embodiment of the application provides an image processing method, device and equipment. The method comprises the following steps: acquiring display parameters of a first image and display equipment, wherein the first image is an SDR (standard dynamic range) image, and the display equipment is high dynamic range HDR equipment; and adjusting the brightness and the saturation of the first image according to the display parameters to obtain a second image, wherein the display parameters at least comprise: the peak luminance DPL and/or the backlight percentage are displayed. In the process, the SDR image is converted into the HDR image matched with the HDR equipment through an inverse tone mapping method based on brightness and saturation adjustment, and the display effect of the SDR image on the HDR equipment is optimized.

Description

Image processing method, device and equipment
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to an image processing method, device and equipment.
Background
Images may be displayed by a display device (e.g., television, computer screen, cell phone, etc.). The display device may be a Standard Dynamic Range (SDR) device, or a High Dynamic Range (HDR) device.
Compared with SDR devices, HDR devices display images with the advantages of high brightness, high contrast, larger color gamut, etc., and therefore, most display devices are HDR devices. However, most of the current images are SDR images, and when the SDR images are displayed on HDR devices, potential problems of excessive noise due to brightness enhancement in dark places, excessive brightness of the whole screen, low screen saturation and the like occur, so that the display effect of the images is poor.
Disclosure of Invention
The embodiment of the application provides an image processing method, device and equipment, and optimizes the display effect of an SDR image on HDR equipment.
In a first aspect, an embodiment of the present application provides an image processing method, including:
acquiring display parameters of a first image and a display device, wherein the first image is an SDR (standard dynamic range) image, and the display device is a HDR (high dynamic range) device;
according to the display parameters, adjusting brightness and saturation of the first image to obtain a second image, wherein the display parameters at least comprise: the peak luminance DPL and/or the backlight percentage are displayed.
In a possible implementation, adjusting brightness and saturation of the first image according to the display parameter to obtain a second image includes:
acquiring first brightness and first saturation of each pixel in the first image;
determining a second brightness of each pixel in the first image according to the display parameter and the first brightness of each pixel in the first image;
determining a second saturation of each pixel in the first image according to the first saturation of each pixel in the first image;
and updating the first image according to the second lightness and the second saturation of each pixel in the first image to obtain the second image.
In a possible embodiment, said display parameters comprise at least said DPL; for any one pixel in the first image; determining a second brightness of the pixel from the display parameter and the first brightness of the pixel, comprising:
obtaining a lightness mapping curve between a first lightness and a mapping lightness corresponding to the DPL, wherein the lightness mapping curve is determined according to the DPL;
determining a first mapped lightness from the first lightness and the lightness mapping curve;
determining a second brightness of the pixel as a function of the first brightness and the first mapped brightness.
In a possible embodiment, said display parameters further comprise at least said backlight percentage; determining a second brightness of the pixel from the first brightness and the first mapped brightness, comprising:
determining a second brightness of the pixel as a function of the backlight percentage, the first brightness, and the first mapped brightness.
In one possible embodiment, for any one pixel in the first image; determining a second saturation of the pixel based on the first saturation of the pixel, comprising:
determining a first gain coefficient for the pixel as a function of a first luma and a second luma of the pixel;
acquiring a saturation gain curve between the first lightness and the second gain coefficient;
determining a second gain factor for the pixel from the first lightness and saturation gain curves for the pixel;
determining a second saturation of the pixel based on the first saturation, the first gain factor, and the second gain factor.
In a possible implementation, determining a second saturation of the pixel based on the first saturation, the first gain factor, and the second gain factor includes:
and determining a product of the first saturation, the first gain coefficient and the second gain coefficient as a second saturation of the pixel.
In a possible implementation, updating the first image according to a second lightness and a second saturation of each pixel in the first image to obtain the second image includes:
for each pixel in the first image, updating the brightness of the pixel to a corresponding second brightness, and updating the saturation of the pixel to a corresponding second saturation, resulting in the second image.
In a second aspect, an embodiment of the present application provides an image processing apparatus, including an obtaining module and an adjusting module, wherein,
the acquisition module is used for acquiring a first image and display parameters of display equipment, wherein the first image is a Standard Dynamic Range (SDR) image, and the display equipment is High Dynamic Range (HDR) equipment;
the adjusting module is configured to adjust brightness and saturation of the first image according to the display parameter to obtain a second image, where the display parameter at least includes: the peak luminance DPL and/or the backlight percentage are displayed.
In a possible implementation, the adjusting module is specifically configured to:
acquiring first brightness and first saturation of each pixel in the first image;
determining a second brightness of each pixel in the first image according to the display parameter and a first brightness of each pixel in the first image;
determining a second saturation of each pixel in the first image according to the first saturation of each pixel in the first image;
and updating the first image according to the second lightness and the second saturation of each pixel in the first image to obtain the second image.
In a possible implementation, the adjusting module is specifically configured to:
obtaining a lightness mapping curve between a first lightness and a mapping lightness corresponding to the DPL, wherein the lightness mapping curve is determined according to the DPL;
determining a first mapped lightness from the first lightness and the lightness mapping curve;
determining a second brightness of the pixel from the first brightness and the first mapped brightness.
In a possible implementation, the adjusting module is specifically configured to:
determining a second brightness of the pixel as a function of the backlight percentage, the first brightness, and the first mapped brightness.
In a possible implementation, the adjusting module is specifically configured to:
determining a first gain coefficient for the pixel as a function of a first and second brightness of the pixel;
obtaining a saturation gain curve between the first lightness and the second gain coefficient;
determining a second gain coefficient for the pixel from the first lightness and saturation gain curves for the pixel;
and determining a second saturation of the pixel according to the first saturation, the first gain coefficient and the second gain coefficient.
In a possible implementation, the adjusting module is specifically configured to:
determining a product of the first saturation, the first gain factor, and the second gain factor as a second saturation of the pixel.
In a possible implementation, the adjusting module is specifically configured to:
for each pixel in the first image, updating the brightness of the pixel to a corresponding second brightness, and updating the saturation of the pixel to a corresponding second saturation, resulting in the second image.
In a third aspect, an embodiment of the present application provides an image processing apparatus, including: a processor and a memory;
the memory is used for storing a computer program;
the processor is configured to execute the computer program stored in the memory to implement the method according to any of the first aspect.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium having stored therein computer-executable instructions for implementing the method of any one of the first aspect when the computer-executable instructions are executed by a processor.
In a fifth aspect, the present application provides a computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of the first aspect.
According to the image processing method, the device and the equipment, the display parameters of the first image and the display equipment can be obtained, the first image is an SDR image, and the display equipment is HDR equipment; acquiring first lightness and first saturation of each pixel in a first image; aiming at any pixel in the first image, according to display parameters, adjusting first brightness and first saturation of the pixel in the first image to further obtain second brightness and second saturation of the pixel in the first image, wherein the display parameters at least comprise display peak brightness (DPL) and/or backlight percentage; updating the first image based on the second brightness and the second saturation of each pixel in the first image to obtain a second image; the second image is displayed in the display device. In the process, the SDR image is converted into the HDR image matched with the HDR equipment through an inverse tone mapping method based on brightness and saturation adjustment, and the display effect of the SDR image on the HDR equipment is optimized.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
Fig. 1 is a schematic diagram of an application scenario provided in an embodiment of the present application;
fig. 2 is a schematic flowchart of an image processing method according to an embodiment of the present disclosure;
fig. 3 is a schematic flowchart of an image processing method according to an embodiment of the present application;
FIG. 4 is a diagram illustrating a segmented brightness mapping curve for a display device according to an embodiment of the present application;
fig. 5 is a schematic diagram of a saturation gain curve corresponding to a display device according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram of a specific framework of an image processing method according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;
fig. 8 is a schematic diagram of a hardware structure of an image processing apparatus according to an embodiment of the present application.
Specific embodiments of the present application have been shown by way of example in the drawings and will be described in more detail below. The drawings and written description are not intended to limit the scope of the inventive concepts in any manner, but rather to illustrate the concepts of the application by those skilled in the art with reference to specific embodiments.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 is a schematic diagram of an application scenario provided in an embodiment of the present application. Referring to fig. 1, an image processing apparatus 101 is included. A display device may be provided in the image processing device 101, and the display device may be an HDR device, for example, a high definition display screen or the like. Optionally, the image processing apparatus 101 may further include an image acquiring device and an image processing device, for example, the image acquiring device may be a camera; the image processing apparatus may be an image processing platform.
The image processing device 101 may acquire an SDR image, convert the SDR image into a corresponding HDR image by an inverse tone mapping method based on brightness and saturation adjustment, and display the HDR image on a display device.
In the related art, the HDR device displays an image having advantages of high luminance, high contrast, a larger color gamut range, and the like, compared to the SDR device, and therefore, most display devices are HDR devices. However, most of the current images are SDR images, and when the SDR images are displayed on HDR devices, potential problems of excessive noise due to brightness enhancement in dark places, excessive brightness of the whole screen, low screen saturation and the like occur, so that the display effect of the images is poor.
In the embodiment of the application, an HDR image corresponding to an SDR image can be determined and displayed on an HDR device by means of image dynamic range conversion based on display parameters of the HDR device and a first brightness and a first saturation of each pixel in the SDR image. In the process, the SDR image is converted into the HDR image matched with the HDR equipment through an inverse tone mapping method based on brightness and saturation adjustment, and the display effect of the SDR image on the HDR equipment is optimized.
The method described in the present application will be described below with reference to specific examples. It should be noted that the following embodiments may exist alone or in combination with each other, and the description of the same or similar contents is not repeated in different embodiments.
Fig. 2 is a schematic flowchart of an image processing method according to an embodiment of the present application. Referring to fig. 2, the method may include:
s201, acquiring a first image and display parameters of a display device.
The execution subject of the embodiment of the present application may be an image processing apparatus, or may be an image processing device provided in the image processing apparatus. The image processing apparatus may be implemented by software, or may be implemented by a combination of software and hardware.
The first image may be an SDR image, which may be in the format of an IMG format.
The first image may be an image generated or captured by a device such as a mobile phone, a camera, a desktop computer, etc. Optionally, the format of the first image may also be a Joint Photographic Experts Group (JPEG) format or a Portable Network Graphics (PNG) format, and when the format of the first image is a JPG format or a PNG format, the format of the first image needs to be converted and converted into an IMG format.
The display device may be an HDR device. For example, the display device may be a 4k high definition display screen or the like.
The Display parameters may include Display Peak Luminance (DPL) or backlight percentage of the Display device. For a display device, the display parameter DPL may be a fixed value, e.g. DPL may be 5000cd/m 2 . The backlight percentage of the display device may also be a preset fixed parameter value. Generally, the DPL of a display device and the backlight percentage of the display device are in an inverse relationship, i.e., the larger the backlight percentage, the smaller the DPL; the smaller the backlight percentage, the larger the DPL.
S202, adjusting the brightness and the saturation of the first image according to the display parameters to obtain a second image.
Wherein the display parameters may include at least: DPL and/or backlight percentage of the display device.
The second image may be an HDR image. The second image corresponding to the first image may be determined by: acquiring first lightness and first saturation of each pixel in a first image; determining a second brightness of each pixel in the first image according to the display parameters and the first brightness of each pixel in the first image; determining a second saturation of each pixel in the first image according to the first saturation of each pixel in the first image; and updating the first image according to the second lightness and the second saturation of each pixel in the first image to obtain a second image.
Optionally, the HSV color model corresponding to the first image may be updated based on the second brightness, the second saturation, and the first hue corresponding to each pixel in the first image, and the second image may be obtained based on the updated HSV color model.
The first brightness and the second brightness of each pixel in the first image have a correspondence. For example, the correspondence may be as shown in table 1:
TABLE 1
Pixel First brightness Second brightness
Pixel 1 First lightness 1 Second brightness 1
Pixel 2 First brightness 2 Second brightness 2
Pixel 3 First lightness 3 Second lightness 3
…… …… ……
Pixel n First lightness n Second lightness n
According to table 1, the first image may include n pixels, where n is a positive integer greater than or equal to 1. There is a one-to-one correspondence between the first and second values for each pixel in the first image, e.g., a first value 1 for a pixel 1 may correspond to a second value 1 for that pixel.
Similarly, the first saturation and the second saturation of each pixel in the first image also have a one-to-one correspondence relationship, which is not described herein again.
The image processing method provided by the embodiment of the application acquires display parameters of an SDR image and HDR equipment, and a first brightness and a first saturation of each pixel in the SDR image; according to the display parameters and the first lightness and the first saturation of each pixel in the SDR image, determining an HDR image corresponding to the SDR image; HDR images are displayed in a display device. In the process, the SDR image is converted into the HDR image matched with the HDR equipment through an inverse tone mapping method based on brightness and saturation adjustment, and the display effect of the SDR image on the HDR equipment is optimized.
On the basis of any of the above embodiments, a detailed process of an image processing method is described below with reference to fig. 3.
Fig. 3 is a schematic flowchart of an image processing method according to an embodiment of the present application. Referring to fig. 3, the method may include:
s301, acquiring a first image and display parameters of the display device.
The first image may be an SDR image and the display device may be an HDR device.
It should be noted that the execution process of S301 may refer to the execution process of S201, and is not described herein again.
S302, acquiring a first brightness and a first saturation of each pixel in the first image.
The first brightness is brightness corresponding to each pixel in the SDR image; the first saturation is the saturation corresponding to each pixel in the SDR image. The first image may include a plurality of pixels, each pixel having its corresponding first lightness and first saturation. The first lightness and the first saturation of each pixel in the first image may be obtained by: converting the image format of an image from an IMG format to an HSV (Hue, saturation, value; HSV) format to obtain an HSV color model corresponding to the first image; determining brightness and saturation corresponding to each pixel in the first image based on the obtained HSV color model; and normalizing the brightness and the saturation corresponding to each pixel in the first image to determine the first brightness and the first saturation corresponding to each pixel.
Optionally, the hue corresponding to each pixel in the first image may also be obtained based on the HSV color model; the first tone corresponding to each pixel is determined by normalizing the tone corresponding to each pixel in the first image.
The first image may include a plurality of pixels, and the process of determining the second brightness of any one pixel in the first image is the same, and the process of determining the second brightness of any one pixel will be described below with reference to S303 to S305.
S303, acquiring a brightness mapping curve corresponding to the DPL and between the first brightness and the mapping brightness.
A lightness mapping curve may be determined from the DPL, which may reflect a mapping between the first lightness and the mapped lightness.
Alternatively, the lightness mapping curve may be a segmented lightness mapping curve. Aiming at a display device, a segmented brightness mapping curve which can realize the optimal display effect can be adjusted through a DPL corresponding to the display device according to a segmented adjustment mode.
Next, a segmented brightness mapping curve corresponding to one display device is described with reference to fig. 4.
Fig. 4 is a schematic diagram of a segmented brightness mapping curve corresponding to a display device according to an embodiment of the present application. Referring to FIG. 4, the abscissa of the segmented lightness mapping curve is the first lightness V of the pixel SDR The ordinate is the brightness V of the mapping of the pixel HDR-tmp
It can be seen that the segmented lightness mapping curve comprises a straight line segment and a bezier curve segment, wherein,
the initial coordinate of the lightness mapping curve of the straight line segment is the coordinate origin (0, 0), and the end coordinate is (V) SDR1 ,V HDR -tmp 1). The end point ordinate can be obtained by calculating the slope of the lightness curve of the straight line segment and the end point abscissa, and the calculation process is as follows:
V HDR-tmp1 =V SDR1 ×k
wherein k is the slope of the straight-line segment lightness mapping curve.
In practical applications, a V may be preset according to the DPL of the display device SDR1 And the slope k of the straight-line segment mapping curve. DPL and V of display device in general SDR1 Has a corresponding relation that the larger the DPL value is, the V SDR1 The smaller; the smaller the DPL value, V SDR1 The larger, the more V can be adjusted based on the DPL value of the display device SDR1 Therefore, the first mapping brightness corresponding to the first brightness is displayed normally under the condition that the straight-line segment brightness mapping curve can guarantee the middle and low brightness ranges to the maximum extent.
Coordinate (V) of starting point of lightness mapping curve of Bezier curve segment SDR1 ,V HDR-tmp1 ) End point coordinate (V) SDR2 ,V HDR-tmp4 ) And 2 anchor point coordinates (V) SDR3 ,V HDR-tmp3 ) And (V) SDR4 ,V HDR-tmp4)
In practical application, for the bezier curve segment lightness mapping curve, the anchor point may be one or more, and when a plurality of anchor points are selected, the generated bezier curve segment lightness mapping curve reflects a more accurate mapping relationship.
Optionally, the segmented brightness mapping curve corresponding to the display device may be obtained and generated by the following method: inputting the coordinates (0, 0) of the starting point corresponding to the lightness mapping curve of the straight line segment, the slope k of the straight line segment and the horizontal coordinate V of the end point into python software SDR1 Generating a corresponding straight-line segment lightness mapping curve; inputting the coordinates (V) of the starting point corresponding to the Bezier curve into the python software SDR1 ,V HDR-tmp1 ) Endpoint coordinate (V) SDR2 ,V HDR-tmp4 ) And anchor point coordinates (V) SDR3 ,V HDR-tmp3 )、(V SDR4 ,V HDR-tmp4 ) And generating a corresponding Bezier curve segment lightness mapping curve.
Compared with a simple straight-line segment mapping curve or a curve segment mapping curve, the lightness mapping curve can be segmented in the above mode, and the problems of overlarge brightness, excessive dark noise and the like when an SDR image is displayed on HDR equipment can be effectively solved. For example, when the first lightness of pixels in the SDR image is in the low lightness range or the middle lightness range, the pixels can be guaranteed to be displayed normally by mapping the curve with straight line segments; when the first lightness of the pixels in the SDR image is in the high brightness range, the first mapped lightness of the pixels can be improved by the bezier curve segment, thereby improving the contrast of the SDR image as a whole.
And S304, determining a first mapping brightness according to the first brightness and the brightness mapping curve.
When the first brightness is obtained, a first mapping brightness corresponding to the first brightness may be queried on the brightness mapping curve. For example, when the first lightness is V SDR1 Then, it can be found in the lightness mapping curve shown in fig. 4 that the corresponding first mapping lightness is V HDR-tmp1
S305, determining a second brightness of the pixel according to the backlight percentage, the first brightness and the first mapping brightness.
Optionally, according to the backlight percentage, the first brightness, and the first mapped brightness, the following formula may be used to determine the second brightness of the pixel:
V HDR =P×V HDR-tmp +(1-P)×V SDR
wherein, V HDR Is a second brightness of the pixel; v SDR A first brightness of the pixel; v HDR-tmp A first mapped brightness for the pixel; p is the backlight percentage of the display device.
In the above process, by referring to the backlight percentage of the display device, the first brightness and the first mapping brightness of each pixel of the first image are corrected to obtain the corresponding second brightness, so that the situation that the actual display brightness of the image in the display device is reduced due to the reduction of the backlight percentage of the display device can be effectively improved, and the display effect of the image in the display device is further optimized.
The processes of S303-S305 are performed on each pixel in the first image, and a second brightness of each pixel in the first image can be obtained.
The first image may include a plurality of pixels, and the process of determining the second saturation of any one pixel in the first image is the same, and the process of determining the second saturation of any one pixel will be described below with reference to S306 to S309.
S306, determining a first gain coefficient of the pixel according to the first brightness and the second brightness of the pixel.
Based on the first and second luminances of the pixel, a first gain coefficient of the pixel may be obtained by calculating:
Figure BDA0003841329170000101
wherein, g 1 A first gain factor for a pixel; v HDR Is a second brightness of the pixel; v SDR Is a first brightness of the pixel.
S307, acquiring a saturation gain curve between the first lightness and the second gain coefficient.
The saturation gain curve may reflect a mapping between the first lightness and the second gain factor.
In practical application, for one display device, the saturation gain curve can be manually adjusted according to the change condition of the corresponding saturation under different brightness ranges, so as to realize the optimal saturation gain adjustment result. For example, based on the change of the saturation corresponding to the low brightness range, the saturation gain curve is adjusted, so that the color noise problem caused by the low first brightness and the high saturation can be avoided; based on the change condition of the corresponding saturation under the condition of high brightness range, the saturation gain curve is adjusted to avoid the problem of detail distortion caused by higher first brightness and higher saturation.
Next, a saturation gain curve corresponding to one display device will be described with reference to fig. 5.
Fig. 5 is a schematic diagram of a saturation gain curve corresponding to a display device according to an embodiment of the present disclosure. Referring to fig. 5, the abscissa of the saturation gain curve is a first brightness; the ordinate is the second gain factor. The saturation gain curve has a start point coordinate of (0, 0.6), an end point coordinate of (1, 0.8), and a corresponding coordinate of (0.5, 0.95) corresponding to the maximum value of the second gain coefficient.
S308, determining a second gain coefficient of the pixel according to the first brightness and saturation gain curve of the pixel.
When the first brightness is obtained, a second gain coefficient corresponding to the first brightness can be queried on the saturation gain curve. For example, when the first brightness is 0.5, the saturation gain curve shown in fig. 5 can be found to have a corresponding second gain coefficient of 0.95.
S309, determining a second saturation of the pixel according to the first saturation, the first gain coefficient and the second gain coefficient.
Alternatively, the first saturation, the product of the first gain factor and the second gain factor may be determined as the second saturation of the pixel. For example, the calculation formula of the second saturation of the pixel may be as follows:
S HDR =S SDR ×g 1 ×g sat
wherein S is HDR Is a second saturation of the pixel; s SDR Is a first saturation of the pixel; g is a radical of formula 1 A first gain factor for the pixel; g is a radical of formula sat Is the second gain factor of the pixel.
In an actual application process, for the first image, a saturation compensation algorithm may be adopted to adjust the first saturation of each pixel in the first image, so as to obtain a second saturation corresponding to each pixel. The calculation formula can be applied to the saturation compensation algorithm, and the color defect problem which may occur in the process of adjusting the first saturation can be avoided through twice correction of the first gain coefficient and the second gain coefficient.
The processes of S306-S309 are performed on each pixel in the first image, and the second saturation of each pixel in the first image can be obtained.
S310, aiming at each pixel in the first image, updating the brightness of the pixel to be a corresponding second brightness, and updating the saturation of the pixel to be a corresponding second saturation, so as to obtain a second image.
Optionally, an HSV color model corresponding to the second image may be obtained according to the first hue, the updated second lightness and second saturation of each pixel in the first image, and the second image may be obtained based on the HSV color model corresponding to the second image.
And S311, displaying the second image in the display device.
Optionally, the second image may be displayed on the display device after the second image is obtained. It can be appreciated that since the second image is an HDR image, which has better matching with the HDR device, the second image may present a better display effect in the display device than the first image.
The image processing method provided by the embodiment of the application acquires display parameters of an SDR image and HDR equipment, and a first brightness and a first saturation of each pixel in the SDR image; according to the display parameters and the first lightness and the first saturation of each pixel in the SDR image, determining an HDR image corresponding to the SDR image; HDR images are displayed in a display device. In the process, the SDR image is converted into the HDR image matched with the HDR equipment through an inverse tone mapping method based on brightness and saturation adjustment, and the display effect of the SDR image on the HDR equipment is optimized.
On the basis of any of the above embodiments, the following describes in detail an image processing method according to an embodiment of the present application by taking a specific example in conjunction with fig. 6.
Fig. 6 is a schematic diagram of a specific framework of an image processing method according to an embodiment of the present application. Referring to fig. 6, a first image may be input in a display device, where the display device may be an HDR device and the first image may be an SDR image. And acquiring a first lightness, a first saturation and a first hue of the first image based on the HSV color model corresponding to the first image. Acquiring a segmented brightness mapping curve corresponding to the display equipment according to the DPL of the display equipment; according to the first brightness of each pixel in the first image, searching in a segmented brightness mapping curve to obtain a first mapping brightness corresponding to the pixel; based on the backlight percentage of the display device, and the first brightness and the first mapping brightness of each pixel in the first image obtained in the above steps, a second brightness corresponding to each pixel in the first image can be obtained through the brightness mapping module. Based on the first brightness and the second brightness corresponding to each pixel in the first image, a first gain coefficient corresponding to each pixel is obtained. Acquiring a saturation gain curve corresponding to display equipment; based on the saturation gain curve, a second gain coefficient corresponding to a first brightness of each pixel in the first image may be obtained according to the first brightness. Based on the first saturation, the first gain coefficient and the second gain coefficient corresponding to each pixel in the first image, the second saturation corresponding to each pixel in the first image can be obtained through the saturation mapping module. A second image, which may be an HDR image, is output in the image processing device according to the second lightness, the second saturation, and the first hue in the first image.
It should be noted that, for the execution process of the brightness mapping module, reference may be made to the execution process of step S305 in the embodiment shown in fig. 3 of the present application, and details are not described here again.
It should be noted that, the execution process of the saturation mapping module may refer to step S309 in the embodiment shown in fig. 3 of the present application for processing, and details are not repeated here.
In the embodiment of the application, an HDR image corresponding to an SDR image can be determined and displayed by a brightness and saturation adjustment inverse tone mapping method based on display parameters of an HDR device and a first brightness, a first saturation and a first tone of each pixel in the SDR image. In the process, the SDR image is converted into the HDR image matched with the HDR equipment through an inverse tone mapping method based on brightness and saturation adjustment, and the display effect of the SDR image on the HDR equipment is optimized.
Fig. 7 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure. Referring to fig. 7, the image processing apparatus 10 includes an obtaining module 11 and an adjusting module 12, wherein,
the obtaining module 11 is configured to obtain a first image and display parameters of a display device, where the first image is a standard dynamic range SDR image, and the display device is a high dynamic range HDR device;
the adjusting module 12 is configured to adjust brightness and saturation of the first image according to the display parameter to obtain a second image, where the display parameter at least includes: the peak brightness DPL and/or the backlight percentage are displayed.
The image processing apparatus provided in the embodiment of the present application may execute the technical solutions shown in the foregoing method embodiments, and the implementation principles and beneficial effects thereof are similar, and are not described herein again.
In a possible implementation, the adjusting module 12 is specifically configured to:
acquiring first lightness and first saturation of each pixel in the first image;
determining a second brightness of each pixel in the first image according to the display parameter and a first brightness of each pixel in the first image;
determining a second saturation of each pixel in the first image according to the first saturation of each pixel in the first image;
and updating the first image according to the second lightness and the second saturation of each pixel in the first image to obtain the second image.
In a possible implementation, the adjusting module 12 is specifically configured to:
obtaining a lightness mapping curve between a first lightness and a mapping lightness corresponding to the DPL, wherein the lightness mapping curve is determined according to the DPL;
determining a first mapped lightness from the first lightness and the lightness mapping curve;
determining a second brightness of the pixel as a function of the first brightness and the first mapped brightness.
In a possible implementation, the adjusting module 12 is specifically configured to:
determining a second brightness of the pixel as a function of the backlight percentage, the first brightness, and the first mapped brightness.
In a possible implementation, the adjusting module 12 is specifically configured to:
determining a first gain coefficient for the pixel as a function of a first and second brightness of the pixel;
acquiring a saturation gain curve between the first lightness and the second gain coefficient;
determining a second gain coefficient for the pixel from the first lightness and saturation gain curves for the pixel;
determining a second saturation of the pixel based on the first saturation, the first gain factor, and the second gain factor.
In a possible implementation, the adjusting module 12 is specifically configured to:
determining a product of the first saturation, the first gain factor, and the second gain factor as a second saturation of the pixel.
In a possible implementation, the adjusting module 12 is specifically configured to:
for each pixel in the first image, updating the brightness of the pixel to a corresponding second brightness, and updating the saturation of the pixel to a corresponding second saturation, resulting in the second image.
Fig. 8 is a schematic hardware structure diagram of an image processing apparatus according to an embodiment of the present application. Referring to fig. 8, the image processing apparatus 20 may include a processor 21 and a memory 22. Wherein the processor 21 and the memory 22 may be in communication; illustratively, the processor 21 and the memory 22 communicate via a communication bus 23.
The memory 22 is used for storing computer execution instructions;
the processor 21 is configured to execute the computer-executable instructions stored in the memory 22, so that the processor 21 executes the image processing method according to the embodiment of the method.
Optionally, the image processing device 20 may further comprise a communication interface, which may comprise a transmitter and/or a receiver.
Optionally, the Processor may be a Central Processing Unit (CPU), or may be another general-purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in a processor.
An embodiment of the present application provides a readable storage medium, on which a computer program is stored; the computer program is for implementing the image processing method as described in any of the embodiments above.
The embodiment of the application provides a computer program product, which comprises instructions, when the instructions are executed, the instructions cause a computer to execute the image processing method.
All or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The foregoing program may be stored in a readable memory. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned memory (storage medium) includes: read-only memory (ROM), RAM, flash memory, hard disk, solid state disk, magnetic tape, floppy disk, optical disk, and any combination thereof.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It is to be understood that the various numerical references referred to in the embodiments of the present application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of the present application.
In the present application, the terms "include" and variations thereof may refer to non-limiting inclusions; the term "or" and variations thereof may mean "and/or". The terms "first," "second," and the like in this application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. In the present application, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
It will be apparent to those skilled in the art that various changes and modifications may be made in the embodiments of the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to encompass such modifications and variations.

Claims (11)

1. An image processing method, comprising:
acquiring display parameters of a first image and display equipment, wherein the first image is a Standard Dynamic Range (SDR) image, and the display equipment is High Dynamic Range (HDR) equipment;
according to the display parameters, adjusting brightness and saturation of the first image to obtain a second image, wherein the display parameters at least comprise: the peak brightness DPL and/or the backlight percentage are displayed.
2. The method of claim 1, wherein adjusting brightness and saturation of the first image according to the display parameters to obtain a second image comprises:
acquiring first lightness and first saturation of each pixel in the first image;
determining a second brightness of each pixel in the first image according to the display parameter and the first brightness of each pixel in the first image;
determining a second saturation of each pixel in the first image according to the first saturation of each pixel in the first image;
and updating the first image according to the second lightness and the second saturation of each pixel in the first image to obtain the second image.
3. The method of claim 2, wherein the display parameters comprise at least the DPL; for any one pixel in the first image; determining a second brightness of the pixel from the display parameter and the first brightness of the pixel, comprising:
obtaining a lightness mapping curve between a first lightness and a mapping lightness corresponding to the DPL, wherein the lightness mapping curve is determined according to the DPL;
determining a first mapped lightness from the first lightness and the lightness mapping curve;
determining a second brightness of the pixel as a function of the first brightness and the first mapped brightness.
4. The method of claim 3, wherein the display parameters further comprise at least the backlight percentage; determining a second brightness of the pixel from the first brightness and the first mapped brightness, comprising:
determining a second brightness of the pixel as a function of the backlight percentage, the first brightness, and the first mapped brightness.
5. The method according to any of claims 2-4, wherein for any one pixel in the first image; determining a second saturation of the pixel from the first saturation of the pixel, comprising:
determining a first gain coefficient for the pixel as a function of a first and second brightness of the pixel;
acquiring a saturation gain curve between the first lightness and the second gain coefficient;
determining a second gain coefficient for the pixel from the first lightness and saturation gain curves for the pixel;
determining a second saturation of the pixel based on the first saturation, the first gain factor, and the second gain factor.
6. The method of claim 5, wherein determining a second saturation of the pixel based on the first saturation, the first gain factor, and the second gain factor comprises:
and determining a product of the first saturation, the first gain coefficient and the second gain coefficient as a second saturation of the pixel.
7. The method according to any of claims 2-6, wherein updating the first image to obtain the second image according to a second lightness and a second saturation of each pixel in the first image comprises:
for each pixel in the first image, updating the brightness of the pixel to a corresponding second brightness, and updating the saturation of the pixel to a corresponding second saturation, resulting in the second image.
8. An image processing apparatus comprising an acquisition module and an adjustment module, wherein,
the acquisition module is used for acquiring a first image and display parameters of display equipment, wherein the first image is a Standard Dynamic Range (SDR) image, and the display equipment is High Dynamic Range (HDR) equipment;
the adjusting module is configured to adjust brightness and saturation of the first image according to the display parameter to obtain a second image, where the display parameter at least includes: the peak luminance DPL and/or the backlight percentage are displayed.
9. An image processing apparatus characterized by comprising: a processor and a memory;
the memory is used for storing a computer program;
the processor is configured to execute the computer program stored in the memory to implement the method according to any one of claims 1 to 7.
10. A computer-readable storage medium having computer-executable instructions stored thereon, which when executed by a processor, perform the method of any one of claims 1 to 7.
11. A computer program product, characterized in that it comprises a computer program which, when executed by a processor, implements the method of any one of claims 1 to 7.
CN202211102784.XA 2022-09-09 2022-09-09 Image processing method, device and equipment Pending CN115457920A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211102784.XA CN115457920A (en) 2022-09-09 2022-09-09 Image processing method, device and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211102784.XA CN115457920A (en) 2022-09-09 2022-09-09 Image processing method, device and equipment

Publications (1)

Publication Number Publication Date
CN115457920A true CN115457920A (en) 2022-12-09

Family

ID=84303598

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211102784.XA Pending CN115457920A (en) 2022-09-09 2022-09-09 Image processing method, device and equipment

Country Status (1)

Country Link
CN (1) CN115457920A (en)

Similar Documents

Publication Publication Date Title
US8089560B2 (en) Image processing apparatus, image processing method and program
US9767544B2 (en) Scene adaptive brightness/contrast enhancement
US8463067B2 (en) Apparatus and method for improving visibility of image
US9743073B2 (en) Image processing device with image compensation function and image processing method thereof
CN109274985B (en) Video transcoding method and device, computer equipment and storage medium
JP2018510573A (en) Display unevenness correction method, apparatus, and system
US10332481B2 (en) Adaptive display management using 3D look-up table interpolation
WO2019101005A1 (en) Pixel compensation method and apparatus, and terminal device
WO2020216085A1 (en) Tetrahedral interpolation calculation method and apparatus, gamut conversion method and apparatus, and medium
CN109599054A (en) The control method and device of display panel brightness
JP5102351B2 (en) Video signal processing circuit, display device, portable terminal, and program
CN108846871B (en) Image processing method and device
CN112929625B (en) Display material rendering method and device
CN113079362B (en) Video signal processing method and device and electronic equipment
JP2014220815A (en) Image color adjusting method and electronic device using the same
JP2004151167A (en) Method and system for image correction
CN112911366B (en) Saturation adjustment method and device and display equipment
WO2009093294A1 (en) Image signal processing device and image signal processing program
CN115457920A (en) Image processing method, device and equipment
CN116382540A (en) Display method and device for electronic paper, electronic equipment and storage medium
CN115801969A (en) Video data processing method, video display method and device, electronic equipment and readable storage medium
KR20120138477A (en) Method for generating panorama image within digital image processing apparatus
CN114999363A (en) Color shift correction method, device, equipment, storage medium and program product
US10735703B2 (en) Electronic device and associated image processing method
JP5123270B2 (en) Image processing apparatus and image display apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination