WO2018111682A1 - Systems and methods for adjusting video processing curves for high dynamic range images - Google Patents

Systems and methods for adjusting video processing curves for high dynamic range images Download PDF

Info

Publication number
WO2018111682A1
WO2018111682A1 PCT/US2017/065114 US2017065114W WO2018111682A1 WO 2018111682 A1 WO2018111682 A1 WO 2018111682A1 US 2017065114 W US2017065114 W US 2017065114W WO 2018111682 A1 WO2018111682 A1 WO 2018111682A1
Authority
WO
WIPO (PCT)
Prior art keywords
curve
original
adjustment
mapping
video
Prior art date
Application number
PCT/US2017/065114
Other languages
French (fr)
Inventor
Jaclyn Anne Pytlarz
Robin Atkins
Original Assignee
Dolby Laboratories Licensing Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dolby Laboratories Licensing Corporation filed Critical Dolby Laboratories Licensing Corporation
Priority to US16/461,779 priority Critical patent/US11468547B2/en
Priority to EP17818715.9A priority patent/EP3552178B1/en
Priority to JP2019551501A priority patent/JP6845946B2/en
Priority to CN201780076408.9A priority patent/CN110050292B/en
Publication of WO2018111682A1 publication Critical patent/WO2018111682A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • G06T5/92Dynamic range modification of images or parts thereof based on global image properties
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20208High dynamic range [HDR] image processing

Definitions

  • the present invention relates to High Dynamic Range Displays (HDR), and more particularly to HDR displays using dual modulation.
  • HDR High Dynamic Range Displays
  • the term 'dynamic range' may relate to a capability of the human visual system (HVS) to perceive a range of intensity (e.g., luminance, luma) in an image, e.g., from darkest grays (blacks) to brightest whites (highlights).
  • HVS human visual system
  • DR relates to a 'scene-referred' intensity.
  • DR may also relate to the ability of a display device to adequately or approximately render an intensity range of a particular breadth. In this sense, DR relates to a 'display-referred' intensity.
  • the term may be used in either sense, e.g. interchangeably.
  • HDR high dynamic range
  • HVS human visual system
  • EDR enhanced dynamic range
  • VDR visual dynamic range
  • EDR may individually or interchangeably relate to the DR that is perceivable within a scene or image by a human visual system (HVS) that includes eye movements, allowing for some light adaptation changes across the scene or image.
  • EDR may relate to a DR that spans 5 to 6 orders of magnitude.
  • HDR displays and the technology behind them are marketed as DOLBY
  • HDR displays now being constructed, may use a backlight comprising modulated light sources such as modulated LEDs.
  • modulated LEDs Such backlights are sometimes called IMLED (Individually Modulated Array of LED) backlights.
  • IMLED Individually Modulated Array of LED
  • the brightness of each LED is controlled by an 8-bit signal, so each LED has 256 brightness steps.
  • a plurality of small regions are backlit in a modulated manner according to the local brightness and contrast in the scene being shown.
  • n ⁇ 8 e.g., color 24-bit JPEG images
  • images where n > 8 may be considered images of enhanced dynamic range.
  • EDR and HDR images may also be stored and distributed using high-precision (e.g., 16-bit) floating-point formats, such as the OpenEXR file format developed by Industrial Light and Magic.
  • a reference electro-optical transfer function (EOTF) for a given display characterizes the relationship between color values (e.g., luminance) of an input video signal to output screen color values (e.g., screen luminance) produced by the display.
  • color values e.g., luminance
  • screen color values e.g., screen luminance
  • ITU Rec. rrU-R BT. 1886 "Reference electro-optical transfer function for flat panel displays used in HDTV studio production," (03/2011), which is included herein by reference in its entity, defines the reference EOTF for flat panel displays based on measured characteristics of the Cathode Ray Tube (CRT).
  • CRT Cathode Ray Tube
  • Metadata relates to any auxiliary information that is transmitted as part of the coded bitstream and assists a decoder to render a decoded image.
  • metadata may include, but are not limited to, color space or gamut information, reference display parameters, and auxiliary signal parameters, as those described herein.
  • HDR lower dynamic range
  • SDR standard dynamic range
  • HDR content may be color graded and displayed on HDR displays that support higher dynamic ranges (e.g., from 1,000 nits to 5,000 nits or more).
  • Such displays may be defined using alternative EOTFs that support high luminance capability (e.g., 0 to 10,000 nits).
  • An example of such an EOTF is defined in SMPTE ST 2084:2014 "High Dynamic Range EOTF of Mastering Reference Displays," which is incorporated herein by reference in its entirety.
  • the methods of the present disclosure relate to any dynamic range higher than SDR.
  • a method for applying an adjustment to an original curve derived from a set of input image data comprising: receiving a set of input image data to be adjusted; calculating an original curve from the set of input image data; receiving an adjustment curve, the adjustment curve based upon a desired image parameter; and applying the adjustment curve to the original curve to produce a resulting curve.
  • a display management unit comprising a processor that, upon receiving a set of input image data, processes the original curve according to: calculating an original curve from the set of input image data; receiving an adjustment curve, the adjustment curve based upon a desired image parameter; and applying the adjustment curve to the original curve to produce a resulting curve.
  • the original curve may be a luminance mapping or chrominance mapping curve, i.e. instructions for mapping the image data to luma or chroma values for rendering a final image on a display device.
  • the adjustment curve (which may be represented by a lookup-table featuring multiple values) may be based on a scaling factor representing an ambient illumination of a viewing environment and/or user preferences such that the original curve may represent the default mapping parameters that would be applied if neither ambient illumination nor user preferences were available.
  • FIG. 1 depicts an example process for a video delivery pipeline.
  • FIG. 2 depicts one embodiment of an application of an adjustment curve to an original curve.
  • FIG. 3 depicts one example of the application of the adjustment module of FIG. 2.
  • FIG. 4 depicts this embodiment of an application of a brightness adjustment curve to an original curve.
  • FIG. 5 depicts one embodiment of an application of a contrast adjustment curve to an original curve.
  • FIGS. 6 through 11 depict a number of adjustment processing examples that may be applied to an exemplary original curve.
  • FIG. 1 depicts an example process of a video delivery pipeline (100) showing various stages from video capture to video content display.
  • a sequence of video frames (102) is captured or generated using image generation block (105).
  • Video frames (102) may be digitally captured (e.g. by a digital camera) or generated by a computer (e.g. using computer animation) to provide video data (107).
  • video frames (102) may be captured on film by a film camera. The film is converted to a digital format to provide video data (107).
  • a production phase (110) video data (107) is edited to provide a video production stream (112).
  • Block (115) post-production editing may include adjusting or modifying colors or brightness in particular areas of an image to enhance the image quality or achieve a particular appearance for the image in accordance with the video creator's creative intent. This is sometimes called "color timing" or "color grading.”
  • Other editing e.g. scene selection and sequencing, image cropping, addition of computer-generated visual special effects, etc.
  • video images are viewed on a reference display (125).
  • video data of final production may be delivered to encoding block (120) for delivering downstream to decoding and playback devices such as television sets, set-top boxes, movie theaters, and the like.
  • coding block (120) may include audio and video encoders, such as those defined by ATSC, DVB, DVD, Blu-Ray, and other delivery formats, to generate coded bit stream (122).
  • the coded bit stream (122) is decoded by decoding unit (130) to generate a decoded signal (132) representing an identical or close approximation of signal (117).
  • the receiver may be attached to a target display (140) which may have completely different characteristics than the reference display (125).
  • a display management unit (135) may be used to map the dynamic range of decoded signal (132) to the characteristics of the target display (140) by generating display-mapped signal (137).
  • DMU display management unit
  • the display management unit may be implemented external to the display or internal to the display system and that the scope of the present application encompasses these various embodiments.
  • the DMU may comprise a processor and a computer readable memory, executing image processing algorithms as described herein - e.g., in the form of a set-top box, codec as is well known in the art.
  • both systems and methods are disclosed to adjust various video curves according to tone, saturation, brightness and the like.
  • the adjustments may be either accomplished automatically - or according to user preference and input.
  • ambient corrections may be made to the video curves due to increased room illumination, screen reflectance - as well as for user preference adjustments to change, e.g., the average pixel luminance of an image, or to alter saturation.
  • FIG. 2 is one embodiment of an application of adjusting an original image curve according to some adjustment parameter.
  • this adjustment method may be executed as an adjustment module in a DMU at some point in the video pipeline.
  • Method (200) calculates one or more adjustment curves (202) and calculates the original curve (204) and applies the adjustment curve to the original curve (206).
  • an original curve may be derived from a number of sources - e.g., an image, a frame of video data, a scene in a video (e.g., multiple consecutive frames of video data) or the like.
  • an original curve may be the processing that would happen irrespective of any adjustment curve.
  • this original curve may be the display curve designed to tone map an image from one display to another.
  • This original curve may be input and/or otherwise received by a suitable module and/or processing component in the video pipeline. It will also be appreciated that, while the present application talks of "original curve”, the “original curve” may also be presented as a sequence of numbers to the suitable module for further processing - and may or may not literally be a curve.
  • FIG. 3 depicts one example of the application of the adjustment module of FIG. 2.
  • the original data is calculated as curve 302 and an adjustment curve is calculated as curve 304.
  • the resulting, combined curve is shown as curve 306.
  • the original curve may be calculated according to one or more parameters - e.g., saturation, tone mapping, 1 : 1 mapping and the like.
  • the adjustment curve may be received, derived and/or calculated from one or more image parameters (e.g., brightness, saturation, contrast or the like) and may or may not literally be presented as a curve (e.g., the adjustment curve may be presented as a derived sequence of numbers to a suitable module).
  • the adjustment curve may be applied to additionally process the image beyond the parameters specified in the "original curve". In one embodiment, this curve allows for a user preference such as increased saturation to be applied during tone mapping (tone mapping is the "original curve”). This tends to increase efficiency and color accuracy.
  • the application of adjustment curve to an original curve may be performed by one or more of the linear or nonlinear operations (e.g., addition, subtraction, multiplication, division, convolution etc.). In one embodiment, it is desirable to ensure that the resulting, combined curve 306 should substantially be a monotonic function - otherwise, it may be possible to produce some odd visual effect. It will be appreciated that the resulting curve may be presented by the suitable module, DMU or the like to the display for final rendering of an image. As with the "original curves" and “adjustment curves” above, the final resulting curve may or may not literally be a curve - but presented as a derived sequence of numbers to a suitable module, DMU, or display for final rendering.
  • the adjustment curve may also be applied to the input parameters
  • the adjusted input parameters may be used to calculate an adjusted original curve
  • - the adjusted original curve may be applied to the adjustment curve; and - the adjusted adjustment curve may be applied to the input image.
  • the image should be adjusted if the relative appearance is to remain consistent.
  • the image adjustment may be applied using a one-dimensional function, e.g., where the single variable is the surround luminance of the display. Such a one- dimensional function may be calculated first, and a scalar is applied.
  • the Table 1 is one embodiment
  • a typical value for L original adapting luminance may be 5 cd/m2.
  • Typical scaling factor values range from 0-10 and should be correlated with ambient illumination which may be derived from sensor data or theoretically based on user preference.
  • B may also comprise a Barton contrast sensitivity function in some embodiments.
  • the original curve may be defined by previous mapping or tone curves applied to an image. If no previous mapping or curve is available, or if none is desired, a 1 : 1 curve may be used as the original curve.
  • Step 3 Apply (add) the adjustment curve to the original curve
  • A Input pixel value scaled 0-1 (encoded with the ST 2084 non-linearity).
  • L and S may change based on user preference, display capabilities, or ambient illumination. These equations may also be altered to apply various ambient correction look-up-tables in a similar fashion.
  • a saturation adjustment curve may be applied/changed based on user preference.
  • the adjustment curve may be applied to any form of saturation component (e.g., RGB independently or a chroma component CTCP of IOrCp).
  • saturation component e.g., RGB independently or a chroma component CTCP of IOrCp.
  • the saturation of each pixel may be modified according to its intensity using the following equation (e.g., as in the method noted in FIG. 2 and as may be substituted in Table 1 above):
  • CT and Cp are the chroma components of the source image
  • C'T and C'p are the chroma components of the target image, in ICTCP or IPT color space as described in Rec. ITU-R BT. 2100, "Image parameter values for high dynamic range television for use in production and international programme exchange," July 2016, which is incorporated herein by reference..
  • the SaturationScaleFunction may be further
  • PreferenceScaleFunction are pre-determined or tuned curves as described herein.
  • a brightness adjustment curve may be employed. Such a curve may be modified to change the brightness of the image and may be applied to any form of brightness component (e.g., RGB independently or a luminance component such as I of ICTCP).
  • the adjustment curve may be applied during the time that the DMU is applying a display tone mapping and may be applied directly to the original tone mapping curve.
  • the minimum, mean and maximum of the image may be used to define a Gaussian-like function.
  • min, mean, and max values denote the minimum, average, and maximum luminance values in a frame or a scene
  • the m function outputs the minimum between
  • the variables a, b, and c may be altered independently based on user preference.
  • the Gaussian curve may also be skewed based on the mean of the image so as to avoid brightening noise in an image.
  • FIG. 4 depicts this embodiment - as original curve 402 is adjusted by curve 404, to produce a resulting, combined curve 406. It will be noted that the min, mean and max values are as shown in curve 404 and the resulting values as mapped in curve 406.
  • the same processing concepts may apply - e.g., there is some original tone mapping and some contrast adjustment curve may be applied. It will be appreciated that a suitable contrast adjustment curve may be derived automatically (e.g., with ambient data, possibly recorded by a sensor), or may be user-supplied.
  • FIG. S depicts one embodiment of a contrast adjustment curve being applied to original curve S02.
  • the contrast curve may look like the negative of the derivative of the brightness curve (e.g., the derivative of a Gaussian). In one embodiment, this may allow to increase the slope of the curve around the midpoint (as noted)— but without changing the brightness at the midpoint in resulting curve 506. Increasing the slope may increase the contrast in a way that doesn't affect the brightness. By selecting the width and center of the adjustment curve, it is possible to optimize the effect on the image.
  • FIGS. 6 through 11 depict a number of adjustment processing examples that may be applied to an exemplary original curve 602. It will be appreciated that although the original curve 602 (and other original curves depicted herein) may be shown as a 1 : 1 mapping, the original curve may assume may other forms and/or mappings.
  • Curves 702 and 802 depict exemplary brightness and contrast adjustment curves, respectively.
  • Curves 902, 1002 and 1102 depict final curves, resulting from brightness adjustment, contrast adjustment and a combination of both brightness and contrast
  • the present invention includes a computer program product which is a storage medium (media) having instructions stored thereon/in which can be used to control, or cause, a computer to perform any of the processes of the present invention.
  • the storage medium can include, but is not limited to, any type of disk including floppy disks, mini disks (MD's), optical discs, DVD, HD-DVD, Blue-ray, CD-ROMS, CD or DVD RW+/-, micro-drive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices (including flash cards, memory sticks), magnetic or optical cards, SIM cards, MEMS, nanosystems (including molecular memory ICs), RAID devices, remote data storage/archive/warehousing, or any type of media or device suitable for storing instructions and/or data.
  • the present invention includes software for controlling both the hardware of the general
  • Such software may include, but is not limited to, device drivers, operating systems, and user applications.
  • Such computer readable media further includes software for performing the present invention, as described above.
  • the present invention may suitably comprise, consist of, or consist essentially of, any of element (the various parts or features of the invention) and their equivalents as described herein. Further, the present invention illustratively disclosed herein may be practiced in the absence of any element, whether or not specifically disclosed herein.
  • EEE 1 A method for applying an adjustment to an original curve derived from a set of input image data, comprising:
  • EEE 2 The method according to EEE 1, wherein the set of input image data comprises one of an image, a frame of video data and a scene in a video.
  • EEE 3 The method according to EEE 1 or 2, wherein calculating an original curve from the set of input image data further comprises calculating original curve from one or more image parameters.
  • EEE 4 The method according to EEE 3, wherein one or more image parameters for calculating an original curve comprises one of a saturation parameter, tone mapping parameter and 1:1 mapping parameter.
  • EEE 5 The method according to any of the EEEs 1-4, wherein the desired image parameter upon which the adjustment curve is based comprises one of ambient parameter, saturation parameter, brightness parameter and a contrast parameter.
  • EEE 6 The method according to EEE 5, wherein applying the adjustment curve to the original curve comprises applying an operation to the original curve employing the adjustment curve.
  • EEE 7 The method according to EEE 6, wherein the operation comprises one of addition, subtraction, multiplying, dividing and convolving.
  • EEE 8 The method according to any of the EEEs 5-7, wherein the desired image parameter comprises an ambient parameter and the adjustment curve is calculated as:
  • S comprises a scaling factor based on ambient illumination and B is a function dependent on input pixel values, assumed original adapting luminance and a function based on EOTF.
  • EEE 9 The method according to any of the EEEs 5-7, wherein the desired image parameter comprises a saturation parameter and the adjustment curve is calculated as:
  • EEE 11 The method according to any of the EEEs 5-7, wherein the desired image parameter comprises a brightness parameter and the adjustment curve is calculated as: wherein x comprises an input pixel value, a comprises a change in brightness requested based on preference, b comprises the mean and c comprises the min(max-mean, mean-mi n).
  • EEE 12 The method according to any of the EEEs 5-7, wherein the desired image parameter comprises a contrast parameter and the adjustment curve is calculated as negative of the derivative of the brightness curve.
  • EEE 13 The method according to any of the EEEs 1-12, wherein the method further comprises:
  • a display management unit comprising a processor that, upon receiving a set of input image data, processes the original curve according to:
  • EEE 15 The DMU according to EEE 14, wherein the desired image parameter upon which the adjustment curve is based comprises one of ambient parameter, saturation parameter, brightness parameter and a contrast parameter.
  • EEE 16 The DMU according to EEE 15, wherein applying the adjustment curve to the original curve comprises applying an operation to the original curve employing the adjustment curve.
  • EEE 17 The DMU according to EEE 16, wherein the operation comprises one of addition, subtraction, multiplying, dividing and convolving.
  • EEE 18 The DMU according to any of the EEEs 14-17, wherein the DMU sends the resulting curve to a display for rendering a final image based on the resulting curve.
  • EEE 19 The DMU according to EEE 18, wherein the DMU is external to the display.
  • EEE 20 The DMU according to EEE 18, wherein the display comprises the DMU.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Systems and methods for adjusting video processing curves are disclosed herein. In one embodiment a method for applying an adjustment to an original curve derived from a set of input image data is disclosed, comprising: receiving a set of input image data to be adjusted; calculating an original curve from the set of input image data; receiving an adjustment curve, the adjustment curve based upon a desired image parameter; and applying the adjustment curve to the original curve to produce a resulting curve. In another embodiment, a display management unit (DMU) comprising a processor is disclosed that, upon receiving a set of input image data, processes the original curve according to: calculating an original curve from the set of input image data; receiving an adjustment curve, the adjustment curve based upon a desired image parameter; and applying the adjustment curve to the original curve to produce a resulting curve.

Description

SYSTEMS AND METHODS FOR ADJUSTING VIDEO PROCESSING CURVES FOR HIGH DYNAMIC RANGE IMAGES
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims the benefit of priority to European Patent Application
No. 17152419.2, filed January 20, 2017, and U.S. Provisional Patent Application No.
62/432,912, filed December 12, 2016, both of which are incorporated herein by reference in their entirety.
TECHNICAL FIELD
[0002] The present invention relates to High Dynamic Range Displays (HDR), and more particularly to HDR displays using dual modulation.
BACKGROUND
[0003] As used herein, the term 'dynamic range' (DR) may relate to a capability of the human visual system (HVS) to perceive a range of intensity (e.g., luminance, luma) in an image, e.g., from darkest grays (blacks) to brightest whites (highlights). In this sense, DR relates to a 'scene-referred' intensity. DR may also relate to the ability of a display device to adequately or approximately render an intensity range of a particular breadth. In this sense, DR relates to a 'display-referred' intensity. Unless a particular sense is explicitly specified to have particular significance at any point in the description herein, it should be inferred that the term may be used in either sense, e.g. interchangeably.
[0004] As used herein, the term high dynamic range (HDR) relates to a DR breadth that spans the some 14-15 orders of magnitude of the human visual system (HVS). In practice, the DR over which a human may simultaneously perceive an extensive breadth in intensity range may be somewhat truncated, in relation to HDR. As used herein, the terms enhanced dynamic range (EDR) or visual dynamic range (VDR) may individually or interchangeably relate to the DR that is perceivable within a scene or image by a human visual system (HVS) that includes eye movements, allowing for some light adaptation changes across the scene or image. As used herein, EDR may relate to a DR that spans 5 to 6 orders of magnitude. Thus while perhaps somewhat narrower in relation to true scene referred HDR, EDR nonetheless represents a wide DR breadth and may also be referred to as HDR. [0005] HDR displays and the technology behind them are marketed as DOLBY
VISION™ by Dolby Laboratories Licensing Corporation., related to the assignee of the present invention. HDR displays, now being constructed, may use a backlight comprising modulated light sources such as modulated LEDs. Such backlights are sometimes called IMLED (Individually Modulated Array of LED) backlights. In one version, the brightness of each LED is controlled by an 8-bit signal, so each LED has 256 brightness steps. Rather than having a single light source behind an LCD screen, a plurality of small regions are backlit in a modulated manner according to the local brightness and contrast in the scene being shown.
[0006] In practice, images comprise one or more color components (e.g., luma Y and chroma Cb and Cr) wherein each color component is represented by a precision of n-bits per pixel (e.g., n=8). Using linear luminance coding, images where n < 8 (e.g., color 24-bit JPEG images) are considered images of standard dynamic range, while images where n > 8 may be considered images of enhanced dynamic range. EDR and HDR images may also be stored and distributed using high-precision (e.g., 16-bit) floating-point formats, such as the OpenEXR file format developed by Industrial Light and Magic.
[0007] A reference electro-optical transfer function (EOTF) for a given display characterizes the relationship between color values (e.g., luminance) of an input video signal to output screen color values (e.g., screen luminance) produced by the display. For example, ITU Rec. rrU-R BT. 1886, "Reference electro-optical transfer function for flat panel displays used in HDTV studio production," (03/2011), which is included herein by reference in its entity, defines the reference EOTF for flat panel displays based on measured characteristics of the Cathode Ray Tube (CRT). Given a video stream, information about its EOTF is typically embedded in the bit stream as metadata. As used herein, the term "metadata" relates to any auxiliary information that is transmitted as part of the coded bitstream and assists a decoder to render a decoded image. Such metadata may include, but are not limited to, color space or gamut information, reference display parameters, and auxiliary signal parameters, as those described herein.
[0008] Most consumer desktop displays currently support luminance of 200 to 300 cd/m2 or nits. Most consumer HDTVs range from 300 to 500 nits with new models reaching 1000 nits (cd/m2). Such conventional displays thus typify a lower dynamic range (LDR), also referred to as a standard dynamic range (SDR), in relation to HDR or EDR. As the availability of HDR content grows due to advances in both capture equipment (e.g., cameras) and HDR displays (e.g., the PRM-4200 professional reference monitor from Dolby Laboratories), HDR content may be color graded and displayed on HDR displays that support higher dynamic ranges (e.g., from 1,000 nits to 5,000 nits or more). Such displays may be defined using alternative EOTFs that support high luminance capability (e.g., 0 to 10,000 nits). An example of such an EOTF is defined in SMPTE ST 2084:2014 "High Dynamic Range EOTF of Mastering Reference Displays," which is incorporated herein by reference in its entirety. In general, without limitation, the methods of the present disclosure relate to any dynamic range higher than SDR.
[0009] The approaches described in this section are approaches that could be pursued, but not necessarily approaches that have been previously conceived or pursued. Therefore, unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section. Similarly, issues identified with respect to one or more approaches should not assume to have been recognized in any prior art on the basis of this section, unless otherwise indicated.
SUMMARY
[00010] Systems and methods for adjusting video processing curves are disclosed herein. In one embodiment, a method for applying an adjustment to an original curve derived from a set of input image data is disclosed, comprising: receiving a set of input image data to be adjusted; calculating an original curve from the set of input image data; receiving an adjustment curve, the adjustment curve based upon a desired image parameter; and applying the adjustment curve to the original curve to produce a resulting curve.
[00011] In another embodiment, a display management unit (DMU) comprising a processor is disclosed that, upon receiving a set of input image data, processes the original curve according to: calculating an original curve from the set of input image data; receiving an adjustment curve, the adjustment curve based upon a desired image parameter; and applying the adjustment curve to the original curve to produce a resulting curve.
[00012] The original curve may be a luminance mapping or chrominance mapping curve, i.e. instructions for mapping the image data to luma or chroma values for rendering a final image on a display device. The adjustment curve (which may be represented by a lookup-table featuring multiple values) may be based on a scaling factor representing an ambient illumination of a viewing environment and/or user preferences such that the original curve may represent the default mapping parameters that would be applied if neither ambient illumination nor user preferences were available.
BRIEF DESCRIPTION OF THE DRAWINGS
[00013] A more complete appreciation of the invention and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:
[00014] FIG. 1 depicts an example process for a video delivery pipeline.
[00015] FIG. 2 depicts one embodiment of an application of an adjustment curve to an original curve.
[00016] FIG. 3 depicts one example of the application of the adjustment module of FIG. 2.
[00017] FIG. 4 depicts this embodiment of an application of a brightness adjustment curve to an original curve.
[00018] FIG. 5 depicts one embodiment of an application of a contrast adjustment curve to an original curve.
[00019] FIGS. 6 through 11 depict a number of adjustment processing examples that may be applied to an exemplary original curve.
DESCRIPTION OF EXAMPLE EMBODIMENTS
[00020] Various video processing adjustments are described herein. In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, that the present invention may be practiced without these specific details. In other instances, well- known structures and devices are not described in exhaustive detail, in order to avoid unnecessarily occluding, obscuring, or obfuscating the present invention.
Example Video Delivery Processing Pipeline
[00021] Many example embodiments described herein relate to the adjustment of video curves according to several conditions - e.g., (including, but not limited to) ambient correction, user preference settings or the like. Such adjustments may be performed to one or more of the following parameters— tone, saturation, brightness, among others. These adjustments may be performed at various points in the image pipeline delivery - e.g., during display management or the like.
[00022] FIG. 1 depicts an example process of a video delivery pipeline (100) showing various stages from video capture to video content display. A sequence of video frames (102) is captured or generated using image generation block (105). Video frames (102) may be digitally captured (e.g. by a digital camera) or generated by a computer (e.g. using computer animation) to provide video data (107). Alternatively, video frames (102) may be captured on film by a film camera. The film is converted to a digital format to provide video data (107). In a production phase (110), video data (107) is edited to provide a video production stream (112).
[00023] The video data of production stream (112) is then provided to a processor at block (115) for post-production editing. Block (115) post-production editing may include adjusting or modifying colors or brightness in particular areas of an image to enhance the image quality or achieve a particular appearance for the image in accordance with the video creator's creative intent. This is sometimes called "color timing" or "color grading." Other editing (e.g. scene selection and sequencing, image cropping, addition of computer-generated visual special effects, etc.) may be performed at block (115) to yield a final version (117) of the production for distribution. During post-production editing (115), video images are viewed on a reference display (125).
[00024] Following post-production (115), video data of final production (117) may be delivered to encoding block (120) for delivering downstream to decoding and playback devices such as television sets, set-top boxes, movie theaters, and the like. In some embodiments, coding block (120) may include audio and video encoders, such as those defined by ATSC, DVB, DVD, Blu-Ray, and other delivery formats, to generate coded bit stream (122). In a receiver, the coded bit stream (122) is decoded by decoding unit (130) to generate a decoded signal (132) representing an identical or close approximation of signal (117). The receiver may be attached to a target display (140) which may have completely different characteristics than the reference display (125). In that case, a display management unit (DMU) (135) may be used to map the dynamic range of decoded signal (132) to the characteristics of the target display (140) by generating display-mapped signal (137). [0002S] As mentioned above, there may be several points in this video pipeline where adjustment curves are applied to the video data - including display management unit (135). It will be appreciated that the display management unit may be implemented external to the display or internal to the display system and that the scope of the present application encompasses these various embodiments. In one embodiment, the DMU may comprise a processor and a computer readable memory, executing image processing algorithms as described herein - e.g., in the form of a set-top box, codec as is well known in the art.
Overview of Video Adjustments
[00026] In many embodiments of the present application, both systems and methods are disclosed to adjust various video curves according to tone, saturation, brightness and the like. The adjustments may be either accomplished automatically - or according to user preference and input. For just a few examples, ambient corrections may be made to the video curves due to increased room illumination, screen reflectance - as well as for user preference adjustments to change, e.g., the average pixel luminance of an image, or to alter saturation.
[00027] FIG. 2 is one embodiment of an application of adjusting an original image curve according to some adjustment parameter. In one embodiment, this adjustment method may be executed as an adjustment module in a DMU at some point in the video pipeline. Method (200) calculates one or more adjustment curves (202) and calculates the original curve (204) and applies the adjustment curve to the original curve (206). In several embodiments, an original curve may be derived from a number of sources - e.g., an image, a frame of video data, a scene in a video (e.g., multiple consecutive frames of video data) or the like. Also, an original curve may be the processing that would happen irrespective of any adjustment curve. In one embodiment, this original curve may be the display curve designed to tone map an image from one display to another. This original curve may be input and/or otherwise received by a suitable module and/or processing component in the video pipeline. It will also be appreciated that, while the present application talks of "original curve", the "original curve" may also be presented as a sequence of numbers to the suitable module for further processing - and may or may not literally be a curve.
[00028] FIG. 3 depicts one example of the application of the adjustment module of FIG. 2. As is shown, the original data is calculated as curve 302 and an adjustment curve is calculated as curve 304. The resulting, combined curve is shown as curve 306. The original curve may be calculated according to one or more parameters - e.g., saturation, tone mapping, 1 : 1 mapping and the like. As with the "original curve" mentioned above, the adjustment curve may be received, derived and/or calculated from one or more image parameters (e.g., brightness, saturation, contrast or the like) and may or may not literally be presented as a curve (e.g., the adjustment curve may be presented as a derived sequence of numbers to a suitable module). The adjustment curve may be applied to additionally process the image beyond the parameters specified in the "original curve". In one embodiment, this curve allows for a user preference such as increased saturation to be applied during tone mapping (tone mapping is the "original curve"). This tends to increase efficiency and color accuracy. The application of adjustment curve to an original curve may be performed by one or more of the linear or nonlinear operations (e.g., addition, subtraction, multiplication, division, convolution etc.). In one embodiment, it is desirable to ensure that the resulting, combined curve 306 should substantially be a monotonic function - otherwise, it may be possible to produce some odd visual effect. It will be appreciated that the resulting curve may be presented by the suitable module, DMU or the like to the display for final rendering of an image. As with the "original curves" and "adjustment curves" above, the final resulting curve may or may not literally be a curve - but presented as a derived sequence of numbers to a suitable module, DMU, or display for final rendering.
[00029] It should be appreciated that one main benefit of implementing a single resulting curve is efficiency and ease of adjustment. In one embodiment, it is possible to employ an interchangeable function that is added to a tone or saturation mapping curve - making modifications simpler. In another embodiment, the curve may also be implemented as a one-dimensional look-up table for speed and efficient. Such an implementation would be efficient because the adjustment curves may be tuned/tweaked to meet customer
requirements, without requiring major changes to the overall algorithm.
[00030] It should also be appreciated that the application of adjustment may occur at various parts of a system and method and need not necessarily follow in any order as a step in a method. For merely some examples, the adjustment curve could be applied to the input image, as follows:
- the adjustment curve may also be applied to the input parameters;
- the adjusted input parameters may be used to calculate an adjusted original curve;
- the adjusted original curve may be applied to the adjustment curve; and - the adjusted adjustment curve may be applied to the input image.
[00031] These various adjustments may occur in any suitable order without departing from the scope of the present application. In addition, adjustments may also be made to the metadata at some point in the processing.
Embodiment for Applying Ambient Correction
[00032] It will now be described several embodiments of applying ambient
corrections/adjustments to an original curve. In one embodiment, as a surround luminance of a display increases, the image should be adjusted if the relative appearance is to remain consistent. In this embodiment, the image adjustment may be applied using a one-dimensional function, e.g., where the single variable is the surround luminance of the display. Such a one- dimensional function may be calculated first, and a scalar is applied. The Table 1 is one embodiment
TABLE 1 - AMBIENT CORRECTION METHOD
Figure imgf000009_0001
A typical value for L (original adapting luminance) may be 5 cd/m2. Typical scaling factor values range from 0-10 and should be correlated with ambient illumination which may be derived from sensor data or theoretically based on user preference. B may also comprise a Barton contrast sensitivity function in some embodiments.
Step 2: Calculate the original curve
The original curve may be defined by previous mapping or tone curves applied to an image. If no previous mapping or curve is available, or if none is desired, a 1 : 1 curve may be used as the original curve.
Let: A = Input pixel value scaled 0-1 (encoded with the ST 2084 non-linearity). D = Original curve, then D=A
Step 3: Apply (add) the adjustment curve to the original curve
Let: A = Input pixel value scaled 0-1 (encoded with the ST 2084 non-linearity).
E = Output pixel value scaled 0-1 (encoded with the ST 2084 non-linearity), then
E=D+C
The actual values used for L and S may change based on user preference, display capabilities, or ambient illumination. These equations may also be altered to apply various ambient correction look-up-tables in a similar fashion.
Various Adjustment Curves Embodiments
[00033] It will now be described several embodiments of implementing various adjustment curves according to some parameter. Many embodiments may be variations of the general embodiment of FIG. 2 - e.g., the adjustment curve is altered compared to the ambient correction adjustment curve. [00034] For example, one embodiment of a saturation adjustment curve may be applied/changed based on user preference. The adjustment curve may be applied to any form of saturation component (e.g., RGB independently or a chroma component CTCP of IOrCp). For example, in a display management algorithm , the saturation of each pixel may be modified according to its intensity using the following equation (e.g., as in the method noted in FIG. 2 and as may be substituted in Table 1 above):
Figure imgf000011_0001
[00035] Where CT and Cp are the chroma components of the source image, and C'T and C'p are the chroma components of the target image, in ICTCP or IPT color space as described in Rec. ITU-R BT. 2100, "Image parameter values for high dynamic range television for use in production and international programme exchange," July 2016, which is incorporated herein by reference..
[00036] In this embodiment, the SaturationScaleFunction may be further
Figure imgf000011_0003
modified by a user preference or ambient adjustment function, such that
Figure imgf000011_0002
[00037] where j and k are scaling values based on a measure of the ambient environment and user preference respectively, and the AmbientScaleFunction and
PreferenceScaleFunction are pre-determined or tuned curves as described herein.
Brightness Adjustment Curve Embodiments
[00038] For yet another embodiment of applying adjustment curves, the following discloses methods and systems for adjusting the brightness of original curves.
[00039] In one embodiment, it may be desired to change the average pixel luminance of a given image, scene or program. In such cases, a brightness adjustment curve may be employed. Such a curve may be modified to change the brightness of the image and may be applied to any form of brightness component (e.g., RGB independently or a luminance component such as I of ICTCP). [00040] In one embodiment, the adjustment curve may be applied during the time that the DMU is applying a display tone mapping and may be applied directly to the original tone mapping curve. In addition, if image data is available, the minimum, mean and maximum of the image may be used to define a Gaussian-like function. One such embodiment might be performed as follows:
Let:
Figure imgf000012_0001
where min, mean, and max values denote the minimum, average, and maximum luminance values in a frame or a scene, and the m function outputs the minimum between
Figure imgf000012_0002
variables d\ and dl.
[00041] In one embodiment, the variables a, b, and c may be altered independently based on user preference. The Gaussian curve may also be skewed based on the mean of the image so as to avoid brightening noise in an image.
[00042] FIG. 4 depicts this embodiment - as original curve 402 is adjusted by curve 404, to produce a resulting, combined curve 406. It will be noted that the min, mean and max values are as shown in curve 404 and the resulting values as mapped in curve 406.
Contrast Adjustment Curve Embodiments
[00043] Just as with brightness and saturation preference adjustment above, it is also possible to consider contrast adjustment curves.
[00044] As with the other adjustments, the same processing concepts may apply - e.g., there is some original tone mapping and some contrast adjustment curve may be applied. It will be appreciated that a suitable contrast adjustment curve may be derived automatically (e.g., with ambient data, possibly recorded by a sensor), or may be user-supplied.
[00045] FIG. S depicts one embodiment of a contrast adjustment curve being applied to original curve S02. It should be appreciated that one difference between the brightness curve and the contrast curve 504 is that the contrast curve may look like the negative of the derivative of the brightness curve (e.g., the derivative of a Gaussian). In one embodiment, this may allow to increase the slope of the curve around the midpoint (as noted)— but without changing the brightness at the midpoint in resulting curve 506. Increasing the slope may increase the contrast in a way that doesn't affect the brightness. By selecting the width and center of the adjustment curve, it is possible to optimize the effect on the image.
A Few Processing Examples
[00046] FIGS. 6 through 11 depict a number of adjustment processing examples that may be applied to an exemplary original curve 602. It will be appreciated that although the original curve 602 (and other original curves depicted herein) may be shown as a 1 : 1 mapping, the original curve may assume may other forms and/or mappings.
[00047] Curves 702 and 802 depict exemplary brightness and contrast adjustment curves, respectively. Curves 902, 1002 and 1102 depict final curves, resulting from brightness adjustment, contrast adjustment and a combination of both brightness and contrast
respectively.
[00048] Portions of the present invention may be conveniently implemented using a conventional general purpose or a specialized digital computer or microprocessor
programmed according to the teachings of the present disclosure, as will be apparent to those skilled in the computer art.
[00049] Appropriate software coding can readily be prepared by skilled programmers based on the teachings of the present disclosure, as will be apparent to those skilled in the software art. The invention may also be implemented by the preparation of application specific integrated circuits or by interconnecting an appropriate network of conventional component circuits, as will be readily apparent to those skilled in the art based on the present disclosure.
[00050] The present invention includes a computer program product which is a storage medium (media) having instructions stored thereon/in which can be used to control, or cause, a computer to perform any of the processes of the present invention. The storage medium can include, but is not limited to, any type of disk including floppy disks, mini disks (MD's), optical discs, DVD, HD-DVD, Blue-ray, CD-ROMS, CD or DVD RW+/-, micro-drive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices (including flash cards, memory sticks), magnetic or optical cards, SIM cards, MEMS, nanosystems (including molecular memory ICs), RAID devices, remote data storage/archive/warehousing, or any type of media or device suitable for storing instructions and/or data.
[00051] Stored on any one of the computer readable medium (media), the present invention includes software for controlling both the hardware of the general
purpose/specialized computer or microprocessor, and for enabling the computer or microprocessor to interact with a human user or other mechanism utilizing the results of the present invention. Such software may include, but is not limited to, device drivers, operating systems, and user applications. Ultimately, such computer readable media further includes software for performing the present invention, as described above.
[00052] Included in the programming (software) of the general/specialized computer or microprocessor are software modules for implementing the teachings of the present invention, including, but not limited to, calculating pixel/sub-pixel blurring of a local dimming panel, calculating color correction or characterizations, preparing image signals and applying them to driver and/or other electronics to energize backlights, panels, or other devices in a display, calculating luminance values, interpolating, averaging, or adjusting luminance based on any of the factors described herein, including a desired luminance for a pixel or region of an image to be displayed, and the display, storage, or communication of results according to the processes of the present invention.
[00053] The present invention may suitably comprise, consist of, or consist essentially of, any of element (the various parts or features of the invention) and their equivalents as described herein. Further, the present invention illustratively disclosed herein may be practiced in the absence of any element, whether or not specifically disclosed herein.
Obviously, numerous modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.
[00054] Various aspects of the present invention may be appreciated from the following enumerated example embodiments (EEEs):
EEE 1. A method for applying an adjustment to an original curve derived from a set of input image data, comprising:
receiving a set of input image data to be adjusted;
calculating an original curve from the set of input image data; receiving an adjustment curve, the adjustment curve based upon a desired image parameter; and
applying the adjustment curve to the original curve to produce a resulting curve. EEE 2. The method according to EEE 1, wherein the set of input image data comprises one of an image, a frame of video data and a scene in a video.
EEE 3. The method according to EEE 1 or 2, wherein calculating an original curve from the set of input image data further comprises calculating original curve from one or more image parameters.
EEE 4. The method according to EEE 3, wherein one or more image parameters for calculating an original curve comprises one of a saturation parameter, tone mapping parameter and 1:1 mapping parameter.
EEE 5. The method according to any of the EEEs 1-4, wherein the desired image parameter upon which the adjustment curve is based comprises one of ambient parameter, saturation parameter, brightness parameter and a contrast parameter.
EEE 6. The method according to EEE 5, wherein applying the adjustment curve to the original curve comprises applying an operation to the original curve employing the adjustment curve.
EEE 7. The method according to EEE 6, wherein the operation comprises one of addition, subtraction, multiplying, dividing and convolving.
EEE 8. The method according to any of the EEEs 5-7, wherein the desired image parameter comprises an ambient parameter and the adjustment curve is calculated as:
Figure imgf000015_0001
wherein S comprises a scaling factor based on ambient illumination and B is a function dependent on input pixel values, assumed original adapting luminance and a function based on EOTF.
EEE 9. The method according to any of the EEEs 5-7, wherein the desired image parameter comprises a saturation parameter and the adjustment curve is calculated as:
Figure imgf000015_0002
wherein CT and Cp are the chroma components of the source image, and C'T and C'p are the chroma components of the target image and I is the luminance component. EEE 10. The method according to EEE 9, wherein the Saturation Scale Function may be a function of one of ambient conditions and user preferences.
EEE 11. The method according to any of the EEEs 5-7, wherein the desired image parameter comprises a brightness parameter and the adjustment curve is calculated as:
Figure imgf000016_0001
wherein x comprises an input pixel value, a comprises a change in brightness requested based on preference, b comprises the mean and c comprises the min(max-mean, mean-mi n).
EEE 12. The method according to any of the EEEs 5-7, wherein the desired image parameter comprises a contrast parameter and the adjustment curve is calculated as negative of the derivative of the brightness curve.
EEE 13. The method according to any of the EEEs 1-12, wherein the method further comprises:
sending the resulting curve to a display for rendering a final image based on the resulting curve.
EEE 14. A display management unit (DMU) comprising a processor that, upon receiving a set of input image data, processes the original curve according to:
calculating an original curve from the set of input image data;
receiving an adjustment curve, the adjustment curve based upon a desired image parameter; and
applying the adjustment curve to the original curve to produce a resulting curve.
EEE 15. The DMU according to EEE 14, wherein the desired image parameter upon which the adjustment curve is based comprises one of ambient parameter, saturation parameter, brightness parameter and a contrast parameter.
EEE 16. The DMU according to EEE 15, wherein applying the adjustment curve to the original curve comprises applying an operation to the original curve employing the adjustment curve.
EEE 17. The DMU according to EEE 16, wherein the operation comprises one of addition, subtraction, multiplying, dividing and convolving.
EEE 18. The DMU according to any of the EEEs 14-17, wherein the DMU sends the resulting curve to a display for rendering a final image based on the resulting curve.
EEE 19. The DMU according to EEE 18, wherein the DMU is external to the display.
EEE 20. The DMU according to EEE 18, wherein the display comprises the DMU.

Claims

CLAIMS What is claimed is:
1. A method for applying an adjustment to an original luminance mapping curve or to an original chrominance mapping curve derived from a set of input image data, comprising: receiving a set of input image data to be adjusted;
calculating an original luminance mapping curve and/or an original chrominance mapping curve from the set of input image data;
receiving an adjustment curve, the adjustment curve being based upon a scaling factor representing an ambient illumination of a viewing environment and/or user preferences; and applying the adjustment curve to one original mapping curve to produce a resulting mapping curve used for rendering a final image based on the resulting curve.
2. The method according to claim 1, wherein the set of input image data comprises one of an image, a frame of video data and a scene in a video to be displayed by a display device in the viewing environment, wherein the scene in the video comprises multiple consecutive frames of video data.
3. The method according to claim 1 or 2, wherein calculating the original luminance mapping curve from the set of input image data further comprises calculating the original luminance mapping curve from one or more tone mapping parameters.
4. The method according to any of the claims 1-3, wherein calculating the original chrominance mapping curve from the set of input image data further comprises calculating the original chrominance mapping curve from one or more saturation mapping parameters.
5. The method according to any of the claims 1-4, wherein the user preferences comprise user preferences regarding one of saturation, brightness and contrast of the final image.
6. The method according to any of the claims 1-5, wherein applying the adjustment curve to one original curve comprises applying an operation to said original curve employing the adjustment curve, wherein optionally the operation comprises one of addition, subtraction, multiplying, dividing and convolving.
7. The method according to claim S or claim 6, wherein the adjustment curve is calculated as:
Figure imgf000018_0001
wherein S is the scaling factor representing the ambient illumination and B is a function dependent on input pixel values, assumed original adapting luminance and a function based on an Electro-Optical Transfer Function, EOTF.
8. The method according to claim 5 or claim 6, wherein the adjustment curve is calculated as:
Figure imgf000018_0002
wherein CT and Cp are the chroma components of a source image, and C'T and C'p are the chroma components of a target image and I is the luminance component, wherein optionally the Saturation Scale Function may be a function of one of ambient conditions and user preferences.
9. The method according to claim S or claim 6, wherein the adjustment curve is calculated as:
Figure imgf000018_0003
wherein x comprises an input pixel value, a comprises a change in brightness requested based on user preferences, b comprises the mean and c comprises the
Figure imgf000018_0006
luminance values in an image, a frame of video data or a scene in a video, wherein the scene in the video comprises multiple consecutive frames of video data.
10. The method according to claim S or claim 6, wherein the adjustment curve is calculated as the negative of the derivative of wherein x comprises an input pixel value, a
Figure imgf000018_0004
comprises a change in brightness requested based on user preferences, b comprises the mean and c comprises the luminance values in an image, a frame of
Figure imgf000018_0005
video data or a scene in a video, wherein the scene in the video comprises multiple consecutive frames of video data.
11. The method according to any of the claims 1-10 wherein the method further comprises: sending the resulting curve to a display for rendering a final image based on the resulting curve.
12. A display management unit, DMU, comprising a processor that, upon receiving a set of input image data, processes an original luminance or chrominance mapping curve according to:
calculating an original luminance mapping or chrominance mapping curve from the set of input image data;
receiving an adjustment curve, the adjustment curve being based upon a scaling factor representing an ambient illumination of a viewing environment and/or user preferences; and applying the adjustment curve to the original mapping curve to produce a resulting curve for rendering a final image based on the resulting curve.
13. The DMU according to claim 12, wherein the user preferences comprise user preferences regarding one of saturation, brightness and contrast of the final image.
14. The DMU according to claim 13, wherein applying the adjustment curve to the original curve comprises applying an operation to the original curve employing the adjustment curve, wherein optionally the operation comprises one of addition, subtraction, multiplying, dividing and convolving.
15. The DMU according to any of the claims 12-14, wherein the DMU sends the resulting curve to a display for rendering a final image based on the resulting curve.
PCT/US2017/065114 2016-12-12 2017-12-07 Systems and methods for adjusting video processing curves for high dynamic range images WO2018111682A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US16/461,779 US11468547B2 (en) 2016-12-12 2017-12-07 Systems and methods for adjusting video processing curves for high dynamic range images
EP17818715.9A EP3552178B1 (en) 2016-12-12 2017-12-07 Systems and methods for adjusting video processing curves for high dynamic range images
JP2019551501A JP6845946B2 (en) 2016-12-12 2017-12-07 Systems and methods for adjusting video processing curves for high dynamic range images
CN201780076408.9A CN110050292B (en) 2016-12-12 2017-12-07 System and method for adjusting video processing curve of high dynamic range image

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201662432912P 2016-12-12 2016-12-12
US62/432,912 2016-12-12
EP17152419.2 2017-01-20
EP17152419 2017-01-20

Publications (1)

Publication Number Publication Date
WO2018111682A1 true WO2018111682A1 (en) 2018-06-21

Family

ID=57868099

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/065114 WO2018111682A1 (en) 2016-12-12 2017-12-07 Systems and methods for adjusting video processing curves for high dynamic range images

Country Status (1)

Country Link
WO (1) WO2018111682A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020038505A (en) * 2018-09-04 2020-03-12 キヤノン株式会社 Image processing device, capturing device, image processing method, and program
WO2021004176A1 (en) * 2019-07-11 2021-01-14 华为技术有限公司 Image processing method and apparatus
WO2021223205A1 (en) * 2020-05-08 2021-11-11 Huawei Technologies Co., Ltd. Encoder, decoder, system, and method for determining tone mapping curve parameters

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040213457A1 (en) * 2003-04-10 2004-10-28 Seiko Epson Corporation Image processor, image processing method, and recording medium on which image processing program is recorded
US20130076974A1 (en) * 2011-09-26 2013-03-28 Dolby Laboratories Licensing Corporation Image Formats and Related Methods and Apparatuses

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040213457A1 (en) * 2003-04-10 2004-10-28 Seiko Epson Corporation Image processor, image processing method, and recording medium on which image processing program is recorded
US20130076974A1 (en) * 2011-09-26 2013-03-28 Dolby Laboratories Licensing Corporation Image Formats and Related Methods and Apparatuses

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
IMAGE PARAMETER VALUES FOR HIGH DYNAMIC RANGE TELEVISION FOR USE IN PRODUCTION AND INTERNATIONAL PROGRAMME EXCHANGE, July 2016 (2016-07-01)
TANIA POULI ET AL: "Color Correction for Tone Reproduction", COLOR AND IMAGING CONFERENCE, 1 November 2013 (2013-11-01), pages 215 - 220, XP055114893, Retrieved from the Internet <URL:http://taniapouli.co.uk/research/CIC2013.pdf> [retrieved on 20140423] *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020038505A (en) * 2018-09-04 2020-03-12 キヤノン株式会社 Image processing device, capturing device, image processing method, and program
JP7227719B2 (en) 2018-09-04 2023-02-22 キヤノン株式会社 IMAGE PROCESSING DEVICE, IMAGING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM
WO2021004176A1 (en) * 2019-07-11 2021-01-14 华为技术有限公司 Image processing method and apparatus
WO2021223205A1 (en) * 2020-05-08 2021-11-11 Huawei Technologies Co., Ltd. Encoder, decoder, system, and method for determining tone mapping curve parameters

Similar Documents

Publication Publication Date Title
US11468547B2 (en) Systems and methods for adjusting video processing curves for high dynamic range images
US10600166B2 (en) Tone curve mapping for high dynamic range images
US9554020B2 (en) Workflow for content creation and guided display management of EDR video
JP7084984B2 (en) Tone curve optimization method and related video encoders and video decoders
TW202101956A (en) Display management for high dynamic range images
WO2018152063A1 (en) Tone curve mapping for high dynamic range images
US20230169930A1 (en) Image-dependent contrast and brightness control for hdr displays
WO2018111682A1 (en) Systems and methods for adjusting video processing curves for high dynamic range images
US11361699B2 (en) Display mapping for high dynamic range images on power-limiting displays
US11792532B2 (en) Picture metadata for high dynamic range video
US11837140B2 (en) Chromatic ambient light correction
US20230230617A1 (en) Computing dynamic metadata for editing hdr content
AU2022358503A1 (en) Multi-step display mapping and metadata reconstruction for hdr video
CN118044189A (en) Encoding and decoding multi-intent images and video using metadata

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17818715

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019551501

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2017818715

Country of ref document: EP