EP2144444A1 - HDR video data compression devices and methods - Google Patents

HDR video data compression devices and methods Download PDF

Info

Publication number
EP2144444A1
EP2144444A1 EP08012452A EP08012452A EP2144444A1 EP 2144444 A1 EP2144444 A1 EP 2144444A1 EP 08012452 A EP08012452 A EP 08012452A EP 08012452 A EP08012452 A EP 08012452A EP 2144444 A1 EP2144444 A1 EP 2144444A1
Authority
EP
European Patent Office
Prior art keywords
stream
video
tone mapping
previous
compressing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP08012452A
Other languages
German (de)
French (fr)
Other versions
EP2144444B1 (en
Inventor
Francesco Banterle
Alessandro Artusi
Kurt Debattista
Patrick Ledda
Alan Chalmers
Gavin John Edwards
Gerhard Bonnet
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Warwick
Original Assignee
University of Warwick
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Warwick filed Critical University of Warwick
Priority to ES08012452T priority Critical patent/ES2389458T3/en
Priority to EP08012452A priority patent/EP2144444B1/en
Priority to PCT/EP2009/005042 priority patent/WO2010003692A1/en
Publication of EP2144444A1 publication Critical patent/EP2144444A1/en
Priority to US12/984,992 priority patent/US9406112B2/en
Application granted granted Critical
Publication of EP2144444B1 publication Critical patent/EP2144444B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • G06T5/92Dynamic range modification of images or parts thereof based on global image properties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/33Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/34Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • G06T2207/20028Bilateral filtering
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Definitions

  • the present invention relates to the handling of high quality video data.
  • the quality of digital images has vastly improved over the past few years.
  • the number of pixels in a picture has increased due to improvements in both cameras and.displays.
  • the resolution of commercial flat panel displays used for television has increased step by step from 640x480 pixels VGA resolution to full high definition having 1920x1080 pixels. This has already brought about a change in the amount of data that needs to be handled to display an image.
  • the spatial resolution was improved, but also the dynamic resolution. For a black and white picture this would mean that a single pixel could represent any of a large number of different shades of grey instead of only being black or white.
  • the overall dynamic range easily compares to the human eye.
  • a human being can distinguish objects both in starlight during night time or in bright sun light, even though on a moonless night objects receive only approximately 1/1.000.000.000 of the illumination they would on a bright sunny day: This corresponds to a dynamic range of 90 db.
  • the eye needs time to adjust to different light levels.
  • the dynamic range of the human eye without adjustment of the pupil is only approximately 30 db.
  • the differences between very dark and very light spots in a picture taken by a modern camera system can easily be larger than those the human eye can distinguish without adaption; with a modern camera system it is thus possible to determine fine details in very dark spots even while very bright spots are also present in a picture.
  • the dynamic range of a modern camera system may also easily surpass the dynamic range of a conventional display.
  • tone mapping is very helpful in the production of realistic images and several operators have been proposed.
  • Tone mapping operator that produces high quality results in real time due to restriction of the data processing capacity, in particular for large high definition pictures.
  • TRC algorithms are efficient because the operation is applied to pixels independently and thus can be performed in parallel using a simple look-up table.
  • models also exist that are able to capture some important aspects, such as visual adaption.
  • TRCs fail to capture the important information on local contrast that could be represented in the spatial context of neighbouring image pixels which is of great importance for the human visual system.
  • HD-image formats can account for all the dynamic range visible by the human visual system.
  • HD high definition
  • HDR high dynamic range
  • the above-mentioned tone mapping reduces the dynamic range of a picture in a way that attempts to allow the user to observe all details relevant to the human eye even if this would not be possible in a conventional scene and/or adaption. Reducing the dynamic range may also be used to reduce the amount of data necessary to fully describe the picture. Furthermore, for video streams consisting of a sequence of digital images (frames), methods that allow reduction (compression) of data have been described such as the MPEG-standard.
  • High Dynamic Range Images consume a considerable amount of memory, and efficient compression methods are not easy to implement.
  • a typical low dynamic range image consists of 24 bit-per-pixel (bpp) RGB data that can be compressed considerably.
  • an uncompressed HDR image typically uses 96 bpp for an RGB image. Accordingly, an uncompressed HDR image consumes four times the memory of an uncompressed LDR image.
  • WARD JPEG-HDR: A BACKWARDS-COMPATIBLE, HIGH DYNAMIC RANGE EXTENSION TO JPEG, in: CIC 13th: Proceedings of the Thirteenth Color Imaging Conference, The Society for Imaging Science and Technology, 2005 ; G. WARD : A GENERAL APPROACH TO BACKWARDS-COMPATIBLE DELIVERY OF HIGH DYNAMIC RANGE IMAGES AND VIDEO in: CIC 14th: Proceedings of the Fourteenth Color Imaging Conference, The Society for Imaging Science and Technology, 2006 ; G. WARD and M.
  • SIMMONS SUB BAND ENCODING OF HIGH DYNAMIC RANGE IMAGERY in: APGV '04: Proceedings of the 1st Symposium on Applied Perception in Graphics and Visualization, pages 83-90, New York, NY, USA, 2004, ACM Press .
  • HDR-JPEG extends the JPEG-standard keeping retro-compatibility.
  • an HDR-image is tone mapped using a standard tone reproduction curve and stored as a normal JPEG.
  • a sub-band corresponding to HDR in-formation is stored in the "application markers" of the standard for a maximum of 64 Kbytes which is a constraint for encoding high resolution HDR images.
  • HDR-JPEG 2000 is an extension to JPEG 2000 that exploits the support of the standard for 16 bit integer data. With this method, HDR data is transformed into the logarithmic domain, quantized into integers and compressed using standard JPEG 2000 encoding.
  • HDR textures are typically used in interactive applications; due to the size of HDR images they need to be compressed.
  • Methods related to high dynamic range texture compression can either be designed for general purpose graphics hardware or custom made processors that allow decoding of the HDR textures in real time.
  • HDR texture compression has been addressed by numerous authors, compare e.g. J. MUNKBERG, P. CLARBERG, J. HASSELGREN, and T. AKENINE-M ⁇ LLER: HIGH DYNAMIC RANGE TEXTURE COMPRESSION FOR GRAPHICS HARDWARE in: ACM Trans. Graph., 25(3):698-706, 2006 ; K. ROIMELA, T. AARNIO and J. ITARANTA: HIGH DYNAMIC RANGE TEXTURE COMPRESSION in: ACM Trans. Graph., 25(3):707-712, 2006 ; K. ROIMELA, T. AARNIO and J.
  • HDR-MPEG compression schemes have been proposed in: R. MANTIUK, A. EFREMOV, K. MYSZKOWSKI, and H.-P.
  • SEIDEL BACKWARD COMPATIBLE HIGH DYNAMIC RANGE MPEG VIDEO COMPRESSION, ACM Trans. Graph., 25(3):713-723, 2006 ;
  • SEIDEL PERCEPTION-MOTIVATED HIGH DYNAMIC RANGE VIDEO ENCODING, ACM Trans. Graph., 23(3):733-741, 2004 .
  • the suggested schemes can be used as an extension to MPEG-4.
  • HDR-JPEG backwards-compatible videos are tone mapped, for each frame a reconstruction function is calculated when storing the HDR data. To improve quality, residuals of frames are saved in the video stream. While these algorithms present high quality and high compression ratios, they are not ideally suitable for real time applications since their lack of hardware support results in complex implementations, particularly due to the complex fetching mechanisms required for decoding.
  • HOPPE COMPRESSED RANDOM-ACCESS TREES FOR SPATIALLY COHERENT DATA in: Rendering techniques (Proceedings of the Eurographics Symposium on Rendering), Eurographics, 2007 .
  • the method described therein relies on a hierarchical data structure that represents spatially coherent graphics data. Despite the good compression the shader is complex and about twenty times slower than a fetch to a compressed texture using S3TC.
  • AD-AMI RAW IMAGE ENCODING BASED ON POLYNOMIAL APPROXIMATION, IEEE International Conference on Acoustics, Speech and Signal Processing, 2007, ICASSP 2007, pages 15-31, 2007 .
  • the tone mapping operators based on the Hill functionals for inverse tone mapping are calculated using minimization techniques and then encoded using JPEG.
  • the residuals are calculated for increased quality and are compressed using wavelets.
  • wavelets and DCT decompression are computational expensive to evaluate and do not provide a constant decompression time which is particularly disadvantageous in real time critical applications.
  • the present invention aims at providing an improved method of compressing a stream of video frame data as well as devices for implementing the method.
  • a method of compressing a stream of video frame data is suggested wherein tone mapping functions are determined for video frames of said stream, said tone mapping functions being different from one another for frames relating to different scenes and wherein the tone mapping functions will be altered for frames of the stream relating to the same scene.
  • the method of the present invention thus provides a stream of video data which has a significantly better quality compared to a video stream where a change of tone mapping function is only effected for a change of scene. It is possible and preferred to apply the method of compressing the stream to high definition video data, i. e. images that comprise a large number of pixels.
  • the present invention provides advantages as fine spatial details offered by high definition video data can be more clearly identified while the scene lasts.
  • the tone mapping function within a scene only gradually.
  • the differences from frame to frame will be small and thus the received image will seem to be more natural.
  • the illumination of a scene is altered for example by switching on or off a light, exceptions from the general rule that the tone mapping function is to be altered gradually only, can be made.
  • the gradual change of the tone mapping function can be achieved by evaluating both a given frame as well as a plurality of previously observed frames and/or frames that will subsequently follow within the data stream. This can be effected either by calculating the average of image data and/or by calculating data derived from original frames such as bilaterally filtered base frames and/or by determining a tone mapping function for any given frame in response to tone mapping functions determined for previous frames.
  • the amount of data is significantly reduced in comparison to cases where a plurality of video frames has to be evaluated in order to determine one single tone mapping function.
  • a base frame having reduced spatial resolution is determined from an initial HDR frame using e. g. bilateral filtering, the amount of data that needs to be handled for determining the tone mapping function is significantly reduced, thus allowing even for the calculation of averages and so forth.
  • a tone mapping function for a base frame is computationally more simple without degrading image quality, it is highly preferred to separate the base frame information from a given HDR frame prior to determining the tone mapping function and to determine the tone mapping function in response to the base frame information extracted from the initial HDR frame. It is also possible to determine base frame information only for some frames of the video stream; however, it is obviously preferred to determine a base frame for the majority of frames of the initial HDR frames and to operate on this majority of frames in order to determine the tone mapping function. In particular, it is preferred to determine a base frame for every frame of the initial HDR video stream.
  • a low dynamic range base frame in response to a base frame extracted from the initial HDR frame and information relating to the tone mapping function for the respective base frame. It should be noted that it is preferred to include information regarding the current tone mapping function used for any given frame in the stream of compressed video data. This can be done in a plurality of ways without significantly increasing the amount of data needed. In particular, it is possible to refer to a number of predefined tone mapping functions and to select one of a number of predefined tone mapping functions for any given frame. This number and any associated parameters can be included in the compressed stream of video frame data.
  • the decoder will usually have access to or comprise a look-up-table for tone mapping functions.
  • the look-up-tables for different display devices may relate to different inverse tone mapping functions for a given look-up-table entry. It should be noted that the number of predefined different tone mapping functions can be comparatively small and that between 16 and 512 predefined tone mapping functions should generally be sufficient for encoding and compressing any given HDR video frame data stream.
  • any information of a user defined tone mapping function can be included in the compressed stream of video frame data, it is possible to transfer the information of user defined tone mapping functions from the encoder to the decoder.
  • the detail frame can preferably be obtained by subtraction of the base frame from the HDR frame and/or by division of the base frame.
  • the detail frame has a sig-nificantly lower dynamic range than the base frame even without dynamic compression.
  • the low dynamic range base frame can be subjected to further compression, in particular to temporal compression schemes as known in the art.
  • the detail frame can also be compressed further using (conventional) temporal compression schemes. Accordingly, a final frame in the stream of compressed HDR data generally will comprise information on the tone mapping function used for the particular frame, as well as a compressed base frame information and compressed detail frame information. Additional information such as data headers and so forth may obviously be included.
  • the low dynamic range base frame information and the low dynamic range detail frame information can be obtained as known per se in the art.
  • the initial high dynamic range base frame can be reconstructed and the detail frame information as re-obtained from the temporally compressed detail frame can be added and/or in other ways combined with the uncompressed base frame information to obtain a reproduced HDR frame of high quality.
  • a video stream obtained in this way will provide high quality images while not imposing high computational loads on any graphics hardware processing the initial HDR video frame data.
  • luminance information referring to the overall luminosity of a frame and/or of parts thereof separately from the tone mapping information.
  • tone mapping function information for a fixed area, for example a fixed rectangle in a given frame. This area may or may not relate to a given object; in particular, it is possible to provide a tone mapping function for moving objects in the initial stream of video frame data. This allows for maintaining tone mapping for any given object moving through a scene.
  • the present invention also relates to a video encoder for decoding a stream of video data as described with respect to the methods above.
  • a video encoder can be implemented in software or in hardware, e. g. as ASIC. It will be obvious to the average skilled person how a decoder has to be designed.
  • the present invention also relates to a data carrier carrying video data compressed according to the present invention.
  • a stream of video frame data 1 consisting of high definition high dynamic range video frames is provided.
  • a single HDR frame 2 of the video stream 1 is inputted to a filter 3 which may be implemented by either soft-or hardware and which is used to extract a base frame 4 from the HDR frame 2.
  • the filter 3 may be a bilateral filter.
  • the base frame 4 is combined in a combining stage with the initial HDR frame, for example by subtracting the base frame 4 from the HDR frame 2 and/or by dividing the HDR frame 2 by the base frame 4 so as to provide a detail frame 5 relating to the fine details of the HDR frame 2.
  • the base frame 4 is further fed to a tone mapping operation stage 6 wherein one of a plurality of - here predefined tone mapping functions stored in a tone mapping look-up-table 7 is selected for the base frame.
  • the tone mapping function 6 selected for a given base frame 4 is altered to a tone mapping function TMO* with respect to the temporal properties of HDR frames and/or previous tone mapping functions as will be described later on.
  • the tone mapping function TMO* is then applied to the base frame 4 so as to obtain a low dynamic range base frame 8.
  • the low dynamic range base frame 8 and the detail frame 5 are subjected to temporal compression algorithms separately at stages 9 and 10 respectively.
  • the temporal compression schemes may be as known per se in the art and may relate inter alia to MPEG encoding and so forth.
  • a final frame is constructed.
  • the tone mapping function for a given base frame is fed to a temporal property stage 11 which stores the properties of a number of previous tone mapping functions obtained for previous frames of the same scene. This can be done by storing the number of the previous tone mapping functions in a tone mapping function table 7 and/or by storing the entire tone mapping function.
  • a scene change identifier stage may be provided to reset the temporal property stage on any change of scene (not shown).
  • the temporal property stage 11 on receiving an initial tone mapping function as initially determined for a base frame 4 determines whether or not the change in the tone mapping function compared to prior tone mapping function is large or not. It will be obvious to the skilled person that any such deviation can be weighted so that particular parts of the tone mapping curve have a weight higher than others.
  • tone mapping function table 7 it would also be possible to store tone mapping functions in tone mapping function table 7 in a way so that small changes of the look-up table-entry number correspond to small changes in the tone mapping function allows for a particularly simple way of determining whether or not the change from one tone mapping function of a given base frame to previous base frames is large or not. If the change in tone mapping function 6 is gradual, then the actual tone mapping function TMO* corresponds to the initial tone mapping function determined for base frame 4. If the changes of the tone mapping function determined for a given base frame 4 are too large, then the initial tone mapping function is corrected to a tone mapping function which corresponds closer to previous tone mapping functions. This can be determined by simple comparators. Accordingly, the change of tone mapping functions is small within a scene and thus the sequence of frames can be shown based on the compressed video data stream 12 which is of high quality.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Picture Signal Circuits (AREA)
  • Image Processing (AREA)

Abstract

The invention relates to a method of compressing a stream of video frame data wherein tone mapping functions are determined for video frames of said stream, said tone mapping functions being different from one another for frames relating to different scenes and wherein it is suggested that the tone mapping functions will be altered for frames of the stream relating to the same scene.

Description

  • The present invention relates to the handling of high quality video data.
  • The quality of digital images has vastly improved over the past few years. The number of pixels in a picture has increased due to improvements in both cameras and.displays. For example, the resolution of commercial flat panel displays used for television has increased step by step from 640x480 pixels VGA resolution to full high definition having 1920x1080 pixels. This has already brought about a change in the amount of data that needs to be handled to display an image. Furthermore, not only has the spatial resolution been improved, but also the dynamic resolution. For a black and white picture this would mean that a single pixel could represent any of a large number of different shades of grey instead of only being black or white. The overall dynamic range easily compares to the human eye. A human being can distinguish objects both in starlight during night time or in bright sun light, even though on a moonless night objects receive only approximately 1/1.000.000.000 of the illumination they would on a bright sunny day: This corresponds to a dynamic range of 90 db. However, the eye needs time to adjust to different light levels. Thus, the dynamic range of the human eye without adjustment of the pupil is only approximately 30 db. In contrast, the differences between very dark and very light spots in a picture taken by a modern camera system can easily be larger than those the human eye can distinguish without adaption; with a modern camera system it is thus possible to determine fine details in very dark spots even while very bright spots are also present in a picture. The dynamic range of a modern camera system may also easily surpass the dynamic range of a conventional display.
  • It should also be noted that not only the dynamic range of a picture to be (re-)produced needs amendment but also a correction is necessary due to numerous technological limitations such as limited colour gamut and contrast, limited spatial resolution, usually limited field of view and nontrivial workarounds to achieve stereo capacity. Furthermore, in order to reproduce the correct appearance, it is often necessary to simulate the behaviour of the human visual system. Here, it should be noted that the viewing conditions of an observer, observing either the scene or a display may be completely different. Tone mapping is very helpful in the production of realistic images and several operators have been proposed. However, it is still prohibitive to have a complex tone mapping operator that produces high quality results in real time due to restriction of the data processing capacity, in particular for large high definition pictures. Two main tone mapping operator classes exist, namely tone reproduction curves (TRCs) and tone reproduction operators (TROs). Both will be referred to as tone mapping functions in the present application.
  • TRC algorithms are efficient because the operation is applied to pixels independently and thus can be performed in parallel using a simple look-up table. In addition, models also exist that are able to capture some important aspects, such as visual adaption. However, TRCs fail to capture the important information on local contrast that could be represented in the spatial context of neighbouring image pixels which is of great importance for the human visual system.
  • The algorithms based on TROs when compared with TRCs are able to capture the important information on local contrast. Unfortunately, they typically introduce artefacts in some parts of the image, such as dark halos, and are computationally more demanding.
  • Now, images that have a high dynamic range have a higher pixel depth than the more conventional low dynamic range images. The increased bit depth per pixel presented by HDR-image formats can account for all the dynamic range visible by the human visual system. Both the increased number of pixels in a high definition (HD) picture and the improved dynamic information in a high dynamic range (HDR) picture increase the amount of data relating to a picture. This poses severe technical problems. The data size gives rise to problems when transmitting and/or storing image data. These problems become more severe when video data consisting of a plurality of frames need to be handled instead of single digital images. For high dynamic range still pictures, the above-mentioned tone mapping reduces the dynamic range of a picture in a way that attempts to allow the user to observe all details relevant to the human eye even if this would not be possible in a conventional scene and/or adaption. Reducing the dynamic range may also be used to reduce the amount of data necessary to fully describe the picture. Furthermore, for video streams consisting of a sequence of digital images (frames), methods that allow reduction (compression) of data have been described such as the MPEG-standard.
  • However, despite the fact that both the high definition as well as high dynamic range information may be compressed, the results when applying such conventional compression schemes to a stream of video data are still not satisfying for a user.
  • High Dynamic Range Images (HDRIs) consume a considerable amount of memory, and efficient compression methods are not easy to implement. A typical low dynamic range image consists of 24 bit-per-pixel (bpp) RGB data that can be compressed considerably. On the other hand, an uncompressed HDR image typically uses 96 bpp for an RGB image. Accordingly, an uncompressed HDR image consumes four times the memory of an uncompressed LDR image.
  • The first attempt to compress the HDR data was introduced by G. WARD in REAL PIXELS, Graphics Gems, 2:15-31, 1991. It has been suggested that the 96 bpp image is compressed to 32 bpp using a light bit mantissa for each channel and a shared light bit exponent. The resulting RGBE representation however does not cover the full visible colour gamut since it does not allow for negative values. Other formats have been suggested for example in G. W. LARSON: LOGLUV ENCODING FOR FULL-GAMUT, HIGH DYNAMIC RANGE IMAGES, Journal of Graphics Tools, 3(1) :15-31, 1998. Further suggestions, using different data formats can be found in INDUSTRIAL LIGHT & MAGIC, OpenEXR., http://www.openexr.org, 2002 and G. McTAGGERT, C. GREEN and J. MITCHELL: HIGH DYNAMIC RANGE RENDERING IN VALVE'S SOURCE ENGINE, in SIGGRAPH '06: ACM SIGGRAPH 2006 Courses, . Furthermore, several extension to standard compression algorithms have been presented such as for example in G. WARD: JPEG-HDR: A BACKWARDS-COMPATIBLE, HIGH DYNAMIC RANGE EXTENSION TO JPEG, in: CIC 13th: Proceedings of the Thirteenth Color Imaging Conference, The Society for Imaging Science and Technology, 2005; G. WARD : A GENERAL APPROACH TO BACKWARDS-COMPATIBLE DELIVERY OF HIGH DYNAMIC RANGE IMAGES AND VIDEO in: CIC 14th: Proceedings of the Fourteenth Color Imaging Conference, The Society for Imaging Science and Technology, 2006; G. WARD and M. SIMMONS: SUB BAND ENCODING OF HIGH DYNAMIC RANGE IMAGERY in: APGV '04: Proceedings of the 1st Symposium on Applied Perception in Graphics and Visualization, pages 83-90, New York, NY, USA, 2004, ACM Press.
  • Here, backwards-compatible HDR-JPEG extends the JPEG-standard keeping retro-compatibility. Firstly, an HDR-image is tone mapped using a standard tone reproduction curve and stored as a normal JPEG. Secondly, a sub-band corresponding to HDR in-formation is stored in the "application markers" of the standard for a maximum of 64 Kbytes which is a constraint for encoding high resolution HDR images. HDR-JPEG 2000 is an extension to JPEG 2000 that exploits the support of the standard for 16 bit integer data. With this method, HDR data is transformed into the logarithmic domain, quantized into integers and compressed using standard JPEG 2000 encoding.
  • While the suggested compression schemes known in the art are helpful for still images, they leave room for improvement and are hardly applicable for HDR videos.
  • There are two important applications for video data streams providing HDR video data. The first application is movie pictures such as produced by video cameras; the second is graphic applications such as in video games and so forth. Here, there is a particular need to compress the high dynamic range of textures. HDR textures are typically used in interactive applications; due to the size of HDR images they need to be compressed. Methods related to high dynamic range texture compression can either be designed for general purpose graphics hardware or custom made processors that allow decoding of the HDR textures in real time.
  • The problem of HDR texture compression has been addressed by numerous authors, compare e.g. J. MUNKBERG, P. CLARBERG, J. HASSELGREN, and T. AKENINE-MÖLLER: HIGH DYNAMIC RANGE TEXTURE COMPRESSION FOR GRAPHICS HARDWARE in: ACM Trans. Graph., 25(3):698-706, 2006; K. ROIMELA, T. AARNIO and J. ITARANTA: HIGH DYNAMIC RANGE TEXTURE COMPRESSION in: ACM Trans. Graph., 25(3):707-712, 2006; K. ROIMELA, T. AARNIO and J. ITARANTA; EFFICTENT HIGH DYNAMIC RANGE TEXTURE COMPRESSION in: S13D'08: Proceedings of the 2008 Symposium on Interactive 3D Graphics and Games, pages 207-214, ACM Press, New York, NY, USA, 2008. One problem of the methods described in the prior art is that they require complex hardware.
  • For HDR videos, HDR-MPEG compression schemes have been proposed in: R. MANTIUK, A. EFREMOV, K. MYSZKOWSKI, and H.-P. SEIDEL: BACKWARD COMPATIBLE HIGH DYNAMIC RANGE MPEG VIDEO COMPRESSION, ACM Trans. Graph., 25(3):713-723, 2006; R. MANTIUK, G. KRAWCZYK, K. MYSZKOWSKI, and H.-P. SEIDEL: PERCEPTION-MOTIVATED HIGH DYNAMIC RANGE VIDEO ENCODING, ACM Trans. Graph., 23(3):733-741, 2004. The suggested schemes can be used as an extension to MPEG-4. As HDR-JPEG backwards-compatible videos are tone mapped, for each frame a reconstruction function is calculated when storing the HDR data. To improve quality, residuals of frames are saved in the video stream. While these algorithms present high quality and high compression ratios, they are not ideally suitable for real time applications since their lack of hardware support results in complex implementations, particularly due to the complex fetching mechanisms required for decoding.
  • A further approach has been adopted by L. WANG, X. WANG, P-P SLOAN, L-Y WEI, X. TONG and B. GUO: RENDERING FROM COMPRESSED HIGH DYNAMIC RANGE TEXTURES ON PROGRAMMABLE GRAPHICS HARDWARE, I3D '07: Proceedings of the 2007 symposium on Interactive 3D graphics and games, 17-24, ACM Press, New York, 2007. In this paper it has been suggested to separate HDR and LDR parts of the images and to quantize two 8-bit textures compressed using S3TC with their residuals. The reconstruction (decoding) was performed by combining HDR and LDR parts using a simple shader. A more general compression scheme has recently been proposed in S. LEFEBVRE and H. HOPPE: COMPRESSED RANDOM-ACCESS TREES FOR SPATIALLY COHERENT DATA in: Rendering techniques (Proceedings of the Eurographics Symposium on Rendering), Eurographics, 2007. The method described therein relies on a hierarchical data structure that represents spatially coherent graphics data. Despite the good compression the shader is complex and about twenty times slower than a fetch to a compressed texture using S3TC.
  • It should be noted that hardware solutions for RGBE filtering and so forth have been suggested as well, compare M. KILGARD, P. BROWN and J. LEECH: GLEXT TEXTURE SHARED EXPONENT in: OpenGL Extension, http://www.opengl.org/registryJspecs/EXT/texture_shared_expon ent.txt, 2007 as well as in D. BLYTHE: THE .
  • It has also already been suggested to use inverse tone mapping for compression. Here, a multi-scale image processing technique for both tone mapping and companding has been proposed by Y. LI, L. SHARAN and E. H. ADELSON: COMPRESSING AND COMPANDING HIGH DYNAMIC RANGE IMAGES WITH SUB BAND ARCHITECTURES in: SIGGRAPH '05: ACM SIGGRAPH 2005 Papers, pages 836-844, New York, NY, USA, 2005, ACM Press. However, the operation is not efficient on current hardware given the fact that the compressed low dynamic range has to be decomposed into sub bands. A compression method based on an inverse tone mapping operator and JPEG was presented in M. OKUDA and N. AD-AMI: RAW IMAGE ENCODING BASED ON POLYNOMIAL APPROXIMATION, IEEE International Conference on Acoustics, Speech and Signal Processing, 2007, ICASSP 2007, pages 15-31, 2007. The tone mapping operators based on the Hill functionals for inverse tone mapping are calculated using minimization techniques and then encoded using JPEG. The residuals are calculated for increased quality and are compressed using wavelets. However, wavelets and DCT decompression are computational expensive to evaluate and do not provide a constant decompression time which is particularly disadvantageous in real time critical applications.
  • A compression scheme for still images and videos using a tone mapping operator based on a model of a human cones was presented in J.H.V. HATEREN: ENCODING OF HIGH DYNAMIC RANGE VIDEO WITH A MODEL OF HUMAN CONES, ACM Trans. Graph., 25(4):1380-1399, 2006.
  • The above discussion shows that despite numerous attempts at compressing high dynamic range images, the results achieved thus far are not completely satisfying in view of compression efficiency, quality of result images and computational load. These problems increase when streams of video frame data need to be handled. As long as the stream of video data corresponds to a slide show of only still images, it will be obvious that a tone mapping function used for compression can be altered whenever the still image (and thus in a context of a video stream the scene) changes. However, in a conventional video stream, there are a number of cases where the scene does not change abruptly, for example in cases where a panning, tilting or zooming in of a camera occurs and/or one or a plurality of objects move within a given picture and/or the illumination changes, for example in cases where a room is shown where lights are switched on or off. In cases like this, it is necessary to provide both an efficient compression as well as a compression that does not lead to severe artefacts in a reproduced video.
  • The present invention aims at providing an improved method of compressing a stream of video frame data as well as devices for implementing the method.
    According to a first basic idea of the present invention, a method of compressing a stream of video frame data is suggested wherein tone mapping functions are determined for video frames of said stream, said tone mapping functions being different from one another for frames relating to different scenes and wherein the tone mapping functions will be altered for frames of the stream relating to the same scene.
  • It has been found that it is clearly advantageous to determine a different tone mapping function not only for every scene but to change the tone mapping function even while the same scene is shown in a video stream. The method of the present invention thus provides a stream of video data which has a significantly better quality compared to a video stream where a change of tone mapping function is only effected for a change of scene. It is possible and preferred to apply the method of compressing the stream to high definition video data, i. e. images that comprise a large number of pixels. Here, the present invention provides advantages as fine spatial details offered by high definition video data can be more clearly identified while the scene lasts.
  • In the present invention, it is highly preferred to alter the tone mapping function within a scene only gradually. By altering the tone mapping function only gradually, the differences from frame to frame will be small and thus the received image will seem to be more natural. It should be noted that in cases where, without a change of scene, the illumination of a scene is altered for example by switching on or off a light, exceptions from the general rule that the tone mapping function is to be altered gradually only, can be made.
  • Accordingly, it is possible to evaluate the overall luminance of an image and to allow for larger changes when there is a significant change of luminance from frame to frame. However, it is obvious that changes like this could also be accounted for by handling luminance separately.
  • The gradual change of the tone mapping function can be achieved by evaluating both a given frame as well as a plurality of previously observed frames and/or frames that will subsequently follow within the data stream. This can be effected either by calculating the average of image data and/or by calculating data derived from original frames such as bilaterally filtered base frames and/or by determining a tone mapping function for any given frame in response to tone mapping functions determined for previous frames.
  • By relating the current tone mapping function to both a given frame and a number of previously obtained tone mapping functions instead of the frames they are derived from, the amount of data is significantly reduced in comparison to cases where a plurality of video frames has to be evaluated in order to determine one single tone mapping function. Here, it should be noted that once a base frame having reduced spatial resolution is determined from an initial HDR frame using e. g. bilateral filtering, the amount of data that needs to be handled for determining the tone mapping function is significantly reduced, thus allowing even for the calculation of averages and so forth. As the determination of a tone mapping function for a base frame is computationally more simple without degrading image quality, it is highly preferred to separate the base frame information from a given HDR frame prior to determining the tone mapping function and to determine the tone mapping function in response to the base frame information extracted from the initial HDR frame. It is also possible to determine base frame information only for some frames of the video stream; however, it is obviously preferred to determine a base frame for the majority of frames of the initial HDR frames and to operate on this majority of frames in order to determine the tone mapping function. In particular, it is preferred to determine a base frame for every frame of the initial HDR video stream.
  • It is possible to determine a low dynamic range base frame in response to a base frame extracted from the initial HDR frame and information relating to the tone mapping function for the respective base frame. It should be noted that it is preferred to include information regarding the current tone mapping function used for any given frame in the stream of compressed video data. This can be done in a plurality of ways without significantly increasing the amount of data needed. In particular, it is possible to refer to a number of predefined tone mapping functions and to select one of a number of predefined tone mapping functions for any given frame. This number and any associated parameters can be included in the compressed stream of video frame data. The decoder will usually have access to or comprise a look-up-table for tone mapping functions.
  • It is possible to predefine every single tone mapping function and to provide information on the tone mapping function for the decoder. In the decoding process, it is also possible to amend an initial tone mapping function so as to directly take into account the particular properties of a device for displaying the actual video frame data. Thus, the look-up-tables for different display devices may relate to different inverse tone mapping functions for a given look-up-table entry. It should be noted that the number of predefined different tone mapping functions can be comparatively small and that between 16 and 512 predefined tone mapping functions should generally be sufficient for encoding and compressing any given HDR video frame data stream.
  • However, it is also possible to allow the user to define one tone mapping function or a plurality of tone mapping functions as needed. Since any information of a user defined tone mapping function can be included in the compressed stream of video frame data, it is possible to transfer the information of user defined tone mapping functions from the encoder to the decoder.
  • It should be noted that once the base frame has been determined from the initial high dynamic range frame, it is possible to determine a detail frame in response to both the initial frame and the base frame. The detail frame can preferably be obtained by subtraction of the base frame from the HDR frame and/or by division of the base frame.
  • It should be noted that generally the detail frame has a sig-nificantly lower dynamic range than the base frame even without dynamic compression. The low dynamic range base frame can be subjected to further compression, in particular to temporal compression schemes as known in the art. It should also be noted that the detail frame can also be compressed further using (conventional) temporal compression schemes. Accordingly, a final frame in the stream of compressed HDR data generally will comprise information on the tone mapping function used for the particular frame, as well as a compressed base frame information and compressed detail frame information. Additional information such as data headers and so forth may obviously be included. When decoding the video stream, the low dynamic range base frame information and the low dynamic range detail frame information can be obtained as known per se in the art. Then, applying the tone mapping information, the initial high dynamic range base frame can be reconstructed and the detail frame information as re-obtained from the temporally compressed detail frame can be added and/or in other ways combined with the uncompressed base frame information to obtain a reproduced HDR frame of high quality. A video stream obtained in this way will provide high quality images while not imposing high computational loads on any graphics hardware processing the initial HDR video frame data.
  • It should be noted that it is possible and preferred to include in the compressed video data stream inter alia luminance information referring to the overall luminosity of a frame and/or of parts thereof separately from the tone mapping information.
  • It should be noted that although the present application refers generally to frames and one tone mapping function used for one single frame, it would be possible to use different tone mapping functions for different areas of a given frame without deviating from the disclosure of the present invention. In cases where different tone mapping function information is determined for different areas, a plurality of possibilities exist and it should be noted that any possibility can be applied exclusively or in combination with others. In particular, it is possible to determine a tone mapping function information for a fixed area, for example a fixed rectangle in a given frame. This area may or may not relate to a given object; in particular, it is possible to provide a tone mapping function for moving objects in the initial stream of video frame data. This allows for maintaining tone mapping for any given object moving through a scene. It should be noted that this may require the identification of objects within the video data stream to be compressed. However, since it is possible to identify moving objects within the base frames, the amount of data that needs to be handled can be comparatively small even for high definition pictures. If a plurality of tone mapping functions are determined for one frame, then it is obviously preferred to gradually alter each single tone mapping function for any given area from frame to frame. However, this may not hold for special cases, e. g. when a scene shows a room with a TV set where a movie is shown; now, even if the room remains unchanged otherwise and tone mapping functions for any place in the room other than for the TV set shown change gradually only, there may be large changes in the TV set thus requiring non-gradual changes in the tone mapping function.
  • The present invention also relates to a video encoder for decoding a stream of video data as described with respect to the methods above. A video encoder can be implemented in software or in hardware, e. g. as ASIC. It will be obvious to the average skilled person how a decoder has to be designed.
  • Furthermore, it is possible to provide a video camera that stores and/or transmits a video data stream obtained according to a method as described above.
  • It is possible to provide streams of video data according to the present invention, for example on DVDs or/as downloadable video data streams.
  • The present invention also relates to a data carrier carrying video data compressed according to the present invention.
  • The present invention will now be described by way of example only with respect to the drawing wherein it is shown by
  • Fig. 1
    a compression scheme according to the present invention.
  • According to Fig. 1, a stream of video frame data 1 consisting of high definition high dynamic range video frames is provided. A single HDR frame 2 of the video stream 1 is inputted to a filter 3 which may be implemented by either soft-or hardware and which is used to extract a base frame 4 from the HDR frame 2. The filter 3 may be a bilateral filter.
  • The base frame 4 is combined in a combining stage with the initial HDR frame, for example by subtracting the base frame 4 from the HDR frame 2 and/or by dividing the HDR frame 2 by the base frame 4 so as to provide a detail frame 5 relating to the fine details of the HDR frame 2. The base frame 4 is further fed to a tone mapping operation stage 6 wherein one of a plurality of - here predefined tone mapping functions stored in a tone mapping look-up-table 7 is selected for the base frame.
  • The tone mapping function 6 selected for a given base frame 4 is altered to a tone mapping function TMO* with respect to the temporal properties of HDR frames and/or previous tone mapping functions as will be described later on. The tone mapping function TMO* is then applied to the base frame 4 so as to obtain a low dynamic range base frame 8. The low dynamic range base frame 8 and the detail frame 5 are subjected to temporal compression algorithms separately at stages 9 and 10 respectively. The temporal compression schemes may be as known per se in the art and may relate inter alia to MPEG encoding and so forth.
  • From the temporally compressed detail frames and base frames 9 and 10 and the temporally corrected tone mapping function TMO*, a final frame is constructed. In order to obtain a high quality compressed video stream, it is suggested in the embodiment described to determine the tone mapping function with respect to tone mapping functions previously obtained for previous frames. Thus, the tone mapping function for a given base frame is fed to a temporal property stage 11 which stores the properties of a number of previous tone mapping functions obtained for previous frames of the same scene. This can be done by storing the number of the previous tone mapping functions in a tone mapping function table 7 and/or by storing the entire tone mapping function. It should be noted that a scene change identifier stage may be provided to reset the temporal property stage on any change of scene (not shown). The temporal property stage 11 on receiving an initial tone mapping function as initially determined for a base frame 4 determines whether or not the change in the tone mapping function compared to prior tone mapping function is large or not. It will be obvious to the skilled person that any such deviation can be weighted so that particular parts of the tone mapping curve have a weight higher than others.
  • It would also be possible to store tone mapping functions in tone mapping function table 7 in a way so that small changes of the look-up table-entry number correspond to small changes in the tone mapping function allows for a particularly simple way of determining whether or not the change from one tone mapping function of a given base frame to previous base frames is large or not. If the change in tone mapping function 6 is gradual, then the actual tone mapping function TMO* corresponds to the initial tone mapping function determined for base frame 4. If the changes of the tone mapping function determined for a given base frame 4 are too large, then the initial tone mapping function is corrected to a tone mapping function which corresponds closer to previous tone mapping functions. This can be determined by simple comparators. Accordingly, the change of tone mapping functions is small within a scene and thus the sequence of frames can be shown based on the compressed video data stream 12 which is of high quality.

Claims (21)

  1. Method of compressing a stream of video frame data wherein
    tone mapping functions are determined for video frames of said stream,
    said tone mapping functions being different from one another
    for frames relating to different scenes
    characterized in that
    the tone mapping functions will be altered for frames of the stream relating to the same scene.
  2. Method of compressing a stream of video frame data according to claim 1 wherein the stream or uncompressed video frame data is a stream of high dynamic range video frames.
  3. Method of compressing a stream of video frame data according to any of the previous claims wherein the stream of uncompressed video frame data is a stream of high definition video data.
  4. Method of compressing a stream of video frame data according to any of the previous claims wherein for at least some frames a base frame is determined.
  5. Method of compressing a stream of video frame data according to the previous claim wherein a base frame is determined for a majority of frames
  6. Method of compressing a stream of video frame data according to the previous claim wherein a base frame is determined for every frame.
  7. Method of compressing a stream of video frame data according to any of the three previous claims wherein the tone mapping function is determined in response to a base frame.
  8. Method of compressing a stream of video frame data according to any of the previous claims wherein a low dynamic range base frame determined in response to a base frame and information relating to a tone mapping function for the base frame is included in the stream of compressed video data.
  9. Method of compressing a stream of video frame data according to any of the previous claims wherein the tone mapping function for a given frame is selected from one of a number of predefined tone mapping functions.
  10. Method of compressing a stream of video frame data according to any of the previous claims wherein the predefined tone mapping functions comprise at least one fixed tone mapping function.
  11. Method of compressing a stream of video frame data according to any of the previous claims wherein the predefined tone mapping functions comprise at least one user defined tone mapping function.
  12. Method of compressing a stream of video frame data according to any of the previous claims wherein the low dynamic base frames are subjected to further base frame compression.
  13. Method of compressing a stream of video frame data according to any of the previous claims wherein a frame detail is extracted from the frames of the uncompressed video data stream.
  14. Method of compressing a stream of video frame data according to any of the previous claims wherein the frame detail is compressed separately from the base frame.
  15. Method of compressing a stream of video frame data according to any of the previous claims wherein a tone mapping function is determined in response to information relating to a present and at least one previous frame.
  16. Method of compressing a stream of video frame data according to the previous claims wherein the tone mapping function is altered gradually as long as no change of scene occurs.
  17. Method of compressing a stream of video frame data according to any of the previous claims wherein a tone mapping function information is included in the video data stream separately from luminance information relating to the same frame.
  18. Video camera for storing and/or transmitting a video data stream obtained according to a method of any of the previous method claims.
  19. Video decoder for decoding a stream of video data obtained according to a method as described in any of the previous method claims.
  20. A stream of video data compressed according to any of the previous method claims.
  21. A data carrier carrying video data for providing a stream of video data according to claim 21.
EP08012452A 2008-07-10 2008-07-10 HDR video data compression devices and methods Not-in-force EP2144444B1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
ES08012452T ES2389458T3 (en) 2008-07-10 2008-07-10 Methods and devices for compression of HDR video data
EP08012452A EP2144444B1 (en) 2008-07-10 2008-07-10 HDR video data compression devices and methods
PCT/EP2009/005042 WO2010003692A1 (en) 2008-07-10 2009-07-10 Hdr video data compression devices and methods
US12/984,992 US9406112B2 (en) 2008-07-10 2011-01-05 Video data compression

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP08012452A EP2144444B1 (en) 2008-07-10 2008-07-10 HDR video data compression devices and methods

Publications (2)

Publication Number Publication Date
EP2144444A1 true EP2144444A1 (en) 2010-01-13
EP2144444B1 EP2144444B1 (en) 2012-06-27

Family

ID=40580886

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08012452A Not-in-force EP2144444B1 (en) 2008-07-10 2008-07-10 HDR video data compression devices and methods

Country Status (4)

Country Link
US (1) US9406112B2 (en)
EP (1) EP2144444B1 (en)
ES (1) ES2389458T3 (en)
WO (1) WO2010003692A1 (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012071235A1 (en) 2010-11-23 2012-05-31 Dolby Laboratories Licensing Corporation Content metadata enhancement of high dynamic range images
WO2012122425A1 (en) * 2011-03-10 2012-09-13 Dolby Laboratories Licensing Corporation Bitdepth and color scalable video coding
WO2012122426A1 (en) * 2011-03-10 2012-09-13 Dolby Laboratories Licensing Corporation Reference processing for bitdepth and color format scalable video coding
WO2012142471A1 (en) * 2011-04-14 2012-10-18 Dolby Laboratories Licensing Corporation Multiple color channel multiple regression predictor
WO2012099691A3 (en) * 2011-01-17 2012-11-15 Exaimage Corporation Systems and methods for wavelet and channel-based high definition video encoding
WO2013067101A1 (en) * 2011-11-04 2013-05-10 Dolby Laboratories Licensing Corporation Layer decomposition in hierarchical vdr coding
EP2591606A1 (en) * 2010-07-06 2013-05-15 Koninklijke Philips Electronics N.V. Generation of high dynamic range images from low dynamic range images in multi-view video coding
WO2014131755A1 (en) * 2013-02-27 2014-09-04 Thomson Licensing Method and device for selecting an image dynamic range conversion operator
EP2887668A1 (en) * 2013-12-19 2015-06-24 Thomson Licensing Method and device for encoding a high-dynamic range image
EP3054418A1 (en) * 2015-02-06 2016-08-10 Thomson Licensing Method and apparatus for processing high dynamic range images
US9443495B2 (en) 2011-06-14 2016-09-13 Koninklijke Philips N.V. Graphics processing for high dynamic range video
EP2973225A4 (en) * 2013-03-12 2016-11-16 Tandent Vision Science Inc Selective perceptual masking via scale separation in the spatial and temporal domains using intrinsic images for use in data compression
US9538176B2 (en) 2008-08-08 2017-01-03 Dolby Laboratories Licensing Corporation Pre-processing for bitdepth and color format scalable video coding
US9549194B2 (en) 2012-01-09 2017-01-17 Dolby Laboratories Licensing Corporation Context based inverse mapping method for layered codec
EP3139345A1 (en) * 2015-09-04 2017-03-08 Disney Enterprises, Inc. High dynamic range tone mapping
EP3168809A1 (en) * 2012-08-08 2017-05-17 Dolby Laboratories Licensing Corporation Image processing for hdr images
US10225485B1 (en) 2014-10-12 2019-03-05 Oliver Markus Haynold Method and apparatus for accelerated tonemapping
WO2021223193A1 (en) * 2020-05-08 2021-11-11 Huawei Technologies Co., Ltd. Determination of a parameter set for a tone mapping curve
US11290612B1 (en) 2014-08-21 2022-03-29 Oliver Markus Haynold Long-exposure camera

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8346022B2 (en) * 2009-09-02 2013-01-01 Tandent Vision Science, Inc. System and method for generating an intrinsic image using tone mapping and log chromaticity
TWI559779B (en) * 2010-08-25 2016-11-21 杜比實驗室特許公司 Extended image dynamic range
GB2500835B (en) 2010-12-10 2014-02-12 Ibm High-dynamic range video tone mapping
US8781000B2 (en) * 2010-12-30 2014-07-15 Vixs Systems, Inc. Dynamic video data compression
KR101538296B1 (en) 2011-03-02 2015-07-29 돌비 레버러토리즈 라이쎈싱 코오포레이션 Local multiscale tone-mapping operator
US8334911B2 (en) 2011-04-15 2012-12-18 Dolby Laboratories Licensing Corporation Encoding, decoding, and representing high dynamic range images
US8891863B2 (en) 2011-06-13 2014-11-18 Dolby Laboratories Licensing Corporation High dynamic range, backwards-compatible, digital cinema
CN104541301B (en) * 2012-03-26 2017-11-03 皇家飞利浦有限公司 Apparatus and method based on brightness region for HDR image encoding and decoding
EP2920759B1 (en) * 2012-11-16 2021-01-27 InterDigital VC Holdings, Inc. Processing high dynamic range images
US8897378B2 (en) 2013-03-12 2014-11-25 Tandent Vision Science, Inc. Selective perceptual masking via scale separation in the spatial and temporal domains using intrinsic images for use in data compression
US9955084B1 (en) 2013-05-23 2018-04-24 Oliver Markus Haynold HDR video camera
JP6227778B2 (en) 2013-07-30 2017-11-08 ドルビー ラボラトリーズ ライセンシング コーポレイション System and method for generating scene invariant metadata
KR102509533B1 (en) * 2014-02-25 2023-03-14 애플 인크. Adaptive transfer function for video encoding and decoding
US10542265B2 (en) 2014-09-09 2020-01-21 Dolby Laboratories Licensing Corporation Self-adaptive prediction method for multi-layer codec
KR20160070512A (en) * 2014-12-10 2016-06-20 삼성전자주식회사 Semiconductor device and operating method thereof
JP2018524875A (en) * 2015-06-09 2018-08-30 華為技術有限公司Huawei Technologies Co.,Ltd. Video encoding method, video decoding method, video encoder, and video decoder
KR102403360B1 (en) * 2015-06-16 2022-05-30 광운대학교 산학협력단 Method and apparatus for employing dynamic range mapping data for hdr video decoder considering backward compatibility
EP3113492A1 (en) * 2015-06-30 2017-01-04 Thomson Licensing Method and apparatus for determining prediction of current block of enhancement layer
WO2018006390A1 (en) * 2016-07-08 2018-01-11 SZ DJI Technology Co., Ltd. System and method for image processing
US10218952B2 (en) 2016-11-28 2019-02-26 Microsoft Technology Licensing, Llc Architecture for rendering high dynamic range video on enhanced dynamic range display devices
US10104334B2 (en) 2017-01-27 2018-10-16 Microsoft Technology Licensing, Llc Content-adaptive adjustment of display device brightness levels when rendering high dynamic range content
US10176561B2 (en) 2017-01-27 2019-01-08 Microsoft Technology Licensing, Llc Content-adaptive adjustments to tone mapping operations for high dynamic range content
US11100888B2 (en) * 2017-06-28 2021-08-24 The University Of British Columbia Methods and apparatuses for tone mapping and inverse tone mapping
US11049225B2 (en) * 2017-07-07 2021-06-29 Panasonic Intellectual Property Management Co., Ltd. Video processing system and video processing method
EP3477946A1 (en) * 2017-10-31 2019-05-01 Thomson Licensing Method and device for obtaining a second image from a first image when the dynamic range of the luminance of said first image is greater than the dynamic range of the luminance of said second image
KR102550846B1 (en) * 2018-03-06 2023-07-05 삼성디스플레이 주식회사 Method of performing an image-adaptive tone mapping and display device employing the same
US10445865B1 (en) * 2018-03-27 2019-10-15 Tfi Digital Media Limited Method and apparatus for converting low dynamic range video to high dynamic range video
EP3594894A1 (en) 2018-07-11 2020-01-15 InterDigital VC Holdings, Inc. Tone-mapping of colors of a video content
US11317103B2 (en) * 2020-04-28 2022-04-26 Honeywell Federal Manufacturings Technologies, Llc Electronic device and method for compressing video data
US12132916B2 (en) * 2018-10-03 2024-10-29 Honeywell Federal Manufacturing & Technologies, Llc Electronic device and method for compressing video data
US11812039B2 (en) * 2018-10-03 2023-11-07 Honeywell Federal Manufacturing & Technologies, Llc Electronic device and method for compressing video data
US10957024B2 (en) 2018-10-30 2021-03-23 Microsoft Technology Licensing, Llc Real time tone mapping of high dynamic range image data at time of playback on a lower dynamic range display

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1827024A1 (en) * 2006-02-24 2007-08-29 Sharp Kabushiki Kaisha High dynamic range video coding

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6993076B1 (en) * 1999-05-11 2006-01-31 Thomson Licensing S.A. Apparatus and method for deriving an enhanced decoded reduced-resolution video signal from a coded high-definition video signal
US6301393B1 (en) * 2000-01-21 2001-10-09 Eastman Kodak Company Using a residual image formed from a clipped limited color gamut digital image to represent an extended color gamut digital image
US7146059B1 (en) * 2003-03-05 2006-12-05 Massachusetts Institute Of Technology Method of performing fast bilateral filtering and using the same for the display of high-dynamic-range images
US8218625B2 (en) * 2004-04-23 2012-07-10 Dolby Laboratories Licensing Corporation Encoding, decoding and representing high dynamic range images
US20050259729A1 (en) * 2004-05-21 2005-11-24 Shijun Sun Video coding with quality scalability
CN101371583B (en) * 2006-01-23 2012-03-21 马普科技促进协会 Method and device for encoding/decoding high dynamic range images
US8503524B2 (en) * 2007-01-23 2013-08-06 Sharp Laboratories Of America, Inc. Methods and systems for inter-layer image prediction
US8233536B2 (en) * 2007-01-23 2012-07-31 Sharp Laboratories Of America, Inc. Methods and systems for multiplication-free inter-layer image prediction
US7983496B2 (en) * 2007-06-26 2011-07-19 Mitsubishi Electric Research Laboratories, Inc. Inverse tone mapping for bit-depth scalable image coding adapted to variable block sizes
EP2193661A4 (en) * 2007-06-27 2011-10-19 Thomson Licensing METHOD AND APPARATUS FOR ENCODING AND / OR DECODING VIDEO DATA USING RESIDUAL PREDICTION OF IMPROVING LAYER FOR SCALABILITY OF BINARY DEPTH
EP2051527A1 (en) * 2007-10-15 2009-04-22 Thomson Licensing Enhancement layer residual prediction for bit depth scalability using hierarchical LUTs
DK2835976T3 (en) * 2008-04-16 2016-12-05 Ge Video Compression Llc Bit depth scalability
WO2010105036A1 (en) * 2009-03-13 2010-09-16 Dolby Laboratories Licensing Corporation Layered compression of high dynamic range, visual dynamic range, and wide color gamut video

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1827024A1 (en) * 2006-02-24 2007-08-29 Sharp Kabushiki Kaisha High dynamic range video coding

Non-Patent Citations (20)

* Cited by examiner, † Cited by third party
Title
G. MCTAGGERT; C. GREEN; J. MITCHELL: "SIGGRAPH '06: ACM SIGGRAPH", 2006, ACM PRESS, article "HIGH DYNAMIC RANGE RENDERING IN VAL VE'S SOURCE ENGINE", pages: 7
G. W. LARSON: "LOGLUV ENCODING FOR FULL-GAMUT, HIGH DYNAMIC RANGE IMAGES", JOURNAL OF GRAPHICS TOOLS, vol. 3, no. 1, 1998, pages 15 - 31
G. WARD: "A GENERAL APPROACH TO BACKWARDS-COMPATIBLE DELIVERY OF HIGH DYNAMIC RANGE IMAGES AND VIDEO", CIC 14TH: PROCEEDINGS OF THE FOURTEENTH COLOR IMAGING CONFERENCE, THE SOCIETY FOR IMAGING SCIENCE AND TECHNOLOGY, 2006
G. WARD: "JPEG-HDR: A BACKWARDS-CaMPA TlBLE, HIGH DYNAMIC RANGE EXTENSION TO JPEG", CIC 13TH: PROCEEDINGS OF THE THIRTEENTH COLOR IMAGING CONFERENCE, THE SOCIETY FOR IMAGING SCIENCE AND TECHNOLOGY, 2005
G. WARD: "REAL PIXELS", GRAPHICS GEMS, vol. 2, 1991, pages 15 - 31
G. WARD; M. SIMMONS: "Graphics and Visualization", 2004, ACM PRESS, article "SUB BAND ENCODING OF HIGH DYNAMIC RANGE IMAGERYin: APGV '04: Proceedings of the 1st Symposium on Applied Perception", pages: 83 - 90
J. MUNKBERG; P. CLARBERG; J. HASSELGREN; T. AKENINE-MOLLER: "HIGH DYNAMIC RANGE TEXTURE COMPRESSION FOR GRAPHICS HARDWARE", ACM TRANS. GRAPH., vol. 25, no. 3, 2006, pages 698 - 706
J.H.V. HATEREN: "ENCODING OF HIGH DYNAMIC RANGE VIDEO WITH A MODEL OF HUMAN CONES", ACM TRANS. GRAPH., vol. 25, no. 4, 2006, pages 1380 - 1399
K. ROIMELA; T. AARNIO; J. ITARANTA: "HIGH DYNAMIC RANGE TEXTURE COMPRESSION", ACM TRANS. GRAPH., vol. 25, no. 3, 2006, pages 707 - 712
K. ROIMELA; T. AARNIO; J. ITARANTA: "S13D'08: Proceedings of the 2008 Symposium on Interactive 3D Graphics and Games", 2008, ACM PRESS, article "EFFICIENT HIGH DYNAMIC RANGE TEXTURE COMPRESSION", pages: 207 - 214
L. WANG; X. WANG; P-P SLOAN; L-Y WEI; X. TONG; B. GUO: "13D '07: Proceedings of the 2007 symposium on Interactive 3D graphics and games", vol. 17, 2007, ACM PRESS, article "RENDERING FROM COMPRESSED HIGH DYNAMIC RANGE TEXTURES ON PROGRAMMABLE GRAPHICS HARDWARE", pages: 24
LIU S ET AL: "SVC inter-layer pred for SVC bit-depth scalability", JOINT VIDEO TEAM (JVT) OF ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6), XX, XX, no. JVT-X075, 30 June 2007 (2007-06-30), XP030007182 *
M. KILGARD; P. BROWN; J. LEECH: "GLEXT TEXTURE SHARED EXPONENT in: OpenGL Extension, http://www.opengl.org/registry/specs/EXT /texture _shared_exponent. txt, 2007 as well as in D. BLYTHE: THE DIRECT3D 10 SYSTEM", ACM TRANS. GRAPH., vol. 25, no. 3, 2006, pages 724 - 734
M. OKUDA; N. ADAMI: "RAW IMAGE ENCODING BASED ON POLYNOMIAL APPROXIMATION", IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, 2007, pages 15 - 31
MARTIN WINKEN ET AL: "Bit-Depth Scalable Video Coding", IMAGE PROCESSING, 2007. ICIP 2007. IEEE INTERNATIONAL CONFERENCE ON, IEEE, PI, 1 September 2007 (2007-09-01), pages I - 5, XP031157664, ISBN: 978-1-4244-1436-9 *
R. MANTIUK; A. EFREMOV; K. MYSZKOWSKI; H.-P. SEIDEL: "BACKWARD COMPATIBLE HIGH DYNAMIC RANGE MPEG VIDEO COMPRESSION", ACM TRANS. GRAPH., vol. 25, no. 3, 2006, pages 713 - 723
R. MANTIUK; G. KRAWCZYK; K. MYSZKOWSKI; H.-P. SEIDEL: "ERCEPTION-MOTIVATED HIGH DYNAMIC RANGE VIDEO ENCODING", ACM TRANS. GRAPH., vol. 23, no. 3, 2004, pages 733 - 741
S. LEFEBVRE; H. HOPPE: "COMPRESSED RANDOM-ACCESS TREES FOR SPATIALLYCOHERENT DATA", RENDERING TECHNIQUES (PROCEEDINGS OF THE EUROGRAPHICS SYMPOSIUM ON RENDERING), EUROGRAPHICS, 2007
WINKEN M ET AL: "SVC bit depth scalability", JOINT VIDEO TEAM (JVT) OF ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 AND ITU-T SG16 Q6), XX, XX, no. JVT-V078, 14 January 2007 (2007-01-14), XP030006886 *
Y. LI; L. SHARAN; E. H. ADELSON: "SIGGRAPH '05: ACM SIGGRAPH", 2005, ACM PRESS, article "COMPRESSING AND COMPANDING HIGH DYNAMIC RANGE IMAGES WITH SUB BAND ARCHITECTURES", pages: 836 - 844

Cited By (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9538176B2 (en) 2008-08-08 2017-01-03 Dolby Laboratories Licensing Corporation Pre-processing for bitdepth and color format scalable video coding
EP2591606A1 (en) * 2010-07-06 2013-05-15 Koninklijke Philips Electronics N.V. Generation of high dynamic range images from low dynamic range images in multi-view video coding
EP3716632A1 (en) * 2010-11-23 2020-09-30 Dolby Laboratories Licensing Corporation Display of high dynamic range images on a global dimming display using bit depth reduction mapping metadata
EP2643809A4 (en) * 2010-11-23 2014-12-17 Dolby Lab Licensing Corp ENHANCING CONTENT METADATA IN HIGH DYNAMIC RANGE IMAGES
EP4053786A1 (en) * 2010-11-23 2022-09-07 Dolby Laboratories Licensing Corporation Display of high dynamic range images on a local dimming display using bit depth reduction mapping metadata
CN103210418A (en) * 2010-11-23 2013-07-17 杜比实验室特许公司 Content metadata enhancement of high dynamic range images
WO2012071235A1 (en) 2010-11-23 2012-05-31 Dolby Laboratories Licensing Corporation Content metadata enhancement of high dynamic range images
CN103210418B (en) * 2010-11-23 2016-08-17 杜比实验室特许公司 The content metadata of high dynamic range images strengthens
US9275605B2 (en) 2010-11-23 2016-03-01 Dolby Laboratories Licensing Corporation Content metadata enhancement of high dynamic range images
WO2012099691A3 (en) * 2011-01-17 2012-11-15 Exaimage Corporation Systems and methods for wavelet and channel-based high definition video encoding
WO2012122426A1 (en) * 2011-03-10 2012-09-13 Dolby Laboratories Licensing Corporation Reference processing for bitdepth and color format scalable video coding
WO2012122425A1 (en) * 2011-03-10 2012-09-13 Dolby Laboratories Licensing Corporation Bitdepth and color scalable video coding
US10237552B2 (en) 2011-04-14 2019-03-19 Dolby Laboratories Licensing Corporation Multiple color channel multiple regression predictor
WO2012142471A1 (en) * 2011-04-14 2012-10-18 Dolby Laboratories Licensing Corporation Multiple color channel multiple regression predictor
US10021390B2 (en) 2011-04-14 2018-07-10 Dolby Laboratories Licensing Corporation Multiple color channel multiple regression predictor
EP3324622A1 (en) * 2011-04-14 2018-05-23 Dolby Laboratories Licensing Corporation Multiple color channel multiple regression predictor
EP2782348A1 (en) * 2011-04-14 2014-09-24 Dolby Laboratories Licensing Corporation Multiple color channel multiple regression predictor
US8811490B2 (en) 2011-04-14 2014-08-19 Dolby Laboratories Licensing Corporation Multiple color channel multiple regression predictor
US9699483B2 (en) 2011-04-14 2017-07-04 Dolby Laboratories Licensing Corporation Multiple color channel multiple regression predictor
CN103563372B (en) * 2011-04-14 2017-05-24 杜比实验室特许公司 Multi-color channel multiple regression predictor
CN103563372A (en) * 2011-04-14 2014-02-05 杜比实验室特许公司 Multi-color channel multiple regression predictor
US9386313B2 (en) 2011-04-14 2016-07-05 Dolby Laboratories Licensing Corporation Multiple color channel multiple regression predictor
US9443495B2 (en) 2011-06-14 2016-09-13 Koninklijke Philips N.V. Graphics processing for high dynamic range video
RU2644065C9 (en) * 2011-11-04 2018-04-04 Долби Лабораторис Лайсэнзин Корпорейшн Decomposition of levels in hierarchical vdr encoding
US9924171B2 (en) 2011-11-04 2018-03-20 Dolby Laboratories Licensing Corporation Layer decomposition in hierarchical VDR coding
EP3468203A1 (en) * 2011-11-04 2019-04-10 Dolby Laboratories Licensing Corporation Layer decomposition in hierarchical vdr coding
CN105744277A (en) * 2011-11-04 2016-07-06 杜比实验室特许公司 Layer decomposition in hierarchical VDR coding
US9497456B2 (en) 2011-11-04 2016-11-15 Dolby Laboratories Licensing Corporation Layer decomposition in hierarchical VDR coding
CN104322072A (en) * 2011-11-04 2015-01-28 杜比实验室特许公司 Layer Decomposition in Layered VDR Coding and Decoding
RU2586572C2 (en) * 2011-11-04 2016-06-10 Долби Лабораторис Лайсэнзин Корпорейшн Layer decomposition in hierarchical vdr coding
CN105657425A (en) * 2011-11-04 2016-06-08 杜比实验室特许公司 Layer decomposition in hierarchical VDR coding
WO2013067101A1 (en) * 2011-11-04 2013-05-10 Dolby Laboratories Licensing Corporation Layer decomposition in hierarchical vdr coding
CN104322072B (en) * 2011-11-04 2016-04-20 杜比实验室特许公司 Layered VDR encoding method and encoder
RU2644065C1 (en) * 2011-11-04 2018-02-07 Долби Лабораторис Лайсэнзин Корпорейшн Decomposition of levels in hierarchical vdr encoding
TWI575933B (en) * 2011-11-04 2017-03-21 杜比實驗室特許公司 Layer decomposition in hierarchical vdr coding
CN105744277B (en) * 2011-11-04 2019-12-24 杜比实验室特许公司 Layer Decomposition in Layered VDR Coding and Decoding
US9549194B2 (en) 2012-01-09 2017-01-17 Dolby Laboratories Licensing Corporation Context based inverse mapping method for layered codec
EP3168809A1 (en) * 2012-08-08 2017-05-17 Dolby Laboratories Licensing Corporation Image processing for hdr images
JP2016517194A (en) * 2013-02-27 2016-06-09 トムソン ライセンシングThomson Licensing Method and device for selecting an image dynamic range conversion operator
US9767542B2 (en) 2013-02-27 2017-09-19 Thomson Licensing Method and device for selecting an image dynamic range conversion operator
WO2014131755A1 (en) * 2013-02-27 2014-09-04 Thomson Licensing Method and device for selecting an image dynamic range conversion operator
EP2973225A4 (en) * 2013-03-12 2016-11-16 Tandent Vision Science Inc Selective perceptual masking via scale separation in the spatial and temporal domains using intrinsic images for use in data compression
WO2015091309A1 (en) * 2013-12-19 2015-06-25 Thomson Licensing Method and device for encoding a high-dynamic range image
EP2887668A1 (en) * 2013-12-19 2015-06-24 Thomson Licensing Method and device for encoding a high-dynamic range image
US11290612B1 (en) 2014-08-21 2022-03-29 Oliver Markus Haynold Long-exposure camera
US10868969B1 (en) 2014-10-12 2020-12-15 Promanthan Brains Llc, Series Gaze Only Method and apparatus for accelerated tonemapping and display
US10225485B1 (en) 2014-10-12 2019-03-05 Oliver Markus Haynold Method and apparatus for accelerated tonemapping
WO2016124451A1 (en) * 2015-02-06 2016-08-11 Thomson Licensing Method and apparatus for processing high dynamic range images
EP3054418A1 (en) * 2015-02-06 2016-08-10 Thomson Licensing Method and apparatus for processing high dynamic range images
JP2017049992A (en) * 2015-09-04 2017-03-09 ディズニー エンタープライゼス インコーポレイテッド High dynamic range tone mapping
CN106504278B (en) * 2015-09-04 2019-08-13 迪士尼企业公司 High dynamic range tone mapping
US9979895B2 (en) 2015-09-04 2018-05-22 Disney Enterprises, Inc. High dynamic range tone mapping
CN106504278A (en) * 2015-09-04 2017-03-15 迪士尼企业公司 HDR tone maps
EP3139345A1 (en) * 2015-09-04 2017-03-08 Disney Enterprises, Inc. High dynamic range tone mapping
WO2021223193A1 (en) * 2020-05-08 2021-11-11 Huawei Technologies Co., Ltd. Determination of a parameter set for a tone mapping curve
US12505523B2 (en) 2020-05-08 2025-12-23 Huawei Technologies Co., Ltd. Determination of a parameter set for a tone mapping curve

Also Published As

Publication number Publication date
US9406112B2 (en) 2016-08-02
WO2010003692A1 (en) 2010-01-14
ES2389458T3 (en) 2012-10-26
US20110235720A1 (en) 2011-09-29
EP2144444B1 (en) 2012-06-27

Similar Documents

Publication Publication Date Title
EP2144444B1 (en) HDR video data compression devices and methods
US10992898B2 (en) Display method and display device
JP6609708B2 (en) System and method for reconstruction and adaptation of high dynamic range video data
US8462194B2 (en) Multi-compatible low and high dynamic range and high bit-depth texture and video encoding system
Mantiuk et al. Perception-motivated high dynamic range video encoding
CN108605125B (en) Method and device for encoding and decoding HDR video
AU2011213266B2 (en) High dynamic range image generation and rendering
JP2022140582A (en) Systems for Encoding High Dynamic Range and Wide Gamut Sequences
JP5965025B2 (en) Image processing for HDR images
US7773099B2 (en) Context aware image conversion method and playback system
US20060002611A1 (en) Method and apparatus for encoding high dynamic range video
JP2014523661A (en) Scalable system to control color management including various levels of metadata
WO2018231968A1 (en) Efficient end-to-end single layer inverse display management coding
EP3639238A1 (en) Efficient end-to-end single layer inverse display management coding
WO2010043922A1 (en) High dynamic range texture and video coding
WO2019036522A1 (en) Bit-depth efficient image processing
GB2408872A (en) Converting a high dynamic range image to a low dynamic range image using a film transfer function
US20250106410A1 (en) Beta scale dynamic display mapping
Myszkowski et al. HDR Image, Video, and Texture Compression
CN120281916A (en) HDR10 image layered coding and decoding method, device and storage medium
CN121616505A (en) HDR image-oriented adaptive gray scale stretching and local contrast enhancement method and system
Hatchett Efficient and adaptable high dynamic range compression
Zhang et al. High Dynamic Range Video Compression

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

17P Request for examination filed

Effective date: 20100713

17Q First examination report despatched

Effective date: 20100810

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 564702

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120715

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602008016640

Country of ref document: DE

Effective date: 20120823

REG Reference to a national code

Ref country code: NL

Ref legal event code: T3

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2389458

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20121026

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120927

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 564702

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120627

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120627

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120928

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121027

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120731

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121029

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120731

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120731

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20130328

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602008016640

Country of ref document: DE

Effective date: 20130328

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120927

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120627

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120710

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080710

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20170721

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20170818

Year of fee payment: 10

Ref country code: IT

Payment date: 20170721

Year of fee payment: 10

Ref country code: DE

Payment date: 20170727

Year of fee payment: 10

Ref country code: FR

Payment date: 20170725

Year of fee payment: 10

Ref country code: FI

Payment date: 20170719

Year of fee payment: 10

Ref country code: GB

Payment date: 20170725

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20170725

Year of fee payment: 10

Ref country code: IE

Payment date: 20170724

Year of fee payment: 10

Ref country code: BE

Payment date: 20170720

Year of fee payment: 10

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602008016640

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MM

Effective date: 20180801

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20180710

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20180731

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180710

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180710

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180710

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180731

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180711

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180731

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180710

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20190917

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180711