CN107154059B - High dynamic range video processing method - Google Patents
High dynamic range video processing method Download PDFInfo
- Publication number
- CN107154059B CN107154059B CN201710497390.1A CN201710497390A CN107154059B CN 107154059 B CN107154059 B CN 107154059B CN 201710497390 A CN201710497390 A CN 201710497390A CN 107154059 B CN107154059 B CN 107154059B
- Authority
- CN
- China
- Prior art keywords
- scene
- dynamic range
- color space
- brightness
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
Abstract
The invention discloses a high dynamic range video processing method. The method comprises the steps of obtaining a gamma value corresponding to each scene by detecting brightness values and contrast ratios of different scenes of a Standard Dynamic Range (SDR) video, further obtaining parameters required during inverse tone mapping by calculation according to the gamma value, and finally converting to obtain High Dynamic Range (HDR) video data. The invention has the beneficial effects that: the method can automatically adapt to videos of most of different scenes with different styles, fully considers the influence of different brightness/contrast in different scenes and regions on the conversion process, and the final conversion result can keep the creation intention of an original content producer to a great extent and can present good image aesthetic feeling and fidelity.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a high dynamic range video processing method.
Background
Compared with a Standard Dynamic Range (SDR) video, a High Dynamic Range (HDR) video has a clearer light and shade level of an image, richer image details, and can more vividly reproduce a real scene. With the development of HDR technology and the increasing popularity of HDR displays, the demand for HDR video increases. Real HDR video production needs to use an imaging device with a high dynamic range at an acquisition end, and also needs to use non-editing software supporting HDR during production, that is, content production of HDR video has high requirements on shooting equipment and preprocessing technology, so that HDR content in the market is still in a relatively deficient state at present. On the other hand, there are relatively sufficient high definition/ultra high definition SDR film sources which are well-produced in the market. How to convert the SDR content into the high-quality HDR format video has important practical significance.
Most of research is currently focused on interconversion between SDR images and HDR images, and Tone Mapping (ToneMapping) and Inverse Tone Mapping (Inverse Tone Mapping) are key technologies for interconversion between SDR images and HDR images. The main consideration of the currently mainstream tone mapping algorithm is the display capability of the output device, and the scene characteristics of the video itself also have a large influence on the display effect, but are often ignored. Due to the non-linear characteristic of human eyes to brightness perception, the simplest image inverse tone mapping algorithm generally adjusts the SDR image in a manner similar to gamma correction, that is, the SDR image is converted by global parameters to generate an HDR image. The limitations of this conversion algorithm are apparent because different images have different brightness/contrast ranges and the global parameter can only be manually adjusted to accommodate different styles of images. In addition, because there is a great difference between video and image processing methods, the inverse tone mapping algorithm of the image cannot be directly applied to video conversion. Generally, different video content producers typically express their movie creation intentions by adjusting different brightness, contrast, saturation, and the like. If different scenes are divided according to brightness/contrast, the scenes can be roughly divided into different styles such as "low brightness low contrast", "low brightness high contrast", "medium brightness medium contrast", "high brightness low contrast" and "high brightness high contrast", that is, different videos have different styles, and the same video segment may also be composed of scenes of different styles. If different video files or different scenes of the same video file are processed with the same parameters, the converted HDR video certainly cannot present good aesthetic feeling and fidelity, and the intention of the content creator cannot be well preserved.
Disclosure of Invention
The invention provides a high dynamic range video processing method capable of improving the aesthetic feeling and the fidelity of images in order to overcome the defects in the prior art.
In order to achieve the purpose, the invention adopts the following technical scheme:
a high dynamic range video processing method comprises the following specific operation steps:
(1) decoding the input standard dynamic range video to obtain data of a YCbCr color space;
(2) carrying out color space conversion on the acquired data of the YCbCr color space to acquire data of an RGB color space;
(3) in the obtained RGB color space data, electro-optical conversion is respectively carried out on color components in three channels of R/G/B;
(4) respectively processing color components in the R/G/B three channels through inverse tone mapping parameters;
(5) respectively carrying out photoelectric conversion on the color components in the R/G/B channels in the step (4);
(6) mapping the data of the color space to a corresponding color space according to the setting requirement of the output parameters;
(7) performing color space conversion on the finally processed RGB color space data to obtain YCbCr color space data;
(8) and (4) coding the YCbCr color space data processed in the step (7) to obtain a high dynamic range video stream.
The invention aims to provide a method for converting an SDR video into an HDR video, which applies different parameter processing to different scenes. The method finally converts the HDR video data according to the parameters required by inverse tone mapping. The method can automatically adapt to most videos with different styles and scenes, fully considers the influence of different inverse tone mapping parameters on the conversion process, and the final conversion result can present good image aesthetic feeling and fidelity.
Preferably, in step (4), the inverse tone mapping parameters are obtained as follows:
(a) decoding the input standard dynamic range video and detecting a scene;
(b) traversing the scene to obtain the contrast C of the scene;
(c) traversing the scene to obtain a brightness median of each frame in the scene;
(d) obtaining the brightness average value of the scene according to the brightness value of each frame in the scene
(e) According to the contrast C of the scene and the brightness average value of the scene
Obtaining the gamma value corresponding to the scene
Wherein α is an adjusting coefficient, and the effective range of gamma is [0.2, 1.4 ]]；
(f) Obtaining inverse tone mapping parameters of each pixel point in each frame of the scene through the gamma value in the step (e)
Wherein LSDR_maxIs the maximum luminance value of the input standard dynamic range video, LHDR_maxIs the maximum luminance value, Y, of the target high dynamic range video settingSDRIs the brightness value of each pixel point in the standard dynamic range video.
The method comprises the steps of detecting brightness values and contrasts of different scenes of an SDR video to obtain a gamma value corresponding to each scene, and calculating according to the gamma value to obtain parameters required during inverse tone mapping. The photoelectric/electro-optical function conversion, color gamut conversion, etc. involved in the conversion process may refer to relevant standards and are not within the scope of the present invention. It can be known from experimental tests that the value of the gamma value is generally in direct proportion to the contrast of a scene and in inverse proportion to the brightness of the scene. Namely, in the scene with higher brightness, the gamma value tends to be selected to be smaller; in a scene with low contrast, a smaller gamma value tends to be selected. The invention can automatically adapt to most videos with different styles and scenes, fully considers the influence of different brightness/contrast in different scenes and regions on the conversion process, and the final conversion result can present good image aesthetic feeling and fidelity.
Preferably, in step (c), the median luminance value of each frame is obtained as follows: when the brightness median value is obtained from each frame, the frame signal is converted into XYZ color space, Y component is extracted as the brightness value of corresponding pixel point, and the brightness median values of all pixel points are taken as the brightness value of the frame
Preferably, in step (2), the obtained data of the YCbCr color space is subjected to color space conversion in the bt.709 color gamut; in the step (3), the conversion function of the electro-optical conversion adopts ITU-RBT.709 standard; in step (5), the conversion function of the photoelectric conversion adopts the ITU-R bt.2100 standard.
Preferably, in step (4), after the color components in the three R/G/B channels are processed by the inverse tone mapping parameters, the result is: rHDR＝RSDR·Coef，GHDR＝GSDR·Coef，BHDR＝BSDR·Coef。
The invention has the beneficial effects that: the method can automatically adapt to videos of most of different scenes with different styles, fully considers the influence of different brightness/contrast in different scenes and regions on the conversion process, and the final conversion result can keep the creation intention of an original content producer to a great extent and can present good image aesthetic feeling and fidelity.
Drawings
FIG. 1 is a flow chart of a method of the present invention;
FIG. 2 is a flow chart of a method of inverse tone mapping parameters in the present invention.
Detailed Description
The invention is further described with reference to the following figures and detailed description.
In the embodiment shown in fig. 1, a high dynamic range video processing method includes the following specific operation steps:
(1) decoding the input standard dynamic range video to obtain data of a YCbCr color space;
(2) carrying out color space conversion on the acquired YCbCr color space data in a BT.709 color gamut to acquire data of an RGB color space;
(3) in the obtained RGB color space data, electro-optical conversion is respectively carried out on color components in three channels of R/G/B; the conversion function of the electro-optical conversion adopts ITU-R BT.709 standard;
(4) the color components in the three channels of R/G/B are respectively processed by inverse tone mapping parameters, and the result is: rHDR＝RSDR·Coef，GHDR＝GSDR·Coef，BHDR＝BSDR·Coef；
(5) Respectively carrying out photoelectric conversion on the color components in the R/G/B channels in the step (4); the conversion function of photoelectric conversion adopts ITU-R BT.2100 standard;
(6) mapping the data of the color space to a corresponding color space according to the setting requirement of the output parameters; if the output parameter setting requirement is BT.2020 color gamut, the data of BT.709 color gamut needs to be mapped to BT.2020 color gamut, namely color gamut mapping, and the conversion method can refer to ITU-R BT.2087 standard;
(7) performing color space conversion on the finally processed RGB color space data to obtain YCbCr color space data;
(8) and (4) coding the YCbCr color space data processed in the step (7) to obtain a high dynamic range video stream.
Wherein: as shown in fig. 2, in step (4), the inverse tone mapping parameters are obtained as follows:
(a) decoding the input standard dynamic range video and detecting a scene;
(b) traversing the scene to obtain the contrast C of the scene;
(c) traversing the scene to obtain a brightness median of each frame in the scene; the method for obtaining the brightness median value of each frame is as follows: when the brightness median value is obtained from each frame, the frame signal is converted into XYZ color space, Y component is extracted as the brightness value of corresponding pixel point, and the brightness median values of all pixel points are taken as the brightness value of the frame
(d) Obtaining the brightness average value of the scene according to the brightness value of each frame in the scene
(e) According to the contrast C of the scene and the brightness average value of the scene
Obtaining the gamma value corresponding to the scene
Wherein α is an adjusting coefficient, and the effective range of gamma is [0.2, 1.4 ]]；
(f) Obtaining inverse tone mapping parameters of each pixel point in each frame of the scene through the gamma value in the step (e)
Wherein LSDR_maxIs the maximum luminance value of the input standard dynamic range video, LHDR_maxIs the maximum luminance value, Y, of the target high dynamic range video settingSDRIs the brightness value of each pixel point in the standard dynamic range video.
The invention aims to provide a method for converting Standard Dynamic Range (SDR) video into High Dynamic Range (HDR) video, which applies different parameter processing to different scenes. The method comprises the steps of obtaining a gamma value corresponding to each scene by detecting brightness values and contrast ratios of different scenes of a Standard Dynamic Range (SDR) video, further calculating parameters required during inverse tone mapping according to the gamma values, and finally converting to obtain High Dynamic Range (HDR) video data. The invention can automatically adapt to most videos with different styles and scenes, fully considers the influence of different brightness/contrast in different scenes and regions on the conversion process, and the final conversion result can present good image aesthetic feeling and fidelity. The photoelectric/electro-optical function conversion, color gamut conversion, etc. involved in the conversion process may refer to relevant standards and are not within the scope of the present invention. It can be known from experimental tests that the value of the gamma value is generally in direct proportion to the contrast of a scene and in inverse proportion to the brightness of the scene. Namely, in the scene with higher brightness, the gamma value tends to be selected to be smaller; in a scene with low contrast, a smaller gamma value tends to be selected. Wherein: the same gamma value is used in the same scene, parameters required by inverse tone mapping are calculated according to the gamma value, and the finally obtained High Dynamic Range (HDR) video can greatly keep the creation intention of an original content producer and can enable the image to present good aesthetic feeling and fidelity.
Claims (3)
1. A high dynamic range video processing method is characterized by comprising the following specific operation steps:
(1) decoding the input standard dynamic range video to obtain data of a YCbCr color space;
(2) carrying out color space conversion on the acquired data of the YCbCr color space to acquire data of an RGB color space;
(3) in the obtained RGB color space data, electro-optical conversion is respectively carried out on color components in three channels of R/G/B;
(4) respectively processing color components in the R/G/B three channels through inverse tone mapping parameters; the inverse tone mapping parameters are obtained as follows:
(a) decoding the input standard dynamic range video and detecting a scene;
(b) traversing the scene to obtain the contrast C of the scene;
(c) traversing the scene to obtain a brightness median of each frame in the scene; the method for obtaining the brightness median value of each frame is as follows: when the brightness median value is obtained from each frame, the frame signal is converted into XYZ color space, Y component is extracted as the brightness value of corresponding pixel point, and the brightness median values of all pixel points are taken as the brightness value of the frame
(d) Obtaining the brightness average value of the scene according to the brightness value of each frame in the scene
(e) According to the contrast C of the scene and the brightness average value of the scene
Obtaining the gamma value corresponding to the scene
Wherein α is an adjusting coefficient, and the effective range of gamma is [0.2, 1.4 ]]；
(f) Obtaining inverse tone mapping parameters of each pixel point in each frame of the scene through the gamma value in the step (e)
Wherein:LSDR_maxis the maximum luminance value of the input standard dynamic range video, LHDR_maxIs the maximum luminance value, Y, of the target high dynamic range video settingSDRThe brightness value of each pixel point in the standard dynamic range video;
(5) respectively carrying out photoelectric conversion on the color components in the R/G/B channels in the step (4);
(6) mapping the data of the color space to a corresponding color space according to the setting requirement of the output parameters;
(7) performing color space conversion on the finally processed RGB color space data to obtain YCbCr color space data;
(8) and (4) coding the YCbCr color space data processed in the step (7) to obtain a high dynamic range video stream.
2. The high dynamic range video processing method according to claim 1, wherein in step (2), the obtained data of the YCbCr color space is color space converted in the bt.709 color gamut; in the step (3), the conversion function of the electro-optical conversion adopts the ITU-R BT.709 standard; in step (5), the conversion function of the photoelectric conversion adopts the ITU-R bt.2100 standard.
3. The high dynamic range video processing method according to claim 1, wherein in step (4), after the color components in the three R/G/B channels are processed by inverse tone mapping parameters, the result is: rHDR＝RSDR·Coef，GHDR＝GSDR·Coef，BHDR＝BSDR·Coef。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710497390.1A CN107154059B (en) | 2017-06-26 | 2017-06-26 | High dynamic range video processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710497390.1A CN107154059B (en) | 2017-06-26 | 2017-06-26 | High dynamic range video processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107154059A CN107154059A (en) | 2017-09-12 |
| CN107154059B true CN107154059B (en) | 2020-08-04 |
Family
ID=59796174
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710497390.1A Active CN107154059B (en) | 2017-06-26 | 2017-06-26 | High dynamic range video processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107154059B (en) |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10972674B2 (en) | 2017-12-27 | 2021-04-06 | Canon Kabushiki Kaisha | Electronic apparatus |
| CN108305232B (en) * | 2018-03-01 | 2019-07-12 | 电子科技大学 | A kind of single frames high dynamic range images generation method |
| CN108495108B (en) * | 2018-03-02 | 2019-11-05 | 深圳创维－Rgb电子有限公司 | Image conversion method and device, terminal, storage medium |
| US10445865B1 (en) * | 2018-03-27 | 2019-10-15 | Tfi Digital Media Limited | Method and apparatus for converting low dynamic range video to high dynamic range video |
| CN108769804B (en) * | 2018-04-25 | 2020-12-15 | 杭州当虹科技股份有限公司 | Format conversion method for high dynamic range video |
| CN108986039B (en) * | 2018-06-06 | 2019-07-09 | 贝壳找房(北京)科技有限公司 | A kind of tone mapping method and system based on grayscale image |
| CN108882028B (en) * | 2018-07-05 | 2019-06-14 | 华为技术有限公司 | The processing method and processing device of vision signal |
| CN109274985B (en) * | 2018-10-12 | 2020-04-28 | 腾讯科技（深圳）有限公司 | Video transcoding method and device, computer equipment and storage medium |
| CN109327734B (en) * | 2018-11-27 | 2020-11-13 | 成都索贝数码科技股份有限公司 | Method for down-converting HDR video to SDR video based on dynamic photometry |
| CN110769210B (en) * | 2019-11-07 | 2022-06-03 | 湖南国科微电子股份有限公司 | Method and device for generating HDR image |
| CN112261442B (en) * | 2020-10-19 | 2022-11-11 | 上海网达软件股份有限公司 | Method and system for real-time transcoding of HDR (high-definition link) and SDR (short-definition link) of video |
| CN113781318A (en) * | 2021-08-02 | 2021-12-10 | 中国科学院深圳先进技术研究院 | Image color mapping method and device, terminal equipment and storage medium |
| CN113706412B (en) * | 2021-08-24 | 2024-02-09 | 北京电影学院 | SDR (read-write memory) to HDR (high-definition digital interface) conversion method |
| CN115797154A (en) * | 2021-09-10 | 2023-03-14 | 北京字跳网络技术有限公司 | Color card generation method, image processing device and readable storage medium |
| CN116137674B (en) * | 2021-11-18 | 2024-04-09 | 腾讯科技（深圳）有限公司 | Video playing method, device, computer equipment and storage medium |
| CN114051126B (en) * | 2021-12-06 | 2023-12-19 | 北京达佳互联信息技术有限公司 | Video processing method and video processing device |
| CN115442636A (en) * | 2022-07-19 | 2022-12-06 | 广州博冠信息科技有限公司 | Live video stream conversion method, device, equipment and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103581634B (en) * | 2013-08-12 | 2015-07-22 | 泰邦泰平科技（北京）有限公司 | Processing method for image wide dynamic range |
| CN106713697B (en) * | 2013-10-22 | 2019-02-12 | 杜比实验室特许公司 | Guidance color grading for extended dynamic range image |
| EP2958075A1 (en) * | 2014-06-20 | 2015-12-23 | Thomson Licensing | Method and apparatus for dynamic range expansion of LDR video sequence |
-
2017
- 2017-06-26 CN CN201710497390.1A patent/CN107154059B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107154059A (en) | 2017-09-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107154059B (en) | High dynamic range video processing method | |
| US10992898B2 (en) | Display method and display device | |
| CN108769804B (en) | Format conversion method for high dynamic range video | |
| JP6876007B2 (en) | Methods and devices for converting HDR signals | |
| KR102157032B1 (en) | Display management for high dynamic range video | |
| TWI684166B (en) | Signal reshaping for high dynamic range signals | |
| JP5792369B2 (en) | Method and apparatus for image data conversion | |
| JP6042583B2 (en) | Workflow for EDR video content generation and support display management | |
| KR102553977B1 (en) | Scalable systems for controlling color management comprising varying levels of metadata | |
| US20150256860A1 (en) | Graphics Blending for High Dynamic Range Video | |
| US10839495B2 (en) | Computing devices and methods of image processing with input image data and reference tone mapping strength data | |
| US10332481B2 (en) | Adaptive display management using 3D look-up table interpolation | |
| TWI766666B (en) | Image-dependent contrast and brightness control for hdr displays | |
| WO2018231968A1 (en) | Efficient end-to-end single layer inverse display management coding | |
| CN114866809B (en) | Video conversion method, apparatus, device, storage medium, and program product | |
| EP3639238A1 (en) | Efficient end-to-end single layer inverse display management coding | |
| JP6742417B2 (en) | Digital image processing method, associated device, terminal device and computer program | |
| CN107197235A (en) | A kind of HDR video pre-filterings method | |
| KR101634652B1 (en) | Method and apparatus for intensificating contrast in image | |
| FR3045903A1 (en) | METHOD FOR PROCESSING DIGITAL IMAGE, DEVICE, TERMINAL EQUIPMENT AND COMPUTER PROGRAM THEREOF | |
| CN116167950B (en) | Image processing method, device, electronic equipment and storage medium | |
| EP4277281A1 (en) | Hdr video reconstruction by converted tone mapping | |
| CN117440118A (en) | Image processing method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 310000 E, 16 floor, A block, Paradise software garden, 3 West Gate Road, Xihu District, Hangzhou, Zhejiang. Applicant after: Hangzhou Dang Hong Polytron Technologies Inc Address before: 310012 E, 16 floor, A block, Paradise software garden, 3 West Gate Road, Xihu District, Hangzhou, Zhejiang. Applicant before: HANGZHOU DANGHONG TECHNOLOGY CO., LTD. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |