CN114138218A - Content display method and content display equipment - Google Patents

Content display method and content display equipment Download PDF

Info

Publication number
CN114138218A
CN114138218A CN202111443423.7A CN202111443423A CN114138218A CN 114138218 A CN114138218 A CN 114138218A CN 202111443423 A CN202111443423 A CN 202111443423A CN 114138218 A CN114138218 A CN 114138218A
Authority
CN
China
Prior art keywords
sdr
hdr
content
value
brightness
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111443423.7A
Other languages
Chinese (zh)
Other versions
CN114138218B (en
Inventor
刘培坤
徐宁
戴宇荣
章佳杰
何刚
于冰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dajia Internet Information Technology Co Ltd
Original Assignee
Beijing Dajia Internet Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dajia Internet Information Technology Co Ltd filed Critical Beijing Dajia Internet Information Technology Co Ltd
Priority to CN202111443423.7A priority Critical patent/CN114138218B/en
Publication of CN114138218A publication Critical patent/CN114138218A/en
Application granted granted Critical
Publication of CN114138218B publication Critical patent/CN114138218B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Abstract

The present disclosure relates to a content display method and a content display apparatus, the method including: acquiring multimedia data; adjusting the SDR brightness value of the HDR screen based on the comparison result of the current SDR brightness value of the HDR screen and a preset threshold; and displaying the multimedia data on the HDR screen with the adjusted SDR brightness value, wherein the multimedia data comprises at least one of HDR content and first SDR content. In this way, the HDR content and the SDR content can be simultaneously displayed by adjusting the SDR luminance value of the HDR screen, so that it is possible to prevent a white portion in the SDR content from becoming dark, and it is not necessary to convert the SDR content into the HDR content, thereby preventing phenomena such as overexposure and blurring.

Description

Content display method and content display equipment
Technical Field
The present disclosure relates to the field of video technologies, and in particular, to a content display method and a content display device.
Background
When displaying video using a High Dynamic Range (HDR) screen, there may be a case where HDR content and Standard Dynamic Range (SDR) content need to be displayed simultaneously. For example, in the process of displaying HDR video, SDR content such as barrage or interface operation control needs to be displayed at the same time.
When HDR content and SDR content are displayed simultaneously on an HDR screen, the HDR screen enables an HDR luminance range for the HDR content, and adopts an SDR luminance range for the SDR content, where the SDR content may have a problem of abnormal display, for example, a white portion in the SDR content may become dark. In order to solve the above problem, in the prior art, the SDR content is first converted into the HDR content, and then the HDR content obtained through the conversion is displayed on the HDR screen. However, because the SDR content loses the highlight region compared to the HDR content, the SDR content is easily overexposed and blurred after conversion.
Disclosure of Invention
The present disclosure provides a content display method and a content display apparatus, to at least solve the above-mentioned problem in the related art that when HDR content and SDR content are simultaneously displayed on an HDR screen, the SDR content is easily overexposed and blurred after being converted because the SDR content loses a highlight region compared to the HDR content.
According to a first aspect of the embodiments of the present disclosure, there is provided a content display method including: acquiring multimedia data; adjusting an SDR brightness value of an HDR screen based on a comparison result of a current SDR brightness value of the HDR screen and a preset threshold; displaying the multimedia data on the HDR screen with the adjusted SDR brightness value, wherein the multimedia data comprises at least one of HDR content and first SDR content.
Optionally, the adjusting the SDR brightness value of the HDR screen based on the comparison result of the current SDR brightness value of the HDR screen with a preset threshold includes: on a condition that the current SDR luma value is greater than or equal to the preset threshold, upshifting SDR luma values of the HDR screen on the basis of the current SDR luma values; the displaying the multimedia data on the HDR screen with the adjusted SDR brightness value comprises: and rendering and displaying the multimedia data on the HDR screen with the adjusted SDR brightness value.
Optionally, the increasing the SDR luma value of the HDR screen on the basis of the current SDR luma value comprises: in the event that the current SDR luma value is less than a predetermined luma value, increasing an SDR luma value of the HDR screen to the predetermined luma value; the predetermined brightness value is greater than the preset threshold value; in the event that the current SDR luma value is equal to or greater than the predetermined luma value, no adjustment is made to the SDR luma values of the HDR screen.
Optionally, the adjusting the SDR brightness value of the HDR screen based on the comparison result of the current SDR brightness value of the HDR screen with a preset threshold includes: adjusting the SDR brightness value of the HDR screen according to a preset brightness adjustment mapping relation under the condition that the current SDR brightness value is smaller than the preset threshold; the displaying the multimedia data on the HDR screen with the adjusted SDR brightness value comprises: identifying the HDR content and/or the first SDR content in the multimedia data; converting the identified HDR content into second SDR content; rendering and displaying the identified first SDR content directly on the HDR screen with the adjusted SDR brightness value, and/or rendering and displaying the second SDR content.
Optionally, before the step of acquiring multimedia data, the method further includes: correspondingly setting the preset brightness adjustment mapping relation according to the type of the HDR screen; the adjusting the SDR brightness value of the HDR screen according to the preset brightness adjustment mapping relation comprises: and adjusting the SDR brightness value of the HDR screen according to a preset brightness adjustment mapping relation corresponding to the type of the HDR screen.
Optionally, the preset brightness adjustment mapping relationship includes a plurality of original brightness values and corresponding adjusted brightness values; the adjusting the SDR brightness value of the HDR screen according to the preset brightness adjustment mapping relation comprises: and adjusting the SDR luma values of the HDR screen from the current SDR luma values to adjusted luma values corresponding to the current SDR luma values in the preset luma adjustment mapping relationship when the current SDR luma values match one of the plurality of original luma values.
Optionally, the preset brightness adjustment mapping relationship includes a plurality of original brightness values and corresponding adjusted brightness values; the adjusting the SDR brightness value of the HDR screen according to the preset brightness adjustment mapping relation comprises: determining an original brightness interval in the preset brightness adjustment mapping relation to which the current SDR brightness value belongs and an adjusted brightness interval corresponding to the original brightness interval under the condition that the current SDR brightness value is not matched with the original brightness values; calculating a target SDR brightness value based on the current SDR brightness value, the original brightness interval and the adjusted brightness interval; adjusting the SDR luma values of the HDR screen from the current SDR luma values to the target SDR luma values.
Optionally, the calculating a target SDR luma value based on the current SDR luma value, the original luma interval, and the adjusted luma interval includes: determining a first brightness difference value according to the tail brightness value and the starting brightness value of the original brightness interval; determining a second brightness difference value according to the tail brightness value and the initial brightness value of the adjusted brightness interval; determining a third brightness difference value according to the current SDR brightness value and the initial brightness value of the original brightness interval; and calculating the target SDR brightness value according to the first brightness difference value, the second brightness difference value, the third brightness difference value and the adjusted initial brightness value of the brightness interval.
Optionally, the converting the identified HDR content into a second SDR content includes: acquiring linear RGB data of the HDR content; mapping linear RGB data of the HDR content to nonlinear SDR RGB data according to a tone mapping function; adjusting RGB data of the nonlinear SDR according to SDR brightness characteristics of the HDR screen to obtain the second SDR content.
Optionally, the adjusting the RGB data of the nonlinear SDR according to the SDR luminance characteristic of the HDR screen includes: obtaining a first adjustment factor based on a luminance parameter of the HDR screen, a maximum luminance parameter of the HDR content, and RGB data of the nonlinear SDR; obtaining a second adjustment factor based on the luminance parameters of the HDR screen and the RGB data of the nonlinear SDR; adjusting RGB data of the non-linear SDR based on the first adjustment factor and the second adjustment factor.
According to a second aspect of the embodiments of the present disclosure, there is provided a content display apparatus including: the acquisition module is used for acquiring multimedia data; the adjusting module is used for adjusting the SDR brightness value of the HDR screen based on the comparison result of the current SDR brightness value of the HDR screen and a preset threshold; a display module for displaying the multimedia data on the HDR screen with the adjusted SDR brightness value, wherein the multimedia data comprises at least one of HDR content and first SDR content.
Optionally, the adjusting module is configured to increase the SDR luma value of the HDR screen on the basis of the current SDR luma value if the current SDR luma value is greater than or equal to the preset threshold; the display module is configured to render and display the multimedia data on the HDR screen with the adjusted SDR luma values.
Optionally, the adjusting module is configured to: the adjustment module is configured to: in the event that the current SDR luma value is less than a predetermined luma value, increasing an SDR luma value of the HDR screen to the predetermined luma value; the predetermined brightness value is greater than the preset threshold value; in the event that the current SDR luma value is equal to or greater than the predetermined luma value, no adjustment is made to the SDR luma values of the HDR screen.
Optionally, the adjusting module is configured to adjust the SDR luma value of the HDR screen according to a preset luma adjustment mapping relationship if the current SDR luma value is less than the preset threshold; the display module is configured to: identifying the HDR content and/or the first SDR content in the multimedia data; converting the identified HDR content into second SDR content; rendering and displaying the identified first SDR content directly on the HDR screen with the adjusted SDR brightness value, and/or rendering and displaying the second SDR content.
Optionally, the content display apparatus further includes: the setting module is configured to correspondingly set the preset brightness adjustment mapping relation according to the type of the HDR screen; the adjusting module is configured to adjust SDR brightness values of the HDR screen according to a preset brightness adjusting mapping relation corresponding to the type of the HDR screen.
Optionally, the preset brightness adjustment mapping relationship includes a plurality of original brightness values and corresponding adjusted brightness values; the adjusting module is configured to adjust the SDR luma values of the HDR screen from the current SDR luma values to adjusted luma values corresponding to the current SDR luma values in the preset luma adjustment mapping relationship if the current SDR luma values match one of the plurality of original luma values.
Optionally, the preset brightness adjustment mapping relationship includes a plurality of original brightness values and corresponding adjusted brightness values; the adjustment module is configured to: determining an original brightness interval in the preset brightness adjustment mapping relation to which the current SDR brightness value belongs and an adjusted brightness interval corresponding to the original brightness interval under the condition that the current SDR brightness value is not matched with the original brightness values; calculating a target SDR brightness value based on the current SDR brightness value, the original brightness interval and the adjusted brightness interval; adjusting the SDR luma values of the HDR screen from the current SDR luma values to the target SDR luma values.
Optionally, the adjusting module is configured to: determining a first brightness difference value according to the tail brightness value and the starting brightness value of the original brightness interval; determining a second brightness difference value according to the tail brightness value and the initial brightness value of the adjusted brightness interval; determining a third brightness difference value according to the current SDR brightness value and the initial brightness value of the original brightness interval; and calculating the target SDR brightness value according to the first brightness difference value, the second brightness difference value, the third brightness difference value and the adjusted initial brightness value of the brightness interval.
Optionally, the display module is configured to: acquiring linear RGB data of the HDR content; mapping linear RGB data of the HDR content to nonlinear SDR RGB data according to a tone mapping function; adjusting RGB data of the nonlinear SDR according to SDR brightness characteristics of the HDR screen to obtain the second SDR content.
Optionally, the display module is configured to: obtaining a first adjustment factor based on a luminance parameter of the HDR screen, a maximum luminance parameter of the HDR content, and RGB data of the nonlinear SDR; obtaining a second adjustment factor based on the luminance parameters of the HDR screen and the RGB data of the nonlinear SDR; adjusting RGB data of the non-linear SDR based on the first adjustment factor and the second adjustment factor.
According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement a content display method according to the present disclosure.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform a content display method according to the present disclosure.
According to a fifth aspect of embodiments of the present disclosure, there is provided a computer program product, which when executed by a processor, implements a content display method according to the present disclosure.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
the HDR content and the SDR content can be simultaneously displayed by adjusting the SDR brightness value of the HDR screen, so that the phenomenon that the white part in the SDR content becomes dark can be avoided, the SDR content does not need to be converted into the HDR content, and the phenomena of overexposure, blurring and the like are avoided. Further, the SDR luminance values of the HDR screen may be adjusted up based on the current SDR luminance values when the current SDR luminance values are greater than or equal to a preset threshold. Turning up the SDR luma value of the HDR screen may make the HDR content less distinct from the luma of the SDR content, avoiding the white portions in the SDR content from becoming dull. In addition, the SDR brightness value of the screen of the electronic equipment can be automatically adjusted according to the brightness of the external environment light, and when the current SDR brightness value is larger than or equal to the preset threshold value, the current external environment is brighter, so that the eyes of a user cannot be stimulated by strong light due to the increase of the SDR brightness value of the HDR screen, and the user experience cannot be influenced. Further, if the current SDR brightness value is smaller than the preset threshold, it indicates that the current external environment is dark, and because the brightness range required by the HDR content is relatively high, if the HDR content is still displayed according to the brightness range required by the HDR content at this time, the HDR screen may be too bright, which may cause irritation to the eyes of the user. Therefore, HDR content can be converted into SDR content for display, the brightness degree of the HDR screen can be adapted to the current environment, and stimulation to eyes of a user caused by the fact that the HDR screen is too bright is avoided. Also, since the HDR content is converted into the second SDR content and displayed together with the first SDR content, i.e., both are displayed simultaneously as the SDR content, it is possible to prevent the white portion in the SDR content from becoming dull.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
Fig. 1 is a flowchart illustrating a content display method according to an exemplary embodiment of the present disclosure;
fig. 2 is a schematic diagram illustrating a preset brightness adjustment mapping relationship according to an exemplary embodiment of the present disclosure;
fig. 3(a) is an effect diagram illustrating directly displaying HDR content and SDR content on an HDR screen in the related art;
fig. 3(b) is an effect diagram illustrating simultaneous display of HDR content and SDR content according to an exemplary embodiment of the present disclosure;
FIG. 4 is a flowchart illustrating a specific implementation of a content display method according to an exemplary embodiment of the present disclosure;
fig. 5 is a block diagram illustrating a content display apparatus according to an exemplary embodiment of the present disclosure;
fig. 6 is a block diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The embodiments described in the following examples do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
In this case, the expression "at least one of the items" in the present disclosure means a case where three types of parallel expressions "any one of the items", "a combination of any plural ones of the items", and "the entirety of the items" are included. For example, "include at least one of a and B" includes the following three cases in parallel: (1) comprises A; (2) comprises B; (3) including a and B. For another example, "at least one of the first step and the second step is performed", which means that the following three cases are juxtaposed: (1) executing the step one; (2) executing the step two; (3) and executing the step one and the step two.
High Dynamic Range (HDR) refers to a dynamic range that is 14-15 orders of magnitude higher than the visible range acceptable by the human visual system. In fact, the visible Dynamic Range (EDR) that the human visual system can accept is a subset of the high Dynamic Range, which can be referred to as the narrow high Dynamic Range.
In practice each pixel in an image is usually composed of one or more color components. For example, one luminance component Y and two components Cb, Cr, called YCbCr color space; or the three color components R, G, B are referred to as the RGB color space. The different color spaces can be mutually converted by a conversion matrix defined by the color gamut (such as the BT2020 color gamut and the BT709 color gamut) in which the different color spaces are positioned. Each color component value in a pixel is typically represented by an n-bit precision. In linear luminance coding, if the bit precision n of an image is less than or equal to 8, the image is considered as a standard dynamic range image (such as a JPEG image); if the bit precision n of the image is more than 8, the image is considered to be a High Dynamic Range (HDR) image. A high dynamic range image may also be stored by a 16-bit floating point type data file, such as an OpenEXR file.
The dynamic range supported by the consumer-grade display is typically 200-300 cd/m2Or
nits, the dynamic range supported by the HDTV display is 300 to 1000 nits. The Dynamic Range of these displays represents either a Low Dynamic Range (LDR) or Standard Dynamic Range (SDR). The dynamic range of the HDR video generally reaches 1000nits to 5000nits, and the dynamic range supported by the HDR display device covers the SDR video and the HDR video. When displaying HDR content, the HDR display device enables the HDR brightness range to meet the brightness range required by the HDR content; when displaying SDR content, HDR display devices may employ an SDR luma range to meet the luma range required by the SDR content, and when displaying HDR content and SDR content simultaneously on an HDR screen, the SDR content may have a problem of display abnormality, for example, a white portion in the SDR content may become dull. In order to solve the above problem, in the prior art, the SDR content is first converted into the HDR content, and then the HDR content obtained through the conversion is displayed on the HDR screen.
In the prior art, the inverse tone mapping technique is mainly adopted (for example, the inverse mapping of ACES function can be adopted) to convert SDR content into HDR content. Wherein:
the ACES tone mapping curve is shown in formula (1):
lumaces＝lumin×(lumin×a+b)/(lumin×(luminx c + d) + e) (1) wherein a is 2.51, b is 0.03, c is 2.43, d is 0.59, e is 0.14, luminThe light is RGB linear light obtained by inverse OETF.
Obtaining an inverse ACES curve formula according to the ACES curve formula (1) and the inverse ACES curve formula is shown as a formula (2);
Figure BDA0003384095730000081
when the SDR content is converted into HDR content, the following procedure is mainly adopted:
1. inputting an SDR video: it may be an SDR video encoded in H265 format or in AV1 format.
2. And (3) decoding: the video decoder is adopted to decode the input video to obtain YUV data, an H265 decoder corresponding to the video format or an AV1 decoder can be adopted, and the obtained YUV data is nonlinear YUV data in an SDR form.
3. BT709/BT601 color space conversion: the BT709 or BT601 YUV to RGB conversion matrices are used to convert nonlinear SDR YUV data to nonlinear SDR RGB data.
4. EOFT (EOFT): and converting the nonlinear SDR RGB data into linear SDR RGB data by adopting an inverse OETF curve corresponding to the OETF conversion curve specified by BT709/BT 601.
5. inverse tone mapping: and (3) converting the linear RGB curve by adopting the inverse ACES curve of the formula (2), and outputting the linear RGB curve as nonlinear HDR RGB data after inverse tone mapping.
6. Rendering: and directly sending the nonlinear HDR RGB data obtained in the last step to an HDR screen for rendering.
However, because the SDR content loses the highlight region compared to the HDR content, the SDR content is easily overexposed and blurred after conversion.
In order to solve the technical problem that phenomena such as overexposure and blurring easily occur after SDR content is converted in the related art, the content display method provided by the disclosure can simultaneously display HDR content and SDR content by adjusting the SDR brightness value of an HDR screen, can prevent a white part in the SDR content from becoming dark, does not need to convert the SDR content into the HDR content, and avoids phenomena such as overexposure and blurring. Further, the SDR luminance values of the HDR screen may be adjusted up based on the current SDR luminance values when the current SDR luminance values are greater than or equal to a preset threshold. Turning up the SDR luma value of the HDR screen may make the HDR content less distinct from the luma of the SDR content, avoiding the white portions in the SDR content from becoming dull. In addition, the SDR brightness value of the screen of the electronic equipment can be automatically adjusted according to the brightness of the external environment light, and when the current SDR brightness value is larger than or equal to the preset threshold value, the current external environment is brighter, so that the eyes of a user cannot be stimulated by strong light due to the increase of the SDR brightness value of the HDR screen, and the user experience cannot be influenced. Further, if the current SDR brightness value is smaller than the preset threshold, it indicates that the current external environment is dark, and because the brightness range required by the HDR content is relatively high, if the HDR content is still displayed according to the brightness range required by the HDR content at this time, the HDR screen may be too bright, which may cause irritation to the eyes of the user. Therefore, HDR content can be converted into SDR content for display, the brightness degree of the HDR screen can be adapted to the current environment, and stimulation to eyes of a user caused by the fact that the HDR screen is too bright is avoided. Also, since the HDR content is converted into the second SDR content and displayed together with the first SDR content, i.e., both are displayed simultaneously as the SDR content, it is possible to prevent the white portion in the SDR content from becoming dull.
Fig. 1 is a flowchart illustrating a content display method according to an exemplary embodiment of the present disclosure.
Referring to fig. 1, in step 101, multimedia data may be acquired, wherein the multimedia data may include at least one of HDR content and first SDR content. In using the HDR display device, there may be a case where the HDR content and the SDR content need to be displayed simultaneously, and thus, the HDR content and the first SDR content may represent the HDR content and the SDR content displayed simultaneously, respectively. For example, in the process of displaying the HDR video, SDR content such as a barrage and an operation element of an interface needs to be displayed at the same time, so the HDR content may be the HDR video, and the first SDR content may be the barrage of the HDR video in the process of displaying, the operation element of the interface, and the like.
At step 102, the SDR luminance values of the HDR screen may be adjusted based on the comparison of the current SDR luminance values of the HDR screen to a preset threshold. And in step 103, the multimedia data can be displayed on the HDR screen with the adjusted SDR brightness value.
That is, for both the case where the current SDR luminance value is greater than or equal to the preset threshold and the case where the current SDR luminance value is less than the preset threshold, the SDR luminance value of the HDR screen is adjusted according to different rules, and the content is displayed on the adjusted HDR screen. The HDR display screen can have two brightness levels, namely an HDR brightness level and an SDR brightness level, the HDR brightness level is generally not adjustable, the SDR brightness level is adjustable, and the adjusting range of the HDR display screen can be 0% -100%. A user may adjust the SDR luma of an HDR display to some percentage of the HDR display's maximum SDR luma, often referring to SDR luma that does not reach the HDR display's maximum SDR luma as system luma. Typically, the system brightness is below 50% of the maximum brightness of the display SDR. Here, the current SDR luma value may represent the current system luma value, and the preset threshold may be set, for example, but not limited to, to 50% to 60% of the maximum SDR luma of the HDR screen.
According to an exemplary embodiment of the present disclosure, when the current SDR luma value is greater than or equal to a preset threshold, the SDR luma value of the HDR screen may be adjusted up on the basis of the current SDR luma value. Turning up the SDR luma value of the HDR screen may make the HDR content less distinct from the luma of the SDR content, avoiding the white portions in the SDR content from becoming dull. In addition, the SDR brightness value of the screen of the electronic equipment can be automatically adjusted according to the brightness of the external environment light, and when the current SDR brightness value is larger than or equal to the preset threshold value, the current external environment is brighter, so that the eyes of a user cannot be stimulated by strong light due to the increase of the SDR brightness value of the HDR screen, and the user experience cannot be influenced. Subsequently, since the required luminance range of the HDR content is relatively high, the HDR screen is relatively bright, and the current external environment is also relatively bright, so that even if the HDR screen is relatively bright, the user's eyes are not greatly stimulated. Therefore, the HDR content and the first SDR content may be rendered and displayed directly on the HDR screen with the adjusted SDR luminance value without performing the conversion processing on the HDR content.
According to an exemplary embodiment of the present disclosure, the current SDR luma value may be adjusted up to a predetermined luma value, which is greater than a preset threshold. For example, the predetermined luminance value may be set to, but is not limited to, 90% of the maximum SDR luminance for the HDR screen. That is, when the current SDR luma value is less than the predetermined luma value, the SDR luma value of the HDR screen may be adjusted up to the predetermined luma value; when the current SDR luma value is equal to or greater than the predetermined luma value, no adjustment may be made to the SDR luma value of the HDR screen. For example, assuming the current SDR luma value is 66% of the HDR screen's maximum SDR luma, the SDR luma value of the HDR screen may be adjusted up to 90% of the HDR screen's maximum SDR luma; if the current SDR luma value is 95% of the maximum SDR luma for the HDR screen, the current SDR luma value may be maintained, i.e., no adjustment is made to the SDR luma values of the HDR screen.
According to the exemplary embodiment of the disclosure, if the current SDR brightness value is smaller than the preset threshold, which indicates that the current external environment is dark, since the brightness range required by the HDR content is relatively high, if the HDR content is still displayed according to the brightness range required by the HDR content at this time, the HDR screen may be too bright, which may cause irritation to the eyes of the user. Therefore, HDR content can be converted into SDR content for display, the brightness degree of the HDR screen can be adapted to the current environment, and stimulation to eyes of a user caused by the fact that the HDR screen is too bright is avoided. Furthermore, the SDR brightness value of the HDR screen can be adjusted according to experience values or experimental data, so that the display effect of the SDR content converted from the HDR content is better.
For example, in the case that the current SDR luma value is less than the preset threshold, the SDR luma value of the HDR screen may be adjusted according to the preset luma adjustment mapping relationship. Then, HDR content and/or first SDR content in the multimedia data may be identified. Next, the identified HDR content may be converted to second SDR content, and the identified first SDR content may be rendered and displayed directly on the HDR screen with the SDR luma values adjusted, and/or the second SDR content may be rendered and displayed.
The preset brightness adjustment mapping relationship may be a brightness adjustment comparison table, and the brightness adjustment comparison table may include a plurality of original brightness values and a plurality of corresponding adjusted brightness values. In this way, since the HDR content is converted to the second SDR content and displayed together with the first SDR content, i.e., both are displayed simultaneously as SDR content, it is possible to prevent the white portion in the SDR content from becoming dull.
According to the exemplary embodiment of the disclosure, the preset brightness adjustment mapping relationship may be correspondingly set according to the type of the HDR screen, and then the SDR brightness value of the HDR screen may be adjusted according to the preset brightness adjustment mapping relationship corresponding to the type of the HDR screen. For example, the HDR screen may be an OLED screen or an LCD screen, and each screen type may correspond to a corresponding preset luminance adjustment mapping relationship. Fig. 2 is a schematic diagram of a preset luminance adjustment mapping relationship according to an exemplary embodiment of the disclosure. Fig. 2 shows a preset luminance adjustment mapping relationship corresponding to the OLED screen and a preset luminance adjustment mapping relationship corresponding to the LCD screen.
According to an exemplary embodiment of the present disclosure, still taking fig. 2 as an example, the preset luminance adjustment mapping relationship may include a plurality of original luminance values and corresponding adjusted luminance values. In the case where the current SDR luma value matches one of the plurality of original luma values, the SDR luma value of the HDR screen may be adjusted from the current SDR luma value to an adjusted luma value in the preset luma adjustment mapping corresponding to the current SDR luma value. For example, assuming the type of HDR screen is an OLED screen, and the current SDR brightness value is 30% of the maximum SDR brightness of the HDR screen, the corresponding adjusted brightness value is 45%. Alternatively, assuming that the type of HDR screen is an LCD screen, and the current SDR luma value is 25% of the maximum SDR luma of the HDR screen, the corresponding adjusted luma value is 40%.
According to an exemplary embodiment of the present disclosure, still taking fig. 2 as an example, the preset luminance adjustment mapping relationship may include a plurality of original luminance values and corresponding adjusted luminance values. Under the condition that the current SDR brightness value is not matched with a plurality of original brightness values, an original brightness interval in a preset brightness adjustment mapping relation to which the current SDR brightness value belongs and an adjusted brightness interval corresponding to the original brightness interval can be determined. A target SDR luma value may then be calculated based on the current SDR luma value, the original luma interval, and the adjusted luma interval. Next, the SDR luma value for the HDR screen may be adjusted from the current SDR luma value to the target SDR luma value.
According to an exemplary embodiment of the present disclosure, the first luminance difference value may also be determined according to an end luminance value and a start luminance value of the original luminance interval; determining a second brightness difference value according to the adjusted tail brightness value and the adjusted initial brightness value of the brightness interval; the third luminance difference may be determined according to the current SDR luminance value and the starting luminance value of the original luminance interval. Next, a target SDR luminance value may be calculated according to the first luminance difference value, the second luminance difference value, the third luminance difference value, and the adjusted start luminance value of the luminance interval.
For example, assuming the type of HDR screen is an OLED screen, the current SDR brightness value is 32% of the maximum SDR brightness of the HDR screen. Since 32% does not match with a plurality of original brightness values, the original brightness interval [0.3, 0.35] and the adjusted brightness interval [0.45, 0.5] corresponding to the original brightness interval [0.3, 0.35] in the preset brightness adjustment mapping relation to which 32% belongs can be determined.
Then, the target SDR luma value may be calculated using the following formula:
Figure BDA0003384095730000121
wherein lumAdj is a target SDR brightness value, [ lumOrgBottom, lumOrgTop ] is an original brightness interval, lumOrgBottom is a starting brightness value of the original brightness interval,
lumOrgTop is the end brightness value of the original brightness interval, [ lumBottom, lumTop ] is the adjusted brightness interval, lumBottom is the initial brightness value of the adjusted brightness interval,
lumTop is the last luma value of the adjusted luma interval, and lumOrg is the current SDR luma value. For example, the target SDR luma value may be calculated as:
Figure BDA0003384095730000131
i.e., the target SDR luma value obtained after the adjustment may be 47% of the maximum SDR luma for HDR screens. Next, the SDR luma value of the HDR screen may be adjusted from the current SDR luma value to the target SDR luma value, i.e., the SDR luma value of the HDR screen may be adjusted from 32% to 47%. It should be noted that the above formula (3) can also be modified, for example, by increasing the coefficient. The formula obtained after the modification of the formula (3) is still within the protection scope of the present disclosure.
According to an exemplary embodiment of the present disclosure, HDR content may be converted to SDR content by: linear RGB data for HDR content may be acquired first. Linear RGB data of HDR content may then be mapped to nonlinear SDR RGB data according to a tone mapping function. Next, the RGB data of the non-linear SDR may be adjusted according to the SDR luma characteristic of the HDR screen, obtaining a second SDR content.
Specifically, when linear RGB data of HDR content is acquired, it can be acquired by:
first, HDR video may be input. For example, the HDR video may be, but is not limited to, HDR10 video. For example, HDR video may include, but is not limited to, HDR video encoded in h.265 format or encoded in AVI format.
The input HDR video may then be decoded. The YUV data may be obtained by decoding the input video by using a video decoder, for example, an h.265 decoder corresponding to a video coding format or an AVI decoder. At this time, the YUV data obtained by the decoding processing is nonlinear YUV data in the HDR form.
The non-linear YUV data may then be converted to non-linear RGB data. For example, the color space conversion of the nonlinear YUV data can be performed by adopting the BT2020 color gamut standard, namely, the nonlinear BT2020YUV data is converted into the nonlinear BT2020 RGB data by adopting a BT2020 YUV-to-RGB conversion matrix, and the normalization is (0-1).
Subsequently, the non-linear RGB data may be converted into linear RGB data. For example, an inverse OETF (i.e., EOFT) curve corresponding to the OETF transform curve specified by SMPT2084 may be used to convert the non-linear RGB data into linear RGB data.
The visual characteristics of the human eye are non-linear in response to natural visible light. The human eye has a relatively low response to a high brightness region and a relatively high response to a low brightness region or a normal brightness region. The response characteristic of the human eye with respect to natural light is generally represented by a response curve like a log function. In order to make an image displayed on a display conform to the visual response characteristics of human eyes, when making an HDR video, a photoelectric conversion (OETF) function is usually used to process linear light in the nature to obtain nonlinear light, so as to retain details of a low-brightness region to which human eyes are sensitive, i.e. visual quantization (PQ). On the display device, electro-optical conversion (EOTF) processing is performed on the non-linear light to obtain display linear light, and gamma adjustment is performed on the display linear light for display. For example, the OETF transformation curve specified by SMPT2084, as shown in equation (4) below.
Figure BDA0003384095730000141
Wherein L represents linear RGB data, YeotfRepresenting non-linear RGB data, c1、c2、c3、m1And m2Can represent parameters of an OETF transformation curve, wherein c1＝0.8359375c2＝18.8515625
c3＝18.6875 m1＝.1593017578125 m2＝78.84375。
Therefore, the inverse OETF curve can be expressed as shown in the following equation (5):
Figure BDA0003384095730000142
wherein L represents nonlinear RGB data, Yinverse_eotfLinear RGB data is represented. c. C1、c2、c3、m1And m2The same as in equation (4). Accordingly, the nonlinear RGB data may be converted into linear RGB data using the above equation (5).
The linear RGB data may then be tone mapped to obtain nonlinear SDR RGB data. For example, linear RGB data may be transformed using an ACES tone mapping curve. For example, an ACES tone mapping curve may be as shown in equation (6) below:
lumaces＝lumin×(lumin×a+b)/(lumin×(lumin×c+d)+e) (6)
wherein, luminRepresenting input linear RGB data, lumacesRepresenting the nonlinear SDR RGB data obtained after transformation, a, b, c, d and e are ACES curve parameters, a is 2.51, b is 0.03, c is 2.43, d is 0.59,
e is 0.14. However, the ACES tone mapping curve does not handle the process of transferring HDR video luma to SDR video luma well, and overexposure, blur, etc. occur.
Thus, linear RGB data of HDR content may be mapped to RGB data of non-linear SDR according to the tone mapping function of the present disclosure. Here, the tone mapping function of the present disclosure may be mapped based on the coding standard of ACES, and is obtained by adjusting the tone mapping function of the coding standard of ACES, that is, the ACES tone mapping curve, as shown in the above equation (6), based on the video image exposure degree.
In order to improve the problems that the ACES tone mapping curve can generate overexposure and blurring in the process of transferring the HDR video brightness to the SDR video brightness, according to the scheme disclosed by the invention, linear RGB data can be mapped based on the adjusted tone mapping function, and the mapping result is adjusted based on the brightness characteristic of a display, so that the purposes of preventing overexposure of brightness, effectively relieving the overexposure of brightness, improving the brightness distribution of the bright and dark area of the image and enabling the video image to be clearer and have the effect of layering are achieved. The tone mapping function according to the present disclosure will be described in detail below.
According to the exemplary embodiment of the disclosure, the parameter c in the tone mapping function of the coding standard of ACES can be adjusted by judging the exposure degree of the mapped video image, and the scale factor scale is added in the tone mapping function of the coding standard of ACES, so as to reduce the brightness overexposure degree of the mapped video image. Here, the parameter c in the tone mapping function of the coding standard of ACES is adjusted to adjust the bit number allocation of the highlight region in the tone mapping process, thereby displaying the brightness of the highlight region more naturally. Furthermore, the scale factor is added to avoid luminance overexposure.
For example, the tone mapping function of the present disclosure may be expressed as:
lumtmp＝lumin×(lumin×a+b)/(lumin×(lumin×c+d)+e×scale (7)
wherein, lumtmpRGB data, lum, representing a non-linear standard dynamic rangeinNormalized data representing linear RGB data, which may range from 0, 1]A, b, c, d and e are tone mapping function parameters, scale is a scale factor.
In the above equation (7), the tone mapping function of the present disclosure may lower the parameter c of the tone mapping function of the coding standard of ACES to increase the bit number allocation of the highlight region, thereby avoiding too little bit number allocation of the highlight region in the tone mapping process. For example, the parameter c of the tone mapping function of the coding standard of ACES may be adjusted to 2.43, and c may be adjusted to 1.23. The remaining parameters may be constant, i.e., a-2.51, b-0.03, d-0.59, and e-0.14.
Further, in equation (7) above, the tone mapping function of the present disclosure may set scale greater than 1 to avoid luminance overexposure. For example, scale may be set to 1.3.
Next, the RGB data of the non-linear SDR may be adjusted according to the SDR luma characteristic of the HDR screen, obtaining a second SDR content. For example, both overall luminance and luminance distribution adjustments can be made to the mapped RGB data for the nonlinear SDR.
According to an exemplary embodiment of the present disclosure, a first adjustment factor may be obtained based on a luminance parameter of an HDR screen, a maximum luminance parameter of HDR content, and RGB data of a nonlinear SDR obtained by mapping; obtaining a second adjustment factor based on the luminance parameter of the HDR screen and the RGB data of the nonlinear SDR obtained by mapping; and adjusting the RGB data of the nonlinear SDR obtained by mapping based on the first adjusting factor and the second adjusting factor. Here, the first adjustment factor is used to adjust the mapped RGB data of the nonlinear SDR in terms of overall luminance according to the luminance parameter of the HDR screen and the maximum luminance parameter of the HDR content, thereby effectively alleviating the luminance over-luminance problem of the transform result. The second adjusting factor is used for adjusting the RGB data of the nonlinear SDR obtained by mapping in the aspect of brightness distribution according to the brightness parameters of the HDR screen, so that the problem of uneven brightness distribution of a high brightness region and a low brightness region of the RGB data of the nonlinear SDR obtained by mapping is solved, the brightness distribution of a bright and dark region of an image is more uniform, and the image has more layering.
According to an exemplary embodiment of the present disclosure, the first adjustment factor may be calculated according to the following equation (8):
adjustlum＝lumtmp1/γ (8)
wherein the content of the first and second substances,
Figure BDA0003384095730000161
adjustlumwhich is indicative of a first adjustment factor,
lumtmpRGB data representing the mapped nonlinear SDR, m representing a first predetermined parameter,
lumSDRluminance parameter, lum, representing HDR screenEDRThe maximum luminance parameter representing the HDR content. Here, lumSDRAvailable from the relevant parameters of the HDR screen, lumEDRCan be obtained from the relevant parameters of the HDR content.
In the above equation (8), γ may vary with the characteristics of the HDR screen, that is, the higher the screen luminance of the HDR screen, the larger the value of γ. For example, the range of values of γ may be [1.5, 2.4], and thus, the first predetermined parameter m may be set to 2.4.
According to an exemplary embodiment of the present disclosure, the second adjustment factor may be calculated according to the following equation (9):
Figure BDA0003384095730000171
wherein the content of the first and second substances,
Figure BDA0003384095730000172
adjustlevelwhich is indicative of a second adjustment factor,
lumtmpRGB data representing the mapped non-linear SDR, n representing a second predetermined parameter,
lumSDRrepresenting the luminance parameters of the HDR screen.
In the above equation (9), β may vary with the characteristics of the HDR screen, for example, the range of the value of β may be [0, 2], and thus, the second predetermined parameter n may be set to 2.0.
The first adjustment factor, the second adjustment factor and the RGB data of the non-linear SDR may then be multiplied to obtain a second SDR content, i.e. the final RGB data of the non-linear SDR. Here, the finally obtained nonlinear SDR RGB data may be displayed on an HDR screen after being subjected to a color gamut conversion process, rendered.
The final nonlinear SDR RGB data can be obtained by the following equation (10), for example.
lumout＝lumtmp×adjustlum×adjustlevel (10)
Wherein, lumoutRGB data representing the final nonlinear SDR, which may range from 0, 1]，lumtmpCan represent the RGB data of nonlinear SDR obtained by mapping, adjustlumCan represent the firstA regulatory factor, adjustlevelA second adjustment factor may be represented.
Fig. 3(a) is an effect diagram illustrating directly displaying HDR content and SDR content on an HDR screen in the related art; fig. 3(b) is an effect diagram illustrating simultaneous display of HDR content and SDR content according to an exemplary embodiment of the present disclosure. It can be seen that the white parts in the SDR content in fig. 3(a) are darker, i.e. icon 1, icon 2, icon 3, icon 4, icon 5, icon 6, icon 7 are darker. In fig. 3(b), the white part of the SDR content is brighter, i.e. icon 1, icon 2, icon 3, icon 4, icon 5, icon 6, icon 7 are brighter. Therefore, the content display method of the present disclosure can avoid the occurrence of a situation in which a white portion in SDR content becomes dull when HDR content and SDR content are simultaneously displayed on an HDR screen.
Hereinafter, a detailed implementation flow of the content display method according to an exemplary embodiment of the present disclosure will be described in detail with reference to fig. 4. Fig. 4 is an implementation flowchart illustrating a content display method according to an exemplary embodiment of the present disclosure.
Referring to fig. 4, HDR content and SDR content are input in step 401.
In step 402, it is determined whether the current SDR luminance value of the HDR screen is greater than or equal to a preset threshold. The preset threshold may be 50% to 60% of the maximum SDR brightness of the HDR screen.
In step 403, the SDR luma value of the HDR screen may be adjusted up on the basis of the current SDR luma value in case the current SDR luma value is greater than or equal to the preset threshold. For example, assuming the current SDR luma value is 62% of the HDR screen's maximum SDR luma, the SDR luma value of the HDR screen may be adjusted up to 90% of the HDR screen's maximum SDR luma.
In step 404, in the case that the current SDR luma value is less than the preset threshold, the SDR luma value of the HDR screen may be adjusted according to the preset luma adjustment mapping relationship. The specific adjustment process has been described in the foregoing embodiments, and is not described herein again.
In step 405, it is determined whether the content to be displayed is HDR content.
In step 406, when the content to be displayed is not HDR content but SDR content, RGB data in the SDR format is acquired.
In step 407, when the content to be displayed is HDR content, HDR content adaptation is performed under low brightness condition to obtain RGB data in SDR format.
At step 408, the HDR content and the SDR content are displayed on the HDR screen with the SDR luma values adjusted. For example, when the current SDR brightness value is greater than or equal to the preset threshold, the HDR content and the SDR content are rendered and displayed directly on the HDR screen after the SDR brightness value is adjusted; in the case that the current SDR brightness value is less than the preset threshold, the SDR content converted from the HDR content and the unconverted SDR content may be rendered and displayed on the HDR screen with the adjusted SDR brightness value.
Fig. 5 is a block diagram illustrating a content display apparatus according to an exemplary embodiment of the present disclosure.
Referring to fig. 5, the apparatus 500 may include an obtaining module 501, an adjusting module 502 and a displaying module 503.
The obtaining module 501 may obtain multimedia data, wherein the multimedia data may include at least one of HDR content and first SDR content. In using the HDR display device, there may be a case where the HDR content and the SDR content need to be displayed simultaneously, and thus, the HDR content and the first SDR content may represent the HDR content and the SDR content displayed simultaneously, respectively. For example, in the process of displaying the HDR video, SDR content such as a barrage and an operation element of an interface needs to be displayed at the same time, so the HDR content may be the HDR video, and the first SDR content may be the barrage of the HDR video in the process of displaying, the operation element of the interface, and the like.
The adjusting module 502 may adjust the SDR luminance value of the HDR screen based on the comparison of the current SDR luminance value of the HDR screen with a preset threshold. The display module 503 can be used to display the multimedia data on the HDR screen with the adjusted SDR luminance value. That is, for both the case where the current SDR luminance value is greater than or equal to the preset threshold and the case where the current SDR luminance value is less than the preset threshold, the SDR luminance value of the HDR screen is adjusted according to different rules, and the content is displayed on the adjusted HDR screen. The preset threshold may be 50% to 60% of the maximum SDR brightness of the HDR screen.
According to an exemplary embodiment of the disclosure, the adjusting module 502 may increase the SDR luma value of the HDR screen on the basis of the current SDR luma value when the current SDR luma value is greater than or equal to the preset threshold. Turning up the SDR luma value of the HDR screen may make the HDR content less distinct from the luma of the SDR content, avoiding the white portions in the SDR content from becoming dull. In addition, the SDR brightness value of the screen of the electronic equipment can be automatically adjusted according to the brightness of the external environment light, and when the current SDR brightness value is larger than or equal to the preset threshold value, the current external environment is brighter, so that the eyes of a user cannot be stimulated by strong light due to the increase of the SDR brightness value of the HDR screen, and the user experience cannot be influenced. Subsequently, since the required luminance range of the HDR content is relatively high, the HDR screen is relatively bright, and the current external environment is also relatively bright, so that even if the HDR screen is relatively bright, the user's eyes are not greatly stimulated. Therefore, the HDR content and the first SDR content may be rendered and displayed directly on the HDR screen with the adjusted SDR luminance value without performing the conversion processing on the HDR content.
According to an exemplary embodiment of the present disclosure, the adjusting module 502 may adjust the current SDR luma value up to a predetermined luma value, which is greater than a preset threshold. For example, the predetermined luminance value may be set to, but is not limited to, 90% of the maximum SDR luminance for the HDR screen. That is, when the current SDR luma value is less than the predetermined luma value, the adjusting module 502 may adjust the SDR luma value of the HDR screen up to the predetermined luma value; when the current SDR luma value is equal to or greater than the predetermined luma value, the adjusting module 502 may not adjust the SDR luma value of the HDR screen. For example, assuming the current SDR luma value is 66% of the HDR screen's maximum SDR luma, then adjustment module 502 may adjust the SDR luma value of the HDR screen up to 90% of the HDR screen's maximum SDR luma; if the current SDR luma value is 95% of the maximum SDR luma for an HDR screen, then adjustment module 502 may maintain the current SDR luma value, i.e., no adjustment is made to the SDR luma value of the HDR screen.
According to the exemplary embodiment of the disclosure, if the current SDR brightness value is smaller than the preset threshold, which indicates that the current external environment is dark, since the brightness range required by the HDR content is relatively high, if the HDR content is still displayed according to the brightness range required by the HDR content at this time, the HDR screen may be too bright, which may cause irritation to the eyes of the user. Therefore, the display module 503 can convert the HDR content into SDR content for displaying, so that the brightness of the HDR screen can be adapted to the current environment, and the eyes of the user are prevented from being irritated by the excessively bright HDR screen. Further, the adjusting module 502 may adjust the SDR brightness value of the HDR screen according to an empirical value or experimental data, so that the display effect of the SDR content converted from the HDR content is better.
For example, in the case that the current SDR brightness value is less than the preset threshold, the adjusting module 502 may adjust the SDR brightness value of the HDR screen according to the preset brightness adjustment mapping relationship. Then, the display module 503 may identify HDR content and/or first SDR content in the multimedia data. Next, the identified HDR content may be converted to second SDR content, and the identified first SDR content may be rendered and displayed directly on the HDR screen with the SDR luma values adjusted, and/or the second SDR content may be rendered and displayed.
The preset brightness adjustment mapping relationship may be a brightness adjustment comparison table, and the brightness adjustment comparison table may include a plurality of original brightness values and a plurality of corresponding adjusted brightness values. In this way, since the HDR content is converted to the second SDR content and displayed together with the first SDR content, i.e., both are displayed simultaneously as SDR content, it is possible to prevent the white portion in the SDR content from becoming dull.
According to an exemplary embodiment of the disclosure, the apparatus 500 may further include a setting module, where the setting module may correspondingly set the preset luminance adjustment mapping relationship according to the type of the HDR screen, and then the adjusting module 502 may adjust the SDR luminance value of the HDR screen according to the preset luminance adjustment mapping relationship corresponding to the type of the HDR screen.
According to an exemplary embodiment of the present disclosure, the preset luminance adjustment mapping relationship may include a plurality of original luminance values and corresponding adjusted luminance values. In the case where the current SDR luma value matches one of the original luma values, the adjusting module 502 may adjust the SDR luma value of the HDR screen from the current SDR luma value to an adjusted luma value corresponding to the current SDR luma value in the preset luma adjustment mapping.
According to an exemplary embodiment of the present disclosure, the preset luminance adjustment mapping relationship may include a plurality of original luminance values and corresponding adjusted luminance values. In the case that the current SDR brightness value does not match any of the plurality of original brightness values, the adjusting module 502 may determine an original brightness interval in a preset brightness adjustment mapping relationship to which the current SDR brightness value belongs and an adjusted brightness interval corresponding to the original brightness interval.
Then, the adjusting module 502 may determine a first brightness difference according to the end brightness value and the start brightness value of the original brightness interval; determining a second brightness difference value according to the adjusted tail brightness value and the adjusted initial brightness value of the brightness interval; the third luminance difference may be determined according to the current SDR luminance value and the starting luminance value of the original luminance interval. Next, a target SDR luminance value may be calculated according to the first luminance difference value, the second luminance difference value, the third luminance difference value, and the adjusted start luminance value of the luminance interval. Further, the target SDR luminance value may be calculated using the above equation (3). Next, the adjusting module 502 may adjust the SDR luma value of the HDR screen from the current SDR luma value to the target SDR luma value.
According to an exemplary embodiment of the present disclosure, the display module 503 may convert the HDR content into the SDR content according to the manner in the foregoing method embodiment, and a specific conversion process has been described in the foregoing method embodiment, and is not described herein again.
Fig. 6 is a block diagram illustrating an electronic device 600 in accordance with an exemplary embodiment of the present disclosure.
Referring to fig. 6, the electronic device 600 includes at least one memory 601 and at least one processor 602, the at least one memory 601 having instructions stored therein, which when executed by the at least one processor 602, perform a content display method according to an exemplary embodiment of the present disclosure.
By way of example, the electronic device 600 may be a PC computer, tablet device, personal digital assistant, smart phone, or other device capable of executing the instructions described above. Here, the electronic device 600 need not be a single electronic device, but can be any arrangement or collection of circuits capable of executing the above-described instructions (or sets of instructions), either individually or in combination. The electronic device 600 may also be part of an integrated control system or system manager, or may be configured as a portable electronic device that interfaces with local or remote (e.g., via wireless transmission).
In the electronic device 600, the processor 602 may include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a programmable logic device, a special purpose processor system, a microcontroller, or a microprocessor. By way of example, and not limitation, processors may also include analog processors, digital processors, microprocessors, multi-core processors, processor arrays, network processors, and the like.
The processor 602 may execute instructions or code stored in the memory 601, wherein the memory 601 may also store data. The instructions and data may also be transmitted or received over a network via a network interface device, which may employ any known transmission protocol.
The memory 601 may be integrated with the processor 602, for example, with RAM or flash memory disposed within an integrated circuit microprocessor or the like. Further, memory 601 may comprise a stand-alone device, such as an external disk drive, storage array, or any other storage device usable by a database system. The memory 601 and the processor 602 may be operatively coupled or may communicate with each other, e.g., through I/O ports, network connections, etc., such that the processor 602 can read files stored in the memory.
Further, the electronic device 600 may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of the electronic device 600 may be connected to each other via a bus and/or a network.
According to an exemplary embodiment of the present disclosure, there may also be provided a computer-readable storage medium, in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform the above-described content display method. Examples of the computer-readable storage medium herein include: read-only memory (ROM), random-access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD + R, CD-RW, CD + RW, DVD-ROM, DVD-R, DVD + R, DVD-RW, DVD + RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, Blu-ray or compact disc memory, Hard Disk Drive (HDD), solid-state drive (SSD), card-type memory (such as a multimedia card, a Secure Digital (SD) card or a extreme digital (XD) card), magnetic tape, a floppy disk, a magneto-optical data storage device, an optical data storage device, a hard disk, a magnetic tape, a magneto-optical data storage device, a hard disk, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, A solid state disk, and any other device configured to store and provide a computer program and any associated data, data files, and data structures to a processor or computer in a non-transitory manner such that the processor or computer can execute the computer program. The computer program in the computer-readable storage medium described above can be run in an environment deployed in a computer apparatus, such as a client, a host, a proxy device, a server, and the like, and further, in one example, the computer program and any associated data, data files, and data structures are distributed across a networked computer system such that the computer program and any associated data, data files, and data structures are stored, accessed, and executed in a distributed fashion by one or more processors or computers.
According to an exemplary embodiment of the present disclosure, there may also be provided a computer program product comprising a computer program which, when executed by a processor, implements a content display method according to the present disclosure.
According to the content display method and the content display apparatus of the present disclosure, it is possible to simultaneously display HDR content and SDR content by adjusting the SDR luminance value of the HDR screen, it is possible to prevent a white portion in the SDR content from becoming dark, and it is not necessary to convert the SDR content into the HDR content, and it is possible to prevent phenomena such as overexposure, blurring, and the like from occurring. Further, the SDR luminance values of the HDR screen may be adjusted up based on the current SDR luminance values when the current SDR luminance values are greater than or equal to a preset threshold. Turning up the SDR luma value of the HDR screen may make the HDR content less distinct from the luma of the SDR content, avoiding the white portions in the SDR content from becoming dull. In addition, the SDR brightness value of the screen of the electronic equipment can be automatically adjusted according to the brightness of the external environment light, and when the current SDR brightness value is larger than or equal to the preset threshold value, the current external environment is brighter, so that the eyes of a user cannot be stimulated by strong light due to the increase of the SDR brightness value of the HDR screen, and the user experience cannot be influenced. Further, if the current SDR brightness value is smaller than the preset threshold, it indicates that the current external environment is dark, and because the brightness range required by the HDR content is relatively high, if the HDR content is still displayed according to the brightness range required by the HDR content at this time, the HDR screen may be too bright, which may cause irritation to the eyes of the user. Therefore, HDR content can be converted into SDR content for display, the brightness degree of the HDR screen can be adapted to the current environment, and stimulation to eyes of a user caused by the fact that the HDR screen is too bright is avoided. Also, since the HDR content is converted into the second SDR content and displayed together with the first SDR content, i.e., both are displayed simultaneously as the SDR content, it is possible to prevent the white portion in the SDR content from becoming dull.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

1. A content display method, comprising:
acquiring multimedia data;
adjusting SDR brightness values of a High Dynamic Range (HDR) screen based on a comparison result of current standard dynamic range SDR brightness values of the HDR screen and a preset threshold;
displaying the multimedia data on the HDR screen with the adjusted SDR brightness value, wherein the multimedia data comprises at least one of HDR content and first SDR content.
2. The content display method of claim 1, wherein the adjusting the SDR luma value of the HDR screen based on the comparison of the current SDR luma value of the HDR screen to a preset threshold comprises:
on a condition that the current SDR luma value is greater than or equal to the preset threshold, upshifting SDR luma values of the HDR screen on the basis of the current SDR luma values;
the displaying the multimedia data on the HDR screen with the adjusted SDR brightness value comprises:
and rendering and displaying the multimedia data on the HDR screen with the adjusted SDR brightness value.
3. The content display method of claim 2, wherein said upscaling the SDR luma value of the HDR screen based on the current SDR luma value comprises:
in the event that the current SDR luma value is less than a predetermined luma value, increasing an SDR luma value of the HDR screen to the predetermined luma value; the predetermined brightness value is greater than the preset threshold value;
in the event that the current SDR luma value is equal to or greater than the predetermined luma value, no adjustment is made to the SDR luma values of the HDR screen.
4. The content display method of claim 1, wherein the adjusting the SDR luma value of the HDR screen based on the comparison of the current SDR luma value of the HDR screen to a preset threshold comprises:
adjusting the SDR brightness value of the HDR screen according to a preset brightness adjustment mapping relation under the condition that the current SDR brightness value is smaller than the preset threshold;
the displaying the multimedia data on the HDR screen with the adjusted SDR brightness value comprises:
identifying the HDR content and/or the first SDR content in the multimedia data;
converting the identified HDR content into second SDR content;
rendering and displaying the identified first SDR content directly on the HDR screen with the adjusted SDR brightness value, and/or rendering and displaying the second SDR content.
5. The content display method of claim 4, wherein prior to the step of obtaining multimedia data, the method further comprises:
correspondingly setting the preset brightness adjustment mapping relation according to the type of the HDR screen;
the adjusting the SDR brightness value of the HDR screen according to the preset brightness adjustment mapping relation comprises:
and adjusting the SDR brightness value of the HDR screen according to a preset brightness adjustment mapping relation corresponding to the type of the HDR screen.
6. The content display method according to claim 4, wherein the preset luminance adjustment mapping relationship includes a plurality of original luminance values and corresponding adjusted luminance values;
the adjusting the SDR brightness value of the HDR screen according to the preset brightness adjustment mapping relation comprises:
and adjusting the SDR luma values of the HDR screen from the current SDR luma values to adjusted luma values corresponding to the current SDR luma values in the preset luma adjustment mapping relationship when the current SDR luma values match one of the plurality of original luma values.
7. A content display apparatus, comprising:
the acquisition module is used for acquiring multimedia data;
the adjusting module is used for adjusting the SDR brightness value of the HDR screen based on the comparison result of the current standard dynamic range SDR brightness value of the HDR screen and a preset threshold;
a display module for displaying the multimedia data on the HDR screen with the adjusted SDR brightness value, wherein the multimedia data comprises at least one of HDR content and first SDR content.
8. An electronic device, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the content display method of any one of claims 1 to 6.
9. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the content display method of any one of claims 1 to 6.
10. A computer program product comprising a computer program, characterized in that the computer program realizes the content display method of any one of claims 1 to 6 when executed by a processor.
CN202111443423.7A 2021-11-30 2021-11-30 Content display method and content display device Active CN114138218B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111443423.7A CN114138218B (en) 2021-11-30 2021-11-30 Content display method and content display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111443423.7A CN114138218B (en) 2021-11-30 2021-11-30 Content display method and content display device

Publications (2)

Publication Number Publication Date
CN114138218A true CN114138218A (en) 2022-03-04
CN114138218B CN114138218B (en) 2024-02-13

Family

ID=80389920

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111443423.7A Active CN114138218B (en) 2021-11-30 2021-11-30 Content display method and content display device

Country Status (1)

Country Link
CN (1) CN114138218B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114727029A (en) * 2022-03-21 2022-07-08 北京百度网讯科技有限公司 Video processing method and device, electronic equipment and storage medium
CN117130509A (en) * 2023-02-24 2023-11-28 荣耀终端有限公司 Brightness control method and related equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160358346A1 (en) * 2015-06-05 2016-12-08 Apple Inc. Rendering and displaying high dynamic range content
CN108200441A (en) * 2018-01-22 2018-06-22 青岛海信电器股份有限公司 A kind of brightness of image processing method and processing device, electronic equipment
CN108986053A (en) * 2018-08-21 2018-12-11 北京小米移动软件有限公司 Screen display method and device
CN110211549A (en) * 2019-04-25 2019-09-06 深圳市泰衡诺科技有限公司 A kind of screen brightness regulation method, device, terminal and storage medium
CN112419354A (en) * 2018-01-22 2021-02-26 海信视像科技股份有限公司 Image brightness processing method and device and electronic equipment
CN112449169A (en) * 2021-01-28 2021-03-05 北京达佳互联信息技术有限公司 Method and apparatus for tone mapping

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160358346A1 (en) * 2015-06-05 2016-12-08 Apple Inc. Rendering and displaying high dynamic range content
CN108200441A (en) * 2018-01-22 2018-06-22 青岛海信电器股份有限公司 A kind of brightness of image processing method and processing device, electronic equipment
CN112419354A (en) * 2018-01-22 2021-02-26 海信视像科技股份有限公司 Image brightness processing method and device and electronic equipment
CN108986053A (en) * 2018-08-21 2018-12-11 北京小米移动软件有限公司 Screen display method and device
CN110211549A (en) * 2019-04-25 2019-09-06 深圳市泰衡诺科技有限公司 A kind of screen brightness regulation method, device, terminal and storage medium
CN112449169A (en) * 2021-01-28 2021-03-05 北京达佳互联信息技术有限公司 Method and apparatus for tone mapping

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114727029A (en) * 2022-03-21 2022-07-08 北京百度网讯科技有限公司 Video processing method and device, electronic equipment and storage medium
CN114727029B (en) * 2022-03-21 2024-03-22 北京百度网讯科技有限公司 Video processing method and device, electronic equipment and storage medium
CN117130509A (en) * 2023-02-24 2023-11-28 荣耀终端有限公司 Brightness control method and related equipment

Also Published As

Publication number Publication date
CN114138218B (en) 2024-02-13

Similar Documents

Publication Publication Date Title
CN112449169B (en) Method and apparatus for tone mapping
JP6039763B2 (en) Method, apparatus and storage medium for local tone mapping
CN114138218B (en) Content display method and content display device
RU2640717C1 (en) Coding, decoding and presenting high dynamic range images
KR101783497B1 (en) Enhancement of images for display on liquid crystal displays
US20160005153A1 (en) Display Management for High Dynamic Range Video
US20180096467A1 (en) Image processing
KR102314937B1 (en) Method of and apparatus for processing data for a display
CN108460732B (en) Method and computing device for processing images
WO2017091278A1 (en) Spatially adaptive tone mapping for display of high dynamic range (hdr) images
WO2019091196A1 (en) Image processing method and apparatus
CN110996174B (en) Video image quality enhancement method and related equipment thereof
CN109716427A (en) A kind of brightness adjusting method and terminal
WO2019101005A1 (en) Pixel compensation method and apparatus, and terminal device
US8538145B2 (en) Gamma adjustment for maximizing information in images
CN116825039B (en) Backlight brightness calculating method, display device and computer readable storage medium
CN108235037A (en) Image data is coded and decoded
US20200013149A1 (en) Image processing apparatus, image processing method, and storage medium
JP2012510641A (en) Medical image viewer
KR20190000811A (en) Method for tone adapting an image to a target peak luminance lt of a target display device
US10096299B2 (en) Adaptive brightness control for dark display content
CN107888944B (en) Image processing
CN113194267B (en) Image processing method and device and photographing method and device
Brooks et al. Image compression using sparse colour sampling combined with nonlinear image processing
US20210350770A1 (en) Image delivery optimisation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant