CN112702651B - HDR video transmission method, device, system and computer readable storage medium - Google Patents
HDR video transmission method, device, system and computer readable storage medium Download PDFInfo
- Publication number
- CN112702651B CN112702651B CN201911008539.0A CN201911008539A CN112702651B CN 112702651 B CN112702651 B CN 112702651B CN 201911008539 A CN201911008539 A CN 201911008539A CN 112702651 B CN112702651 B CN 112702651B
- Authority
- CN
- China
- Prior art keywords
- video
- brightness
- current
- receiving
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4854—End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
Abstract
The embodiment of the invention provides a High Dynamic Range (HDR) video transmission method, a device, a system and a computer readable storage medium, wherein the method comprises the following steps: the method comprises the steps that the video receiving equipment determines the current display attribute information of a display screen of the video receiving equipment; sending the display attribute information to video publishing equipment, wherein the video publishing equipment is used for dynamically adjusting the display attribute of the currently transmitted video; receiving a video transmitted by video distribution equipment and the peak brightness of the currently transmitted video; dynamically adjusting a maximum brightness of a display screen based on a peak brightness of the currently transmitted video while the video is displayed.
Description
Technical Field
The present invention relates to the field of mobile communications technologies, and in particular, to a High-Dynamic Range (HDR) video transmission method, apparatus, system, and computer readable storage medium.
Background
At present, the latest scheme of HDR video transmission is dolby view and HDR10+, HDR10+ is a standard jointly issued by samsung and amazon, and as the upgrading of HDR, a dynamic tone mapping technology is added, variable dynamic metadata is adopted to help adjust brightness and contrast in real time, and frame-by-frame optimization is performed. Dolby corporation provides a complete set of patent solutions for Dolby view, including that contents, a playing source and display equipment are all compatible with the standard, each Dolby display equipment is provided with a special chip to detect and confirm the output capability of the equipment, and the data is transmitted to a playing signal source of the Dolby during playing, and the Dolby corporation also has a dynamic tone mapping technology.
With the improvement of the HDR demand, the brightness of the screen of the mobile device is also higher and higher, and the battery consumption speed of the mobile device is faster and faster, so how to dynamically adjust the brightness of the display screen to save the electric quantity under the condition of improving the user experience is an important problem for playing the HDR video by the mobile device.
Disclosure of Invention
In view of the above, embodiments of the present invention are directed to a method, an apparatus, a system and a computer-readable storage medium for HDR video transmission.
In order to achieve the above purpose, the technical solution of the embodiment of the present invention is implemented as follows:
the embodiment of the invention provides a high dynamic range HDR video transmission method, which is applied to video receiving equipment and comprises the following steps:
determining the current display attribute information of a display screen of the video receiving equipment;
sending the display attribute information to video publishing equipment, wherein the video publishing equipment is used for dynamically adjusting the display attribute of the currently transmitted video;
receiving a video transmitted by video distribution equipment and the peak brightness of the currently transmitted video;
dynamically adjusting a maximum brightness of a display screen based on a peak brightness of the currently transmitted video while the video is displayed.
Wherein the determining of the current display attribute information of the display screen of the video receiving device comprises:
and determining the highest brightness and the color gamut range of the current expected receiving screen based on the current display parameters of the display screen, the current power condition and the viewing mode selected by the user.
Determining the highest brightness and the color gamut range of the current expected receiving screen based on the current display parameters of the display screen, the current electric quantity condition and the viewing mode selected by the user, wherein the determining comprises the following steps:
if the user selects the best video effect, the currently expected receiving screen maximum brightness and color gamut range are the maximum brightness and the maximum color gamut range supported by the display screen;
if the user selects the longest standby time, setting the highest brightness of the current expected receiving screen as a first preset brightness value, and setting the color gamut range as a first color gamut range;
if the user selects the automatic adaptation mode, calculating the maximum brightness based on the maximum power consumption of the power consumption curve of the video receiving equipment in unit time, and if the calculated maximum brightness is greater than the maximum brightness supported by the display screen, the maximum brightness of the current expected receiving screen is the maximum brightness supported by the display screen; otherwise, if the calculated maximum brightness is smaller than the maximum brightness supported by the display screen, the maximum brightness of the currently expected receiving screen is the calculated maximum brightness; if the maximum brightness of the current expected receiving screen exceeds a second preset brightness value, the color gamut range is a second color gamut range;
wherein the first preset brightness value is smaller than the second preset brightness value.
Wherein the dynamically adjusting the maximum brightness of the display screen based on the peak brightness of the currently transmitted video comprises:
after the video is decoded, the maximum brightness of the display screen is dynamically adjusted based on the peak brightness of the currently transmitted video, the brightness of the currently transmitted video and the standby time of the video receiving equipment for playing the video.
Wherein, dynamically adjusting the maximum brightness of the display screen based on the peak brightness of the currently transmitted video, the brightness of the currently transmitted video and the standby time for the video receiving device to play the video comprises:
if the difference value between the peak brightness in the brightness information of the current transmission video and the brightness of the current transmission video is smaller than the preset percentage of the highest brightness of the current expected receiving screen, the brightness of the display screen is not adjusted;
if the peak brightness in the brightness information of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen, estimating the standby time of the video receiving equipment playing the video under the current brightness condition, and if the standby time is larger than or equal to the preset time, not adjusting the brightness of the display system; and if the standby time is less than the preset time, adjusting the maximum brightness of the current display screen to be the highest brightness of the current expected receiving screen or the preset multiple of the peak brightness.
The embodiment of the invention also provides a high dynamic range HDR video transmission method, which is applied to video release equipment and comprises the following steps:
receiving current display attribute information of a display screen, which is sent by video receiving equipment;
dynamically adjusting the display attribute of the currently transmitted video based on the display attribute information;
and determining the peak brightness of the currently transmitted video and sending the peak brightness to the video receiving equipment for the video receiving equipment to dynamically adjust the maximum brightness of the display screen.
Wherein the dynamically adjusting the display attribute of the currently transmitted video based on the display attribute information comprises:
performing resolution reconstruction on the video based on the resolution of the received video and the resolution of the video source;
and carrying out frame-by-frame color matching on the video, and adjusting the brightness and color gamut of the output video.
Wherein, the determining the peak brightness of the current transmission video and sending to the video receiving device comprises:
and calculating the maximum brightness of the video in the current time region, and dynamically sending the maximum brightness of the video in the current time region through dynamic metadata.
The embodiment of the invention also provides a high dynamic range HDR video transmission device, which is applied to video receiving equipment and comprises:
the determining module is used for determining the current display attribute information of the display screen of the video receiving equipment;
the first sending module is used for sending the display attribute information to video publishing equipment and dynamically adjusting the display attribute of the currently transmitted video by the video publishing equipment;
the first receiving module is used for receiving the video transmitted by the video publishing device and the peak brightness of the currently transmitted video;
and the first adjusting module is used for dynamically adjusting the maximum brightness of the display screen based on the peak brightness of the currently transmitted video while displaying the video.
The embodiment of the invention also provides a high dynamic range HDR video transmission device, which is applied to video distribution equipment and comprises the following components:
the second receiving module is used for receiving the current display attribute information of the display screen, which is sent by the video receiving equipment;
the second adjusting module is used for dynamically adjusting the display attribute of the currently transmitted video based on the display attribute information;
and the second sending module is used for determining the peak brightness of the currently transmitted video and sending the peak brightness to the video receiving equipment, and the second sending module is used for dynamically adjusting the maximum brightness of the display screen by the video receiving equipment.
The embodiment of the invention also provides a high dynamic range HDR video transmission system, which comprises: the device comprises a video receiving device and a video distribution device, wherein the video receiving device and the video distribution device comprise the devices.
An embodiment of the present invention further provides a high dynamic range HDR video transmission apparatus, where the apparatus includes: a processor and a memory for storing a computer program capable of running on the processor,
wherein the processor is configured to perform the steps of the above method when running the computer program.
Embodiments of the present invention also provide a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps of the above-mentioned method.
In the HDR video transmission method, apparatus, system, and computer-readable storage medium provided by the embodiments of the present invention, a video receiving device determines current display attribute information of a display screen of the video receiving device; sending the display attribute information to video publishing equipment, wherein the video publishing equipment is used for dynamically adjusting the display attribute of the currently transmitted video; receiving a video transmitted by video distribution equipment and the peak brightness of the currently transmitted video; dynamically adjusting a maximum brightness of a display screen based on a peak brightness of the currently transmitted video while the video is displayed. The embodiment of the invention considers the current display attribute information of the display screen of the mobile equipment, dynamically adjusts the display attribute of the current transmission video, and dynamically adjusts the maximum brightness of the display screen based on the peak brightness of the current transmission video, thereby ensuring the video quality, bringing better video experience to users, reducing the power consumption and meeting the user requirements.
Drawings
Fig. 1 is a first flowchart illustrating an HDR video transmission method according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a HDR video transmission method according to a second embodiment of the present invention;
fig. 3 is a first structural diagram of an HDR video transmitting apparatus according to an embodiment of the present invention;
fig. 4 is a second structural diagram of an HDR video transmitting apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a video transmission system according to an embodiment of the present invention;
fig. 6 is a schematic view of a video transmission flow of the video transmission system according to the scene embodiment of the present invention;
fig. 7 is a graph of power consumption of a video receiving device according to an embodiment of the present invention;
fig. 8 is a schematic view of a video processing flow of the video receiving apparatus according to the embodiment of the present invention.
Detailed Description
The invention is described below with reference to the figures and examples.
An embodiment of the present invention provides a high dynamic range HDR video transmission method, as shown in fig. 1, where the method is applied to a video receiving device, and includes:
step 101: determining the current display attribute information of a display screen of the video receiving equipment;
step 102: sending the display attribute information to video publishing equipment, wherein the video publishing equipment is used for dynamically adjusting the display attribute of the currently transmitted video;
step 103: receiving a video transmitted by video distribution equipment and the peak brightness of the currently transmitted video;
step 104: and dynamically adjusting the maximum brightness of a display screen based on the peak brightness of the currently transmitted video while the video is displayed.
The method comprises the steps of dynamically adjusting the display attribute of a currently transmitted video by considering the current display attribute information of a display screen of the mobile device, and dynamically adjusting the maximum brightness of the display screen based on the peak brightness of the currently transmitted video, so that the video quality is ensured, better video experience can be brought to a user, the power consumption can be reduced, and the user requirements are met.
In this embodiment of the present invention, the determining the current display attribute information of the display screen of the video receiving device includes:
and determining the highest brightness and the color gamut range of the current expected receiving screen based on the current display parameters of the display screen, the current power condition and the viewing mode selected by the user.
Wherein the display parameters may include: display screen material (such as an LCD screen or an OLED screen), peak brightness, color gamut range, screen resolution, screen size, contrast under ambient light, screen reflectivity, viewing angle brightness variation, and the like. The user-selected viewing mode may include: best video effects, longest standby time, or auto-adaptation mode, etc.
In this embodiment of the present invention, the determining, based on the current display parameter of the display screen, the current power condition, and the viewing mode selected by the user, the maximum brightness and the color gamut range of the currently desired receiving screen includes:
if the user selects the best video effect, the current expected receiving screen maximum brightness and color gamut range is the maximum brightness and the maximum color gamut range supported by the display screen;
if the user selects the longest standby time, setting the highest brightness of the current expected receiving screen as a first preset brightness value, and setting the color gamut range as a first color gamut range;
if the user selects the automatic adaptation mode, calculating the maximum brightness based on the maximum power consumption of the power consumption curve of the video receiving equipment in unit time, and if the calculated maximum brightness is greater than the maximum brightness supported by the display screen, the maximum brightness of the current expected receiving screen is the maximum brightness supported by the display screen; otherwise, if the calculated maximum brightness is smaller than the maximum brightness supported by the display screen, the maximum brightness of the currently expected receiving screen is the calculated maximum brightness; if the maximum brightness of the current expected receiving screen exceeds a second preset brightness value, the color gamut range is a second color gamut range;
wherein the first preset brightness value is smaller than a second preset brightness value.
In this embodiment of the present invention, the dynamically adjusting the maximum brightness of the display screen based on the peak brightness of the currently transmitted video includes:
after the video is decoded, the maximum brightness of the display screen is dynamically adjusted based on the peak brightness of the currently transmitted video, the brightness of the currently transmitted video and the standby time of the video receiving equipment for playing the video.
In the embodiment of the present invention, the dynamically adjusting the maximum brightness of the display screen based on the peak brightness of the currently transmitted video, the brightness of the currently transmitted video, and the standby time for the video receiving device to play the video includes:
if the difference value between the peak brightness in the brightness information of the current transmission video and the brightness of the current transmission video is smaller than the preset percentage of the highest brightness of the current expected receiving screen, the brightness of the display screen is not adjusted;
if the peak brightness in the brightness information of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen, estimating the standby time of the video receiving equipment playing the video under the current brightness condition, and if the standby time is larger than or equal to the preset time, not adjusting the brightness of the display system; and if the standby time is less than the preset time, adjusting the maximum brightness of the current display screen to be the highest brightness of the current expected receiving screen or the preset multiple of the peak brightness.
An embodiment of the present invention further provides a high dynamic range HDR video transmission method, as shown in fig. 2, where the method is applied to a video distribution device, and includes:
step 201: receiving current display attribute information of a display screen sent by video receiving equipment;
step 202: dynamically adjusting the display attribute of the currently transmitted video based on the display attribute information;
step 203: and determining the peak brightness of the currently transmitted video and sending the peak brightness to the video receiving equipment for the video receiving equipment to dynamically adjust the maximum brightness of the display screen.
In this embodiment of the present invention, the dynamically adjusting the display attribute of the currently transmitted video based on the display attribute information includes:
performing resolution reconstruction on the video based on the resolution of the received video and the resolution of the video source;
and carrying out frame-by-frame color matching on the video, and adjusting the brightness and color gamut of the output video.
In this embodiment of the present invention, the determining the peak brightness of the currently transmitted video and sending the determined peak brightness to the video receiving device includes:
and calculating the maximum brightness of the video in the current time region, and dynamically sending the maximum brightness of the video in the current time region through dynamic metadata.
In order to implement the foregoing method embodiment, an embodiment of the present invention further provides a high dynamic range HDR video transmission apparatus, as shown in fig. 3, where the apparatus is applied to a video receiving device, and includes:
a determining module 301, configured to determine current display attribute information of a display screen of the video receiving device;
a first sending module 302, configured to send the display attribute information to a video distribution device, where the video distribution device dynamically adjusts a display attribute of a currently transmitted video;
a first receiving module 303, configured to receive a video transmitted by a video distribution device and a peak brightness of a currently transmitted video;
a first adjusting module 304, configured to dynamically adjust a maximum brightness of a display screen based on a peak brightness of the currently transmitted video while the video is being displayed.
In this embodiment of the present invention, the determining module 301 determines the current display attribute information of the display screen of the video receiving device, including:
and determining the highest brightness and the color gamut range of the current expected receiving screen based on the current display parameters of the display screen, the current power condition and the viewing mode selected by the user.
Wherein the display parameters may include: display screen material (such as an LCD screen or an OLED screen), peak brightness, color gamut range, screen resolution, screen size, contrast under ambient light, screen reflectivity, viewing angle brightness variation, and the like. The user-selected viewing mode may include: best video effects, longest standby time, or auto-adaptation mode, etc.
In this embodiment of the present invention, the determining module 301 determines, based on the current display parameter of the display screen, the current power condition, and the viewing mode selected by the user, the maximum brightness and the color gamut range of the currently expected receiving screen, including:
if the user selects the best video effect, the currently expected receiving screen maximum brightness and color gamut range are the maximum brightness and the maximum color gamut range supported by the display screen;
if the user selects the longest standby time, setting the highest brightness of the current expected receiving screen as a first preset brightness value, and setting the color gamut range as a first color gamut range;
if the user selects the automatic adaptation mode, calculating the maximum brightness based on the maximum power consumption of the power consumption curve of the video receiving equipment in unit time, and if the calculated maximum brightness is greater than the maximum brightness supported by the display screen, the maximum brightness of the current expected receiving screen is the maximum brightness supported by the display screen; otherwise, if the calculated maximum brightness is smaller than the maximum brightness supported by the display screen, the maximum brightness of the currently expected receiving screen is the calculated maximum brightness; if the maximum brightness of the current expected receiving screen exceeds a second preset brightness value, the color gamut range is a second color gamut range;
wherein the first preset brightness value is smaller than the second preset brightness value.
In this embodiment of the present invention, the dynamically adjusting the maximum brightness of the display screen by the first adjusting module 304 based on the peak brightness of the currently transmitted video includes:
after the video is decoded, the maximum brightness of the display screen is dynamically adjusted based on the peak brightness of the currently transmitted video, the brightness of the currently transmitted video and the standby time of the video receiving equipment for playing the video.
In this embodiment of the present invention, the dynamically adjusting the maximum brightness of the display screen by the first adjusting module 304 based on the peak brightness of the currently transmitted video, the brightness of the currently transmitted video, and the standby time for the video receiving device to play the video includes:
if the difference value between the peak brightness in the brightness information of the current transmission video and the brightness of the current transmission video is smaller than the preset percentage of the highest brightness of the current expected receiving screen, the brightness of the display screen is not adjusted;
if the peak brightness in the brightness information of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen, estimating the standby time of the video receiving equipment playing the video under the current brightness condition, and if the standby time is larger than or equal to the preset time, not adjusting the brightness of the display system; and if the standby time is less than the preset time, adjusting the maximum brightness of the current display screen to be the highest brightness of the current expected receiving screen or the preset multiple of the peak brightness.
An embodiment of the present invention further provides a high dynamic range HDR video transmission apparatus, as shown in fig. 4, where the apparatus is applied to a video distribution device, and includes:
a second receiving module 401, configured to receive current display attribute information of a display screen sent by the video receiving device;
a second adjusting module 402, configured to dynamically adjust a display attribute of a currently transmitted video based on the display attribute information;
and a second sending module 403, configured to determine a peak brightness of the currently transmitted video and send the peak brightness to the video receiving device, where the peak brightness is used for the video receiving device to dynamically adjust the maximum brightness of the display screen.
In this embodiment of the present invention, the dynamically adjusting the display attribute of the currently transmitted video by the second adjusting module 402 based on the display attribute information includes:
performing resolution reconstruction on the video based on the resolution of the received video and the resolution of the video source;
and carrying out frame-by-frame color matching on the video, and adjusting the brightness and color gamut of the output video.
In this embodiment of the present invention, the determining, by the second sending module 403, the peak brightness of the currently transmitted video and sending the determined peak brightness to the video receiving device includes:
and calculating the maximum brightness of the video in the current time region, and dynamically sending the maximum brightness of the video in the current time region through dynamic metadata.
The embodiment of the invention also provides a high dynamic range HDR video transmission system, which comprises: a video receiving device and a video distribution device, wherein the video receiving device comprises the device shown in figure 3; the video distribution device comprises the apparatus described in fig. 4.
The embodiment of the invention also provides a high dynamic range HDR video transmission device, which comprises: a processor and a memory for storing a computer program capable of running on the processor,
wherein the processor is configured to execute, when running the computer program:
determining the current display attribute information of a display screen of the video receiving equipment;
sending the display attribute information to video publishing equipment, wherein the video publishing equipment is used for dynamically adjusting the display attribute of the currently transmitted video;
receiving a video transmitted by video distribution equipment and the peak brightness of the currently transmitted video;
dynamically adjusting a maximum brightness of a display screen based on a peak brightness of the currently transmitted video while the video is displayed.
When the current display attribute information of the display screen of the video receiving device is determined, the processor is further configured to execute, when the computer program is run, the following steps:
and determining the highest brightness and the color gamut range of the current expected receiving screen based on the current display parameters of the display screen, the current power condition and the viewing mode selected by the user.
When determining that the maximum brightness and the color gamut range of the screen are expected to be received currently based on the current display parameters of the display screen, the current power condition and the viewing mode selected by the user, the processor is further configured to execute, when running the computer program:
if the user selects the best video effect, the currently expected receiving screen maximum brightness and color gamut range are the maximum brightness and the maximum color gamut range supported by the display screen;
if the user selects the longest standby time, setting the highest brightness of the current expected receiving screen as a first preset brightness value, and setting the color gamut range as a first color gamut range;
if the user selects the automatic adaptation mode, calculating the maximum brightness based on the maximum power consumption of the power consumption curve of the video receiving equipment in unit time, and if the calculated maximum brightness is greater than the maximum brightness supported by the display screen, the maximum brightness of the current expected receiving screen is the maximum brightness supported by the display screen; otherwise, if the calculated maximum brightness is smaller than the maximum brightness supported by the display screen, the maximum brightness of the currently expected receiving screen is the calculated maximum brightness; if the highest brightness of the current expected receiving screen exceeds a second preset brightness value, the color gamut range is a second color gamut range;
wherein the first preset brightness value is smaller than a second preset brightness value.
When the maximum brightness of the display screen is dynamically adjusted based on the peak brightness of the currently transmitted video, the processor is further configured to execute, when the computer program is run:
after the video is decoded, the maximum brightness of the display screen is dynamically adjusted based on the peak brightness of the currently transmitted video, the brightness of the currently transmitted video and the standby time of the video receiving equipment for playing the video.
When the maximum brightness of the display screen is dynamically adjusted based on the peak brightness of the currently transmitted video, the brightness of the currently transmitted video and the standby time of the video receiving device for playing the video, the processor is further configured to execute, when the computer program is run:
if the difference value between the peak value brightness in the brightness information of the current transmission video and the brightness of the current transmission video is smaller than the preset percentage of the highest brightness of the current expected receiving screen, the brightness of the display screen is not adjusted;
if the peak brightness in the brightness information of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen, estimating the standby time of the video receiving equipment playing the video under the current brightness condition, and if the standby time is larger than or equal to the preset time, not adjusting the brightness of the display system; and if the standby time is less than the preset time, adjusting the maximum brightness of the current display screen to be the highest brightness of the current expected receiving screen or the preset multiple of the peak brightness.
An embodiment of the present invention further provides a high dynamic range HDR video transmission apparatus, where the apparatus includes: a processor and a memory for storing a computer program capable of running on the processor,
wherein the processor is configured to execute, when running the computer program:
receiving current display attribute information of a display screen sent by video receiving equipment;
dynamically adjusting the display attribute of the currently transmitted video based on the display attribute information;
and determining the peak brightness of the currently transmitted video and sending the peak brightness to the video receiving equipment for the video receiving equipment to dynamically adjust the maximum brightness of the display screen.
When the display attribute of the currently transmitted video is dynamically adjusted based on the display attribute information, the processor is further configured to execute, when the computer program is run:
performing resolution reconstruction on the video based on the resolution of the received video and the resolution of the video source;
and carrying out frame-by-frame color matching on the video, and adjusting the brightness and color gamut of the output video.
When determining the peak brightness of the currently transmitted video and sending the determined peak brightness to the video receiving device, the processor is further configured to execute, when running the computer program:
and calculating the maximum brightness of the video in the current time region, and dynamically sending the maximum brightness of the video in the current time region through dynamic metadata.
It should be noted that: in the HDR video transmission, the apparatus provided in the foregoing embodiment is only illustrated by dividing the program modules, and in practical applications, the processing allocation may be completed by different program modules as needed, that is, the internal structure of the device is divided into different program modules, so as to complete all or part of the processing described above. In addition, the apparatus provided in the above embodiments and the corresponding method embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments and are not described herein again.
In an exemplary embodiment, the embodiment of the present invention also provides a computer-readable storage medium, which may be a Memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash Memory, magnetic surface Memory, optical disc, or CD-ROM; or may be a variety of devices including one or any combination of the above memories, such as a mobile phone, computer, tablet device, personal digital assistant, etc.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, performs:
determining the current display attribute information of a display screen of the video receiving equipment;
sending the display attribute information to video publishing equipment, wherein the video publishing equipment is used for dynamically adjusting the display attribute of the currently transmitted video;
receiving a video transmitted by video distribution equipment and the peak brightness of the currently transmitted video;
and dynamically adjusting the maximum brightness of a display screen based on the peak brightness of the currently transmitted video while the video is displayed.
When the current display attribute information of the display screen of the video receiving device is determined, the computer program is executed by the processor, and further executes:
and determining the highest brightness and the color gamut range of the current expected receiving screen based on the current display parameters of the display screen, the current power condition and the viewing mode selected by the user.
When determining that the maximum brightness and the color gamut range of the screen are expected to be received currently based on the current display parameters of the display screen, the current power condition and the viewing mode selected by the user, the computer program, when executed by the processor, further performs:
if the user selects the best video effect, the currently expected receiving screen maximum brightness and color gamut range are the maximum brightness and the maximum color gamut range supported by the display screen;
if the user selects the longest standby time, setting the highest brightness of the current expected receiving screen as a first preset brightness value, and setting the color gamut range as a first color gamut range;
if the user selects the automatic adaptation mode, calculating the maximum brightness based on the maximum power consumption of the power consumption curve of the video receiving equipment in unit time, and if the calculated maximum brightness is greater than the highest brightness supported by the display screen, the highest brightness of the current expected receiving screen is the highest brightness supported by the display screen; otherwise, if the calculated maximum brightness is smaller than the maximum brightness supported by the display screen, the maximum brightness of the currently expected receiving screen is the calculated maximum brightness; if the maximum brightness of the current expected receiving screen exceeds a second preset brightness value, the color gamut range is a second color gamut range;
wherein the first preset brightness value is smaller than a second preset brightness value.
When the maximum brightness of the display screen is dynamically adjusted based on the peak brightness of the currently transmitted video, the computer program, when executed by the processor, further performs:
after the video is decoded, the maximum brightness of the display screen is dynamically adjusted based on the peak brightness of the currently transmitted video, the brightness of the currently transmitted video and the standby time of the video receiving equipment for playing the video.
When the maximum brightness of the display screen is dynamically adjusted based on the peak brightness of the currently transmitted video, the brightness of the currently transmitted video and the standby time of the video playing of the video receiving device, the computer program further executes, when executed by the processor:
if the difference value between the peak value brightness in the brightness information of the current transmission video and the brightness of the current transmission video is smaller than the preset percentage of the highest brightness of the current expected receiving screen, the brightness of the display screen is not adjusted;
if the peak value brightness in the brightness information of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen, estimating the standby time of the video receiving equipment playing the video under the current brightness condition, and if the standby time is longer than or equal to the preset time, not adjusting the brightness of the display system; and if the standby time is less than the preset time, adjusting the maximum brightness of the current display screen to be the highest brightness of the current expected receiving screen or the preset multiple of the peak brightness.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, performs:
receiving current display attribute information of a display screen sent by video receiving equipment;
dynamically adjusting the display attribute of the currently transmitted video based on the display attribute information;
and determining the peak brightness of the currently transmitted video and sending the peak brightness to the video receiving equipment for the video receiving equipment to dynamically adjust the maximum brightness of the display screen.
When the display attribute of the currently transmitted video is dynamically adjusted based on the display attribute information, the computer program, when executed by the processor, further performs:
performing resolution reconstruction on the video based on the resolution of the received video and the resolution of the video source;
and carrying out frame-by-frame color matching on the video, and adjusting the brightness and color gamut of the output video.
When determining the peak brightness of the currently transmitted video and sending the determined peak brightness to the video receiving device, the computer program, when executed by the processor, further performs:
and calculating the maximum brightness of the video in the current time region, and dynamically sending the maximum brightness of the video in the current time region through dynamic metadata.
The invention is described below in conjunction with the scenario embodiments.
As shown in fig. 5, the video transmission system of the present embodiment includes a video distribution device and a video receiving device, where the video distribution device includes several modules, namely a video source, a video processing module and a video distribution module; the video receiving device includes a receiving device and a display system. Wherein the content of the first and second substances,
the video source stores high dynamic video content which is edited and produced by video, and the high dynamic video content comprises an HDR master file and an XML metadata file.
The video processing module performs frame-by-frame color matching on an HDR master file acquired from a video source according to received display attribute parameters (brightness, color space, resolution ratio and the like) of the mobile device, adjusts output brightness and color gamut, sets dynamic metadata, and finally encodes and encapsulates the video.
The video distribution module transmits the corresponding video including the metadata to the receiving device according to the request of the receiving device.
The receiving device sends a video request to the video publishing device and transmits the received video to the display system, and the display system dynamically adjusts the display parameters of the device according to the prompt of the receiving device and displays the corresponding video content.
The video transmission flow based on the above system is shown in fig. 6, and includes:
the method comprises the following steps: firstly, the video receiving device acquires display parameters of a current display system, including display screen material (such as an LCD screen or an OLED screen), peak brightness, color gamut range, screen resolution, screen size, contrast under ambient light, screen reflectivity, viewing angle brightness change and the like. Meanwhile, the receiving device in the video receiving device obtains the stored maximum electric quantity, the stored minimum electric quantity, the current electric quantity of the current device power supply and the power consumption curve under the brightness condition in the past period of time, such as the power consumption curve of a certain OLED screen mobile phone shown in fig. 7. According to the current electric quantity condition of the receiving equipment and the watching mode selected by the user, such as: optimal video effects, maximum standby time, or auto-adaptation mode, etc., calculating the current desired receiving screen maximum brightness and color gamut range.
Here, if the user selects the best video effect, the currently desired reception screen maximum brightness and color gamut range are the maximum brightness and maximum color gamut range supported by the display screen; if the user selects the longest standby time, the maximum brightness of the expected receiving screen can be set to be 100nit, and the color gamut range can be the color gamut range of BT.709; if the user selects the auto-adaptation mode, assuming that the receiving device needs to be able to play the HDR video for more than 20 minutes, the maximum power consumption of the screen per second is calculated, which may be: the maximum power consumption Pu = (current power Pn-minimum storage power Pmin)/20 × 60-power consumption Po of other hardware unit time is estimated. When calculating the maximum brightness of the screen, it can be simply assumed that the video brightness is 60% gray, the maximum brightness is calculated from the maximum power consumption per unit time of the curve shown in fig. 7, if the maximum brightness exceeds the maximum brightness supported by the screen, the desired screen maximum brightness is set as the maximum brightness, otherwise, the desired screen maximum brightness is the calculated maximum brightness. If the desired screen maximum brightness exceeds 200nit, the gamut range may be that of bt.2020.
Step two: the video receiving device sends a video request including video links, display attributes (screen maximum brightness, color gamut range, screen resolution, etc.) to the video distribution device.
Step three: after the video publishing equipment receives the request of the receiving system, the HDR master file acquired by the video source firstly carries out resolution reconstruction on the video if the receiving resolution is determined to be lower than the video resolution of the video source after the request of the receiving system is received, so that the processed video resolution is kept consistent with the resolution of the receiving system; then, carrying out frame-by-frame color matching, adjusting the output brightness and color gamut, and simultaneously calculating the maximum brightness of the video in the current time region; setting dynamic metadata, wherein the content of the dynamic metadata comprises: supplemental color luminance grading information such as perceptually quantized PQ information, maximum luminance information of the current video; and finally, encoding the video and packaging the dynamic metadata.
Step four: the video distribution device transmits the encoded video content (including the encoded video content and the video metadata) to the video reception device.
Step five: as shown in fig. 8, the video receiving device processes the video, and first receives the video through a network or other devices, decomposes the video content, extracts the compressed video, and decodes the compressed video. And analyzing the dynamic metadata to obtain the grading information of the supplementary color brightness, the maximum brightness information of the current video and the like. And carrying out tone mapping by using the decoded video and the dynamic metadata to generate an HDR video, and displaying the corresponding video through a display system.
The display system simultaneously receives the current video brightness information in the dynamic metadata and dynamically adjusts the maximum brightness and corresponding color gamut of the display system. If the difference value between the maximum brightness and the current brightness in the brightness information of the current video is less than 10% of the expected maximum brightness, the brightness of the display system is not adjusted; if the maximum brightness in the brightness information of the current video is less than 10% of the expected maximum brightness, the standby time for playing the video by the receiving device under the current brightness condition is estimated, the current brightness is obtained through a power consumption curve, and the power consumption amount Pu under the 60% gray scale condition is obtained, so that the standby time T = (the current power amount Pn-the minimum stored power amount Pmin)/(Pu + the power consumption Po of other hardware unit time). If the standby time T is more than 30 minutes, the brightness of the display system is not adjusted; if the standby time is less than 30 minutes, adjusting the maximum brightness of the current display screen to be: it is currently desired to receive the screen maximum brightness or video maximum brightness x 1.1.
Step six: and after a certain time range, calculating the expected maximum brightness of the current display screen in the first step repeatedly, and if the expected maximum brightness and the color gamut range are changed, sending a display attribute adjustment request to the video distribution equipment. And subsequently repeating the operations of the third step, the fourth step and the fifth step.
According to the embodiment of the invention, the maximum brightness of the display system and the brightness of the HDR video are dynamically adjusted by considering the power consumption condition of the mobile equipment, so that better video experience can be provided for users, the power consumption can be reduced, and the user requirements can be met.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.
Claims (11)
1. A High Dynamic Range (HDR) video transmission method applied to a video receiving device includes:
determining the current display attribute information of a display screen of the video receiving equipment;
sending the display attribute information to video publishing equipment, wherein the video publishing equipment is used for dynamically adjusting the display attribute of the currently transmitted video;
receiving a video transmitted by video distribution equipment and the peak brightness of the currently transmitted video;
when the video is displayed, if the difference value between the peak brightness in the brightness information of the currently transmitted video and the brightness of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen, the brightness of the display screen is not adjusted;
if the peak value brightness in the brightness information of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen, estimating the standby time of the video receiving equipment playing the video under the current brightness condition, and if the standby time is longer than or equal to the preset time, not adjusting the brightness of the display system; and if the standby time is less than the preset time, adjusting the maximum brightness of the current display screen to be the highest brightness of the current expected receiving screen or the preset multiple of the peak brightness.
2. The method of claim 1, wherein determining current display attribute information of a display screen of the video receiving device comprises:
and determining the highest brightness and the color gamut range of the current expected receiving screen based on the current display parameters of the display screen, the current power condition and the viewing mode selected by the user.
3. The method of claim 2, wherein determining the current desired receiving screen maximum brightness and color gamut range based on the current display parameters of the display screen, the current power condition and the viewing mode selected by the user comprises:
if the user selects the best video effect, the currently expected receiving screen maximum brightness and color gamut range are the maximum brightness and the maximum color gamut range supported by the display screen;
if the user selects the longest standby time, setting the highest brightness of the current expected receiving screen as a first preset brightness value, and setting the color gamut range as a first color gamut range;
if the user selects the automatic adaptation mode, calculating the maximum brightness based on the maximum power consumption of the power consumption curve of the video receiving equipment in unit time, and if the calculated maximum brightness is greater than the maximum brightness supported by the display screen, the maximum brightness of the current expected receiving screen is the maximum brightness supported by the display screen; otherwise, if the calculated maximum brightness is smaller than the maximum brightness supported by the display screen, the maximum brightness of the currently expected receiving screen is the calculated maximum brightness; if the highest brightness of the current expected receiving screen exceeds a second preset brightness value, the color gamut range is a second color gamut range;
wherein the first preset brightness value is smaller than the second preset brightness value.
4. A High Dynamic Range (HDR) video transmission method applied to a video distribution device comprises the following steps:
receiving current display attribute information of a display screen, which is sent by video receiving equipment;
dynamically adjusting the display attribute of the currently transmitted video based on the display attribute information;
determining the peak brightness of the currently transmitted video and sending the peak brightness to the video receiving equipment, wherein the peak brightness is used for not adjusting the brightness of the display screen if the difference value between the peak brightness in the brightness information of the currently transmitted video and the brightness of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen while the video receiving equipment displays the video;
if the peak brightness in the brightness information of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen, estimating the standby time of the video receiving equipment playing the video under the current brightness condition, and if the standby time is larger than or equal to the preset time, not adjusting the brightness of the display system; and if the standby time is less than the preset time, adjusting the maximum brightness of the current display screen to be the highest brightness of the current expected receiving screen or the preset multiple of the peak brightness.
5. The method of claim 4, wherein dynamically adjusting the display attribute of the currently transmitted video based on the display attribute information comprises:
performing resolution reconstruction on the video based on the resolution of the received video and the resolution of the video source;
and carrying out frame-by-frame color matching on the video, and adjusting the brightness and color gamut of the output video.
6. The method of claim 4, wherein determining the peak luminance of the currently transmitted video and sending the determined peak luminance to the video receiving device comprises:
and calculating the maximum brightness of the video in the current time region, and dynamically sending the maximum brightness of the video in the current time region through dynamic metadata.
7. A high dynamic range HDR video transmission apparatus, for use in a video receiving device, comprising:
the determining module is used for determining the current display attribute information of a display screen of the video receiving equipment;
the first sending module is used for sending the display attribute information to video publishing equipment and dynamically adjusting the display attribute of the currently transmitted video by the video publishing equipment;
the first receiving module is used for receiving the video transmitted by the video publishing device and the peak brightness of the currently transmitted video;
the first adjusting module is used for not adjusting the brightness of the display screen when the video is displayed and if the difference value between the peak brightness in the brightness information of the currently transmitted video and the brightness of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen; if the peak brightness in the brightness information of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen, estimating the standby time of the video receiving equipment playing the video under the current brightness condition, and if the standby time is larger than or equal to the preset time, not adjusting the brightness of the display system; and if the standby time is less than the preset time, adjusting the maximum brightness of the current display screen to be the highest brightness of the current expected receiving screen or the preset multiple of the peak brightness.
8. A high dynamic range HDR video transmission apparatus, applied to a video distribution device, comprising:
the second receiving module is used for receiving the current display attribute information of the display screen, which is sent by the video receiving equipment;
the second adjusting module is used for dynamically adjusting the display attribute of the currently transmitted video based on the display attribute information;
the second sending module is used for determining the peak brightness of the currently transmitted video and sending the peak brightness to the video receiving equipment, and is used for not adjusting the brightness of the display screen when the video receiving equipment displays the video and the difference value between the peak brightness in the brightness information of the currently transmitted video and the brightness of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen; if the peak brightness in the brightness information of the currently transmitted video is smaller than the preset percentage of the highest brightness of the currently expected receiving screen, estimating the standby time of the video receiving equipment playing the video under the current brightness condition, and if the standby time is larger than or equal to the preset time, not adjusting the brightness of the display system; and if the standby time is less than the preset time, adjusting the maximum brightness of the current display screen to be the highest brightness of the current expected receiving screen or the preset multiple of the peak brightness.
9. A high dynamic range, HDR, video transmission system, comprising: a video receiving device and a video distribution device, the video receiving device comprising the apparatus of claim 7; the video distribution apparatus comprising the apparatus of claim 8.
10. An apparatus for High Dynamic Range (HDR) video transmission, the apparatus comprising: a processor and a memory for storing a computer program capable of running on the processor,
wherein the processor is adapted to perform the steps of the method of any one of claims 1-3 or to perform the steps of the method of any one of claims 4-6 when running the computer program.
11. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 3 or carries out the steps of the method of any one of claims 4 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911008539.0A CN112702651B (en) | 2019-10-22 | 2019-10-22 | HDR video transmission method, device, system and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911008539.0A CN112702651B (en) | 2019-10-22 | 2019-10-22 | HDR video transmission method, device, system and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112702651A CN112702651A (en) | 2021-04-23 |
| CN112702651B true CN112702651B (en) | 2023-03-31 |
Family
ID=75504702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911008539.0A Active CN112702651B (en) | 2019-10-22 | 2019-10-22 | HDR video transmission method, device, system and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112702651B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102833519A (en) * | 2011-06-14 | 2012-12-19 | 华为终端有限公司 | Method, device and system for adaption processing on video image |
| CN104281427A (en) * | 2014-03-10 | 2015-01-14 | 深圳深讯和科技有限公司 | Video data processing method and system in interactive application |
| CN108288278A (en) * | 2018-01-22 | 2018-07-17 | 青岛海信电器股份有限公司 | A kind of brightness of image processing method and processing device, electronic equipment |
| CN109545153A (en) * | 2018-11-23 | 2019-03-29 | 深圳Tcl新技术有限公司 | Luminance regulating method, television set and the storage medium of liquid crystal display |
| CN109691114A (en) * | 2017-07-07 | 2019-04-26 | 松下知识产权经营株式会社 | Image display and image display method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1286542A3 (en) * | 2001-08-01 | 2006-01-11 | Canon Kabushiki Kaisha | Drive control device for a display apparatus, video image display apparatus and method of controlling the driving of the video image display apparatus |
-
2019
- 2019-10-22 CN CN201911008539.0A patent/CN112702651B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102833519A (en) * | 2011-06-14 | 2012-12-19 | 华为终端有限公司 | Method, device and system for adaption processing on video image |
| CN104281427A (en) * | 2014-03-10 | 2015-01-14 | 深圳深讯和科技有限公司 | Video data processing method and system in interactive application |
| CN109691114A (en) * | 2017-07-07 | 2019-04-26 | 松下知识产权经营株式会社 | Image display and image display method |
| CN108288278A (en) * | 2018-01-22 | 2018-07-17 | 青岛海信电器股份有限公司 | A kind of brightness of image processing method and processing device, electronic equipment |
| CN109545153A (en) * | 2018-11-23 | 2019-03-29 | 深圳Tcl新技术有限公司 | Luminance regulating method, television set and the storage medium of liquid crystal display |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112702651A (en) | 2021-04-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10679569B2 (en) | Display device and method of controlling the same | |
| US11158032B2 (en) | Perceptually preserving scene-referred contrasts and chromaticities | |
| US10692465B2 (en) | Transitioning between video priority and graphics priority | |
| CN103004214B (en) | For the quality metric of the view-based access control model of 3 D video | |
| RU2670782C9 (en) | Methods and devices for creating code mapping functions for hdr image coding and methods and devices for using such encoded images | |
| CN111314577B (en) | Transformation of dynamic metadata to support alternate tone rendering | |
| CN110022373B (en) | Service distribution method, device, server and storage medium | |
| EP4336850A2 (en) | Systems and methods for region-of-interest tone remapping | |
| CN112419354B (en) | Image brightness processing method and device and electronic equipment | |
| JP2018512637A (en) | Method and apparatus for processing high dynamic range images | |
| CN108200441A (en) | A kind of brightness of image processing method and processing device, electronic equipment | |
| JP2008299320A (en) | Electronic device, optimization method and optimization system | |
| CN106791915A (en) | A kind of method and apparatus for showing video image | |
| CN115526972A (en) | Scene interaction effect rendering method and system in lighting simulation | |
| CN113612979A (en) | Projection method, electronic equipment and computer equipment | |
| CN112702651B (en) | HDR video transmission method, device, system and computer readable storage medium | |
| CN116368513A (en) | HDR tone mapping based on authoring intention metadata and ambient light | |
| CN110941413B (en) | Display screen generation method and related device | |
| Liu et al. | Content-adaptive display power saving for internet video applications on mobile devices | |
| CN117116201B (en) | Display screen uniformity calibration method, calibration device and display device | |
| CN111416971B (en) | Control method, control system, electronic device and readable storage medium | |
| KR20160138865A (en) | Method and apparatus for video luminance signal processing | |
| Fernandes et al. | Mobile display power reduction for video using standardized metadata | |
| CN117942561A (en) | Game image quality processing method, game image quality processing device, electronic equipment and computer storage medium | |
| WO2022157067A1 (en) | Determining a lighting device white point based on a display white point |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |