CN114422829A - HDR cloud video processing method, system and equipment - Google Patents

HDR cloud video processing method, system and equipment Download PDF

Info

Publication number
CN114422829A
CN114422829A CN202210113659.2A CN202210113659A CN114422829A CN 114422829 A CN114422829 A CN 114422829A CN 202210113659 A CN202210113659 A CN 202210113659A CN 114422829 A CN114422829 A CN 114422829A
Authority
CN
China
Prior art keywords
format
video data
hdr
client
current display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210113659.2A
Other languages
Chinese (zh)
Inventor
任妍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Wulian Technology Co ltd
Original Assignee
Hangzhou Wulian Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Wulian Technology Co ltd filed Critical Hangzhou Wulian Technology Co ltd
Priority to CN202210113659.2A priority Critical patent/CN114422829A/en
Publication of CN114422829A publication Critical patent/CN114422829A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4854—End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast

Abstract

The invention discloses a method, a system and equipment for processing HDR cloud video, which are characterized in that video data are captured by adopting a first format which is the same as the cache format of a display card at a host end, so that when the HDR is displayed at the host end, the video data of a current display picture are captured by adopting a format corresponding to HDR, the phenomenon that pixels with medium brightness in the video data in the HDR format become overexposed after being captured in the SDR format in the prior art is avoided, the dynamic range of the HDR video is correctly displayed at a client end, and the phenomenon of color overexposure is avoided.

Description

HDR cloud video processing method, system and equipment
Technical Field
The invention relates to the technical field of cloud games, in particular to a method, a system and equipment for processing HDR cloud video.
Background
With the development of the 5G network, the services of cloud games, cloud computers and the like are rapidly developed. The cloud game or the cloud computer is characterized in that a current display picture, audio data and cursor data of a host end are coded and then sent to a client end through a network, the current display picture, the audio data and the cursor data of the host end are decoded by the client end and then displayed on a screen of the client end and played, meanwhile, the client end sends data such as mouse displacement to the host end, operation corresponding to the data such as the mouse displacement is carried out on the host end, and the effect of controlling the host end through the client end in real time can be achieved.
The Dynamic Range of an HDR (High Dynamic Range) video can reach over 1000 nits, and compared with an SDR (Standard Dynamic Range) video, the HDR video has richer colors and stronger contrast, and brings people a feeling of being personally on the scene. In the current cloud game or cloud computer service, the HDR is not adapted correspondingly, and the format adopted when capturing the video data is different from the cache format of the video card at the host end. The video data in the HDR format cannot be mapped to the video format of the SDR one by one when the video data is captured, so that pixels with medium brightness in the video data in the HDR format become very bright when the video data is captured in the SDR format, and the dynamic range of the video data cannot be correctly displayed when a client displays the video data after the HDR is started at a host end, and the phenomenon of color overexposure occurs.
Disclosure of Invention
The invention aims to provide a method, a system and equipment for processing an HDR cloud video, so that the dynamic range of the HDR video is correctly displayed at a client, and the phenomenon of color overexposure is avoided.
In order to solve the above technical problem, the present invention provides an HDR cloud video processing method, including:
determining the cache format of a display card at a host end as a first format;
capturing video data of a current display picture at the host end according to the first format;
converting the video data in the first format into a second format receivable by an encoder;
and the encoder encodes the video data in the second format and then transmits the encoded video data to a client, so that the client can convert the video data in the second format into the video data in the first format and then display the video data in the first format after decoding the video data in the second format.
Preferably, before the encoder encodes the video data in the second format and sends the encoded video data to the client, the method further includes:
determining the EOTF and the color space of the current display picture;
judging whether the current display picture is HDR;
if the current display picture is HDR, acquiring metadata of the current display picture;
setting the encoder according to the EOTF and the color space of the current display picture;
the encoding of the video data in the second format by the encoder is then sent to a client, so that the client can convert the video data in the second format into the video data in the first format after decoding the video data in the second format and then display the video data in the first format on the client, and the method comprises the following steps:
and after the encoder encodes the video data in the second format, sending the metadata and the encoded video data to the client, so that the client can convert the video data in the second format into the video data in the first format after decoding the video data in the second format, and display the video data in the first format on the client after setting an exchange chain of a display card of the client according to the metadata.
Preferably, the determining whether the current display screen is HDR includes:
and judging whether the current display picture is HDR according to the color space.
Preferably, the determining whether the current display screen is HDR according to the color space includes:
when the color space is BT.2020 color space, the current display picture is determined to be HDR.
Preferably, the metadata includes:
and the coordinate value of the color space of the current display picture, and the picture maximum brightness, the picture minimum brightness value and the picture average brightness value of the current display picture.
Preferably, the setting, by the client, an exchange chain of the display card of the client according to the metadata includes:
normalizing the coordinate value of the color space of the current display picture and the picture maximum brightness, the picture minimum brightness value and the picture average brightness value of the current display picture;
setting a SetHDRMETADATA function interface according to the coordinate value of the color space of the normalized current display picture, the picture maximum brightness, the picture minimum brightness and the picture average brightness of the current display picture;
the switch chain is set up using the SetHDRMETADATA function interface.
Preferably, after the encoder is set according to the EOTF and the color space of the current display picture, the method further includes:
the QP bias parameter for luminance and the QP bias parameter for chrominance are set in the encoder.
Preferably, before converting the video data in the first format into a second format that can be received by an encoder, the method further includes:
and if the current display picture of the host end is HDR and the client end does not support displaying HDR, mapping the video data in the first format into SDR video data through tone mapping.
The invention also provides a system for processing the HDR cloud video, which comprises:
the first format determining unit is used for determining that the cache format of the display card at the host end is a first format;
the video data capturing unit is used for capturing the video data of the current display picture at the host end according to the first format;
a format conversion unit for converting the video data in the first format into a second format receivable by an encoder;
and the video data sending unit is used for coding the video data in the second format through the coder and then sending the coded video data to a client, so that the client can convert the video data in the second format into the video data in the first format and then display the video data in the first format on the client after decoding the video data in the second format.
The invention also provides an HDR cloud video processing device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the above HDR cloud video processing method when executing the computer program.
The invention provides a method, a system and equipment for processing HDR cloud video, which are characterized in that video data are captured in a first format which is the same as the cache format of a display card at a host end, so that when the host end displays HDR, the video data of a current display picture are captured in a format corresponding to HDR, the phenomenon that pixels with medium brightness in the video data in the HDR format become very bright when being displayed at a client end after being captured in the SDR format due to the capture of the HDR video in the SDR video format in the prior art is avoided, the dynamic range of the HDR video is correctly displayed at the client end, and the phenomenon of color overexposure is avoided.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed in the prior art and the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a flowchart of an HDR cloud video processing method provided in the present invention;
fig. 2 is a schematic structural diagram of an HDR cloud video processing system according to the present invention;
fig. 3 is a schematic structural diagram of an HDR cloud video processing apparatus provided in the present invention.
Detailed Description
The core of the invention is to provide a method, a system and equipment for processing an HDR cloud video, so that the dynamic range of the HDR video is correctly displayed at a client, and the phenomenon of color overexposure is avoided.
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1 in detail, fig. 1 is a flowchart of an HDR cloud video processing method provided in the present invention.
A HDR cloud video processing method includes:
s1: determining the cache format of a display card at a host end as a first format;
the buffer formats of the display cards at the host end are different when the HDR content and the SDR content are displayed, and various options are available. For example, when displaying HDR, the cache FORMAT of the graphics card is usually DXGI _ FORMAT _ R16G16B16a16_ FLOAT or DXGI _ FORMAT _ R10G10B10a10_ UNORM FORMAT, and when displaying SDR on the host side, the cache FORMAT of the graphics card is DXGI _ FORMAT _ R10G10B10a10_ UNORM or DXGI _ FORMAT _ R8G8B8A8_ UNORM. Therefore, in order to adapt the HDR display, so that the client can correctly display the dynamic range of the HDR when the HDR is turned on at the host, in this embodiment, it is required to determine the cache format of the graphics card at the host as the first format.
The first FORMAT herein may be, but is not limited to, DXGI _ FORMAT _ R16G16B16a16_ flow/DXGI _ FORMAT _ R10G10B10a10_ FORMAT/DXGI _ FORMAT _ R8G8B8A8_ FORMAT, which is not specifically limited in this application.
S2: capturing video data of a current display picture at a host end according to a first format;
when the current display picture at the host end is HDR, assuming that the video card buffer format is 16-bit integer, the range of the video data is 0-65535, and if the video data with the 16-bit format is captured in the 10-bit format, namely the HDR video with the SDR video format, the range of the captured video data is only 0-1024, and because the original video data, namely the video data with the range of 0-65535, is not mapped into the range of 0-1024 one by one when the video data of the current display picture at the host end is captured, the value larger than 1024 can be cut off and stored into 1024, so that the pixels with medium brightness in HDR become very bright, and the phenomenon of overexposure is generated. In order to solve the above problem, in this embodiment, the video data of the current display screen at the host end is captured in the first format that is the same as the cache format of the graphics card at the host end, that is, the same first format of the current display screen at the host end, so as to avoid display overexposure when the HDR is displayed at the host end due to the difference between the cache format of the graphics card at the host end and the format of the captured current display screen at the client end when the HDR is displayed at the host end.
S3: converting the video data in the first format into a second format that can be received by an encoder;
consider that the format used by the encoder in encoding and decoding is different from the format used when the video data is displayed by the host and client. Therefore, in order for the encoder to be able to normally encode and decode the video data of the currently displayed picture, it is necessary to convert the video data of the first format into the second format that the encoder can receive. For example, RGB-related FORMATs are typically used in display systems, while Y ' Cb ' Cr ' related FORMATs are typically used in encoders, with the first FORMAT DXGI _ FORMAT _ R16G16B16a16_ floor being P016 or YUV420P10LE, the first FORMAT DXGI _ FORMAT _ R10G10B10a10_ UNORM being YUV420P10LE, the first FORMAT DXGI _ FORMAT _ R8G8B8A8_ UNORM being YUV 420P.
It should be noted that, in order to convert the video data in the first format into the video data in the second format, the video data needs to be down-sampled, and the present application is not particularly limited thereto.
S4: and the video data in the second format is coded by the coder and then sent to the client, so that the client decodes the video data in the second format, converts the video data in the second format into the video data in the first format and then displays the video data in the first format.
In order to display the video data in the second format in the encoder at the client, after receiving the encoded video data in the second format sent by the host, the client decodes the video data in the second format, converts the video data in the second format into the video data in the first format, and displays the video data in the first format on a screen of the client. For example, FFmpeg conversion based on a CPU or CUDA (Unified computing Device Architecture) conversion based on a GPU (Graphics Processing Unit) may be used.
In addition, the encoder herein may be, but not limited to, an HEVC (High Efficiency Video Coding) encoder and an AVC (Advanced Video Coding), and the user may select the encoder according to a current display picture at the host end and an actual need, which is not limited in this application.
It should be further noted that, when the video data in the second format is restored to the video data in the first format, the video data needs to be upsampled through a filtering operation, so as to avoid color loss.
To sum up, in this embodiment, the video data is captured in the first format that is the same as the cache format of the graphics card at the host end, so that when the host end displays the HDR, since the video data of the current display picture is captured in the format corresponding to the HDR, a phenomenon that pixels with medium brightness in the video data in the HDR format become very bright when being displayed at the client end after being captured in the SDR format due to capturing the HDR video in the SDR video format in the prior art is avoided, so that the dynamic range of the HDR video is correctly displayed at the client end, and a phenomenon of color overexposure does not occur.
On the basis of the above embodiments
As a preferred embodiment, before the video data in the second format is encoded by the encoder and sent to the client, the method further includes:
determining an EOTF (Electrical-to-Optical Transfer Function) and a color space of a current display picture;
judging whether the current display picture is HDR;
if the current display frame is HDR, acquiring metadata of the current display frame;
setting an encoder according to the EOTF and the color space of the current display picture;
the method for transmitting the encoded video data in the second format to the client through the encoder so that the client can convert the video data in the second format into the video data in the first format and display the video data in the first format after decoding the video data in the second format comprises the following steps:
after the video data in the second format is coded by the coder, the metadata and the coded video data are sent to the client, so that the client can convert the video data in the second format into the video data in the first format after decoding the video data in the second format, and display the video data in the first format on the client after setting an exchange chain of a display card of the client according to the metadata.
Considering that the color space and EOTF of HDR and SDR are different, bt.2020 color space and PQ (Perceptual quantization) conversion curve are typical for HDR and bt.709 color space and gamma 2.2 curve are typical for SDR. If the bt.709 color space and the gamma 2.2 curve are used to set the encoding parameters of the encoder when the current display picture is HDR at the host, it will result in dim color when the HDR picture is displayed at the client. In order to solve the above problem, in this embodiment, the EOTF and the COLOR SPACE of the current display screen at the host end are determined, for example, the DXGIOutput6 is used to query the COLOR SPACE of the current display screen at the host end through the GetDesc interface, if DXGI _ COLOR _ SPACE _ RGB _ FULL _ G2084_ NONE _ P2020, it indicates that the current display screen at the host end is the bt.2020 COLOR SPACE, and if DXGI _ COLOR _ ce _ RGB _ FULL _ G22_ NONE _ P709, it indicates that the current display screen at the host end is the bt.709 COLOR SPACE. The encoding parameters of the encoder are set according to the EOTF and the color space of the current display picture at the host end, for example, the level of the encoder is set to main10 profile or main profile according to the color space and the conversion curve of the current display picture at the host end, and syntax elements such as video _ signal _ type _ present _ flag, color _ description _ present _ flag, color _ priorities, transfer _ characteristics, and matrix _ coeffs in SPS (Sequence parameter set) are set. Because the HDR video has a unique attribute of metadata, but the SDR does not, and the metadata includes coordinate values and brightness of a color space of the HDR video and other related parameters, when a current display screen at the host end is HDR, a swap chain of a video card of the client needs to be set according to the metadata of the HDR, otherwise, a phenomenon of dim color also occurs. In this embodiment, it is determined whether the current display screen of the host is HDR, and when the current display screen of the host is HDR, the metadata of the current display screen of the host is obtained and sent to the client, and before the client displays the video data in the first format, the swap chain of the display card of the client is set according to the metadata, so that the dynamic range of HDR is correctly displayed, and a phenomenon of dim color is avoided.
As a preferred embodiment, the determining whether the current display screen is HDR includes:
and judging whether the current display picture is HDR according to the color space.
Considering that when displaying HDR and SDR pictures on the host side, the color spaces of the graphics cards on the host side are different, for example, bt.2020 color space is common for HDR and bt.709 color space is common for SDR. Therefore, in the embodiment, whether the current display picture of the host side is HDR is judged according to the color space, the detection of HDR is realized, and the realization mode is simple.
As a preferred embodiment, the determining whether the current display picture is HDR according to the color space includes:
when the color space is the bt.2020 color space, the current display screen is determined to be HDR.
Since HDR is generally bt.2020 color space in a cloud computer or a cloud game system, in the present embodiment, when the color space is bt.2020 color space, it is determined that the current display screen is HDR.
As a preferred embodiment, the metadata includes:
the coordinate value of the color space of the current display picture, the picture maximum brightness, the picture minimum brightness value and the picture average brightness value of the current display picture.
In the present embodiment, the metadata includes coordinate values of the color space of the current display screen, such as a red primary color coordinate value, a blue primary color coordinate value, a green primary color coordinate value, and a white point coordinate value. The metadata further includes a picture maximum luminance, a picture minimum luminance, and a picture average luminance of the currently displayed picture.
It should be noted that, since the coordinate value of the color space of the current display screen is a fixed value, the coordinate value may be acquired only once, or may be acquired periodically or in real time. However, as for the real-time change of the maximum brightness, the minimum brightness and the average brightness of the current display image, it is considered that human eyes cannot detect the change of brightness within a certain range, so the maximum brightness, the minimum brightness and the average brightness of the previous display image can be obtained in real time or periodically, and the present application is not limited thereto.
As a preferred embodiment, the client sets a swap chain of the display card of the client according to the metadata, including:
normalizing the coordinate value of the color space of the current display picture, the picture maximum brightness, the picture minimum brightness value and the picture average brightness value of the current display picture;
setting a SetHDRMETADATA function interface according to the normalized coordinate value of the color space of the current display picture, the maximum picture brightness, the minimum picture brightness and the average picture brightness of the current display picture;
the switch chain is set up using the SetHDRMETADATA function interface.
In this embodiment, when setting the swap chain of the display card, the coordinate value of the color space of the current display screen, the maximum brightness of the current display screen, the minimum brightness of the current display screen, and the average brightness of the current display screen are normalized, and then the relevant setting item in the SetHDRMETADATA function interface, for example DXGI _ HDR _ METADATA in the SetHDRMETADATA function interface, is set according to the coordinate value of the color space of the normalized current display screen, the maximum brightness of the current display screen, the minimum brightness of the current display screen, and the average brightness of the current display screen. The exchange chain of the client's video card is then set using the SetHDRMETADATA function interface, so that the dynamic range of the HDR video in the first format can be displayed correctly at the client.
As a preferred embodiment, after setting the encoder according to the EOTF and the color space of the current display picture, the method further comprises:
a QP (Quantizer Parameter) bias Parameter for luminance and a QP bias Parameter for chrominance are set in the encoder.
In this embodiment, in order to compensate for the loss caused by the chrominance leakage, a QP offset parameter for luminance and a QP offset parameter for chrominance are set in the encoder, thereby further ensuring that the dynamic range of HDR can be displayed correctly at the client.
As a preferred embodiment, before converting the video data in the first format into the second format that can be received by the encoder, the method further includes:
and if the current display picture of the host end is HDR and the client end does not support displaying HDR, mapping the video data in the first format into SDR video data through tone mapping.
It is considered that if the HDR is supported by the host, the client only supports the SDR, that is, the client cannot convert the video data in the second format back to the video data in the first format, so that the client cannot normally display the received video data. In order to solve the above problem, in this embodiment, when the current display screen at the host end is HDR and the client does not support displaying HDR, before converting the video data in the first format into the second format, the video data in the first format, that is, the video data in the HDR, is tone-mapped into the video data in the SDR format, so that the client can display the screen at the host end after receiving the video data. After the HDR video data is tone-mapped to the SDR-formatted video data, the coding parameter settings of the encoder and the relevant settings for the on-screen display at the client are set according to the SDR-related parameters, which is not particularly limited in this application.
It should be further noted that, when one host end is correspondingly connected with a plurality of clients, and a current display picture of the host end is HDR, if a part of the clients among the plurality of clients support HDR, for a client supporting HDR, the host end converts video data in a first format into video data in a second format and then sends the video data to the client supporting HDR, so that the client supporting HDR converts video in the second format into HDR video data in the first format and displays HDR; for the client which does not support HDR, the video data in the first format is tone-mapped into the video data of the SDR and then is sent to the client which does not support HDR, so that the client which does not support HDR displays the video data of the SDR.
Specifically, referring to fig. 2, fig. 2 is a schematic structural diagram of an HDR cloud video processing system provided in the present invention.
The invention also provides a system for processing the HDR cloud video, which comprises:
a first format determining unit 21, configured to determine that a cache format of a graphics card at a host end is a first format;
a video data capture unit 22, configured to capture video data of a current display screen at a host end according to a first format;
a format conversion unit 23 for converting the video data in the first format into a second format receivable by the encoder;
and the video data sending unit 24 is configured to send the encoded video data in the second format to the client through the encoder, so that the client decodes the video data in the second format, converts the video data in the second format into the video data in the first format, and displays the video data in the first format on the client.
Specifically, referring to fig. 3, fig. 3 is a schematic structural diagram of an HDR cloud video processing apparatus provided in the present invention.
The invention also provides an HDR cloud video processing device, comprising:
a memory 31 for storing a computer program;
a processor 32, configured to implement the steps of the HDR cloud video processing method as described above when executing the computer program.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. An HDR cloud video processing method, comprising:
determining the cache format of a display card at a host end as a first format;
capturing video data of a current display picture at the host end according to the first format;
converting the video data in the first format into a second format receivable by an encoder;
and the encoder encodes the video data in the second format and then transmits the encoded video data to a client, so that the client can convert the video data in the second format into the video data in the first format and then display the video data in the first format after decoding the video data in the second format.
2. The HDR cloud video processing method of claim 1, wherein before encoding the video data in the second format by the encoder and sending the encoded video data to a client, further comprising:
determining the EOTF and the color space of the current display picture;
judging whether the current display picture is HDR;
if the current display picture is HDR, acquiring metadata of the current display picture;
setting the encoder according to the EOTF and the color space of the current display picture;
the encoding of the video data in the second format by the encoder is then sent to a client, so that the client can convert the video data in the second format into the video data in the first format after decoding the video data in the second format and then display the video data in the first format on the client, and the method comprises the following steps:
and after the encoder encodes the video data in the second format, sending the metadata and the encoded video data to the client, so that the client can convert the video data in the second format into the video data in the first format after decoding the video data in the second format, and display the video data in the first format on the client after setting an exchange chain of a display card of the client according to the metadata.
3. The HDR cloud video processing method of claim 2, wherein determining whether the current display is HDR comprises:
and judging whether the current display picture is HDR according to the color space.
4. The HDR cloud video processing method of claim 3, wherein determining whether the current display picture is HDR according to the color space comprises:
when the color space is BT.2020 color space, the current display picture is determined to be HDR.
5. The HDR cloud video processing method of claim 2, wherein the metadata comprises:
and the coordinate value of the color space of the current display picture, and the picture maximum brightness, the picture minimum brightness value and the picture average brightness value of the current display picture.
6. The HDR cloud video processing method of claim 5, wherein the client sets a swap chain of the graphics cards of the client according to the metadata, comprising:
normalizing the coordinate value of the color space of the current display picture and the picture maximum brightness, the picture minimum brightness value and the picture average brightness value of the current display picture;
setting a SetHDRMETADATA function interface according to the coordinate value of the color space of the normalized current display picture, the picture maximum brightness, the picture minimum brightness and the picture average brightness of the current display picture;
the switch chain is set up using the SetHDRMETADATA function interface.
7. The HDR cloud video processing method of claim 2, wherein after setting the encoder according to the EOTF and the color space of the current display picture, further comprising:
the QP bias parameter for luminance and the QP bias parameter for chrominance are set in the encoder.
8. The HDR cloud video processing method of any of claims 1 to 7, wherein before converting the video data in the first format into a second format receivable by an encoder, further comprising:
and if the current display picture of the host end is HDR and the client end does not support displaying HDR, mapping the video data in the first format into SDR video data through tone mapping.
9. An HDR cloud video processing system, comprising:
the first format determining unit is used for determining that the cache format of the display card at the host end is a first format;
the video data capturing unit is used for capturing the video data of the current display picture at the host end according to the first format;
a format conversion unit for converting the video data in the first format into a second format receivable by an encoder;
and the video data sending unit is used for coding the video data in the second format through the coder and then sending the coded video data to a client, so that the client can convert the video data in the second format into the video data in the first format and then display the video data in the first format on the client after decoding the video data in the second format.
10. An HDR cloud video processing device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the HDR cloud video processing method of any of claims 1 to 8 when executing the computer program.
CN202210113659.2A 2022-01-30 2022-01-30 HDR cloud video processing method, system and equipment Pending CN114422829A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210113659.2A CN114422829A (en) 2022-01-30 2022-01-30 HDR cloud video processing method, system and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210113659.2A CN114422829A (en) 2022-01-30 2022-01-30 HDR cloud video processing method, system and equipment

Publications (1)

Publication Number Publication Date
CN114422829A true CN114422829A (en) 2022-04-29

Family

ID=81278522

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210113659.2A Pending CN114422829A (en) 2022-01-30 2022-01-30 HDR cloud video processing method, system and equipment

Country Status (1)

Country Link
CN (1) CN114422829A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050162436A1 (en) * 2000-08-23 2005-07-28 Nintendo Co., Ltd. Graphics system with embedded frame buffer having reconfigurable pixel formats
WO2018032696A1 (en) * 2016-08-19 2018-02-22 广州视睿电子科技有限公司 Method and system for desktop screenshot control
CN109274985A (en) * 2018-10-12 2019-01-25 腾讯科技（深圳）有限公司 Video transcoding method, device, computer equipment and storage medium
CN109840058A (en) * 2019-01-07 2019-06-04 烽火通信科技股份有限公司 Cloud game collecting method and system
CN111246050A (en) * 2014-02-25 2020-06-05 苹果公司 System, apparatus and method for video data processing
CN111346378A (en) * 2020-02-26 2020-06-30 腾讯科技（深圳）有限公司 Game picture transmission method, device, storage medium and equipment
CN111654720A (en) * 2020-07-17 2020-09-11 腾讯科技（深圳）有限公司 Video coding method, device, equipment and readable storage medium
CN112422868A (en) * 2020-10-14 2021-02-26 西安万像电子科技有限公司 Data processing method, terminal device and server

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050162436A1 (en) * 2000-08-23 2005-07-28 Nintendo Co., Ltd. Graphics system with embedded frame buffer having reconfigurable pixel formats
CN111246050A (en) * 2014-02-25 2020-06-05 苹果公司 System, apparatus and method for video data processing
WO2018032696A1 (en) * 2016-08-19 2018-02-22 广州视睿电子科技有限公司 Method and system for desktop screenshot control
CN109274985A (en) * 2018-10-12 2019-01-25 腾讯科技（深圳）有限公司 Video transcoding method, device, computer equipment and storage medium
CN109840058A (en) * 2019-01-07 2019-06-04 烽火通信科技股份有限公司 Cloud game collecting method and system
CN111346378A (en) * 2020-02-26 2020-06-30 腾讯科技（深圳）有限公司 Game picture transmission method, device, storage medium and equipment
CN111654720A (en) * 2020-07-17 2020-09-11 腾讯科技（深圳）有限公司 Video coding method, device, equipment and readable storage medium
CN112422868A (en) * 2020-10-14 2021-02-26 西安万像电子科技有限公司 Data processing method, terminal device and server

Similar Documents

Publication Publication Date Title
US10368105B2 (en) Metadata describing nominal lighting conditions of a reference viewing environment for video playback
US10805606B2 (en) Encoding method and device and decoding method and device
WO2019210822A1 (en) Video encoding and decoding method, device, and system, and storage medium
CN105959724B (en) Video data processing method and device
TWI339072B (en) Systems and methods for decoding large images
AU2015276393B2 (en) Method and device for signaling in a bitstream a picture/video format of an LDR picture and a picture/video format of a decoded HDR picture obtained from said LDR picture and an illumination picture
WO2020135357A1 (en) Data compression method and apparatus, and data encoding/decoding method and apparatus
CN113041617B (en) Game picture rendering method, device, equipment and storage medium
EP1850290B1 (en) Image processing apparatus and method for preventing degradation of image quality when bit format of image is converted
CN107409223B (en) Video coding and decoding method and video coder-decoder
KR101248902B1 (en) Image processing apparatus and method having function of image correction based on luminous intensity around
CN114467298B (en) Image signal conversion processing method and device and terminal equipment
US10757426B2 (en) Method and apparatus for processing image data
CN114422829A (en) HDR cloud video processing method, system and equipment
CN111526366B (en) Image processing method, image processing apparatus, image capturing device, and storage medium
CN114827620A (en) Image processing method, apparatus, device and medium
CN107241199B (en) Image processing method and device for conference terminal
CN108370442B (en) Method and device for processing high dynamic range image and computer readable storage medium
US11792359B2 (en) Efficient electro-optical transfer function (EOTF) curve for standard dynamic range (SDR) content
WO2022247066A1 (en) High dynamic range scene cut detection
KR20170033471A (en) Method and apparatus for decoding hdr and sdr video with supplemental information of tone-mapping
CN116051369A (en) Virtual desktop image processing method, device and storage medium
CN115883827A (en) Video coding quantization method, device, equipment and computer readable storage medium
KR20070070626A (en) Imaging device and image correcting method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination