CN113676773A - Video playing method, system, device, computer equipment and storage medium - Google Patents
Video playing method, system, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113676773A CN113676773A CN202110938403.0A CN202110938403A CN113676773A CN 113676773 A CN113676773 A CN 113676773A CN 202110938403 A CN202110938403 A CN 202110938403A CN 113676773 A CN113676773 A CN 113676773A
- Authority
- CN
- China
- Prior art keywords
- video stream
- stream data
- hdr
- ldr
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 238000005457 optimization Methods 0.000 claims abstract description 80
- 238000012545 processing Methods 0.000 claims abstract description 68
- 238000013507 mapping Methods 0.000 claims abstract description 51
- 230000006870 function Effects 0.000 claims description 31
- 230000008569 process Effects 0.000 claims description 17
- 238000012549 training Methods 0.000 claims description 17
- 230000002708 enhancing effect Effects 0.000 claims description 6
- 238000004806 packaging method and process Methods 0.000 claims description 5
- 238000010801 machine learning Methods 0.000 claims description 4
- 239000000126 substance Substances 0.000 claims description 2
- 241000023320 Luma <angiosperm> Species 0.000 claims 3
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 claims 3
- 230000000750 progressive effect Effects 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 8
- 238000006243 chemical reaction Methods 0.000 description 6
- 238000009877 rendering Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 230000009466 transformation Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000001965 increasing effect Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 239000007991 ACES buffer Substances 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000003796 beauty Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
Abstract
The embodiment of the invention discloses a video playing method, a video playing system, a video playing device, computer equipment and a storage medium. The method comprises the following steps: obtaining HDR video stream, and decoding the HDR video stream to obtain HDR decoding data; mapping the HDR decoding data to obtain basic LDR video stream data to be optimized; and performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and performing video playing. The technical scheme of the embodiment of the invention can map the HDR video stream into the LDR video stream, and realize playing the HDR video stream on the existing display; meanwhile, the basic LDR video stream data is optimized step by step, so that more HDR characteristics can be reserved when the video is played, the playing performance of the conventional display is improved, and the image quality of the conventional display is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of video processing, in particular to a video playing method, a video playing system, a video playing device, computer equipment and a storage medium.
Background
High-Dynamic Range (HDR) is a new technology that has emerged in the movie industry in recent years. HDR has a wider color Range, higher order of magnitude of luminance difference, compared to Standard-Dynamic Range (SDR).
However, HDR comes from the television side rather than the mobile side, and the pull-out time of HDR on the mobile side is short. At present, the number of third-party tools for realizing HDR video stream data rendering on a mobile terminal is small, and the technology is immature, so that the HDR is difficult to be directly played on the existing display.
Disclosure of Invention
The embodiment of the invention provides a video playing method, a video playing system, a video playing device, computer equipment and a storage medium, which can realize that the HDR video stream is played by the conventional display, and simultaneously improve the playing performance of the display so as to improve the image quality of the display.
In a first aspect, an embodiment of the present invention provides a video playing method, including:
the method comprises the steps of obtaining an HDR video stream distributed by a server, and decoding the HDR video stream to obtain HDR decoding data;
mapping the HDR decoding data to obtain basic LDR video stream data to be optimized;
and performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and performing video playing on the target LDR video stream data.
In a second aspect, an embodiment of the present invention further provides a video playing system, where the system includes: a collector, a server and a player; wherein:
the collector is used for collecting SDR video stream and transmitting the SDR video stream to the server;
the server is used for decoding the SDR video stream to obtain SDR video stream data; enhancing the SDR video stream data to obtain high dynamic range HDR video stream data corresponding to the SDR video stream data; transcoding and packaging the HDR video stream data to obtain an HDR video stream, and transmitting the HDR video stream to a distribution network;
the player is configured to map the HDR video stream distributed by the server into target LDR video stream data and perform video playing on the target LDR video stream data by using the video playing method according to any embodiment of the present invention.
In a third aspect, an embodiment of the present invention further provides a video playing apparatus, including:
the HDR decoding data acquisition module is used for acquiring an HDR video stream distributed by a server and decoding the HDR video stream to obtain HDR decoding data;
a basic LDR video stream data determining module, configured to perform mapping processing on the HDR decoded data to obtain basic LDR video stream data to be optimized;
and the video playing module is used for optimizing the basic LDR video stream data step by step according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data and playing the target LDR video stream data.
In a fourth aspect, an embodiment of the present invention further provides a computer device, where the computer device includes:
one or more processors; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a video playback method according to any of the embodiments of the present invention.
In a fifth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a computer, implements the video playing method provided in any embodiment of the present invention.
According to the technical scheme of the embodiment of the invention, HDR decoding data is obtained by acquiring HDR video stream and decoding the HDR video stream; mapping the HDR decoding data to obtain basic LDR video stream data to be optimized; and performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and performing video playing. The technical scheme of the embodiment of the invention can map the HDR video stream into the LDR video stream, and realize playing the HDR video stream on the existing display; meanwhile, the basic LDR video stream data is optimized step by step, so that more HDR characteristics can be reserved when the video is played, the playing performance of the conventional display is improved, and the image quality of the conventional display is improved.
Drawings
Fig. 1 is a flowchart of a video playing method according to an embodiment of the present invention;
fig. 2a is a schematic structural diagram of a video playing system according to a second embodiment of the present invention;
fig. 2b is an interaction diagram of a video playing system according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a video playback device in an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example one
Fig. 1 is a flowchart of a video playing method according to an embodiment of the present invention, which is applicable to a case where a player does not support rendering of an HDR video stream, and the present embodiment is particularly applicable to a case where the player performs high-quality playing on the HDR video stream in live broadcasting. The method may be performed by a video playback apparatus, which may be implemented by means of software and/or hardware, and may be generally integrated in a computer device (e.g., various intelligent terminals). As shown in fig. 1, the method includes:
and 110, acquiring the HDR video stream distributed by the server, and decoding the HDR video stream to obtain HDR decoded data.
Dynamic Range (DR) is a term used to mathematically describe the Range of luminance levels for a given scene. The ratio of the image from the brightest to the darkest is defined, namely the number of gray levels divided between the brightest and the darkest of the image; the larger the DR is, the richer the gradation that can be expressed, and the wider the color space included.
HDR video streams refer to images that contain levels of highlights and/or details of the shadows beyond the capabilities of conventional video systems. HDR imaging provides a broader range of tones for content creators, extending the range from darkest to brightest in an image. This can be used to present more realistic images with higher contrast, darker dark portions and lighter bright portions.
In the embodiment of the present invention, the HDR video stream distributed by the server may have a plurality of acquisition manners. For example, the server may obtain an HDR video stream from a video collector, and perform transcoding and packaging operations on the HDR video stream, and distribute the operations to a distribution network, so that the player obtains the HDR video stream. Or, the server may obtain an SDR video stream or a Low Dynamic Range (LDR) video stream from the video collector, perform HDR enhancement processing on the SDR video stream or the LDR video stream, convert the SDR video stream or the LDR video stream into an HDR video stream, perform transcoding encapsulation and other operations, and distribute the HDR video stream to a distribution network, so that the player obtains the HDR video stream. The processing procedure of the received video stream by the server depends on the format of the video stream acquired by the server at the collector. The video playing method provided by the embodiment of the invention can support the communication connection with collectors and servers with various performances, and the technical scheme of the embodiment of the invention does not limit the communication connection.
The decoding processing method of the HDR video stream by the player may correspond to the encoding method of the HDR video stream. For example, the decoding processing manner of the HDR video stream may be to set a decoder to a flag of HEVC _ Main10 at the player end, and start a decoding service of the HDR video stream.
And step 120, mapping the HDR decoding data to obtain basic LDR video stream data to be optimized.
And when the video is played, the video is specifically displayed through a display of the player. The principle of the display is to turn the power on and off to control an optical response of the transmitted light switch. The pixel respectively inputs signal voltage data with different sizes, the rotation states of liquid crystal molecules under different voltages are different, and the rotation degrees of linearly polarized light are also different, so that the components on a transmission shaft of the analyzer are different, namely the emergent light brightness is different, and the multi-gray-scale image display is realized. The illumination brightness values and color tristimulus values displayed by the display are referred to as LDR brightness values and LDR color tristimulus values.
When a display displays images or videos, input data is raw data of RGBA (three primary colors and color space), and the display converts the image data into an Optical signal output by a screen, i.e., Electro-Optical Transfer Function (EOTF) processing. However, HDR is a 10 bit (bit) data source, and SDR or LDR is 8 bit. HDR has more luminance, deeper bit depth, and wider color gamut. Therefore, unless the display itself supports HDR display, the display cannot normally display HDR images or videos.
In the embodiment of the invention, HDR can be mapped, and the mapped basic LDR is further optimized, so that HDR is normally displayed on a display which does not support HDR display, and the requirement of viewing experience of people is met.
The mapping process for HDR can be implemented in various ways, for example, the mapping process for HDR can be implemented by a standard tone mapping function. The standard tone mapping function may be a function generated by an algorithm corresponding to the tone mapping technique. For example, the standard Tone Mapping function may be a function generated by one or more Tone Mapping technique algorithms of mpv algorithm (an empirical Tone Mapping algorithm), ACES algorithm (a film Tone Mapping algorithm), cable algorithm (a fitting Tone Mapping algorithm), base Tone Mapping algorithm (TMP), bt.2390 algorithm, st.2084 algorithm, or the like.
Illustratively, the mpv algorithm may be
Wherein n, m, b, c, d, e represent fine tuning constants; the brightness can be integrally improved by adjusting n and m, the contrast can be reduced by adjusting b and c, and the contrast can be improved by adjusting d and e; src color represents RGBA raw data of HDR decoded data input at the display; color represents the RGBA data of the underlying LDR video stream. The user can freely adjust the HDR decoding data through the mpv algorithm, so that the display can show more characteristics of HDR according to the user requirement, and the image quality is improved.
As yet another example, the base TMP algorithm can be
a. b, c, d, e represent fine tuning constants; src color represents RGBA raw data of HDR decoded data input at the display; color represents the RGBA data of the underlying LDR video stream. User freedom for HDR decoded data can be achieved through the underlying TMP algorithmThe adjustment enables the display to show more characteristics of HDR according to the user requirement, and the image quality is improved. One exemplary case is where a, b, c, d, e may be 2.51, 0.03, 2.43, 0.59, 0.14, respectively.
As another example, in the embodiment of the present invention, the tone mapping technique bt.2390 algorithm may be:
wherein m is1、m2、c1、c2、c3Is a fine tuning constant; src color represents RGBA raw data of HDR decoded data input at the display; color represents the RGBA data of the underlying LDR video stream. The free adjustment of the HDR decoding data by the user can be realized through the BT.2390 algorithm, so that the display can show more characteristics of HDR according to the requirements of the user, and the image quality is improved.
Specifically, when the player is a different operating system, different standard tone mapping functions may be used. For example, when the player supports the Android operating system, an mpv algorithm, an ACES algorithm, a able algorithm, a basic TMP algorithm, or a bt.2390 algorithm may be employed. As another example, when the player supports the iOS operating system, the st.2084 algorithm may be employed. For the Android operating system, the image quality of the image displayed by the display can be better by executing the step 130. For the iOS operating system, the step 130 may not be executed, and the HDR rendering presentation may be implemented by using the conversion technology underlying the iOS operating system. In the following description, the bt.2390 algorithm is used as an example when the player supports the Android operating system, and the technical scheme of the embodiment of the present invention is described.
And step 130, performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and performing video playing on the target LDR video stream data.
The preset optimization algorithm and the optimization parameters may be algorithms and parameters for further performing optimization processing on the HDR decoded data on the basis of the standard tone mapping function. Specifically, the preset optimization algorithm and the optimization parameters may be function adjustment operations and further parameter optimization operations based on a standard tone mapping function, so that target LDR video stream data is closer to ideal LDR video stream data, and when a display performs video playing based on the target LDR video stream data, more HDR characteristics are retained, the brightness of a light source is reduced as truly as possible, the image quality is improved, and the image appearance is closer to the effect of direct vision of human eyes.
In an optional implementation manner of the embodiment of the present invention, before performing the gradual optimization processing on the base LDR video stream data according to the preset optimization algorithm and the optimization parameters, the method further includes: obtaining multiple sample HDR video stream data, and mapping each sample HDR video stream data through a standard tone mapping function to obtain a comparison mapping result; and fitting according to the correlation between each comparison mapping result and the ideal LDR video stream data of each sample HDR video stream data to obtain an optimization algorithm and optimization parameters.
The ideal LDR video stream data may be understood as input data corresponding to a picture with the highest quality that can be displayed when the display performs HDR display. The ideal LDR video stream data may have multiple acquisition modes, for example, by performing constant parameter tuning on the display. And the comparison mapping result and the corresponding ideal LDR video stream data have a gap. In the embodiment of the invention, data fitting can be carried out through the fitting curve, and the data relation between the comparison mapping result and the corresponding ideal LDR video stream data is obtained. The data relationship may be specifically represented by an optimization algorithm and optimization parameters. The embodiment of the present invention does not specifically limit the fitting algorithm.
In an optional implementation manner of the embodiment of the present invention, performing a step-by-step optimization processing on the base LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data includes: determining a first brightness increase according to the basic LDR video stream data, and determining a second brightness increase according to the first brightness increase; and determining target LDR video stream data according to the preset optimization parameter, the first brightness increment and the second brightness increment.
In the physical world, if the intensity of light is doubled, the brightness is also doubled, that is, the intensity of light and the brightness satisfy a linear relationship. In the display, the voltage is doubled, and the brightness is not doubled, i.e. the display output brightness is not linear with the voltage. The first brightness increase value may be obtained by performing a parameter adjustment process on the underlying LDR video stream data in order to provide better display capability of the video stream data in the display. The second luminance increase amount may be obtained by continuing to perform the parameter adjustment on the basis of the first luminance increase amount. The specific parameter adjustment process can be determined according to the correlation between the output brightness and the voltage of the display.
Specifically, in an optional implementation manner of the embodiment of the present invention, determining a first luminance increase amount according to the base LDR video stream data, and determining a second luminance increase amount according to the first luminance increase amount includes: determining a first brightness increment of the basic LDR video stream data according to the incidence relation between the video brightness increment value and the voltage increment value during video playing and the basic LDR video stream data; and determining a second brightness increase of the basic LDR video stream data according to the incidence relation between the video brightness increase value and the voltage increase value and the first brightness increase.
Among them, the inventors have studied and found that the relationship between the luminance increase amount and the voltage increase amount is generally a power function relationship. For example, the brightness increase of a certain display is equal to the voltage increase raised to the power of 2.2, where 2.2 is referred to as the Gamma value (Gamma) of the display.
In the embodiment of the present invention, the association relationship between the video brightness increase value and the voltage increase value during video playing can be understood as a power function relationship under a certain gamma value. The inventor finds in research that the basic LDR video stream data is adjusted through the correlation between the video brightness increase value and the voltage increase value during video playing to obtain the first brightness increase amount of the basic LDR video stream data, so that clear display can be better performed in a display.
Specifically, in an optional implementation manner of the embodiment of the present invention, determining, according to an association relationship between a video brightness increase value and a voltage increase value during video playing and the base LDR video stream data, a first brightness increase amount of the base LDR video stream data includes: and performing power operation processing on the basic LDR video stream data to obtain a first brightness increment.
Wherein the exponentiation process may be a process of obtaining the target value by a deformation process in the form of an exponentiation function. For example, can be
Determining a first luminance increase of the underlying LDR video stream data, wherein n1Is a constant, E0Underlying LDR video stream data. Wherein n is1As a fine tuning parameter, can be understood a compensation adjustment of the gamma value,
which may be understood as a compensation adjustment to the underlying LDR video stream data. n is1The mapping result can be obtained by matching the correlation between the mapping result and the corresponding ideal LDR video stream data.
Can be understood as the relationship between the video brightness increase value and the voltage increase value during video playing, i.e. the gamma value is n1The power functional relationship of (c).
The inventors found in practical studies that merely determining the first luminance increase amount of the base LDR video stream data according to the correlation between the video luminance increase value and the voltage increase value at the time of video playback and the base LDR video stream data still does not ideally represent HDR in a display. Therefore, the second luminance increase amount of the base LDR video stream data is determined based on the first luminance increase amount, and display optimization is continued.
Specifically, the first brightness increase amount may be further transformed based on the correlation between the video brightness increase value and the voltage increase value, and a second brightness increase amount of the base LDR video stream data may be determined, thereby further improving the display performance of the display.
Further modification to the first luminance increase amount may be performed in various ways, for example, linear transformation of the first luminance increase amount may be performed, or a modification form in the standard tone mapping function when mapping processing is performed on HDR decoded data may be referred to. The best performance mode among the plurality of modes can be determined as a specific mode for the first luminance increase amount.
Further, in an optional implementation manner of the embodiment of the present invention, determining the second luminance increase amount of the base LDR video stream data according to the association relationship between the video luminance increase value and the voltage increase value, and the first luminance increase amount, includes: and performing fractional linear operation processing and power operation processing on the first brightness increment to obtain a second brightness increment.
Wherein the fractional linear operation may be in the form of a first brightness increase
Deformation treatment of (c)1、c2、c3And c4Is a constant. For example, can be
Determining a second brightness increase of the base LDR video stream data, wherein c1、c2、c3And n2Is a constant.
In the embodiment of the present invention, it is,
it can be understood as a specific modification to the first luminance increasing amount determined by the embodiment of the present invention.
Can be understood as the relationship between the video brightness increase value and the voltage increase value, i.e. the gamma value is n2The power functional relationship of (c). c. C1、c2、c3And n2Can be obtained by comparing the mapping result with the corresponding ideal LDR video stream dataAnd fitting the correlation relationship to obtain the target.
Further, in order to refine some subtle features in the display, the second brightness increase amount may be deformed, so that the obtained final optimization algorithm may better satisfy the correlation between the mapping result and the corresponding ideal LDR video stream data. The second luminance increase amount may be modified in the same manner as or different from the first luminance increase amount. For example, the second luminance increase amount may be subjected to a linear transformation and/or a power function form transformation at a different value.
Specifically, in an optional implementation manner of the embodiment of the present invention, determining target LDR video stream data according to a preset optimization parameter, a first brightness increase amount, and a second brightness increase amount includes: performing fractional linear operation processing, power operation processing and multiple function operation processing on the first brightness increase value according to preset optimization parameters to determine target LDR video stream data; or, according to preset optimization parameters, performing multiple times of function operation processing on the second brightness increment to determine target LDR video stream data.
The first brightness increased value may be subjected to fractional linear operation and power operation to obtain a variable in the form of the second brightness increased value, and then subjected to multiple functional operation to obtain target LDR video stream data. Alternatively, the second luminance increase amount may be directly subjected to the function operation processing a plurality of times. The multiple function operation may be performed on the target parameter in the form of d0Em+d1Em-1+...+dmObtaining a target value, wherein d0、d1…dmIs a constant; e is a target parameter, e.g. E2Or the shape of E2The parameters of (1); m is the number of times of multiple functional operation processing and is a constant.
Specifically, in the embodiment of the present invention, the target LDR video stream data may be represented by the following formula: PB is (2 TB)3-3TB2+1)KS+(TB3-2TB2+TB)(1-KS)+(-2TB3+3TB2) maxLum determination. Wherein, PB is target LDR video stream data; maxLum is a preset optimization parameter; KS and pretreatSetting optimization parameters to be linearly related; TB is linearly related to the second luminance increase amount.
Where TB may be understood as a linear transformation of the second brightness increase amount, in particular,
KS 1.5 maxLum-0.5. maxLum is a preset optimization parameter, and can be an adjustment after the final comparison is fitted to the incidence relation between the mapping result and the corresponding ideal LDR video stream data. 2TB3-3TB2+1、TB3-2TB2+ TB and-2 TB3+3TB2It is understood that the processing is performed as a plurality of times of function operations at different values of the second luminance increase amount.
According to the technical scheme of the embodiment of the invention, the target LDR video stream data is obtained by optimizing the basic LDR video stream data step by step according to the preset optimization algorithm and the optimization parameters, so that more LDR signals output by the display have HDR performance, the original image quality performance of HDR is not lost while the HDR rendering problem is solved, the method and the device can be suitable for terminals which do not support HDR rendering and playing, and the compatibility problem of the terminals is solved. It should be noted that the above process of converting HDR into LDR is also applicable to converting HDR into SDR for video playing.
According to the technical scheme of the embodiment of the invention, HDR decoding data is obtained by acquiring HDR video stream and decoding the HDR video stream; mapping the HDR decoding data to obtain basic LDR video stream data to be optimized; and performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and performing video playing. The technical scheme of the embodiment of the invention solves the mapping problem of HDR video stream and the problem that HDR video stream is played on playing equipment without HDR compatibility, can map the HDR video stream into LDR video stream, and realizes playing the HDR video stream on the existing display; meanwhile, the basic LDR video stream data is optimized step by step, so that more HDR characteristics can be reserved when the video is played, the playing performance of the conventional display is improved, the image quality of the conventional display is improved, and more sensory experience is brought to a user.
Example two
Fig. 2a is a schematic structural diagram of a video playing system in a second embodiment of the present invention, and as shown in fig. 2a, the system in this embodiment may include: collector 210, server 220, and player 230; wherein:
as shown in fig. 2a, the collector 210 is configured to collect an SDR video stream and transmit the SDR video stream to a server. In practical applications, if the collector supports HDR video stream collection, the collected HDR video stream can also be directly transmitted to the server. The collector may encode the HDR Video stream, for example, in a High Efficiency Video Coding (HEVC) manner. The collector may be a client for video collection in the user equipment. E.g. the cast end in a live device.
A server 220, configured to decode the SDR video stream to obtain SDR video stream data; enhancing SDR video stream data to obtain HDR video stream data corresponding to the SDR video stream data; and carrying out transcoding processing and packaging processing on the HDR video stream data to obtain an HDR video stream, and transmitting the HDR video stream to a distribution network. The transcoding process may be to output the video stream with multiple paths of video streams with different bit rates and resolutions. The Delivery Network may be a Content Delivery Network (CDN).
In practical application, the server may also receive the HDR video stream transmitted by the collector. The server may start the HEVC decoder to decode the HDR video stream. For a device which does not support HDR acquisition, the server can receive the SDR video stream pushed by the server to perform enhancement processing, and convert the SDR video stream into HDR video stream data.
In embodiments of the present invention, the enhancement processing may be implemented in a variety of ways. For example, the three primary color data of the output HDR video stream corresponding to the three primary color data of the input SDR video stream may be determined by a three-dimensional look-up table (3D LUT), respectively. Or feature fusion can be performed on a plurality of 3D LUTs, and the fusion value is learned through a machine learning model, so that three primary color data of the HDR video stream corresponding to the three primary color data of the SDR video stream can be obtained. Or, a video stream data enhancement model can be trained in advance to realize enhancement of SDR video stream data into corresponding HDR video stream data.
In an optional implementation manner of the embodiment of the present invention, the server is specifically configured to: and inputting SDR video stream data into a pre-trained video stream data enhancement model, and performing enhancement processing to obtain HDR video stream data corresponding to the SDR video stream data.
The video stream data enhancement model may be obtained based on learning the historical SDR video stream and the corresponding HDR video stream. For example, a video stream data enhancement model may be obtained by learning and model training a historical SDR video stream and a corresponding HDR video stream through a machine learning model. In order to avoid overfitting during model training and improve the stability of training, a gradient penalty term can be added into the loss function.
The embodiment of the invention carries out enhancement processing through the video stream data enhancement model, can avoid the defects that the prior art depends on a manual intervention mode to carry out image enhancement processing and consumes a large amount of manpower and material resources, and can also reduce the requirement that designers have rich image enhancement experience in the enhancement processing in the prior art.
In an optional implementation manner of the embodiment of the present invention, the server is further configured to: inputting SDR video stream data into a video stream data enhancement model trained in advance, and before enhancement processing, constructing a training sample set, wherein training samples in the training sample set comprise: SDR sample video stream data and corresponding HDR sample video stream data; and training a preset machine learning model by using the training sample set to obtain a video stream data enhancement model.
In the embodiment of the invention, in order to improve the reliability of the trained video stream data enhancement model, training samples can be screened. For example, training samples may be screened to meet the following requirements: a first gamma value between the SDR sample video stream data and the corresponding LDR video stream data, and a second gamma value between the HDR sample video stream data and the corresponding LDR video stream data, satisfy a preset error condition.
Wherein the first gamma value can be determined by the bt.709 algorithm and the second gamma value can be determined by the st.2084 algorithm. When the predetermined error condition is that the first gamma value is equal to the second gamma value, or an absolute difference (an absolute value of a difference) between the first gamma value and the second gamma value is less than or equal to a first predetermined difference, or an absolute difference between a ratio of the first gamma value to the second gamma value and 1 is less than or equal to a second predetermined difference. The smaller the first preset difference value and the second preset difference value are set, the lower the loss degree of the original data is. According to the embodiment of the invention, the selection condition is added to the training samples, so that the samples in the training sample set can be kept in a high-quality state without losing original data basically, the reliability of a video stream data enhancement model can be improved, and the enhancement processing from SDR to HDR with high reliability can be realized. In addition, the embodiment of the invention performs enhancement processing through the video stream data enhancement model, so that the running time of the traditional enhancement processing and the image enhancement effect can be improved.
As shown in fig. 2a, the player 230 is configured to apply the video playing method provided by any embodiment of the present invention, map the HDR video stream distributed by the server to target LDR video stream data, and perform video playing on the target LDR video stream data.
As shown in fig. 2a, specifically, the player 230 may perform decapsulation and decoding processing on the HDR video stream to obtain HDR decoded data. For a player supporting HDR, the HDR video stream can be directly played; for a player which does not support HDR, the HDR video stream may be mapped to the LDR video stream by the above-mentioned video playing method and then played.
In some application scenarios, such as live broadcasting, a user usually needs to perform a skin beautifying process on a video and then play the video. However, none of the current beauty tools substantially support HDR. Therefore, in a player supporting HDR, HDR can be first converted into SDR or LDR for beautifying, and then converted into HDR for playing. On a player which does not support HDR, HDR can be converted into SDR or LDR can be subjected to beautifying processing and then video rendering playing is carried out. Wherein, the inter-conversion between HDR and SDR,or the inter-conversion between the HDR and the LDR can be realized by mutually saving texture parameters. Specifically, n in the first luminance increase amount1And n of the second luminance increase amount2Are respectively replaced by
And
conversion from SDR or LDR to HDR can be achieved.
It should be noted that the above-mentioned process of enhancing SDR into HDR is also applicable to enhancing LDR into HDR.
The technical scheme of the embodiment of the invention is that a video playing system comprising a collector, a server and a player is configured, wherein: the collector is used for collecting the SDR video stream and transmitting the SDR video stream to the server; the server is used for decoding the SDR video stream to obtain SDR video stream data; enhancing SDR video stream data to obtain HDR video stream data corresponding to the SDR video stream data; carrying out transcoding processing and packaging processing on HDR video stream data to obtain HDR video stream, and transmitting the HDR video stream to a distribution network; the player is used for mapping the HDR video stream distributed by the server into target LDR video stream data and playing the video of the target LDR video stream data by adopting the video playing method provided by any embodiment of the invention, so that the problems of converting the acquired SDR into the HDR and playing the HDR on equipment without HDR compatibility are solved, the conversion of the SDR into the HDR to improve the video quality of the acquired video is realized, the HDR is played and mapped to reserve more HDR characteristics during the video playing, the playing performance of the existing display is improved, and the image quality of the existing display is improved.
Fig. 2b is an interaction diagram of a video playing system according to a second embodiment of the present invention. As shown in fig. 2b, in live broadcasting, the broadcasting end may determine whether to support capturing HDR video streams according to a specific device model. When a user starts an HDR acquisition interface at a broadcasting end, an acquisition device of the broadcasting end can acquire HDR; otherwise, collecting SDR. The broadcast end can push the collected video to the server. The server can perform de-encapsulation and decoding processing on the received video. If the video received by the server is SDR, the enhancement processing is HDR; if the video received by the server is HDR, no conversion is needed. The server may transcode and encapsulate the HDR. When the live broadcast end requests the server for video data, the live broadcast end can upload the configuration information related to the current equipment. When a user starts an HDR playing option at a live end, the live end can request HDR data from a server. The server can push the HDR data to the live broadcast end when the HDR playing option is started in the live broadcast room. The live end can play the HDR data.
According to the technical scheme of the embodiment of the invention, through the interactive process, HDR video can be live broadcast, the problem of incompatibility of equipment can be solved, the playing quality of the video can be improved, a user can watch the video with higher image quality, and the user experience is improved.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a video playback device in an embodiment of the present invention. As shown in fig. 3, the video playback apparatus includes: HDR decoded data acquisition module 310, base LDR video stream data determination module 320, and video playback module 330. Wherein:
the HDR decoding data obtaining module 310 is configured to obtain an HDR video stream distributed by a server, and decode the HDR video stream to obtain HDR decoding data;
a basic LDR video stream data determining module 320, configured to perform mapping processing on the HDR decoding data to obtain basic LDR video stream data to be optimized;
and the video playing module 330 is configured to perform step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and perform video playing on the target LDR video stream data.
Optionally, the apparatus further includes:
the comparison mapping result obtaining module is used for obtaining multiple items of sample HDR video stream data before performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters, and mapping each sample HDR video stream data through a standard tone mapping function to obtain a comparison mapping result;
and the optimization algorithm and optimization parameter fitting module is used for fitting according to the incidence relation between each comparison mapping result and the ideal LDR video stream data of each sample HDR video stream data to obtain an optimization algorithm and optimization parameters.
Optionally, the video playing module 330 includes:
a brightness increase determining unit, configured to determine a first brightness increase according to the basic LDR video stream data, and determine a second brightness increase according to the first brightness increase;
and the target LDR video stream data determining unit is used for determining the target LDR video stream data according to the preset optimization parameter, the first brightness increment and the second brightness increment.
Optionally, the brightness increase amount determining unit includes:
a first brightness increment determining subunit, configured to determine, according to an association relationship between a video brightness increment and a voltage increment during video playing and the basic LDR video stream data, a first brightness increment of the basic LDR video stream data;
and the second brightness increase determining subunit is used for determining a second brightness increase of the basic LDR video stream data according to the association relationship between the video brightness increase value and the voltage increase value and the first brightness increase.
Optionally, the first brightness increase determining subunit is specifically configured to:
and performing power operation processing on the basic LDR video stream data to obtain a first brightness increment.
Optionally, the second brightness increase determining subunit is specifically configured to:
and performing fractional linear operation processing and power operation processing on the first brightness increment to obtain a second brightness increment.
Optionally, the target LDR video stream data determining unit is specifically configured to:
performing fractional linear operation processing, power operation processing and multiple function operation processing on the first brightness increase value according to preset optimization parameters to determine target LDR video stream data; alternatively, the first and second electrodes may be,
and performing multiple times of function operation processing on the second brightness increment according to preset optimization parameters to determine target LDR video stream data.
The video playing device provided by the embodiment of the invention can execute the video playing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example four
Fig. 4 is a schematic structural diagram of a computer apparatus according to a fourth embodiment of the present invention, as shown in fig. 4, the computer apparatus includes a processor 410, a memory 420, an input device 430, and an output device 440; the number of the processors 410 in the computer device may be one or more, and one processor 410 is taken as an example in fig. 4; the processor 410, the memory 420, the input device 430 and the output device 440 in the computer apparatus may be connected by a bus or other means, and the connection by the bus is exemplified in fig. 4.
the method comprises the steps of obtaining an HDR video stream distributed by a server, and decoding the HDR video stream to obtain HDR decoding data;
mapping the HDR decoding data to obtain basic LDR video stream data to be optimized;
and performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and performing video playing on the target LDR video stream data.
The memory 420 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 420 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 420 may further include memory located remotely from processor 410, which may be connected to a computer device through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 430 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the computer apparatus. The output device 440 may include a display device such as a display screen.
EXAMPLE five
The fifth embodiment of the present invention further discloses a computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the video playing method is implemented as follows:
the method comprises the steps of obtaining an HDR video stream distributed by a server, and decoding the HDR video stream to obtain HDR decoding data;
mapping the HDR decoding data to obtain basic LDR video stream data to be optimized;
and performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and performing video playing on the target LDR video stream data.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer-readable storage medium may be, for example, but is not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, or the like, as well as conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments illustrated herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (13)
1. A video playback method, comprising:
the method comprises the steps of obtaining an HDR video stream distributed by a server, and decoding the HDR video stream to obtain HDR decoding data;
mapping the HDR decoding data to obtain basic LDR video stream data to be optimized;
and performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and performing video playing on the target LDR video stream data.
2. The method as claimed in claim 1, wherein before performing the progressive optimization processing on the base LDR video stream data according to a preset optimization algorithm and optimization parameters, the method further comprises:
obtaining multiple items of sample HDR video stream data, and mapping each sample HDR video stream data through a standard tone mapping function to obtain a comparison mapping result;
and fitting according to the correlation between each comparison mapping result and the ideal LDR video stream data of each sample HDR video stream data to obtain the optimization algorithm and the optimization parameters.
3. The method according to claim 1 or 2, wherein performing a progressive optimization process on the base LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, comprises:
determining a first brightness increase according to the basic LDR video stream data, and determining a second brightness increase according to the first brightness increase;
and determining the target LDR video stream data according to a preset optimization parameter, the first brightness increment and the second brightness increment.
4. The method of claim 3, wherein determining a first luma increment based on the underlying LDR video stream data and a second luma increment based on the first luma increment comprises:
determining a first brightness increment of the basic LDR video stream data according to the incidence relation between the video brightness increment value and the voltage increment value during video playing and the basic LDR video stream data;
and determining a second brightness increase of the basic LDR video stream data according to the incidence relation between the video brightness increase value and the voltage increase value and the first brightness increase.
5. The method of claim 4, wherein determining the first luminance increase amount of the base LDR video stream data according to the correlation between the video luminance increase value and the voltage increase value during video playing and the base LDR video stream data comprises:
and performing power operation processing on the basic LDR video stream data to obtain a first brightness increment.
6. The method of claim 4, wherein determining a second luminance increase amount of the base LDR video stream data based on the correlation between the video luminance increase value and the voltage increase value and the first luminance increase amount comprises:
and performing fractional linear operation processing and power operation processing on the first brightness increment to obtain a second brightness increment.
7. The method of claim 4, wherein determining the target LDR video stream data according to a preset optimization parameter, the first brightness increase and the second brightness increase comprises:
according to the preset optimization parameters, performing fractional linear operation processing, power operation processing and multiple function operation processing on the first brightness increase value to determine target LDR video stream data; alternatively, the first and second electrodes may be,
and performing multiple times of function operation processing on the second brightness increment according to the preset optimization parameters to determine the target LDR video stream data.
8. A video playback system, the system comprising: a collector, a server and a player; wherein:
the collector is used for collecting SDR video stream and transmitting the SDR video stream to the server;
the server is used for decoding the SDR video stream to obtain SDR video stream data; enhancing the SDR video stream data to obtain high dynamic range HDR video stream data corresponding to the SDR video stream data; transcoding and packaging the HDR video stream data to obtain an HDR video stream, and transmitting the HDR video stream to a distribution network;
the player is used for mapping the HDR video stream distributed by the server to target LDR video stream data and performing video playing on the target LDR video stream data by adopting the video playing method of any one of claims 1 to 7.
9. The system of claim 8, wherein the server is specifically configured to:
and inputting the SDR video stream data into a pre-trained video stream data enhancement model for enhancement processing to obtain HDR video stream data corresponding to the SDR video stream data.
10. The system of claim 9, wherein the server is further configured to:
before inputting the SDR video stream data into a video stream data enhancement model trained in advance and carrying out enhancement processing, constructing a training sample set, wherein training samples in the training sample set comprise: SDR sample video stream data and corresponding HDR sample video stream data;
wherein a first gamma value between the SDR sample video stream data and the corresponding LDR video stream data with the low dynamic range and a second gamma value between the HDR sample video stream data and the corresponding LDR video stream data satisfy a preset error condition;
and training a preset machine learning model by using the training sample set to obtain the video stream data enhancement model.
11. A video playback apparatus, comprising:
the HDR decoding data acquisition module is used for acquiring an HDR video stream distributed by a server and decoding the HDR video stream to obtain HDR decoding data;
a basic LDR video stream data determining module, configured to perform mapping processing on the HDR decoded data to obtain basic LDR video stream data to be optimized;
and the video playing module is used for optimizing the basic LDR video stream data step by step according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data and playing the target LDR video stream data.
12. A computer device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the video playback method of any of claims 1-7.
13. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the video playback method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110938403.0A CN113676773B (en) | 2021-08-16 | 2021-08-16 | Video playing method, system, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110938403.0A CN113676773B (en) | 2021-08-16 | 2021-08-16 | Video playing method, system, device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113676773A true CN113676773A (en) | 2021-11-19 |
| CN113676773B CN113676773B (en) | 2023-11-14 |
Family
ID=78543093
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110938403.0A Active CN113676773B (en) | 2021-08-16 | 2021-08-16 | Video playing method, system, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113676773B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114363702A (en) * | 2021-12-28 | 2022-04-15 | 上海网达软件股份有限公司 | Method, device and equipment for converting SDR video into HDR video and storage medium |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101707666A (en) * | 2009-11-26 | 2010-05-12 | 北京中星微电子有限公司 | Adjusting method and device with high dynamic range |
| CN105393525A (en) * | 2013-07-18 | 2016-03-09 | 皇家飞利浦有限公司 | Methods and apparatuses for creating code mapping functions for encoding an hdr image, and methods and apparatuses for use of such encoded images |
| CN105794216A (en) * | 2014-09-08 | 2016-07-20 | 索尼公司 | Image processing apparatus and image processing method |
| CN106101679A (en) * | 2016-08-23 | 2016-11-09 | 青岛海信电器股份有限公司 | The processing method of high dynamic range signal and processing system |
| US20180152684A1 (en) * | 2016-11-28 | 2018-05-31 | Microsoft Technology Licensing, Llc | Architecture for rendering high dynamic range video on enhanced dynamic range display devices |
| CN108352059A (en) * | 2015-12-26 | 2018-07-31 | 英特尔公司 | For by high dynamic range（HDR）Content Transformation is at standard dynamic range（SDR）The video tone mapping of content |
| CN108805836A (en) * | 2018-05-31 | 2018-11-13 | 大连理工大学 | Method for correcting image based on the reciprocating HDR transformation of depth |
| CN108900823A (en) * | 2018-07-05 | 2018-11-27 | 华为技术有限公司 | A kind of method and device of video frequency signal processing |
| CN109155060A (en) * | 2016-05-25 | 2019-01-04 | 索尼公司 | Image processing apparatus, image processing method and program |
| CN109274985A (en) * | 2018-10-12 | 2019-01-25 | 腾讯科技（深圳）有限公司 | Video transcoding method, device, computer equipment and storage medium |
| CN109410126A (en) * | 2017-08-30 | 2019-03-01 | 中山大学 | A kind of tone mapping method of details enhancing and the adaptive high dynamic range images of brightness |
| WO2019170465A1 (en) * | 2018-03-06 | 2019-09-12 | Koninklijke Philips N.V. | Versatile dynamic range conversion processing |
| US20200099908A1 (en) * | 2017-06-13 | 2020-03-26 | Koninklijke Philips N.V. | Gamut mapping for hdr (de)coding |
| CN111246050A (en) * | 2014-02-25 | 2020-06-05 | 苹果公司 | System, apparatus and method for video data processing |
| CN111885393A (en) * | 2020-07-31 | 2020-11-03 | 广州华多网络科技有限公司 | Live broadcast method, system, storage medium and equipment |
| CN112449169A (en) * | 2021-01-28 | 2021-03-05 | 北京达佳互联信息技术有限公司 | Method and apparatus for tone mapping |
-
2021
- 2021-08-16 CN CN202110938403.0A patent/CN113676773B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101707666A (en) * | 2009-11-26 | 2010-05-12 | 北京中星微电子有限公司 | Adjusting method and device with high dynamic range |
| CN105393525A (en) * | 2013-07-18 | 2016-03-09 | 皇家飞利浦有限公司 | Methods and apparatuses for creating code mapping functions for encoding an hdr image, and methods and apparatuses for use of such encoded images |
| CN111246050A (en) * | 2014-02-25 | 2020-06-05 | 苹果公司 | System, apparatus and method for video data processing |
| CN105794216A (en) * | 2014-09-08 | 2016-07-20 | 索尼公司 | Image processing apparatus and image processing method |
| CN108352059A (en) * | 2015-12-26 | 2018-07-31 | 英特尔公司 | For by high dynamic range（HDR）Content Transformation is at standard dynamic range（SDR）The video tone mapping of content |
| CN109155060A (en) * | 2016-05-25 | 2019-01-04 | 索尼公司 | Image processing apparatus, image processing method and program |
| CN106101679A (en) * | 2016-08-23 | 2016-11-09 | 青岛海信电器股份有限公司 | The processing method of high dynamic range signal and processing system |
| US20180152684A1 (en) * | 2016-11-28 | 2018-05-31 | Microsoft Technology Licensing, Llc | Architecture for rendering high dynamic range video on enhanced dynamic range display devices |
| US20200099908A1 (en) * | 2017-06-13 | 2020-03-26 | Koninklijke Philips N.V. | Gamut mapping for hdr (de)coding |
| CN109410126A (en) * | 2017-08-30 | 2019-03-01 | 中山大学 | A kind of tone mapping method of details enhancing and the adaptive high dynamic range images of brightness |
| WO2019170465A1 (en) * | 2018-03-06 | 2019-09-12 | Koninklijke Philips N.V. | Versatile dynamic range conversion processing |
| CN108805836A (en) * | 2018-05-31 | 2018-11-13 | 大连理工大学 | Method for correcting image based on the reciprocating HDR transformation of depth |
| CN108900823A (en) * | 2018-07-05 | 2018-11-27 | 华为技术有限公司 | A kind of method and device of video frequency signal processing |
| CN109274985A (en) * | 2018-10-12 | 2019-01-25 | 腾讯科技（深圳）有限公司 | Video transcoding method, device, computer equipment and storage medium |
| CN111885393A (en) * | 2020-07-31 | 2020-11-03 | 广州华多网络科技有限公司 | Live broadcast method, system, storage medium and equipment |
| CN112449169A (en) * | 2021-01-28 | 2021-03-05 | 北京达佳互联信息技术有限公司 | Method and apparatus for tone mapping |
Non-Patent Citations (1)
| Title |
|---|
| 刘宗;席志红;: "基于局部线性变换的色阶映射算法", 计算机测量与控制, no. 07 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114363702A (en) * | 2021-12-28 | 2022-04-15 | 上海网达软件股份有限公司 | Method, device and equipment for converting SDR video into HDR video and storage medium |
| CN114363702B (en) * | 2021-12-28 | 2023-09-08 | 上海网达软件股份有限公司 | Method, device, equipment and storage medium for converting SDR video into HDR video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113676773B (en) | 2023-11-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7407373B2 (en) | Display device, display method, and computer program | |
| US10681306B2 (en) | Conversion method and conversion apparatus | |
| CN107203974B (en) | Method, apparatus and system for extended high dynamic range HDR to HDR tone mapping | |
| JP6596125B2 (en) | Method and apparatus for creating a code mapping function for encoding of HDR images, and method and apparatus for use of such encoded images | |
| US11183143B2 (en) | Transitioning between video priority and graphics priority | |
| US9948884B2 (en) | Converting method and converting apparatus for converting luminance value of an input video into a second luminance value | |
| KR102135841B1 (en) | High dynamic range image signal generation and processing | |
| JP6495552B2 (en) | Dynamic range coding for images and video | |
| JP6619888B2 (en) | HDR video encoding and decoding | |
| JP6407717B2 (en) | Apparatus and method for dynamic range conversion of images | |
| JP5992997B2 (en) | Method and apparatus for generating a video encoded signal | |
| KR20170129004A (en) | Image processing device and image processing method thereof | |
| JP7419230B2 (en) | Graphics-safe HDR image brightness regrading | |
| CN113676773B (en) | Video playing method, system, device, computer equipment and storage medium | |
| CN111885393A (en) | Live broadcast method, system, storage medium and equipment | |
| WO2023193524A1 (en) | Live streaming video processing method and apparatus, electronic device, computer-readable storage medium, and computer program product | |
| WO2023150074A1 (en) | Beta scale dynamic display mapping | |
| CN116405730A (en) | Intelligent display effect optimization method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |