CN113676773B - Video playing method, system, device, computer equipment and storage medium - Google Patents
Video playing method, system, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113676773B CN113676773B CN202110938403.0A CN202110938403A CN113676773B CN 113676773 B CN113676773 B CN 113676773B CN 202110938403 A CN202110938403 A CN 202110938403A CN 113676773 B CN113676773 B CN 113676773B
- Authority
- CN
- China
- Prior art keywords
- video stream
- stream data
- hdr
- ldr
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 238000005457 optimization Methods 0.000 claims abstract description 93
- 238000012545 processing Methods 0.000 claims abstract description 61
- 238000013507 mapping Methods 0.000 claims abstract description 54
- 230000006870 function Effects 0.000 claims description 36
- 230000008569 process Effects 0.000 claims description 21
- 238000012549 training Methods 0.000 claims description 16
- 238000010801 machine learning Methods 0.000 claims description 4
- 238000004806 packaging method and process Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 8
- 238000006243 chemical reaction Methods 0.000 description 6
- 238000009877 rendering Methods 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 230000002708 enhancing effect Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 239000007991 ACES buffer Substances 0.000 description 2
- 230000003796 beauty Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000009966 trimming Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000002537 cosmetic Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a video playing method, a video playing system, a video playing device, computer equipment and a storage medium. The method comprises the following steps: acquiring an HDR video stream, and decoding the HDR video stream to obtain HDR decoded data; mapping the HDR decoding data to obtain basic LDR video stream data to be optimized; and carrying out step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and carrying out video playing. The technical scheme of the embodiment of the invention can map the HDR video stream into the LDR video stream, and realize playing the HDR video stream on the existing display; meanwhile, the basic LDR video stream data is subjected to step-by-step optimization processing, so that more HDR characteristics can be reserved when video is played, the playing performance of the existing display is improved, and the image quality of the display is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of video processing, in particular to a video playing method, a system, a device, computer equipment and a storage medium.
Background
High-Dynamic Range (HDR) is a new technology that has emerged in the film and television industry in recent years. HDR has a wider color Range and a luminance difference of an order of magnitude higher than Standard-Dynamic Range (SDR).
However, HDR originates from the television end and not the mobile end, where the push-out time of HDR is short. Currently, third-party tools for realizing HDR video stream data rendering at a mobile terminal are few, and the technology is immature, so that HDR is difficult to directly play on the existing display.
Disclosure of Invention
The embodiment of the invention provides a video playing method, a video playing system, a video playing device, a video playing computer device and a video storage medium, which can realize that the existing display plays an HDR video stream, and simultaneously improve the playing performance of the display, so that the image quality of the display is improved.
In a first aspect, an embodiment of the present invention provides a video playing method, including:
acquiring an HDR video stream distributed by a server, and decoding the HDR video stream to obtain HDR decoded data;
mapping the HDR decoding data to obtain basic LDR video stream data to be optimized;
and carrying out step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and carrying out video playing on the target LDR video stream data.
In a second aspect, an embodiment of the present invention further provides a video playing system, where the system includes: the device comprises a collector, a server and a player; wherein:
the collector is used for collecting the SDR video stream and transmitting the SDR video stream to the server;
the server is used for decoding the SDR video stream to obtain SDR video stream data; performing enhancement processing on the SDR video stream data to obtain high dynamic range HDR video stream data corresponding to the SDR video stream data; transcoding and packaging the HDR video stream data to obtain an HDR video stream, and transmitting the HDR video stream to a distribution network;
the player is configured to map the HDR video stream distributed by the server into target LDR video stream data by using the video playing method according to any embodiment of the present invention, and perform video playing on the target LDR video stream data.
In a third aspect, an embodiment of the present invention further provides a video playing device, including:
the HDR decoding data acquisition module is used for acquiring an HDR video stream distributed by the server and decoding the HDR video stream to obtain HDR decoding data;
The basic LDR video stream data determining module is used for carrying out mapping processing on the HDR decoding data to obtain basic LDR video stream data to be optimized;
the video playing module is used for carrying out step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and carrying out video playing on the target LDR video stream data.
In a fourth aspect, an embodiment of the present invention further provides a computer device, including:
one or more processors; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the video playback method of any of the embodiments of the present invention.
In a fifth aspect, an embodiment of the present invention further provides a computer readable storage medium having stored thereon a computer program, which when executed by a computer, implements the video playing method provided by any embodiment of the present invention.
According to the technical scheme, the HDR video stream is obtained and decoded to obtain HDR decoded data; mapping the HDR decoding data to obtain basic LDR video stream data to be optimized; and carrying out step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and carrying out video playing. The technical scheme of the embodiment of the invention can map the HDR video stream into the LDR video stream, and realize playing the HDR video stream on the existing display; meanwhile, the basic LDR video stream data is subjected to step-by-step optimization processing, so that more HDR characteristics can be reserved when video is played, the playing performance of the existing display is improved, and the image quality of the display is improved.
Drawings
Fig. 1 is a flowchart of a video playing method according to a first embodiment of the present invention;
fig. 2a is a schematic structural diagram of a video playing system according to a second embodiment of the present invention;
fig. 2b is an interaction schematic diagram of a video playing system according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a video playing device according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
It should be further noted that, for convenience of description, only some, but not all of the matters related to the present invention are shown in the accompanying drawings. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently, or at the same time. Furthermore, the order of the operations may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example 1
Fig. 1 is a flowchart of a video playing method according to a first embodiment of the present invention, where the present embodiment is applicable to a case where high quality playing of an HDR video stream is implemented when a player does not support rendering of the HDR video stream, and is particularly applicable to a case where high quality playing of the HDR video stream is implemented in live broadcast. The method may be performed by a video playback apparatus, which may be implemented in software and/or hardware, and which may generally be integrated in a computer device (e.g., various smart terminals). As shown in fig. 1, the method includes:
step 110, obtaining an HDR video stream distributed by a server, and performing decoding processing on the HDR video stream to obtain HDR decoded data.
Among them, dynamic Range (DR) is a technical term for describing the brightness level Range of a given scene mathematically. The ratio from the brightest to the darkest contained in the image is meant to be the number of gradation steps of the gray scale division between the brightest and the darkest of the image; the greater the DR, the more rich the hierarchy that can be represented and the wider the color space that can be included.
HDR video streams refer to images that contain light levels and/or dark details beyond the capabilities of conventional imaging systems. HDR imaging provides a wider range of shades for content creators, extending the range from darkest to brightest in an image. This can be used to reveal more realistic images with higher contrast, darker dark portions and brighter light portions.
In an embodiment of the present invention, the HDR video stream distributed by the server may have multiple acquisition modes. For example, the server may obtain an HDR video stream from a video collector, and transcode the HDR video stream to be encapsulated, and so on, and distribute the HDR video stream to a distribution network, so that the player obtains the HDR video stream. Or, the server may acquire an SDR video stream or a low dynamic range (Low Dynamic Range Image, LDR) video stream from the video collector, perform HDR enhancement processing on the SDR video stream or the LDR video stream, convert the SDR video stream or the LDR video stream into an HDR video stream, and then perform operations such as transcoding and encapsulation to distribute the SDR video stream or the LDR video stream to the distribution network, so that the player acquires the HDR video stream. The processing procedure of the server for the received video stream depends on the video stream format acquired by the server at the collector. The video playing method provided by the embodiment of the invention can support communication connection with collectors and servers with various performances, and the technical scheme of the embodiment of the invention is not limited to the above.
The decoding processing mode of the player for the HDR video stream may correspond to the encoding mode of the HDR video stream. For example, the decoding processing manner of the HDR video stream may be to set the decoder to the flag of hevc_main10 at the player end, and start the decoding service of the HDR video stream.
And 120, mapping the HDR decoded data to obtain basic LDR video stream data to be optimized.
The video is specifically displayed through a display of the player when the video is played. The principle of the display is to turn on and off the power to control an optical response of the transmissive optical switch. Each pixel is respectively input with signal voltage data with different sizes, the rotation states of liquid crystal molecules under different voltages are different, the rotation degrees of the liquid crystal molecules on linearly polarized light are also different, and the components on the transmission axis of the analyzer are different, namely the emergent light brightness is different, so that multi-gray-scale image display is realized. The illumination brightness value and the color tristimulus value displayed by the display are called LDR brightness value and LDR color tristimulus value.
When the display displays an image or video, the input data is RGBA (three primary colors and color space) original data, and the display converts the image data into a light signal output by a screen, namely Electro-optical conversion function (Electro-Optical Transfer Function, EOTF) processing. However, HDR is a 10 bit (bit) data source, and SDR or LDR is 8 bits. HDR has more brightness, deeper bit depth, and a wider color gamut. Thus, the display cannot normally display an HDR image or video unless the display itself supports HDR display.
In the embodiment of the invention, the HDR can be mapped, and the mapped basic LDR is further optimized, so that the HDR is normally displayed on a display which does not support the HDR display, and the requirement of viewing experience of people is met.
The mapping process for HDR may be implemented in a variety of ways, for example, the mapping process for HDR may be implemented by a standard tone mapping function. The standard tone mapping function may be a function generated by an algorithm corresponding to the tone mapping technique. For example, the standard Tone Mapping function may be a function generated by one or more Tone Mapping technique algorithms, such as the mpv algorithm (an empirical Tone Mapping algorithm), the ACES algorithm (a cine Tone Mapping algorithm), the Hable algorithm (a fitting Tone Mapping algorithm), the base Tone Mapping algorithm (TMP), the BT.2390 algorithm, or the ST.2084 algorithm.
Illustratively, the mpv algorithm may beWherein n, m, b, c, d, e represents a trim constant; the brightness can be integrally improved by adjusting n and m, the contrast can be reduced by adjusting b and c, and the contrast can be improved by adjusting d and e; srccolor represents RGBA raw data of HDR decoded data input at the display; color represents RGBA data of the underlying LDR video stream. The free adjustment of the HDR decoding data by the user can be realized through the mpv algorithm, so that the display can display more characteristics of the HDR according to the user requirement, and the image quality is improved.
Still another exemplary, the underlying TMP algorithm can bea. b, c, d, e represents a trim constant; srccolor represents RGBA raw data of HDR decoded data input at the display; color represents RGBA data of the underlying LDR video stream. The free adjustment of the HDR decoding data by the user can be realized through the basic TMP algorithm, so that the display can display more characteristics of the HDR according to the user requirements, and the image quality is improved. One exemplary case is a, b, c, d, e, which may be 2.51, 0.03, 2.43, 0.59, 0.14, respectively.
Still another exemplary, in an embodiment of the present invention, the tone mapping technique bt.2390 algorithm may be:wherein m is 1 、m 2 、c 1 、c 2 、c 3 Is a trimming constant; srccolor represents RGBA raw data of HDR decoded data input at the display; color represents RGBA data of the underlying LDR video stream. The free adjustment of the HDR decoding data by the user can be realized through the BT.2390 algorithm, so that the display can display more characteristics of the HDR according to the user requirement, and the image quality is improved.
In particular, different standard tone mapping functions may be employed when the player is a different operating system. For example, when the player supports the Android operating system, the mpv algorithm, the ACES algorithm, the Hable algorithm, the base TMP algorithm, or the BT.2390 algorithm may be employed. As another example, the ST.2084 algorithm may be employed when the player supports an iOS operating system. For the Android operating system, the image quality displayed by the display can be better by executing the step 130. For the iOS operating system, step 130 may not be performed, and the conversion technology of the bottom layer of the iOS operating system is adopted to implement the rendering and displaying of the HDR. In the following, when the player supports the Android operating system, the bt.2390 algorithm is used as an example, to describe the technical solution of the embodiment of the present invention.
Step 130, performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and performing video playing on the target LDR video stream data.
The preset optimization algorithm and optimization parameters can be an algorithm and parameters for further performing optimization processing on the HDR decoding data on the basis of a standard tone mapping function. Specifically, the preset optimization algorithm and optimization parameters can be function adjustment operation based on a standard tone mapping function and further optimization operation of parameters, so that the obtained target LDR video stream data is more similar to ideal LDR video stream data, and when the display performs video playing based on the target LDR video stream data, more HDR characteristics are reserved, so that the brightness of a light source is restored as truly as possible, the image quality is improved, and the image look and feel is more similar to that of direct vision of human eyes.
In an optional implementation manner of the embodiment of the present invention, before performing the step-by-step optimization processing on the basic LDR video stream data according to the preset optimization algorithm and the optimization parameter, the method further includes: acquiring a plurality of sample HDR video stream data, and mapping each sample HDR video stream data by a standard tone mapping function to obtain a comparison mapping result; and fitting according to the association relation between each comparison mapping result and the ideal LDR video stream data of each sample HDR video stream data to obtain an optimization algorithm and optimization parameters.
The ideal LDR video stream data can be understood as input data corresponding to the highest quality picture that can be displayed when the display performs HDR display. The ideal LDR video stream data can have various acquisition modes, for example, can be obtained by continuously adjusting parameters of a display. There is a gap between the comparison mapping result and the corresponding ideal LDR video stream data. In the embodiment of the invention, the data fitting can be performed through a fitting curve, so that the data relationship between the comparison mapping result and the corresponding ideal LDR video stream data is obtained. The data relationship may be specifically represented by an optimization algorithm and optimization parameters. The embodiment of the invention does not limit the fitting algorithm in detail.
In an optional implementation manner of the embodiment of the present invention, step-by-step optimization processing is performed on basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, including: determining a first brightness increment according to the basic LDR video stream data, and determining a second brightness increment according to the first brightness increment; and determining target LDR video stream data according to the preset optimization parameters, the first brightness increment and the second brightness increment.
In the physical world, if the intensity of light is doubled, the brightness is doubled, that is, the linear relationship between the intensity of light and the brightness is satisfied. In the display, the voltage is doubled, and the brightness is not doubled, i.e. the output brightness of the display is not in a linear relationship with the voltage. The first brightness increase value may be obtained by performing a parameter adjustment process on the base LDR video stream data in order to enable the video stream data to have better display capability in the display. The second brightness increase may be obtained by continuing the modulation on the basis of the first brightness increase. The specific parameter adjusting process can be determined according to the association relation between the output brightness of the display and the voltage.
Specifically, in an optional implementation manner of the embodiment of the present invention, determining a first luminance increase amount according to the base LDR video stream data, and determining a second luminance increase amount according to the first luminance increase amount includes: determining a first brightness increment of basic LDR video stream data according to the association relation between the video brightness increment value and the voltage increment value during video playing and the basic LDR video stream data; and determining a second brightness increment of the basic LDR video stream data according to the association relation between the video brightness increment value and the voltage increment value and the first brightness increment.
Among them, the inventors have found through studies that the relationship between the luminance increase amount and the voltage increase amount is generally a power function relationship. For example, the brightness increase of a display is equal to the power of 2.2 of the voltage increase, where 2.2 is referred to as the Gamma value (Gamma) of the display.
In the embodiment of the invention, the association relationship between the video brightness increasing value and the voltage increasing value during video playing can be understood as a power function relationship under a certain gamma value. The inventor finds in the study that the basic LDR video stream data is adjusted through the association relation between the video brightness increasing value and the voltage increasing value during video playing, so that the first brightness increasing amount of the basic LDR video stream data is obtained, and the basic LDR video stream data can be better and clearly displayed in a display.
Specifically, in an optional implementation manner of the embodiment of the present invention, determining, according to an association relationship between a video brightness increasing value and a voltage increasing value during video playing and base LDR video stream data, a first brightness increasing amount of the base LDR video stream data includes: and performing power operation processing on the basic LDR video stream data to obtain a first brightness increment.
The power operation process may be a process of deforming in the form of a power function to obtain the target value. For example, one can Is determined as the basis LA first luminance increment of DR video stream data, wherein n 1 Is constant, E 0 Base LDR video stream data. Wherein n is 1 Can be used as a trimming parameter, which can be understood as a compensation adjustment of the gamma value,/for>It is understood that the compensation adjustment to the underlying LDR video stream data. n is n 1 The method can be obtained by matching the association relation between the mapping result and the corresponding ideal LDR video stream data. />It can be understood that the association between the video brightness increase value and the voltage increase value during video playing, i.e. the gamma value is n 1 A power function relationship of (c).
The inventor found in practical research that, by determining the first luminance increment of the basic LDR video stream data only according to the association relationship between the video luminance increment value and the voltage increment value during video playing and the basic LDR video stream data, HDR can not be displayed in a display very ideally. Therefore, a second luminance increase amount of the basic LDR video stream data is determined according to the first luminance increase amount, and display optimization is continued.
Specifically, the first brightness increment can be further deformed based on the association relationship between the video brightness increment value and the voltage increment value, and the second brightness increment of the basic LDR video stream data can be determined, so that the display performance of the display can be further improved.
The further modification of the first luminance increase amount may be performed in various ways, for example, may be a linear transformation of the first luminance increase amount, or may refer to a modification of the standard tone mapping function when performing the mapping process on the HDR decoded data, or the like. The best performing of the various modification modes can be determined as a specific modification to the first luminance increase amount.
Further, in an optional implementation manner of the embodiment of the present invention, determining, according to the association relationship between the video brightness increase value and the voltage increase value and the first brightness increase amount, the second brightness increase amount of the base LDR video stream data includes: and performing a piecewise linear operation and a power operation on the first brightness increment to obtain a second brightness increment.
Wherein the partial linear operation may be performed by performing a linear operation on the first brightness increaseDeformation treatment of c 1 、c 2 、c 3 C 4 Is constant. For example, +.>Determining a second brightness increase amount of the base LDR video stream data, wherein c 1 、c 2 、c 3 N is as follows 2 Is constant.
In an embodiment of the present invention, in the present invention,it is understood that the specific modification of the first luminance increase amount determined in the embodiment of the present invention. / >It can be understood that the relation between the video brightness increase value and the voltage increase value, i.e. the gamma value is n 2 A power function relationship of (c). c 1 、c 2 、c 3 N is as follows 2 The specific value of the LDR video stream data can be obtained by fitting according to the association relation between the comparison mapping result and the corresponding ideal LDR video stream data.
Further, in order to refine some fine features in the display of the display, the second brightness increment may be deformed, so that the obtained final optimization algorithm may better satisfy the association relationship between the comparison mapping result and the corresponding ideal LDR video stream data. The second luminance increase amount may be deformed in the same manner as or different from the first luminance increase amount. For example, the second luminance increase amount may be linearly transformed and/or transformed in a power function form at different values.
Specifically, in an optional implementation manner of the embodiment of the present invention, determining target LDR video stream data according to a preset optimization parameter, a first luminance increase amount, and a second luminance increase amount includes: according to preset optimization parameters, carrying out fractional linear operation processing, power operation processing and multiple times of function operation processing on the first brightness increment value, and determining target LDR video stream data; or, according to preset optimization parameters, performing multiple times of function operation processing on the second brightness increment, and determining target LDR video stream data.
The first brightness increment value can be subjected to a linear operation and a power operation to obtain a variable which is shaped like the second brightness increment value, and then the target LDR video stream data can be obtained through a plurality of times of function operation. Alternatively, the second luminance increase amount may be directly subjected to a plurality of times of function operation processing. The multiple function operation process can be to shape the target parameter as d 0 E m +d 1 E m-1 +...+d m To obtain a target value, wherein d 0 、d 1 …d m Is a constant; e is a target parameter, e.g. E 2 Or form as E 2 Parameters of (2); m is the number of times in the multiple function operation process, and is a constant.
Specifically, in the embodiment of the present invention, the target LDR video stream data may be represented by the following formula: pb= (2 TB 3 -3TB 2 +1)KS+(TB 3 -2TB 2 +TB)(1-KS)+(-2TB 3 +3TB 2 ) maxLum determination. PB is target LDR video stream data; maxLum is a preset optimization parameter; KS is linearly related to preset optimization parameters; TB is linearly related to the second luminance increase amount.
The TB may be understood, among other things, as a linear transformation of the second luminance increase amount, in particular,ks=1.5 maxLum-0.5.maxLum is a preset optimization parameter, and can be the final comparison mapping result and the corresponding ideal LDR video stream data association relation fittingAnd (5) adjusting the rear. 2TB 3 -3TB 2 +1、TB 3 -2TB 2 +TB and-2 TB 3 +3TB 2 It can be understood that the second luminance increase amount is subjected to a plurality of function operation processes at different values.
According to the technical scheme provided by the embodiment of the invention, the basic LDR video stream data is subjected to step-by-step optimization processing according to the preset optimization algorithm and the optimization parameters to obtain the target LDR video stream data, so that more LDR signals output by the display have HDR performance, the HDR rendering problem is solved, the original image quality performance of the HDR is not lost, the terminal is suitable for terminals which do not support HDR rendering and playing, and the compatibility problem of the terminals is solved. It should be noted that the above procedure of converting HDR into LDR is also applicable to converting HDR into SDR for video playing.
According to the technical scheme, the HDR video stream is obtained and decoded to obtain HDR decoded data; mapping the HDR decoding data to obtain basic LDR video stream data to be optimized; and carrying out step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and carrying out video playing. The technical scheme of the embodiment of the invention solves the mapping problem of the HDR video stream and the problem that the HDR video stream is played on playing equipment without HDR compatibility, and can map the HDR video stream into the LDR video stream so as to realize the playing of the HDR video stream on the existing display; meanwhile, the basic LDR video stream data is subjected to step-by-step optimization processing, so that more HDR characteristics can be reserved when video is played, the playing performance of the existing display is improved, the image quality of the display is improved, and more sensory experience is brought to users.
Example two
Fig. 2a is a schematic structural diagram of a video playing system according to a second embodiment of the present invention, as shown in fig. 2a, the system of the present embodiment may include: collector 210, server 220, and player 230; wherein:
as shown in fig. 2a, the collector 210 is configured to collect the SDR video stream and transmit the SDR video stream to the server. In practical applications, if the collector supports HDR video stream collection, the collected HDR video stream may also be directly transmitted to the server. The collector may encode the HDR video stream, for example in a high efficiency video coding (High Efficiency Video Coding, HEVC). The collector may be a client for video collection in the user equipment. Such as an open end in a live device.
A server 220 for decoding the SDR video stream to obtain SDR video stream data; enhancing the SDR video stream data to obtain HDR video stream data corresponding to the SDR video stream data; transcoding and packaging the HDR video stream data to obtain an HDR video stream, and transmitting the HDR video stream to a distribution network. The transcoding process may be to output the video stream as multiple video streams with different code rates and resolutions. The delivery network may be a content delivery network (Content Delivery Network, CDN).
In practical application, the server may also receive the HDR video stream transmitted by the collector. The server may initiate the HEVC decoder to decode the HDR video stream. For devices that do not support HDR acquisition, the server may receive its pushed SDR video stream for enhancement processing, converting to HDR video stream data.
In embodiments of the present invention, the enhancement process may be implemented in a variety of ways. For example, the three primary color data of the output HDR video stream corresponding to the three primary color data of the input SDR video stream may be determined by a three-dimensional look-up table (3D LUT), respectively. Or, the three primary color data of the HDR video stream corresponding to the three primary color data of the SDR video stream can be obtained by carrying out feature fusion on a plurality of 3D LUTs and learning the fusion value through a machine learning model. Or, a video stream data enhancement model may be trained in advance to implement enhancement of SDR video stream data into corresponding HDR video stream data.
In an optional implementation manner of the embodiment of the present invention, the server is specifically configured to: and inputting the SDR video stream data into a pre-trained video stream data enhancement model, and performing enhancement processing to obtain HDR video stream data corresponding to the SDR video stream data.
The video stream data enhancement model may be obtained by learning a historical SDR video stream and a corresponding HDR video stream. For example, the machine learning model may be used to learn and model train the historical SDR video stream and the corresponding HDR video stream to obtain the video stream data enhancement model. In order to avoid over fitting during model training and improve training stability, a gradient penalty term can be added into the loss function.
The embodiment of the invention carries out enhancement processing through the video stream data enhancement model, can avoid the defect that the prior art relies on a manual intervention mode to carry out image enhancement processing and consumes a great deal of manpower and material resources, and can also reduce the requirement that the enhancement processing in the prior art requires designers to have rich image enhancement experience.
In an optional implementation manner of the embodiment of the present invention, the server is further configured to: before the SDR video stream data is input into a pre-trained video stream data enhancement model and enhancement processing is carried out, a training sample set is constructed, and training samples in the training sample set comprise: SDR sample video stream data and corresponding HDR sample video stream data; training a preset machine learning model by using a training sample set to obtain a video stream data enhancement model.
In the embodiment of the invention, in order to improve the reliability of the trained video stream data enhancement model, training samples can be screened. For example, training samples may be screened to meet the following requirements: the first gamma value between the SDR sample video stream data and the corresponding LDR video stream data and the second gamma value between the HDR sample video stream data and the corresponding LDR video stream data meet the preset error condition.
Wherein the first gamma value may be determined by bt.709 algorithm and the second gamma value may be determined by st.2084 algorithm. When the preset error condition may mean that the first gamma value is equal to the second gamma value, or that an absolute difference value (an absolute value of a difference value) between the first gamma value and the second gamma value is less than or equal to a first preset difference value, or that an absolute difference value between a ratio of the first gamma value and the second gamma value and 1 is less than or equal to a preset second preset difference value. The smaller the first preset difference value and the second preset difference value are set, the lower the loss degree of the original data is. According to the embodiment of the invention, the selection condition is added to the training samples, so that the samples in the training sample set can be kept in a high-quality state without basically losing original data, the reliability of a video stream data enhancement model can be improved, and further enhancement processing from SDR to HDR with high reliability is realized. In addition, the embodiment of the invention carries out enhancement processing through the video stream data enhancement model, so that the running time and the image enhancement effect of the traditional enhancement processing can be improved.
As shown in fig. 2a, the player 230 is configured to map the HDR video stream distributed by the server into target LDR video stream data by using the video playing method provided by any embodiment of the present invention, and perform video playing on the target LDR video stream data.
As shown in fig. 2a, specifically, the player 230 may perform decapsulation and decoding processes on the HDR video stream to obtain HDR decoded data. For a player supporting HDR, video playing can be directly carried out on an HDR video stream; for a player which does not support HDR, the HDR video stream can be mapped into an LDR video stream through the video playing method and then played.
In some application scenarios, such as live broadcast, users often need to play the video after performing a beautifying process. However, none of the current cosmetic tools support substantially HDR. Therefore, on a player supporting HDR, the HDR can be converted into SDR or LDR for beauty treatment, and then converted into HDR for playing. On a player which does not support HDR, HDR can be converted into SDR or LDR to carry out beauty treatment and then video rendering and playing are carried out. The inter-conversion of the HDR and the SDR or the inter-conversion of the HDR and the LDR can be realized by adopting a mode of mutually storing texture parameters. Specifically, n in the first luminance increase amount 1 And n in the second luminance increase amount 2 Are respectively replaced byAnd->When in use, canTo effect SDR or LDR conversion to HDR.
It should be noted that the above procedure of enhancing SDR to HDR is equally applicable to enhancing LDR to HDR.
According to the technical scheme, a video playing system comprising a collector, a server and a player is configured, wherein: the collector is used for collecting the SDR video stream and transmitting the SDR video stream to the server; the server is used for decoding the SDR video stream to obtain SDR video stream data; enhancing the SDR video stream data to obtain HDR video stream data corresponding to the SDR video stream data; transcoding and packaging the HDR video stream data to obtain an HDR video stream, and transmitting the HDR video stream to a distribution network; the player is used for mapping the HDR video stream distributed by the server into target LDR video stream data and playing the video of the target LDR video stream data by adopting the video playing method provided by any embodiment of the invention, so that the problems of converting the collected SDR into HDR and playing HDR on equipment without HDR compatibility are solved, the purpose of converting the SDR into HDR to improve the video quality of the collected video is realized, and playing mapping is carried out on the HDR to keep more HDR characteristics when the video is played, the playing performance of the existing display is improved, and the image quality of the existing display is improved.
Fig. 2b is an interaction schematic diagram of a video playing system according to a second embodiment of the present invention. As shown in fig. 2b, in live broadcast, the open end may determine that the acquisition of the HDR video stream is supported according to a specific device model. When a user opens an HDR acquisition interface at the open end, an acquisition device at the open end can acquire HDR; otherwise, SDR is collected. The open end can push the acquired video to the server. The server may de-encapsulate and decode the received video. If the video received by the server is SDR, the enhancement processing is HDR; if the video received by the server is HDR, no conversion is required. The server may transcode and encapsulate the HDR. When the live broadcast end requests the video data from the server, the configuration information related to the current equipment can be uploaded. When the user opens an HDR play option at the live end, the live end may request HDR data from the server. The server can push the HDR data to the live broadcast end when the HDR playing option is started in the live broadcast room. The live end can play the HDR data.
According to the technical scheme provided by the embodiment of the invention, through the interaction process, the HDR video can be live broadcast, the problem of incompatibility of equipment can be solved, the playing quality of the video can be improved, the user can watch the video with higher image quality, and the user experience is improved.
Example III
Fig. 3 is a schematic structural diagram of a video playing device according to an embodiment of the present invention. As shown in fig. 3, the video playing device includes: an HDR decode data acquisition module 310, a base LDR video stream data determination module 320, and a video playback module 330. Wherein:
an HDR decoding data obtaining module 310, configured to obtain an HDR video stream distributed by a server, and decode the HDR video stream to obtain HDR decoding data;
the base LDR video stream data determining module 320 is configured to map the HDR decoded data to obtain base LDR video stream data to be optimized;
the video playing module 330 is configured to perform step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters, obtain target LDR video stream data, and perform video playing on the target LDR video stream data.
Optionally, the device further includes:
the comparison mapping result acquisition module is used for acquiring a plurality of samples of HDR video stream data before the basic LDR video stream data is subjected to step-by-step optimization processing according to a preset optimization algorithm and optimization parameters, and mapping each sample of HDR video stream data by a standard tone mapping function to obtain a comparison mapping result;
And the optimization algorithm and optimization parameter fitting module is used for fitting and obtaining an optimization algorithm and optimization parameters according to the association relation between each comparison mapping result and ideal LDR video stream data of each sample HDR video stream data.
Optionally, the video playing module 330 includes:
a luminance increase amount determining unit for determining a first luminance increase amount according to the base LDR video stream data and determining a second luminance increase amount according to the first luminance increase amount;
and the target LDR video stream data determining unit is used for determining target LDR video stream data according to the preset optimization parameters, the first brightness increment and the second brightness increment.
Optionally, the luminance increase amount determination unit includes:
the first brightness increment determining subunit is used for determining the first brightness increment of the basic LDR video stream data according to the association relation between the video brightness increment value and the voltage increment value during video playing and the basic LDR video stream data;
and the second brightness increment determining subunit is used for determining the second brightness increment of the basic LDR video stream data according to the association relation between the video brightness increment value and the voltage increment value and the first brightness increment.
Optionally, the first luminance increase amount determination subunit is specifically configured to:
and performing power operation processing on the basic LDR video stream data to obtain a first brightness increment.
Optionally, the second luminance increase amount determination subunit is specifically configured to:
and performing a piecewise linear operation and a power operation on the first brightness increment to obtain a second brightness increment.
Optionally, the target LDR video stream data determining unit is specifically configured to:
according to preset optimization parameters, carrying out fractional linear operation processing, power operation processing and multiple times of function operation processing on the first brightness increment value, and determining target LDR video stream data; or,
and carrying out multiple times of function operation processing on the second brightness increment according to preset optimization parameters, and determining target LDR video stream data.
The video playing device provided by the embodiment of the invention can execute the video playing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the executing method.
Example IV
Fig. 4 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention, and as shown in fig. 4, the computer device includes a processor 410, a memory 420, an input device 430 and an output device 440; the number of processors 410 in the computer device may be one or more, one processor 410 being taken as an example in fig. 4; the processor 410, memory 420, input device 430, and output device 440 in the computer device may be connected by a bus or other means, for example in fig. 4.
The memory 420 is used as a computer readable storage medium for storing software programs, computer executable programs, and modules, such as program instructions/modules corresponding to the audio/video playing method in the embodiment of the present invention (e.g., the HDR decoded data acquisition module 310, the basic LDR video stream data determination module 320, and the video playing module 330 shown in fig. 3). The processor 410 executes various functional applications and data processing of the computer device by running software programs, instructions and modules stored in the memory 420, namely, implementing the video playing method described above:
acquiring an HDR video stream distributed by a server, and decoding the HDR video stream to obtain HDR decoded data;
mapping the HDR decoding data to obtain basic LDR video stream data to be optimized;
and carrying out step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and carrying out video playing on the target LDR video stream data.
Memory 420 may include primarily a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application program required for functionality; the storage data area may store data created according to the use of the terminal, etc. In addition, memory 420 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 420 may further include memory remotely located relative to processor 410, which may be connected to the computer device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input means 430 may be used to receive entered numeric or character information and to generate key signal inputs related to user settings and function control of the computer device. The output 440 may include a display device such as a display screen.
Example five
The fifth embodiment of the present invention also discloses a computer storage medium, on which a computer program is stored, which when executed by a processor implements the video playing method described above:
acquiring an HDR video stream distributed by a server, and decoding the HDR video stream to obtain HDR decoded data;
mapping the HDR decoding data to obtain basic LDR video stream data to be optimized;
and carrying out step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and carrying out video playing on the target LDR video stream data.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (12)
1. A video playing method, comprising:
acquiring an HDR video stream distributed by a server, and decoding the HDR video stream to obtain HDR decoded data;
mapping the HDR decoding data to obtain basic LDR video stream data to be optimized;
performing step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and performing video playing on the target LDR video stream data;
before the step-by-step optimization processing is carried out on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters, the method further comprises the following steps:
Acquiring a plurality of sample HDR video stream data, and mapping each sample HDR video stream data by a standard tone mapping function to obtain a comparison mapping result;
fitting according to the association relation between each comparison mapping result and ideal LDR video stream data of each sample HDR video stream data to obtain the optimization algorithm and optimization parameters;
the ideal LDR video stream data is input data corresponding to the highest quality picture that can be displayed when the display performs HDR display.
2. The method of claim 1, wherein performing step-by-step optimization on the base LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, comprises:
determining a first brightness increment according to the basic LDR video stream data, and determining a second brightness increment according to the first brightness increment;
and determining the target LDR video stream data according to a preset optimization parameter, the first brightness increment and the second brightness increment.
3. The method of claim 2, wherein determining a first luminance increase from the base LDR video stream data and determining a second luminance increase from the first luminance increase comprises:
Determining a first brightness increment of the basic LDR video stream data according to the association relation between the video brightness increment value and the voltage increment value during video playing and the basic LDR video stream data;
and determining a second brightness increment of the basic LDR video stream data according to the association relation between the video brightness increment value and the voltage increment value and the first brightness increment.
4. A method as claimed in claim 3, wherein determining the first luminance increase amount of the base LDR video stream data based on the association between the video luminance increase value and the voltage increase value at the time of video playback and the base LDR video stream data comprises:
and performing power operation processing on the basic LDR video stream data to obtain a first brightness increment.
5. A method according to claim 3, wherein determining a second luminance increase amount of the base LDR video stream data based on the correlation between the video luminance increase value and the voltage increase value, and the first luminance increase amount, comprises:
and performing a partial linear operation process and a power operation process on the first brightness increment to obtain a second brightness increment.
6. A method according to claim 3, wherein determining the target LDR video stream data according to preset optimization parameters, the first luminance increase amount, and the second luminance increase amount comprises:
according to the preset optimization parameters, carrying out fractional linear operation processing, power operation processing and multiple times of function operation processing on the first brightness increment value, and determining the target LDR video stream data; or,
and carrying out multiple times of function operation processing on the second brightness increment according to the preset optimization parameters, and determining the target LDR video stream data.
7. A video playback system, the system comprising: the device comprises a collector, a server and a player; wherein:
the collector is used for collecting the SDR video stream and transmitting the SDR video stream to the server;
the server is used for decoding the SDR video stream to obtain SDR video stream data; performing enhancement processing on the SDR video stream data to obtain high dynamic range HDR video stream data corresponding to the SDR video stream data; transcoding and packaging the HDR video stream data to obtain an HDR video stream, and transmitting the HDR video stream to a distribution network;
The player is configured to map the HDR video stream distributed by the server into target LDR video stream data by using the video playing method of any one of claims 1 to 6, and perform video playing on the target LDR video stream data.
8. The system according to claim 7, wherein the server is specifically configured to:
and inputting the SDR video stream data into a pre-trained video stream data enhancement model, and performing enhancement processing to obtain HDR video stream data corresponding to the SDR video stream data.
9. The system of claim 8, wherein the server is further configured to:
before the SDR video stream data is input into a pre-trained video stream data enhancement model and enhancement processing is carried out, a training sample set is constructed, and training samples in the training sample set comprise: SDR sample video stream data and corresponding HDR sample video stream data;
the first gamma value between the SDR sample video stream data and the corresponding low dynamic range LDR video stream data and the second gamma value between the HDR sample video stream data and the corresponding LDR video stream data meet the preset error condition;
And training a preset machine learning model by using the training sample set to obtain the video stream data enhancement model.
10. A video playback device, comprising:
the HDR decoding data acquisition module is used for acquiring an HDR video stream distributed by the server and decoding the HDR video stream to obtain HDR decoding data;
the basic LDR video stream data determining module is used for carrying out mapping processing on the HDR decoding data to obtain basic LDR video stream data to be optimized;
the video playing module is used for carrying out step-by-step optimization processing on the basic LDR video stream data according to a preset optimization algorithm and optimization parameters to obtain target LDR video stream data, and carrying out video playing on the target LDR video stream data;
the comparison mapping result acquisition module is used for acquiring a plurality of samples of HDR video stream data before the basic LDR video stream data is subjected to step-by-step optimization processing according to a preset optimization algorithm and optimization parameters, and mapping each sample of HDR video stream data by a standard tone mapping function to obtain a comparison mapping result;
the optimization algorithm and optimization parameter fitting module is used for fitting and obtaining an optimization algorithm and optimization parameters according to the association relation between each comparison mapping result and ideal LDR video stream data of each sample HDR video stream data;
The ideal LDR video stream data is input data corresponding to the highest quality picture that can be displayed when the display performs HDR display.
11. A computer device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the video playback method of any one of claims 1-6.
12. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the video playback method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110938403.0A CN113676773B (en) | 2021-08-16 | 2021-08-16 | Video playing method, system, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110938403.0A CN113676773B (en) | 2021-08-16 | 2021-08-16 | Video playing method, system, device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113676773A CN113676773A (en) | 2021-11-19 |
| CN113676773B true CN113676773B (en) | 2023-11-14 |
Family
ID=78543093
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110938403.0A Active CN113676773B (en) | 2021-08-16 | 2021-08-16 | Video playing method, system, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113676773B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114363702B (en) * | 2021-12-28 | 2023-09-08 | 上海网达软件股份有限公司 | Method, device, equipment and storage medium for converting SDR video into HDR video |
| CN117612482B (en) * | 2024-01-23 | 2024-04-26 | 深圳博邦诚光电有限公司 | Network playing method and system for LED display screen |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101707666A (en) * | 2009-11-26 | 2010-05-12 | 北京中星微电子有限公司 | Adjusting method and device with high dynamic range |
| CN105393525A (en) * | 2013-07-18 | 2016-03-09 | 皇家飞利浦有限公司 | Methods and apparatuses for creating code mapping functions for encoding an hdr image, and methods and apparatuses for use of such encoded images |
| CN105794216A (en) * | 2014-09-08 | 2016-07-20 | 索尼公司 | Image processing apparatus and image processing method |
| CN106101679A (en) * | 2016-08-23 | 2016-11-09 | 青岛海信电器股份有限公司 | The processing method of high dynamic range signal and processing system |
| CN108352059A (en) * | 2015-12-26 | 2018-07-31 | 英特尔公司 | For by high dynamic range（HDR）Content Transformation is at standard dynamic range（SDR）The video tone mapping of content |
| CN108805836A (en) * | 2018-05-31 | 2018-11-13 | 大连理工大学 | Method for correcting image based on the reciprocating HDR transformation of depth |
| CN108900823A (en) * | 2018-07-05 | 2018-11-27 | 华为技术有限公司 | A kind of method and device of video frequency signal processing |
| CN109155060A (en) * | 2016-05-25 | 2019-01-04 | 索尼公司 | Image processing apparatus, image processing method and program |
| CN109274985A (en) * | 2018-10-12 | 2019-01-25 | 腾讯科技（深圳）有限公司 | Video transcoding method, device, computer equipment and storage medium |
| CN109410126A (en) * | 2017-08-30 | 2019-03-01 | 中山大学 | A kind of tone mapping method of details enhancing and the adaptive high dynamic range images of brightness |
| WO2019170465A1 (en) * | 2018-03-06 | 2019-09-12 | Koninklijke Philips N.V. | Versatile dynamic range conversion processing |
| CN111246050A (en) * | 2014-02-25 | 2020-06-05 | 苹果公司 | System, apparatus and method for video data processing |
| CN111885393A (en) * | 2020-07-31 | 2020-11-03 | 广州华多网络科技有限公司 | Live broadcast method, system, storage medium and equipment |
| CN112449169A (en) * | 2021-01-28 | 2021-03-05 | 北京达佳互联信息技术有限公司 | Method and apparatus for tone mapping |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10218952B2 (en) * | 2016-11-28 | 2019-02-26 | Microsoft Technology Licensing, Llc | Architecture for rendering high dynamic range video on enhanced dynamic range display devices |
| EP3416363A1 (en) * | 2017-06-13 | 2018-12-19 | Koninklijke Philips N.V. | Gamut mapping for hdr (de)coding |
-
2021
- 2021-08-16 CN CN202110938403.0A patent/CN113676773B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101707666A (en) * | 2009-11-26 | 2010-05-12 | 北京中星微电子有限公司 | Adjusting method and device with high dynamic range |
| CN105393525A (en) * | 2013-07-18 | 2016-03-09 | 皇家飞利浦有限公司 | Methods and apparatuses for creating code mapping functions for encoding an hdr image, and methods and apparatuses for use of such encoded images |
| CN111246050A (en) * | 2014-02-25 | 2020-06-05 | 苹果公司 | System, apparatus and method for video data processing |
| CN105794216A (en) * | 2014-09-08 | 2016-07-20 | 索尼公司 | Image processing apparatus and image processing method |
| CN108352059A (en) * | 2015-12-26 | 2018-07-31 | 英特尔公司 | For by high dynamic range（HDR）Content Transformation is at standard dynamic range（SDR）The video tone mapping of content |
| CN109155060A (en) * | 2016-05-25 | 2019-01-04 | 索尼公司 | Image processing apparatus, image processing method and program |
| CN106101679A (en) * | 2016-08-23 | 2016-11-09 | 青岛海信电器股份有限公司 | The processing method of high dynamic range signal and processing system |
| CN109410126A (en) * | 2017-08-30 | 2019-03-01 | 中山大学 | A kind of tone mapping method of details enhancing and the adaptive high dynamic range images of brightness |
| WO2019170465A1 (en) * | 2018-03-06 | 2019-09-12 | Koninklijke Philips N.V. | Versatile dynamic range conversion processing |
| CN108805836A (en) * | 2018-05-31 | 2018-11-13 | 大连理工大学 | Method for correcting image based on the reciprocating HDR transformation of depth |
| CN108900823A (en) * | 2018-07-05 | 2018-11-27 | 华为技术有限公司 | A kind of method and device of video frequency signal processing |
| CN109274985A (en) * | 2018-10-12 | 2019-01-25 | 腾讯科技（深圳）有限公司 | Video transcoding method, device, computer equipment and storage medium |
| CN111885393A (en) * | 2020-07-31 | 2020-11-03 | 广州华多网络科技有限公司 | Live broadcast method, system, storage medium and equipment |
| CN112449169A (en) * | 2021-01-28 | 2021-03-05 | 北京达佳互联信息技术有限公司 | Method and apparatus for tone mapping |
Non-Patent Citations (1)
| Title |
|---|
| 基于局部线性变换的色阶映射算法;刘宗;席志红;;计算机测量与控制(第07期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113676773A (en) | 2021-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7407373B2 (en) | Display device, display method, and computer program | |
| US11588998B2 (en) | Conversion method and conversion apparatus | |
| JP6596125B2 (en) | Method and apparatus for creating a code mapping function for encoding of HDR images, and method and apparatus for use of such encoded images | |
| US9948884B2 (en) | Converting method and converting apparatus for converting luminance value of an input video into a second luminance value | |
| CN107203974B (en) | Method, apparatus and system for extended high dynamic range HDR to HDR tone mapping | |
| KR102135841B1 (en) | High dynamic range image signal generation and processing | |
| JP6495552B2 (en) | Dynamic range coding for images and video | |
| JP6619888B2 (en) | HDR video encoding and decoding | |
| CN113676773B (en) | Video playing method, system, device, computer equipment and storage medium | |
| JP6946325B2 (en) | Methods and devices for encoding high dynamic range pictures, corresponding coding methods and devices | |
| KR20170129004A (en) | Image processing device and image processing method thereof | |
| RU2771580C2 (en) | Conversion of dynamic metadata to support alternative tone reproduction | |
| JP2014532195A (en) | Apparatus and method for dynamic range conversion of images | |
| TW201223293A (en) | Extending image dynamic range | |
| JP6937781B2 (en) | Methods and equipment for coding / decoding high dynamic range images into coded bitstreams | |
| JP2020532805A (en) | Graphics-safe HDR image brightness regrading | |
| CN107395950B (en) | Media data processing method, device and system | |
| WO2023193524A1 (en) | Live streaming video processing method and apparatus, electronic device, computer-readable storage medium, and computer program product | |
| WO2023150074A1 (en) | Beta scale dynamic display mapping |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |