WO2024199012A1 - 直播流数据处理方法、设备及存储介质 - Google Patents

直播流数据处理方法、设备及存储介质 Download PDF

Info

Publication number
WO2024199012A1
WO2024199012A1 PCT/CN2024/082483 CN2024082483W WO2024199012A1 WO 2024199012 A1 WO2024199012 A1 WO 2024199012A1 CN 2024082483 W CN2024082483 W CN 2024082483W WO 2024199012 A1 WO2024199012 A1 WO 2024199012A1
Authority
WO
WIPO (PCT)
Prior art keywords
image quality
quality enhancement
target
streaming
enhancement level
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2024/082483
Other languages
English (en)
French (fr)
Inventor
高志新
宦如松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Publication of WO2024199012A1 publication Critical patent/WO2024199012A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27—Server based end-user applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/4424—Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

  • the embodiments of the present disclosure relate to the field of computer technology, and in particular, to a live streaming data processing method, device, and storage medium.
  • the data source of the entire live broadcast process is at the streaming end.
  • the data pushed by the streaming end to the streaming server has a great impact on the user experience of the viewing end.
  • the live streaming data is getting larger and larger.
  • the transmission of live streaming data causes a great increase in bandwidth costs and server costs.
  • the embodiments of the present disclosure provide a live streaming data processing method, device, and storage medium to save bandwidth costs and server costs without losing picture quality.
  • an embodiment of the present disclosure provides a method for processing live streaming data, including:
  • the target streaming bit rate is determined according to the target image quality enhancement information, and the live streaming data with enhanced image quality is pushed to the server according to the target streaming bit rate.
  • an embodiment of the present disclosure provides a live streaming data processing device, including:
  • a detection unit used to detect current performance parameters of the live broadcast device during the process of the live broadcast device recording live streaming data
  • a picture quality enhancement unit configured to determine a target picture quality of the live streaming data according to the current performance parameters Enhancement information, and enhance the image quality of the live streaming data according to the target image quality enhancement information;
  • a bit rate determination unit configured to determine a target streaming bit rate according to the target image quality enhancement information
  • the communication unit is used to push the live streaming data with enhanced image quality to the server according to the target streaming bit rate.
  • an embodiment of the present disclosure provides an electronic device, including: at least one processor and a memory;
  • the memory stores computer-executable instructions
  • the at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the live stream data processing method described in the first aspect and various possible designs of the first aspect.
  • an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored.
  • a processor executes the computer execution instructions, the live stream data processing method described in the first aspect and various possible designs of the first aspect is implemented.
  • an embodiment of the present disclosure provides a computer program product, including computer execution instructions.
  • a processor executes the computer execution instructions, it implements the live streaming data processing method described in the first aspect and various possible designs of the first aspect.
  • the live streaming data processing method, device and storage medium provided by the embodiments of the present disclosure detect the current performance parameters of the live streaming device during the process of the live streaming device recording the live streaming data; determine the target image quality enhancement information of the live streaming data according to the current performance parameters, and enhance the image quality of the live streaming data according to the target image quality enhancement information; determine the target streaming bitrate according to the target image quality enhancement information, and push the live streaming data with enhanced image quality to the server according to the target streaming bitrate.
  • FIG1 is an example diagram of an application scenario of a live streaming data processing method provided by an embodiment of the present disclosure
  • FIG2 is a schematic diagram of a flow chart of a method for processing live streaming data provided by an embodiment of the present disclosure
  • FIG3 is a schematic diagram of a flow chart of a method for processing live streaming data provided by another embodiment of the present disclosure
  • FIG4 is a schematic diagram of a flow chart of a live streaming data processing method provided by another embodiment of the present disclosure.
  • FIG5 is a structural block diagram of a live streaming data processing device provided by an embodiment of the present disclosure.
  • FIG. 6 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure.
  • the link of live streaming data transmission is roughly divided into three parts: the push end (anchor end), the stream server end and the pull end (viewer end).
  • the push end obtains video and audio data through live broadcast devices such as cameras and microphones, compresses and packages the live streaming data, and pushes it to the stream server end (server).
  • the stream server end is responsible for transcoding and distribution.
  • the pull end pulls the live streaming data from the stream server end and decompresses it, and restores the video and audio data for playback.
  • the data source of the entire live broadcast process is at the streaming end.
  • the quality of data pushed by the streaming end to the streaming server has a great impact on the user experience of the viewing end.
  • the live streaming data is getting larger and larger.
  • the transmission of live streaming data causes a great increase in bandwidth costs and server costs.
  • the streaming bit rate indicates the number of bits of audio and video data transmitted per second by the streaming end.
  • the streaming bit rate is proportional to the video picture quality. Reducing the streaming bit rate will lead to a decrease in picture quality.
  • the live streaming data can be enhanced in picture quality first, and then the streaming bit rate can be reduced after the picture quality is enhanced. This can offset the decrease in picture quality caused by reducing the streaming bit rate.
  • picture quality enhancement will occupy the performance of the live broadcast device. Therefore, the live streaming data can be enhanced to an appropriate degree according to the current performance of the live broadcast device, and then the live streaming data can be pushed to the server at a reduced streaming bit rate, thereby ensuring that bandwidth costs and server costs are saved without losing picture quality.
  • the live streaming data processing method disclosed in the present invention detects the current performance parameters of the live streaming device during the process of recording the live streaming data; determines the target image quality enhancement information of the live streaming data according to the current performance parameters, and processes the live streaming data according to the target image quality enhancement information.
  • the data is enhanced in picture quality; a target streaming bitrate is determined according to the target picture quality enhancement information, and the live streaming data with enhanced picture quality is pushed to the server according to the target streaming bitrate.
  • the live streaming data processing method provided by the present disclosure is applicable to the live streaming system as shown in FIG1, including a live streaming device 101 (streaming push end) of the anchor, a server 102 and a terminal device 103 (streaming pull end) of the audience.
  • the live streaming device 101 records the live streaming data.
  • the live streaming data processing method is executed, and the live streaming data is finally pushed to the server 102.
  • the server 102 is responsible for transcoding and distributing to the terminal device 103 of the audience.
  • the live streaming device 101 includes but is not limited to electronic devices such as mobile phones and tablet computers that can realize recording and streaming of live streaming data.
  • the user information and data involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.
  • FIG. 2 is a schematic diagram of a live streaming data processing method provided by an embodiment of the present disclosure.
  • the method of this embodiment can be applied in a live streaming device, and the live streaming data processing method includes:
  • the live broadcast device may start a detection sub-thread to detect the performance parameters.
  • S202 Determine target image quality enhancement information of live streaming data according to the current performance parameter, and perform image quality enhancement on the live streaming data according to the target image quality enhancement information.
  • the image quality enhancement of the live streaming data can be performed by running an image quality enhancement algorithm in the live streaming device, and the image quality enhancement algorithm consumes the performance of the live streaming device.
  • the image quality enhancement effect of the live streaming data the more performance of the live streaming device needs to be consumed.
  • the image quality enhancement effect can be divided into levels, and different image quality enhancement levels run image quality enhancement algorithms that can achieve the image quality enhancement effect corresponding to the level.
  • the performance of the live broadcast device consumed is also different.
  • the image quality enhancement level is divided into three image quality enhancement levels: the first image quality enhancement level, the second image quality enhancement level, and the third image quality enhancement level, wherein the first image quality enhancement level is higher than the second image quality enhancement level, and the second image quality enhancement level is higher than the third image quality enhancement level.
  • the higher image quality enhancement level (such as the first image quality enhancement level) needs to consume more device performance. It can also output better quality images.
  • Higher-level image quality enhancement algorithms are suitable for use in live broadcast rooms with higher-performance live broadcast equipment and that meet certain conditions.
  • the lower-level image quality enhancement level (such as the third image quality enhancement level) consumes low device performance.
  • the output image quality is not as good as the higher-level image quality enhancement level, it is suitable for more live broadcast equipment.
  • the target image quality enhancement information of the live broadcast stream data can be determined according to the current performance parameters of the live broadcast device, where the target image quality enhancement information is the target image quality enhancement level. Specifically, if the performance reflected by the current performance parameters of the live broadcast device is better, it means that the live broadcast device currently allows the running of a higher level of image quality enhancement algorithm, and therefore the target image quality enhancement level is higher.
  • image quality enhancement can be performed according to the target image quality enhancement level, so that the image quality of the live streaming data reaches the effect corresponding to the target image quality enhancement level.
  • the image quality enhancement algorithm corresponding to the target image quality enhancement level can be used to enhance the image quality of the live streaming data; wherein, the higher the target image quality enhancement level, the higher the image quality enhancement quality of the corresponding image quality enhancement algorithm.
  • the image quality enhancement algorithms corresponding to different image quality enhancement levels may differ in data processing granularity to achieve different image quality enhancement qualities.
  • the image quality enhancement algorithm corresponding to the low image quality enhancement level performs image quality enhancement at a granularity of 4 ⁇ 4 pixels
  • the image quality enhancement algorithm corresponding to the medium image quality enhancement level performs image quality enhancement at a granularity of 2 ⁇ 2 pixels
  • the image quality enhancement algorithm corresponding to the high image quality enhancement level performs image quality enhancement at a granularity of a single pixel
  • the image quality enhancement algorithm may be any algorithm that can achieve image quality enhancement, such as a neural network model.
  • S203 Determine a target streaming bitrate according to the target image quality enhancement information, and push the live streaming data with enhanced image quality to the server according to the target streaming bitrate.
  • the streaming bit rate of the live streaming data can be reduced, where the streaming bit rate represents the number of bits of live streaming data (audio and video data) transmitted per second by the streaming end.
  • the lower the streaming bit rate the lower the bandwidth cost and server cost.
  • the streaming bit rate is proportional to the picture quality.
  • the lower the streaming bit rate the lower the picture quality. Since the live streaming data has undergone picture quality enhancement, reducing the streaming bit rate on the basis of picture quality enhancement can ensure that the bandwidth cost and server cost are reduced without losing picture quality.
  • the streaming bitrate also needs to be adjusted according to the level of quality enhancement, that is, the target streaming bitrate is determined according to the target quality enhancement level, and the live streaming data is pushed to the server according to the target streaming bitrate.
  • the higher the quality enhancement level the greater the reduction in streaming bitrate, thereby ensuring the quality of the picture.
  • the live streaming data processing method of this embodiment detects the current performance parameters of the live streaming device during the process of recording the live streaming data by the live streaming device; determines the target quality enhancement level of the live streaming data according to the current performance parameters, and enhances the quality of the live streaming data according to the target quality enhancement level; determines the target streaming bitrate according to the target quality enhancement level, and pushes the live streaming data with enhanced quality to the server according to the target streaming bitrate.
  • This embodiment first enhances the quality of the live streaming data to an appropriate degree according to the current performance of the live streaming device, and then reduces the streaming bitrate of the live streaming data and pushes it to the server, thereby ensuring that bandwidth costs and server costs are saved without losing picture quality.
  • determining the target image quality enhancement information of the live streaming data according to the current performance parameter may specifically include:
  • the target image quality enhancement level corresponding to the current performance parameters is determined; wherein, in the mapping relationship between the performance parameters and the image quality enhancement level, the better the performance reflected by the performance parameters, the higher the corresponding image quality enhancement level.
  • the mapping relationship between performance parameters and image quality enhancement levels can be pre-configured.
  • the image quality enhancement levels are divided into three image quality enhancement levels: the first image quality enhancement level, the second image quality enhancement level, and the third image quality enhancement level.
  • the performance parameter range corresponding to each image quality enhancement level can be configured, where the higher the image quality enhancement level, the better the required performance. In other words, the better the performance reflected by the performance parameters, the higher the corresponding image quality enhancement level.
  • the current performance parameters can be matched with the performance parameter range corresponding to each image quality enhancement level according to the preset mapping relationship between the performance parameters and the image quality enhancement level, thereby determining the target image quality enhancement level corresponding to the current performance parameters.
  • mapping relationship between the performance parameters and the image quality enhancement levels described in the above embodiments includes a preset range of each performance parameter corresponding to each image quality enhancement level.
  • the image quality enhancement level is divided into three image quality enhancement levels: the first image quality enhancement level, the second image quality enhancement level, and the third image quality enhancement level.
  • the current performance parameters include four performance parameters: performance parameter 1, performance parameter 2, performance parameter 3, and performance parameter 4.
  • the preset range of each performance parameter corresponding to each image quality enhancement level is as follows:
  • the performance parameters 1 corresponding to the first image quality enhancement level, the second image quality enhancement level, and the third image quality enhancement level are respectively: less than or equal to a%, greater than a% and less than or equal to b%, greater than b% and less than or equal to c%, if it exceeds c%, the image quality enhancement function is turned off, wherein the critical values a, b, and c of performance parameter 1 are all in the range of 0 to 100, and a ⁇ b ⁇ c;
  • the performance parameters 2 corresponding to the first image quality enhancement level, the second image quality enhancement level, and the third image quality enhancement level are: less than or equal to d%, greater than d% and less than or equal to e%, and greater than e% and less than or equal to f%. If f% is exceeded, the image quality enhancement function will be turned off, wherein the critical values d, e, and f of the performance parameter 2 are all in the range of 0 to 100, and d ⁇ e ⁇ f;
  • the performance parameter 3 corresponding to the first image quality enhancement level, the second image quality enhancement level, and the third image quality enhancement level is less than or equal to g, greater than g and less than or equal to h, and greater than h and less than or equal to i. If i is exceeded, the image quality enhancement function will be turned off, wherein the critical values g, h, and i of the performance parameter 2 are all in the range of 0 to 1000, and g ⁇ h ⁇ i;
  • Performance parameter 4 can also be divided into four levels: level 1, level 2, level 3, and level 4. Level 1 corresponds to better performance than level 2, level 2 corresponds to better performance than level 3, and level 3 corresponds to better performance than level 4.
  • the first picture quality enhancement level corresponds to performance parameter 4 being level 1
  • the second picture quality enhancement level corresponds to performance parameter 4 being level 2
  • the third picture quality enhancement level corresponds to performance parameter 4 being level 3
  • performance parameter 4 being level 4 will turn off the picture quality enhancement function.
  • determining the target image quality enhancement level corresponding to the current performance parameter according to the mapping relationship between the preset performance parameter and the image quality enhancement level may specifically include:
  • the image quality enhancement level is determined to be the target image quality enhancement level corresponding to the current performance parameters.
  • the target image quality enhancement level is determined to be the lower image quality enhancement level.
  • performance parameter 1 ⁇ a%, performance parameter 2 ⁇ d%, performance parameter 3 ⁇ g are satisfied at the same time, and performance parameter 4 is at the first level, then all performance parameters in the current performance parameters are within the preset range of various performance parameters corresponding to the first image quality enhancement level, and the target image quality enhancement level is determined to be the first image quality enhancement level;
  • performance parameter 4 does not satisfy the preset range of various performance parameters corresponding to the first image quality enhancement level, but the unsatisfied performance parameter satisfies the preset range of each performance parameter corresponding to the second image quality enhancement level: a% ⁇ performance parameter 1 ⁇ b%, d% ⁇ performance parameter 2 ⁇ e%, g ⁇ performance parameter 3 ⁇ h, performance parameter 4 is at the second level, that is, at this time, at least one performance parameter of the current performance parameters is within the preset range of the performance parameter corresponding to the second image quality enhancement level, and all performance parameters do not exceed the upper limit of the preset range of each performance parameter corresponding to the second image quality enhancement level, it is determined that the target image quality enhancement level is the second image quality enhancement level;
  • performance parameter 4 exceeds the upper limit of the preset range of each performance parameter corresponding to the second image quality enhancement level, but the performance parameter satisfies the preset range of each performance parameter corresponding to the third image quality enhancement level: b% ⁇ performance parameter 1 ⁇ c%, e% ⁇ performance parameter 2 ⁇ f%, h ⁇ performance parameter 3 ⁇ i, performance parameter 4 is at the third level, that is, at this time, at least one performance parameter of the current performance parameters is in the preset range of the performance parameter corresponding to the third image quality enhancement level, and all performance parameters do not exceed the upper limit of the preset range of each performance parameter corresponding to the third image quality enhancement level, it is determined that the target image quality enhancement level is the third image quality enhancement level;
  • performance parameter 1 At least one of performance parameter 1, performance parameter 2, performance parameter 3, and performance parameter 4 exceeds the upper limit of the preset range of each performance parameter corresponding to the third image quality enhancement level, that is, at least one performance parameter satisfies performance parameter 1>c%, performance parameter 2>f%, and performance parameter 3>i, and performance parameter 4 is at the fourth level, then image quality enhancement is turned off, that is, the image quality enhancement level is the lowest.
  • the current live broadcast mode is some special live broadcast mode, such as a multi-player live broadcast mode (such as a PK (Player Kill) mode), which consumes more device performance
  • PK Player Kill
  • the image quality enhancement level of the live streaming data it can be as shown in Figure 3.
  • the target live broadcast mode includes but is not limited to a multi-person live broadcast mode.
  • the target image quality enhancement information of the live broadcast stream data may be determined according to the current performance parameters
  • the target picture quality enhancement information of the live broadcast stream data determined according to the current performance parameters is stopped, that is, the picture quality is still the initial picture quality at this time, and in order to ensure that the picture quality is not lost, the streaming bit rate is no longer reduced, that is, the live broadcast stream data is pushed to the server with the initial picture quality and the initial streaming bit rate, thereby ensuring the smooth operation of the target live broadcast mode.
  • determining the target streaming bitrate according to the target image quality enhancement information in S203 may specifically include:
  • S402 Determine the target streaming bitrate according to the initial streaming bitrate of the live streaming data and the reduction range of the streaming bitrate.
  • the streaming bitrate can be reduced to ensure that the bandwidth cost and the server cost are reduced without losing the picture quality.
  • the higher the quality enhancement level the greater the reduction in the streaming bitrate. Therefore, the reduction in the streaming bitrate can be determined according to the target quality enhancement level. Then, based on the initial streaming bitrate of the live streaming data, the streaming bitrate can be reduced by the determined streaming bitrate reduction to determine the target streaming bitrate.
  • the initial streaming bitrate is m Mbps
  • the target streaming bitrate is n*m Mbps, where 0 ⁇ n ⁇ 1.
  • a mapping relationship between a preset image quality enhancement level and a reduction in the push bit rate may be pre-configured.
  • the reduction in the push bit rate is expressed in the form of a coefficient
  • the high, medium, and low image quality enhancement levels correspond to coefficients x, y, and z, respectively, where x, y, and z are floating-point numbers in the range of 0 to 1, and x ⁇ y ⁇ z, that is, the push bit rates corresponding to the high, medium, and low image quality enhancement levels are x times, y times, and z times the initial push bit rate, respectively, and the reduction in the push bit rate decreases from large to small.
  • the streaming bitrate reduction amplitude corresponding to the target image quality enhancement level can be determined based on the mapping relationship between the preset image quality enhancement level and the streaming bitrate reduction amplitude; and then, based on the initial streaming bitrate, the streaming bitrate can be reduced by the determined streaming bitrate reduction amplitude to determine the target streaming bitrate.
  • the preset image quality enhancement level and the streaming bit rate reduction are pre-configured.
  • mapping the relationship between low and high amplitudes for any preset picture quality enhancement level, multiple picture qualities corresponding to the preset picture quality enhancement level at different push stream bit rate reduction amplitudes can be obtained, that is, different picture qualities after the picture quality enhancement of the preset picture quality enhancement level and the push stream bit rate reduction amplitudes are reduced by different reduction amplitudes.
  • the multiple picture qualities are compared with the original picture quality (without picture quality enhancement and without reducing the push stream bit rate).
  • the push stream bit rate reduction amplitude is determined to be the optimal push stream bit rate reduction amplitude for the preset picture quality enhancement level.
  • the push stream bit rate reduction amplitude corresponding to each preset picture quality enhancement level can be obtained, so that the mapping relationship between the picture quality enhancement level and the push stream bit rate reduction amplitude can be constructed. Based on the mapping relationship between the picture quality enhancement level and the push stream bit rate reduction amplitude, the maximum savings in bandwidth costs and server costs can be achieved.
  • the image quality is better than the original image quality when the streaming bitrate is reduced, that is, the degree of image quality enhancement caused by the preset image quality enhancement level is greater than the degradation of image quality caused by the reduction of streaming bitrate, then it can ensure that bandwidth cost and server cost are saved while improving image quality.
  • the balance between saving bandwidth cost and server cost and improving image quality can be achieved by adjusting the reduction of streaming bitrate, thereby improving image quality.
  • FIG5 is a structural block diagram of a live streaming data processing device provided by an embodiment of the present disclosure.
  • the live streaming data processing device 500 includes: a detection unit 501, a picture quality enhancement unit 502, a bit rate determination unit 503, and a communication unit 504.
  • the detection unit 501 is used to detect the current performance parameters of the live broadcast device during the process of the live broadcast device recording the live broadcast stream data;
  • the image quality enhancement unit 502 is used to determine a target image quality enhancement level of the live streaming data according to the current performance parameter, and perform image quality enhancement on the live streaming data according to the target image quality enhancement level;
  • a bit rate determination unit 503, configured to determine a target streaming bit rate according to the target image quality enhancement level
  • the communication unit 504 is used to push the live streaming data with enhanced image quality to the server according to the target streaming bit rate.
  • the target image quality enhancement information is a target image quality enhancement level.
  • the bit rate determination unit 503 determines the bit rate according to the target When the target streaming bitrate is determined based on the image quality enhancement information, it is used to:
  • the target streaming bitrate is determined according to the initial streaming bitrate of the live streaming data and the reduction range of the streaming bitrate.
  • the bitrate determination unit 503 when determining the reduction range of the streaming bitrate according to the target image quality enhancement level, is configured to:
  • the higher the image quality enhancement level the greater the corresponding reduction range of the streaming bit rate.
  • the code rate determination unit 503 is further configured to:
  • the multiple picture qualities are compared with the original picture quality, and the reduction amplitude of the streaming bitrate corresponding to the picture quality equivalent to the original picture quality is determined as the reduction amplitude of the streaming bitrate corresponding to the preset picture quality enhancement level, and a mapping relationship between the picture quality enhancement level and the reduction amplitude of the streaming bitrate is constructed.
  • the image quality enhancement unit 502 when determining the target image quality enhancement level of the live streaming data according to the current performance parameter, is configured to:
  • a target image quality enhancement level corresponding to the current performance parameter is determined.
  • the current performance parameters include at least two performance parameters
  • the mapping relationship between the performance parameters and the image quality enhancement levels includes a preset range of each performance parameter corresponding to each image quality enhancement level.
  • the image quality enhancement unit 502 determines the target image quality enhancement level corresponding to the current performance parameter according to the mapping relationship between the preset performance parameter and the image quality enhancement level, it is configured to:
  • the image quality enhancement level is determined to be the target image quality enhancement level corresponding to the current performance parameters.
  • the image quality enhancement unit 502 before determining the target image quality enhancement information of the live streaming data according to the current performance parameter, is further configured to:
  • the determining target picture quality enhancement information of the live streaming data according to the current performance parameter includes:
  • the target image quality enhancement information of the live broadcast stream data is determined according to the current performance parameters.
  • the image quality enhancement unit 502 is further configured to:
  • the target image quality enhancement information of the live streaming data is determined according to the current performance parameters, and the live streaming data is pushed to the server with the initial image quality and the initial streaming bit rate.
  • the target live broadcast mode includes a multi-person live broadcast mode.
  • the device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar, and this embodiment will not be repeated here.
  • FIG6 it shows a schematic diagram of the structure of an electronic device 600 suitable for implementing the embodiment of the present disclosure
  • the electronic device 600 may be a terminal device or a server.
  • the terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc.
  • PDAs personal digital assistants
  • PMPs portable multimedia players
  • vehicle terminals such as vehicle navigation terminals
  • fixed terminals such as digital TVs, desktop computers, etc.
  • the electronic device shown in FIG6 is only an example and should not bring any limitation to the functions and scope of use of the embodiment of the present disclosure.
  • the electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 to a random access memory (RAM) 603.
  • a processing device e.g., a central processing unit, a graphics processing unit, etc.
  • RAM random access memory
  • Various programs and data required for the operation of the electronic device 600 are also stored in the RAM 603.
  • the processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604.
  • An input/output (I/O) interface 605 is also connected to the bus 604.
  • the electronic device 600 includes an input device 606 such as a disk, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 such as a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 608 such as a magnetic tape, a hard disk, etc.; and a communication device 609.
  • the communication device 609 can allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data.
  • FIG. 6 shows an electronic device 600 with various devices, it should be understood that it is not required to implement or have all the devices shown. More or fewer devices may be implemented or provided instead.
  • an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart.
  • the computer program can be downloaded and installed from a network through a communication device 609, or installed from a storage device 608, or installed from a ROM 602.
  • the processing device 601 the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
  • the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above.
  • Computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
  • a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device.
  • a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried.
  • This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above.
  • Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device.
  • the program code contained on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any of the above. The right combination.
  • the computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device.
  • the computer-readable medium carries one or more programs.
  • the electronic device executes the method shown in the above embodiment.
  • Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages.
  • the program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server.
  • the remote computer may be connected to the user's computer via any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
  • LAN Local Area Network
  • WAN Wide Area Network
  • each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function.
  • the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved.
  • each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
  • the units involved in the embodiments described in the present disclosure may be implemented by software or hardware.
  • the name of a unit does not limit the unit itself in some cases.
  • the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".
  • exemplary types of hardware logic components include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
  • FPGAs field programmable gate arrays
  • ASICs application specific integrated circuits
  • ASSPs application specific standard products
  • SOCs systems on chips
  • CPLDs complex programmable logic devices
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment.
  • a machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • a machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing.
  • a more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read-only memory
  • EPROM or flash memory erasable programmable read-only memory
  • CD-ROM portable compact disk read-only memory
  • CD-ROM compact disk read-only memory
  • magnetic storage device or any suitable combination of the foregoing.
  • a method for processing live streaming data including:
  • the target streaming bit rate is determined according to the target image quality enhancement information, and the live streaming data with enhanced image quality is pushed to the server according to the target streaming bit rate.
  • the target image quality enhancement information is a target image quality enhancement level.
  • determining a target streaming bitrate according to the target image quality enhancement information includes:
  • the target streaming bitrate is determined according to the initial streaming bitrate of the live streaming data and the reduction range of the streaming bitrate.
  • determining the reduction range of the streaming bitrate according to the target image quality enhancement level includes:
  • the higher the image quality enhancement level the greater the corresponding reduction range of the streaming bit rate.
  • the method further includes:
  • the multiple picture qualities are compared with the original picture quality, and the reduction amplitude of the streaming bitrate corresponding to the picture quality equivalent to the original picture quality is determined as the reduction amplitude of the streaming bitrate corresponding to the preset picture quality enhancement level, and a mapping relationship between the picture quality enhancement level and the reduction amplitude of the streaming bitrate is constructed.
  • determining a target image quality enhancement level of live streaming data according to the current performance parameter includes:
  • a target image quality enhancement level corresponding to the current performance parameter is determined.
  • the current performance parameters include at least two performance parameters
  • the mapping relationship between the performance parameters and the image quality enhancement levels includes a preset range of each performance parameter corresponding to each image quality enhancement level.
  • determining the target image quality enhancement level corresponding to the current performance parameter according to the mapping relationship between the preset performance parameter and the image quality enhancement level includes:
  • the image quality enhancement level is determined to be the target image quality enhancement level corresponding to the current performance parameters.
  • the method before determining the target image quality enhancement information of the live streaming data according to the current performance parameter, the method further includes:
  • the determining target picture quality enhancement information of the live streaming data according to the current performance parameter includes:
  • the target image quality enhancement information of the live broadcast stream data is determined according to the current performance parameters.
  • the method further includes:
  • the target image quality enhancement information of the live streaming data is determined according to the current performance parameters, and the live streaming data is pushed to the server with the initial image quality and the initial streaming bit rate.
  • the target live broadcast mode includes a multi-person live broadcast mode.
  • a live streaming data processing device including:
  • a detection unit used to detect current performance parameters of the live broadcast device during the process of the live broadcast device recording live streaming data
  • a picture quality enhancement unit configured to determine target picture quality enhancement information of the live streaming data according to the current performance parameter, and perform picture quality enhancement on the live streaming data according to the target picture quality enhancement information
  • a bit rate determination unit configured to determine a target streaming bit rate according to the target image quality enhancement information
  • the communication unit is used to push the live streaming data with enhanced image quality to the server according to the target streaming bit rate.
  • the target image quality enhancement information is a target image quality enhancement level.
  • the bit rate determination unit determines the target streaming bit rate according to the target image quality enhancement information, it is configured to:
  • the target streaming bitrate is determined according to the initial streaming bitrate of the live streaming data and the reduction range of the streaming bitrate.
  • the bitrate determination unit when determining the reduction range of the streaming bitrate according to the target image quality enhancement level, is configured to:
  • the higher the image quality enhancement level the greater the corresponding reduction range of the streaming bit rate.
  • the code rate determination unit is further configured to:
  • the multiple picture qualities are compared with the original picture quality, and the reduction amplitude of the streaming bitrate corresponding to the picture quality equivalent to the original picture quality is determined as the reduction amplitude of the streaming bitrate corresponding to the preset picture quality enhancement level, and a mapping relationship between the picture quality enhancement level and the reduction amplitude of the streaming bitrate is constructed.
  • the image quality enhancement unit determines the target image quality enhancement level of the live streaming data according to the current performance parameter, it is configured to:
  • a target image quality enhancement level corresponding to the current performance parameter is determined.
  • the current performance parameters include at least two performance parameters
  • the mapping relationship between the performance parameters and the image quality enhancement levels includes a preset range of each performance parameter corresponding to each image quality enhancement level.
  • the image quality enhancement unit determines the target image quality enhancement level corresponding to the current performance parameter according to the mapping relationship between the preset performance parameter and the image quality enhancement level, it is used to:
  • the image quality enhancement level is determined to be the target image quality enhancement level corresponding to the current performance parameters.
  • the image quality enhancement unit before determining the target image quality enhancement information of the live streaming data according to the current performance parameter, is further configured to:
  • the determining target picture quality enhancement information of the live streaming data according to the current performance parameter includes:
  • the target image quality enhancement information of the live broadcast stream data is determined according to the current performance parameters.
  • the image quality enhancement unit is further configured to:
  • the target image quality enhancement information of the live streaming data is determined according to the current performance parameters, and the live streaming data is pushed to the server with the initial image quality and the initial streaming bit rate.
  • the target live broadcast mode includes a multi-person live broadcast mode.
  • an electronic device comprising: at least one processor and a memory;
  • the memory stores computer-executable instructions
  • the at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the live stream data processing method described in the first aspect and various possible designs of the first aspect.
  • a computer-readable storage medium stores computer execution instructions.
  • the live stream data processing method described in the first aspect and various possible designs of the first aspect is implemented.
  • a computer program product comprising computer execution instructions.
  • a processor executes the computer execution instructions, the live stream data processing method as described in the first aspect and various possible designs of the first aspect is implemented.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本公开提供一种直播流数据处理方法、设备及存储介质，在直播设备录制直播流数据的过程中，检测直播设备的当前性能参数（S201）；根据当前性能参数确定直播流数据的目标画质增强信息，并根据目标画质增强信息对直播流数据进行画质增强（S202）；根据目标画质增强信息确定目标推流码率，并根据目标推流码率向服务端推送画质增强后的直播流数据（S203）。

Description

直播流数据处理方法、设备及存储介质
本申请是以申请号为202310317744.5，申请日为2023年3月27日的中国申请为基础，并主张其优先权，该中国申请的公开内容在此作为整体引入本申请中。
技术领域
本公开实施例涉及计算机技术领域，尤其涉及一种直播流数据处理方法、设备及存储介质。
背景技术
直播整体流程的数据源头在推流端，推流端推送给流服务端的数据情况对看播端的用户体验有很大的影响，而随着直播设备的不断更新升级，直播流数据越来越大，直播流数据的传输造成带宽成本和服务端成本的极大增加。
发明内容
本公开实施例提供一种直播流数据处理方法、设备及存储介质，以在不损失画面质量的基础上节省带宽成本和服务端成本。
第一方面，本公开实施例提供一种直播流数据处理方法，包括：
在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数；
根据所述当前性能参数确定直播流数据的目标画质增强信息，并根据所述目标画质增强信息对所述直播流数据进行画质增强；
根据所述目标画质增强信息确定目标推流码率，并根据所述目标推流码率向服务端推送画质增强后的直播流数据。
第二方面，本公开实施例提供一种直播流数据处理设备，包括：
检测单元，用于在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数；
画质增强单元，用于根据所述当前性能参数确定直播流数据的目标画质 增强信息，并根据所述目标画质增强信息对所述直播流数据进行画质增强；
码率确定单元，用于根据所述目标画质增强信息确定目标推流码率；
通信单元，用于根据所述目标推流码率向服务端推送画质增强后的直播流数据。
第三方面，本公开实施例提供一种电子设备，包括：至少一个处理器和存储器；
所述存储器存储计算机执行指令；
所述至少一个处理器执行所述存储器存储的计算机执行指令，使得所述至少一个处理器执行如上第一方面以及第一方面各种可能的设计所述的直播流数据处理方法。
第四方面，本公开实施例提供一种计算机可读存储介质，所述计算机可读存储介质中存储有计算机执行指令，当处理器执行所述计算机执行指令时，实现如上第一方面以及第一方面各种可能的设计所述的直播流数据处理方法。
第五方面，本公开实施例提供一种计算机程序产品，包括计算机执行指令，当处理器执行所述计算机执行指令时，实现如上第一方面以及第一方面各种可能的设计所述的直播流数据处理方法。
本公开实施例提供的直播流数据处理方法、设备及存储介质，在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数；根据所述当前性能参数确定直播流数据的目标画质增强信息，并根据所述目标画质增强信息对所述直播流数据进行画质增强；根据所述目标画质增强信息确定目标推流码率，并根据所述目标推流码率向服务端推送画质增强后的直播流数据。
附图说明
为了更清楚地说明本公开实施例或相关技术中的技术方案，下面将对实施例或相关技术描述中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本公开的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本公开一实施例提供的直播流数据处理方法的应用场景示例图；
图2为本公开一实施例提供的直播流数据处理方法流程示意图；
图3为本公开另一实施例提供的直播流数据处理方法流程示意图；
图4为本公开另一实施例提供的直播流数据处理方法流程示意图；
图5为本公开一实施例提供的直播流数据处理设备的结构框图；
图6为本公开一实施例提供的电子设备的硬件结构示意图。
具体实施方式
为使本公开实施例的目的、技术方案和优点更加清楚，下面将结合本公开实施例中的附图，对本公开实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本公开一部分实施例，而不是全部的实施例。基于本公开中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本公开保护的范围。
相关技术中直播流数据传输的链路大致分成三部分，推流端(主播端)、流服务端和拉流端(看播端)，推流端通过摄像头和麦克风等直播设备得到视频和音频数据，经过压缩和打包得到直播流数据推送给流服务端(服务器)，流服务端负责转码和分发，拉流端拉取流服务端的直播流数据后解压缩，将视频和音频数据还原播放。
直播整体流程的数据源头在推流端，推流端推送给流服务端的数据质量对看播端的用户体验有很大的影响，而随着直播设备的不断更新升级，直播流数据越来越大，直播流数据的传输造成带宽成本和服务器成本的极大增加。
为了解决上述技术问题，本公开考虑到降低推流码率可以降低带宽成本和服务器成本，推流码率表示推流端每秒传输音视频数据的比特位数，推流码率和视频画面质量成正比，降低推流码率会导致画质下降，而为了不损失画质，可先对直播流数据进行画质增强，在画质增强后再进行降低推流码率，则可抵消降低推流码率导致的画质下降，而画质增强会占用直播设备的性能，因此可根据直播设备的当前性能对直播流数据进行合适程度的画质增强，再对直播流数据降低推流码率推送给服务端，从而保证在不损失画面质量的基础上节省带宽成本和服务器成本。
具体的，本公开的直播流数据处理方法，在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数；根据所述当前性能参数确定直播流数据的目标画质增强信息，并根据所述目标画质增强信息对所述直播流 数据进行画质增强；根据所述目标画质增强信息确定目标推流码率，并根据所述目标推流码率向服务端推送画质增强后的直播流数据。
本公开提供的直播流数据处理方法，适用于如图1所示的直播系统，包括主播端的直播设备101(推流端)、服务端102和观众的终端设备103(拉流端)，直播设备101录制直播流数据，在直播设备101录制直播流数据的过程中，执行上述的直播流数据处理方法，并最终将直播流数据推送给服务端102，服务端102负责转码和分发给观众的终端设备103。其中直播设备101包括但不限于手机、平板电脑等能够实现录制直播流数据和推流的电子设备。
需要说明的是，本公开所涉及的用户信息和数据，均为经用户授权或者经过各方充分授权的信息和数据，并且相关数据的收集、使用和处理需要遵守相关国家和地区的相关法律法规和标准，并提供有相应的操作入口，供用户选择授权或者拒绝。
下面将结合具体实施例对本公开的直播流数据处理方法进行详细介绍。
参考图2，图2为本公开一实施例提供的直播流数据处理方法流程示意图。本实施例的方法可以应用在直播设备中，该直播流数据处理方法包括：
S201、在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数。
可选的，直播设备可开启一个检测子线程，检测所述性能参数。
S202、根据所述当前性能参数确定直播流数据的目标画质增强信息，并根据所述目标画质增强信息对所述直播流数据进行画质增强。
在本实施例中，对直播流数据进行画质增强可在直播设备中运行画质增强算法，而画质增强算法需要消耗直播设备的性能，对直播流数据画质增强效果越好，则需要消耗直播设备越多的性能。
可选的，可对画质增强效果划分级别，不同的画质增强级别运行能够达到该级别对应画质增强效果的画质增强算法，相应的，消耗直播设备的性能也有所不同，例如画质增强级别划分为三个画质增强级别：第一画质增强级别、第二画质增强级别、第三画质增强级别，其中第一画质增强级别高于第二画质增强级别，第二画质增强级别高于第三画质增强级别，三个画质增强级别中更高的画质增强级别(如第一画质增强级别)需要消耗更多的设备性 能，同时也能输出更优质的图像，更高级别画质增强算法适合应用在更高性能直播设备且能满足一定条件的直播间中；而三个画质增强级别中较低级别的画质增强级别(如第三画质增强级别)消耗设备性能低，输出的图像质量虽不如更高级别的画质增强级别，但适用于更多直播设备。
为了保证直播设备性能的稳定，可根据直播设备的当前性能参数确定直播流数据的目标画质增强信息，其中目标画质增强信息为目标画质增强级别，具体的，若直播设备的当前性能参数所反映的性能越好，则说明直播设备当前允许运行越高级别的画质增强算法，因此目标画质增强级别越高。
在确定目标画质增强级别后，则可根据目标画质增强级别进行画质增强，从而使得直播流数据的画质达到目标画质增强级别对应的效果。具体的，可采用目标画质增强级别对应的画质增强算法，对直播流数据进行画质增强；其中，所述目标画质增强级别越高，对应的画质增强算法的画质增强质量越高。可选的，不同画质增强级别对应的画质增强算法可以在数据处理粒度上存在差别，达到不同画质增强质量，例如，低画质增强级别对应的画质增强算法以4×4个像素点为粒度进行画质增强，中画质增强级别对应的画质增强算法以2×2个像素点为粒度进行画质增强，高画质增强级别对应的画质增强算法以单个像素点为粒度进行画质增强，其中画质增强算法可以是任意能够实现画质增强的算法，例如神经网络模型。
S203、根据所述目标画质增强信息确定目标推流码率，并根据所述目标推流码率向服务端推送画质增强后的直播流数据。
在本实施例中，为了节省带宽成本，降低服务端成本，可对直播流数据降低推流码率，其中推流码率表示推流端每秒传输直播流数据(音视频数据)的比特位数，推流码率越低，越能降低带宽成本和服务端成本，但是推流码率和画面质量成正比，推流码率越低画面质量越低，而由于直播流数据经过了画质增强，因此在画质增强基础上降低推流码率，可以保证在不损失画面质量的基础上降低带宽成本和服务端成本。
在直播流数据经过了不同级别的画质增强的情况下，为了保证不损失画面质量，因此推流码率也需要根据画质增强的级别进行调整，也即根据目标画质增强级别确定目标推流码率，并根据目标推流码率向服务端推送直播流数据。可选的，画质增强级别越高，则推流码率降低幅度可以越大，从而在保 证在不损失画面质量的基础上对带宽成本和服务端成本降低幅度越大。
本实施例的直播流数据处理方法，在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数；根据所述当前性能参数确定直播流数据的目标画质增强级别，并根据所述目标画质增强级别对所述直播流数据进行画质增强；根据所述目标画质增强级别确定目标推流码率，并根据所述目标推流码率向服务端推送画质增强后的直播流数据。本实施例先根据直播设备的当前性能对直播流数据进行合适程度的画质增强，再对直播流数据降低推流码率推送给服务端，从而保证在不损失画面质量的基础上节省带宽成本和服务端成本。
在上述任一实施例的基础上，所述根据所述当前性能参数确定直播流数据的目标画质增强信息，具体可包括：
根据预设的性能参数与画质增强级别之间的映射关系，确定所述当前性能参数对应的目标画质增强级别；其中，在所述性能参数与画质增强级别之间的映射关系中，性能参数所反映的性能越好，则对应的画质增强级别越高。
在本实施例中，可预先配置性能参数与画质增强级别之间的映射关系，例如画质增强级别划分为三个画质增强级别：第一画质增强级别、第二画质增强级别、第三画质增强级别，可配置每种画质增强级别对应的性能参数范围，其中画质增强级别越高，所需的性能越好，换言之，性能参数所反映的性能越好，则对应的画质增强级别越高。
在确定目标画质增强级别时，可根据预设的性能参数与画质增强级别之间的映射关系，将当前性能参数与每种画质增强级别对应的性能参数范围进行匹配，从而确定当前性能参数对应的目标画质增强级别。
相应的，上述实施例中所述的性能参数与画质增强级别之间的映射关系包括各画质增强级别对应的每种性能参数的预设范围。
例如，画质增强级别划分为三个画质增强级别：第一画质增强级别、第二画质增强级别、第三画质增强级别，当前性能参数中包括四种性能参数：性能参数1、性能参数2、性能参数3、性能参数4，各画质增强级别对应的每种性能参数的预设范围如下：
第一画质增强级别、第二画质增强级别、第三画质增强级别对应的性能参数1分别为：小于等于a％、大于a％且小于等于b％、大于b％且小于等于 c％，如果超过c％关闭画质增强功能，其中性能参数1的临界值a、b、c都在0～100范围，并且a<b<c；
第一画质增强级别、第二画质增强级别、第三画质增强级别对应的性能参数2分别为：小于等于d％、大于d％且小于等于e％、大于e％且小于等于f％，如果超过f％会关闭画质增强功能，其中性能参数2的临界值d、e、f都在0～100范围，并且d<e<f；
第一画质增强级别、第二画质增强级别、第三画质增强级别对应的性能参数3小于等于g、大于g且小于等于h、大于h且小于等于i，如果超过i会关闭画质增强功能，其中性能参数2的临界值g、h、i都在0～1000范围，并且g<h<i；
性能参数4情况也可分为四个级别：第一级别、第二级别、第三级别、第四级别，第一级别对应的性能优于第二级别，第二级别对应的性能优于第三级别，第三级别对应的性能优于第四级别。第一画质增强级别对应性能参数4为第一级别，第二画质增强级别对应性能参数4为第二级别，第三画质增强级别对应性能参数4为第三级别，性能参数4为第四级别会关闭画质增强功能。
在上述实施例的基础上，所述根据预设的性能参数与画质增强级别之间的映射关系，确定所述当前性能参数对应的目标画质增强级别，具体可包括：
若所述当前性能参数中至少一种性能参数处于某一画质增强级别对应的该种性能参数的预设范围内，且所述当前性能参数中所有性能参数均未超过该画质增强级别对应的每种性能参数的预设范围上限，则确定该画质增强级别为所述当前性能参数对应的目标画质增强级别。
在本实施例中，在将当前性能参数中各性能参数与各画质增强级别对应的各种性能参数的预设范围进行比较时，采用类似于木桶效应的方式，只要任一性能参数落入到更低一级画质增强级别该种性能参数的预设范围内、且未超过预设范围上限，则确定目标画质增强级别为该更低一级画质增强级别。
例如上述实施例中，若同时满足性能参数1≤a％，性能参数2≤d％，性能参数3≤g，性能参数4处于第一级别，则当前性能参数中所有性能参数处于第一画质增强级别对应的各种性能参数的预设范围内，确定目标画质增强级别为第一画质增强级别；
若性能参数1、性能参数2、性能参数3、性能参数4至少一个性能参数不满足第一画质增强级别对应的各种性能参数的预设范围，但该不满足的性能参数满足第二画质增强级别对应的每种性能参数的预设范围：a％＜性能参数1≤b％，d％＜性能参数2≤e％，g＜性能参数3≤h，性能参数4处于第二级别，也即此时当前性能参数中至少一个性能参数处于第二画质增强级别对应的该种性能参数的预设范围内，而所有性能参数均未超过第二画质增强级别对应的每种性能参数的预设范围上限，确定目标画质增强级别为第二画质增强级别；
若性能参数1、性能参数2、性能参数3、性能参数4至少一个性能参数超过第二画质增强级别对应的每种性能参数的预设范围上限，但该性能参数满足第三画质增强级别对应的每种性能参数的预设范围：b％＜性能参数1≤c％，e％＜性能参数2≤f％，h＜性能参数3≤i，性能参数4处于第三级别，也即此时当前性能参数中至少一个性能参数处于第三画质增强级别对应的该种性能参数的预设范围，而所有性能参数均未超过第三画质增强级别对应的每种性能参数的预设范围上限，确定目标画质增强级别为第三画质增强级别；
若性能参数1、性能参数2、性能参数3、性能参数4至少一个性能参数超过第三画质增强级别对应的每种性能参数的预设范围上限，也即至少一个性能参数满足性能参数1＞c％，性能参数2＞f％，性能参数3＞i，性能参数4处于第四级别，则关闭画质增强，也即画质增强级别最低。
在上述任一实施例的基础上，考虑到当前直播模式为某些特殊的直播模式，例如多人连麦直播模式(如PK(Player Kill)模式)，会消耗更多的设备性能，为了保证当前直播模式的正常运行，需要关闭画质增强，避免画质增强造成的性能问题。因此，在根据所述当前性能参数确定直播流数据的目标画质增强级别前，可如图3所示。
S301、判断当前直播模式是否为目标直播模式；
其中目标直播模式包括但不限于多人连麦直播模式。
S302、若确定当前直播模式不为目标直播模式，则可继续执行根据所述当前性能参数确定直播流数据的目标画质增强信息；
S303、若确定当前直播模式为目标直播模式，则停止执行根据所述当前性能参数确定直播流数据的目标画质增强信息，并以初始画质以及初始推流 码率向所述服务端推送所述直播流数据。
在本实施例中，若当前直播模式为目标直播模式，为了避免画质增强造成的性能问题，停止执行根据所述当前性能参数确定直播流数据的目标画质增强信息，也即此时画质仍为初始画质，而为了保证不损失画质，也不再降低推流码率，也即以初始画质以及初始推流码率向服务端推送所述直播流数据，从而保证目标直播模式的流畅运行。
在上述任一实施例的基础上，如图4所示，S203所述的根据所述目标画质增强信息确定目标推流码率，具体可包括：
S401、根据所述目标画质增强级别确定推流码率降低幅度；
S402、根据所述直播流数据的初始推流码率以及所述推流码率降低幅度，确定所述目标推流码率。
在本实施例中，由于直播流数据经过了画质增强，因此可降低推流码率，保证在不损失画面质量的基础上降低带宽成本和服务端成本，而画质增强级别越高，则推流码率降低幅度可以越大，因此可根据目标画质增强级别确定推流码率降低幅度，进而在直播流数据的初始推流码率基础上，以所确定的推流码率降低幅度降低推流码率，确定目标推流码率。例如，初始推流码率为m Mbps，目标推流码率为n*m Mbps，其中0＜n＜1。
具体的，可预先配置预设的画质增强级别与推流码率降低幅度之间的映射关系，在所述画质增强级别与推流码率降低幅度之间的映射关系中，画质增强级别越高，则对应的推流码率降低幅度越大，例如，推流码率降低幅度以系数的形式表示，高、中、低画质增强级别分别对应系数x、y、z，其中x、y、z是0～1范围的浮点数，并且x＜y＜z，也即高、中、低画质增强级别对应的推流码率分别为初始推流码率的x倍、y倍、z倍，推流码率降低幅度由大减小。
因此，在确定所述目标推流码率时，可根据预设的画质增强级别与推流码率降低幅度之间的映射关系，确定所述目标画质增强级别对应的推流码率降低幅度；进而在初始推流码率基础上，以所确定的推流码率降低幅度降低推流码率，确定目标推流码率。
在上述实施例的基础上，在预先配置预设的画质增强级别与推流码率降 低幅度之间的映射关系时，对于任一预设画质增强级别可获取该预设画质增强级别在不同推流码率降低幅度下对应的多个画质，也即经过该预设画质增强级别的画质增强后以不同降低幅度降低推流码率后的不同画质，将该多个画质与原始画质(未经画质增强、未降低推流码率)进行对比，若某一推流码率降低幅度下画质与原始画质相当，则确定该推流码率降低幅度为该预设画质增强级别的最优的推流码率降低幅度。通过对不同预设画质增强级别进行上述过程，可得到每一预设画质增强级别对应的推流码率降低幅度，从而可构建画质增强级别与推流码率降低幅度之间的映射关系，基于画质增强级别与推流码率降低幅度之间的映射关系可实现最大化的节省带宽成本和服务端成本。
当然，若推流码率降低幅度下画质优于原始画质，也即预设画质增强级别对画质增强的程度大于推流码率降低导致画质下降，则可保证节省带宽成本和服务端成本的同时，也提高画质，可以通过调节推流码率降低幅度达到节省带宽成本和服务端成本和提高画质之间的平衡，画质提高。
对应于上文实施例的直播流数据处理方法，图5为本公开实施例提供的直播流数据处理设备的结构框图。为了便于说明，仅示出了与本公开实施例相关的部分。参照图5，所述直播流数据处理设备500包括：检测单元501、画质增强单元502、码率确定单元503以及通信单元504。
其中，检测单元501，用于在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数；
画质增强单元502，用于根据所述当前性能参数确定直播流数据的目标画质增强级别，并根据所述目标画质增强级别对所述直播流数据进行画质增强；
码率确定单元503，用于根据所述目标画质增强级别确定目标推流码率；
通信单元504，用于根据所述目标推流码率向服务端推送画质增强后的直播流数据。
在本公开的一个或多个实施例中，所述目标画质增强信息为目标画质增强级别。
在本公开的一个或多个实施例中，所述码率确定单元503在根据所述目 标画质增强信息确定目标推流码率时，用于：
根据所述目标画质增强级别确定推流码率降低幅度；
根据所述直播流数据的初始推流码率以及所述推流码率降低幅度，确定所述目标推流码率。
在本公开的一个或多个实施例中，所述码率确定单元503在根据所述目标画质增强级别确定推流码率降低幅度时，用于：
根据预设的画质增强级别与推流码率降低幅度之间的映射关系，确定所述目标画质增强级别对应的推流码率降低幅度；
其中，在所述画质增强级别与推流码率降低幅度之间的映射关系中，画质增强级别越高，则对应的推流码率降低幅度越大。
在本公开的一个或多个实施例中，所述码率确定单元503还用于：
获取预设画质增强级别在不同推流码率降低幅度下对应的多个画质；
将所述多个画质与原始画质进行对比，确定与原始画质相当的画质对应的推流码率降低幅度，作为预设画质增强级别对应的推流码率降低幅度，构建画质增强级别与推流码率降低幅度之间的映射关系。
在本公开的一个或多个实施例中，所述画质增强单元502在根据所述当前性能参数确定直播流数据的目标画质增强级别时，用于：
根据预设的性能参数与画质增强级别之间的映射关系，确定所述当前性能参数对应的目标画质增强级别。
在本公开的一个或多个实施例中，所述当前性能参数包括至少两种性能参数；
所述性能参数与画质增强级别之间的映射关系包括各画质增强级别对应的每种性能参数的预设范围。
在本公开的一个或多个实施例中，所述画质增强单元502在根据预设的性能参数与画质增强级别之间的映射关系，确定所述当前性能参数对应的目标画质增强级别时，用于：
若所述当前性能参数中至少一种性能参数处于某一画质增强级别对应的该种性能参数的预设范围内，且所述当前性能参数中所有性能参数均未超过该画质增强级别对应的每种性能参数的预设范围上限，则确定该画质增强级别为所述当前性能参数对应的目标画质增强级别。
在本公开的一个或多个实施例中，所述画质增强单元502在根据所述当前性能参数确定直播流数据的目标画质增强信息前，还用于：
判断当前直播模式是否为目标直播模式；
所述根据所述当前性能参数确定直播流数据的目标画质增强信息，包括：
若确定当前直播模式不为目标直播模式，则根据所述当前性能参数确定直播流数据的目标画质增强信息。
在本公开的一个或多个实施例中，所述画质增强单元502还用于：
若确定当前直播模式为目标直播模式，则停止执行根据所述当前性能参数确定直播流数据的目标画质增强信息，并以初始画质以及初始推流码率向所述服务端推送所述直播流数据。
在本公开的一个或多个实施例中，所述目标直播模式包括多人连麦直播模式。
本实施例提供的设备，可用于执行上述方法实施例的技术方案，其实现原理和技术效果类似，本实施例此处不再赘述。
参考图6，其示出了适于用来实现本公开实施例的电子设备600的结构示意图，该电子设备600可以为终端设备或服务器。其中，终端设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、个人数字助理(Personal Digital Assistant，简称PDA)、平板电脑(Portable Android Device，简称PAD)、便携式多媒体播放器(Portable Media Player，简称PMP)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。图6示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
如图6所示，电子设备600可以包括处理装置(例如中央处理器、图形处理器等)601，其可以根据存储在只读存储器(Read Only Memory，简称ROM)602中的程序或者从存储装置608加载到随机访问存储器(Random Access Memory，简称RAM)603中的程序而执行各种适当的动作和处理。在RAM 603中，还存储有电子设备600操作所需的各种程序和数据。处理装置601、ROM 602以及RAM 603通过总线604彼此相连。输入/输出(I/O)接口605也连接至总线604。
通常，以下装置可以连接至I/O接口605：包括例如触摸屏、触摸板、键 盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置606；包括例如液晶显示器(Liquid Crystal Display，简称LCD)、扬声器、振动器等的输出装置607；包括例如磁带、硬盘等的存储装置608；以及通信装置609。通信装置609可以允许电子设备600与其他设备进行无线或有线通信以交换数据。虽然图6示出了具有各种装置的电子设备600，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信装置609从网络上被下载和安装，或者从存储装置608被安装，或者从ROM602被安装。在该计算机程序被处理装置601执行时，执行本公开实施例的方法中限定的上述功能。
需要说明的是，本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、RF(射频)等等，或者上述的任意 合适的组合。
上述计算机可读介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该电子设备执行时，使得该电子设备执行上述实施例所示的方法。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(Local Area Network，简称LAN)或广域网(Wide Area Network，简称WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现，也可以通过硬件的方式来实现。其中，单元的名称在某种情况下并不构成对该单元本身的限定，例如，第一获取单元还可以被描述为“获取至少两个网际协议地址的单元”。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执 行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
第一方面，根据本公开的一个或多个实施例，提供了一种直播流数据处理方法，包括：
在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数；
根据所述当前性能参数确定直播流数据的目标画质增强信息，并根据所述目标画质增强信息对所述直播流数据进行画质增强；
根据所述目标画质增强信息确定目标推流码率，并根据所述目标推流码率向服务端推送画质增强后的直播流数据。
根据本公开的一个或多个实施例，所述目标画质增强信息为目标画质增强级别。
根据本公开的一个或多个实施例，所述根据所述目标画质增强信息确定目标推流码率，包括：
根据所述目标画质增强级别确定推流码率降低幅度；
根据所述直播流数据的初始推流码率以及所述推流码率降低幅度，确定所述目标推流码率。
根据本公开的一个或多个实施例，所述根据所述目标画质增强级别确定推流码率降低幅度，包括：
根据预设的画质增强级别与推流码率降低幅度之间的映射关系，确定所述目标画质增强级别对应的推流码率降低幅度；
其中，在所述画质增强级别与推流码率降低幅度之间的映射关系中，画质增强级别越高，则对应的推流码率降低幅度越大。
根据本公开的一个或多个实施例，所述方法还包括：
获取预设画质增强级别在不同推流码率降低幅度下对应的多个画质；
将所述多个画质与原始画质进行对比，确定与原始画质相当的画质对应的推流码率降低幅度，作为预设画质增强级别对应的推流码率降低幅度，构建画质增强级别与推流码率降低幅度之间的映射关系。
根据本公开的一个或多个实施例，所述根据所述当前性能参数确定直播流数据的目标画质增强级别，包括：
根据预设的性能参数与画质增强级别之间的映射关系，确定所述当前性能参数对应的目标画质增强级别。
根据本公开的一个或多个实施例，所述当前性能参数包括至少两种性能参数；
所述性能参数与画质增强级别之间的映射关系包括各画质增强级别对应的每种性能参数的预设范围。
根据本公开的一个或多个实施例，所述根据预设的性能参数与画质增强级别之间的映射关系，确定所述当前性能参数对应的目标画质增强级别，包括：
若所述当前性能参数中至少一种性能参数处于某一画质增强级别对应的该种性能参数的预设范围内，且所述当前性能参数中所有性能参数均未超过该画质增强级别对应的每种性能参数的预设范围上限，则确定该画质增强级别为所述当前性能参数对应的目标画质增强级别。
根据本公开的一个或多个实施例，在所述根据所述当前性能参数确定直播流数据的目标画质增强信息前，还包括：
判断当前直播模式是否为目标直播模式；
所述根据所述当前性能参数确定直播流数据的目标画质增强信息，包括：
若确定当前直播模式不为目标直播模式，则根据所述当前性能参数确定直播流数据的目标画质增强信息。
根据本公开的一个或多个实施例，所述方法还包括：
若确定当前直播模式为目标直播模式，则停止执行根据所述当前性能参数确定直播流数据的目标画质增强信息，并以初始画质以及初始推流码率向所述服务端推送所述直播流数据。
根据本公开的一个或多个实施例，所述目标直播模式包括多人连麦直播模式。
第二方面，根据本公开的一个或多个实施例，提供了一种直播流数据处理设备，包括：
检测单元，用于在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数；
画质增强单元，用于根据所述当前性能参数确定直播流数据的目标画质增强信息，并根据所述目标画质增强信息对所述直播流数据进行画质增强；
码率确定单元，用于根据所述目标画质增强信息确定目标推流码率；
通信单元，用于根据所述目标推流码率向服务端推送画质增强后的直播流数据。
根据本公开的一个或多个实施例，所述目标画质增强信息为目标画质增强级别。
根据本公开的一个或多个实施例，所述码率确定单元在根据所述目标画质增强信息确定目标推流码率时，用于：
根据所述目标画质增强级别确定推流码率降低幅度；
根据所述直播流数据的初始推流码率以及所述推流码率降低幅度，确定所述目标推流码率。
根据本公开的一个或多个实施例，所述码率确定单元在根据所述目标画质增强级别确定推流码率降低幅度时，用于：
根据预设的画质增强级别与推流码率降低幅度之间的映射关系，确定所述目标画质增强级别对应的推流码率降低幅度；
其中，在所述画质增强级别与推流码率降低幅度之间的映射关系中，画质增强级别越高，则对应的推流码率降低幅度越大。
根据本公开的一个或多个实施例，所述码率确定单元还用于：
获取预设画质增强级别在不同推流码率降低幅度下对应的多个画质；
将所述多个画质与原始画质进行对比，确定与原始画质相当的画质对应的推流码率降低幅度，作为预设画质增强级别对应的推流码率降低幅度，构建画质增强级别与推流码率降低幅度之间的映射关系。
根据本公开的一个或多个实施例，所述画质增强单元在根据所述当前性能参数确定直播流数据的目标画质增强级别时，用于：
根据预设的性能参数与画质增强级别之间的映射关系，确定所述当前性能参数对应的目标画质增强级别。
根据本公开的一个或多个实施例，所述当前性能参数包括至少两种性能参数；
所述性能参数与画质增强级别之间的映射关系包括各画质增强级别对应的每种性能参数的预设范围。
根据本公开的一个或多个实施例，所述画质增强单元在根据预设的性能参数与画质增强级别之间的映射关系，确定所述当前性能参数对应的目标画质增强级别时，用于：
若所述当前性能参数中至少一种性能参数处于某一画质增强级别对应的该种性能参数的预设范围内，且所述当前性能参数中所有性能参数均未超过该画质增强级别对应的每种性能参数的预设范围上限，则确定该画质增强级别为所述当前性能参数对应的目标画质增强级别。
根据本公开的一个或多个实施例，所述画质增强单元在根据所述当前性能参数确定直播流数据的目标画质增强信息前，还用于：
判断当前直播模式是否为目标直播模式；
所述根据所述当前性能参数确定直播流数据的目标画质增强信息，包括：
若确定当前直播模式不为目标直播模式，则根据所述当前性能参数确定直播流数据的目标画质增强信息。
根据本公开的一个或多个实施例，所述画质增强单元还用于：
若确定当前直播模式为目标直播模式，则停止执行根据所述当前性能参数确定直播流数据的目标画质增强信息，并以初始画质以及初始推流码率向所述服务端推送所述直播流数据。
根据本公开的一个或多个实施例，所述目标直播模式包括多人连麦直播模式。
第三方面，根据本公开的一个或多个实施例，提供了一种电子设备，包括：至少一个处理器和存储器；
所述存储器存储计算机执行指令；
所述至少一个处理器执行所述存储器存储的计算机执行指令，使得所述至少一个处理器执行如上第一方面以及第一方面各种可能的设计所述的直播流数据处理方法。
第四方面，根据本公开的一个或多个实施例，提供了一种计算机可读存储介质，所述计算机可读存储介质中存储有计算机执行指令，当处理器执行所述计算机执行指令时，实现如上第一方面以及第一方面各种可能的设计所述的直播流数据处理方法。
第五方面，根据本公开的一个或多个实施例，提供了一种计算机程序产品，包括计算机执行指令，当处理器执行所述计算机执行指令时，实现如上第一方面以及第一方面各种可能的设计所述的直播流数据处理方法。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解，本公开中所涉及的公开范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离上述公开构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
此外，虽然采用特定次序描绘了各操作，但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行来执行。在一定环境下，多任务和并行处理可能是有利的。同样地，虽然在上面论述中包含了若干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施例中。相反地，在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。

Claims (16)

  1. 一种直播流数据处理方法，包括：
    在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数；
    根据所述当前性能参数确定直播流数据的目标画质增强信息，并根据所述目标画质增强信息对所述直播流数据进行画质增强；
    根据所述目标画质增强信息确定目标推流码率，并根据所述目标推流码率向服务端推送画质增强后的直播流数据。
  2. 根据权利要求1所述的方法，其中，所述目标画质增强信息包括目标画质增强级别。
  3. 根据权利要求2所述的方法，其中，所述根据所述目标画质增强信息确定目标推流码率，包括：
    根据所述目标画质增强级别确定推流码率降低幅度；
    根据所述直播流数据的初始推流码率以及所述推流码率降低幅度，确定所述目标推流码率。
  4. 根据权利要求3所述的方法，其中，所述根据所述目标画质增强级别确定推流码率降低幅度，包括：
    根据预设的画质增强级别与推流码率降低幅度之间的映射关系，确定所述目标画质增强级别对应的推流码率降低幅度；
    其中，在所述画质增强级别与推流码率降低幅度之间的映射关系中，画质增强级别越高，则对应的推流码率降低幅度越大。
  5. 根据权利要求4所述的方法，其中，所述方法还包括：
    获取预设画质增强级别在不同推流码率降低幅度下对应的多个画质；
    将所述多个画质与原始画质进行对比，确定与原始画质相当的画质对应的推流码率降低幅度，作为预设画质增强级别对应的推流码率降低幅度，构建画质增强级别与推流码率降低幅度之间的映射关系。
  6. 根据权利要求1-5任一项所述的方法，其中，所述根据所述当前性能参数确定直播流数据的目标画质增强级别，包括：
    根据预设的性能参数与画质增强级别之间的映射关系，确定所述当前性 能参数对应的目标画质增强级别。
  7. 根据权利要求6所述的方法，其中，所述当前性能参数包括至少两种性能参数；
    所述性能参数与画质增强级别之间的映射关系包括各画质增强级别对应的每种性能参数的预设范围。
  8. 根据权利要求7所述的方法，其中，所述根据预设的性能参数与画质增强级别之间的映射关系，确定所述当前性能参数对应的目标画质增强级别，包括：
    若所述当前性能参数中至少一种性能参数处于某一画质增强级别对应的该种性能参数的预设范围内，且所述当前性能参数中所有性能参数均未超过该画质增强级别对应的每种性能参数的预设范围上限，则确定该画质增强级别为所述当前性能参数对应的目标画质增强级别。
  9. 根据权利要求1-8中任一项所述的方法，其中，在所述根据所述当前性能参数确定直播流数据的目标画质增强信息前，还包括：
    判断当前直播模式是否为目标直播模式；
    所述根据所述当前性能参数确定直播流数据的目标画质增强信息，包括：
    若确定当前直播模式不为目标直播模式，则根据所述当前性能参数确定直播流数据的目标画质增强信息。
  10. 根据权利要求9所述的方法，其中，还包括：
    若确定当前直播模式为目标直播模式，则停止执行根据所述当前性能参数确定直播流数据的目标画质增强信息，并以初始画质以及初始推流码率向所述服务端推送所述直播流数据。
  11. 根据权利要求9或10所述的方法，其中，所述目标直播模式包括多人连麦直播模式。
  12. 一种直播流数据处理设备，包括：
    检测单元，用于在直播设备录制直播流数据的过程中，检测所述直播设备的当前性能参数；
    画质增强单元，用于根据所述当前性能参数确定直播流数据的目标画质增强信息，并根据所述目标画质增强信息对所述直播流数据进行画质增强；
    码率确定单元，用于根据所述目标画质增强信息确定目标推流码率；
    通信单元，用于根据所述目标推流码率向服务端推送画质增强后的直播流数据。
  13. 一种电子设备，包括：至少一个处理器和存储器；
    所述存储器存储计算机执行指令；
    所述至少一个处理器执行所述存储器存储的计算机执行指令，使得所述至少一个处理器执行如权利要求1-11任一项所述的方法。
  14. 一种计算机可读存储介质，所述计算机可读存储介质中存储有计算机执行指令，当处理器执行所述计算机执行指令时，实现如权利要求1-11任一项所述的方法。
  15. 一种计算机程序产品，包括计算机执行指令，当处理器执行所述计算机执行指令时，实现如权利要求1-11任一项所述的方法。
  16. 一种计算机程序，当处理器执行所述计算机程序时，实现如权利要求1-11任一项所述的方法。
PCT/CN2024/082483 2023-03-27 2024-03-19 直播流数据处理方法、设备及存储介质 Ceased WO2024199012A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202310317744.5A CN116320523B (zh) 2023-03-27 2023-03-27 直播流数据处理方法、设备及存储介质
CN202310317744.5 2023-03-27

Publications (1)

Publication Number Publication Date
WO2024199012A1 true WO2024199012A1 (zh) 2024-10-03

Family

ID=86835882

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/082483 Ceased WO2024199012A1 (zh) 2023-03-27 2024-03-19 直播流数据处理方法、设备及存储介质

Country Status (2)

Country Link
CN (1) CN116320523B (zh)
WO (1) WO2024199012A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116320523B (zh) * 2023-03-27 2026-03-20 北京字跳网络技术有限公司 直播流数据处理方法、设备及存储介质
CN121442129A (zh) * 2024-07-29 2026-01-30 北京字跳网络技术有限公司 用于视频推送的方法、装置、设备和存储介质

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516721A (zh) * 2014-10-20 2016-04-20 广东中星电子有限公司 一种视频编码器及其码率控制方法
CN112738571A (zh) * 2020-12-14 2021-04-30 联想(北京)有限公司 一种流媒体参数的确定方法及装置
WO2021179304A1 (zh) * 2020-03-13 2021-09-16 深圳市大疆创新科技有限公司 自动调整视频直播码率的方法、视频传输装置和服务器
WO2021213336A1 (zh) * 2020-04-22 2021-10-28 华为技术有限公司 一种画质增强装置及相关方法
CN113852860A (zh) * 2021-09-26 2021-12-28 北京金山云网络技术有限公司 视频处理方法、装置、系统及存储介质
CN114173160A (zh) * 2021-12-01 2022-03-11 上海哔哩哔哩科技有限公司 直播推流方法及装置
CN114390307A (zh) * 2021-12-28 2022-04-22 广州虎牙科技有限公司 图像画质增强方法、装置、终端及可读存储介质
US20220207299A1 (en) * 2020-12-24 2022-06-30 Beijing Baidu Netcom Science And Technology Co., Ltd. Method and apparatus for building image enhancement model and for image enhancement
CN115665485A (zh) * 2022-12-26 2023-01-31 杭州星犀科技有限公司 视频画面优化方法及装置、存储介质和视频终端
CN116320523A (zh) * 2023-03-27 2023-06-23 北京字跳网络技术有限公司 直播流数据处理方法、设备及存储介质

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108271071B (zh) * 2016-12-30 2021-03-19 广州方硅信息技术有限公司 一种提高视频清晰度的方法及装置
CN112752109B (zh) * 2019-10-30 2022-05-17 上海哔哩哔哩科技有限公司 视频播放控制方法和系统
CN112312229A (zh) * 2020-10-27 2021-02-02 唐桥科技(杭州)有限公司 一种视频传输方法、装置、电子设备及存储介质

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516721A (zh) * 2014-10-20 2016-04-20 广东中星电子有限公司 一种视频编码器及其码率控制方法
WO2021179304A1 (zh) * 2020-03-13 2021-09-16 深圳市大疆创新科技有限公司 自动调整视频直播码率的方法、视频传输装置和服务器
WO2021213336A1 (zh) * 2020-04-22 2021-10-28 华为技术有限公司 一种画质增强装置及相关方法
CN112738571A (zh) * 2020-12-14 2021-04-30 联想(北京)有限公司 一种流媒体参数的确定方法及装置
US20220207299A1 (en) * 2020-12-24 2022-06-30 Beijing Baidu Netcom Science And Technology Co., Ltd. Method and apparatus for building image enhancement model and for image enhancement
CN113852860A (zh) * 2021-09-26 2021-12-28 北京金山云网络技术有限公司 视频处理方法、装置、系统及存储介质
CN114173160A (zh) * 2021-12-01 2022-03-11 上海哔哩哔哩科技有限公司 直播推流方法及装置
CN114390307A (zh) * 2021-12-28 2022-04-22 广州虎牙科技有限公司 图像画质增强方法、装置、终端及可读存储介质
CN115665485A (zh) * 2022-12-26 2023-01-31 杭州星犀科技有限公司 视频画面优化方法及装置、存储介质和视频终端
CN116320523A (zh) * 2023-03-27 2023-06-23 北京字跳网络技术有限公司 直播流数据处理方法、设备及存储介质

Also Published As

Publication number Publication date
CN116320523B (zh) 2026-03-20
CN116320523A (zh) 2023-06-23

Similar Documents

Publication Publication Date Title
WO2024199012A1 (zh) 直播流数据处理方法、设备及存储介质
CN114584826B (zh) 一种视频动态下载方法、装置、电子设备及存储介质
WO2021143273A1 (zh) 直播流采样方法、装置及电子设备
WO2024114390A1 (zh) 视频流播放方法、设备、存储介质及程序产品
CN115776590A (zh) 动态画质视频播放方法、装置、电子设备及存储介质
CN108391170A (zh) 切换edid文件的方法、装置、电视机和存储介质
CN113535105B (zh) 媒体文件处理方法、装置、设备、可读存储介质及产品
CN114647468A (zh) 投屏图像显示方法、装置、电子设备及存储介质
WO2025213922A1 (zh) 视频处理方法、装置、存储介质及电子设备
JP2024504476A (ja) 画像処理方法、装置、電子機器、及び媒体
US10728493B1 (en) Method and apparatus for reducing interference from content play in multi-device environment
CN109951737B (zh) 视频处理方法、装置、电子设备和计算机可读存储介质
CN117857849A (zh) 一种带宽分配方法、装置、设备和存储介质
US12563261B2 (en) Video preloading method and apparatus, device and medium
CN114693559B (zh) 图像处理优化方法、装置、电子设备及可读存储介质
US11641444B2 (en) Method and apparatus for reducing interference from content play in multi-device environment
WO2024078245A1 (zh) 视频控制方法、装置、电子设备以及存储介质
CN115134641A (zh) 投屏方法、装置和电子设备
WO2024183716A1 (zh) 视频流播放方法、设备、存储介质及程序产品
CN115775290A (zh) 动画帧率的处理方法、装置、设备及存储介质
JP5968463B2 (ja) データを別の記憶装置にコピーせずにデータソースによりバッファに格納されたデータを処理するためのポインタのスワッピング
WO2025195522A1 (zh) 直播处理方法、设备及存储介质
CN114564168B (zh) 投屏阅读方法、电子设备及可读存储介质
CN118264767A (zh) 一种超级分辨率功能的控制方法、装置、设备及介质
CN117354551A (zh) 网络状态确定方法、装置、设备、可读存储介质及产品

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24777801

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 24777801

Country of ref document: EP

Kind code of ref document: A1