CN115150641A - Cloud game video coding parameter dynamic adjustment method and device - Google Patents
Cloud game video coding parameter dynamic adjustment method and device Download PDFInfo
- Publication number
- CN115150641A CN115150641A CN202210751371.8A CN202210751371A CN115150641A CN 115150641 A CN115150641 A CN 115150641A CN 202210751371 A CN202210751371 A CN 202210751371A CN 115150641 A CN115150641 A CN 115150641A
- Authority
- CN
- China
- Prior art keywords
- quality
- coding
- ratio
- configuration information
- delay
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 17
- 230000005540 biological transmission Effects 0.000 claims abstract description 14
- 238000009877 rendering Methods 0.000 claims description 7
- 230000000903 blocking effect Effects 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 5
- 238000001514 detection method Methods 0.000 claims description 5
- 238000009825 accumulation Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 abstract description 3
- 238000004458 analytical method Methods 0.000 abstract description 2
- 230000002349 favourable effect Effects 0.000 abstract description 2
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000010200 validation analysis Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26291—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for providing content or additional data updates, e.g. updating software modules, stored at the client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
- H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method and a device for dynamically adjusting cloud game video coding parameters, relates to the technical field of data transmission, and solves the technical problem that audio and video data transmission in cloud games is not stable enough. Meanwhile, through monitoring and analysis of two dimensions of content quality and operation quality, the real experience of a user is closer, the decoding performance of the current terminal can be reflected most, and more favorable data support is provided for dynamically adjusting the encoding parameters.
Description
Technical Field
The present application relates to the field of data transmission technologies, and in particular, to a method and an apparatus for dynamically adjusting cloud game video coding parameters.
Background
The cloud game is characterized in that the game runs based on a cloud end, and the rendered game picture is compressed and encoded and then transmitted to the terminal in an audio and video streaming mode through a network; and the terminal side decodes and plays the audio and video and uploads the control instruction to the cloud end to form a game interaction process.
The traditional video coding quality is improved mainly by the new compression standard. Under the same compression standard, different encoders achieve different compression efficiencies, which are usually very different, and the main reason is that it is difficult to optimize the selection of encoding parameters, so that the adaptability of video encoding is poor. However, in the existing mobile communication network, the network performance index is in the process of changing from moment to moment, and it is difficult to make the cloud game player obtain the best quality and the lowest delay audiovisual experience and interactive experience in a fixed and unchangeable video coding mode.
Disclosure of Invention
The application provides a method and a device for dynamically adjusting cloud game video coding parameters, and the technical purpose is to ensure that video and audio data in a cloud game experience process can be quickly and stably transmitted to a terminal.
The technical purpose of the application is realized by the following technical scheme:
a dynamic adjustment method for cloud game video coding parameters comprises the following steps:
after the terminal is started, setting the configuration information of the first-time coding parameters according to the hardware condition of the terminal and the current network state, and performing data transmission through the first-time coding parameters; the coding parameters comprise resolution, frame rate, maximum code rate, average code rate and coding speed;
in the data transmission process, detecting the content quality and the operation quality of an image frame in each time interval T, and acquiring the total frame number of problem frames and the total number of operation response time delay times; the content quality comprises packet loss, frame skipping, screen blooming, blocking, decoding delay and rendering delay; the quality of operation comprises an operation response delay;
calculating the ratio according to the total frame number of the problem frame and the total number of the operation response time delay to obtain the final ratio, and selecting corresponding coding parameter configuration information according to the final ratio;
and negotiating with the server side according to the dynamically adjusted coding parameters to complete the setting and effectiveness of the coding parameters.
Further, the occupation ratio comprises a content quality occupation ratio and an operation quality occupation ratio, and a larger one is selected as a final occupation ratio in the content quality occupation ratio and the operation quality occupation ratio.
Further, the calculation of the content quality ratio is represented as:
the calculation of the operation quality ratio is represented as:
Further, the configuration information of the encoding parameter includes a first level, a second level and a third level; when the final ratio is not more than 2%, selecting the configuration information of the first level for coding; when the final ratio is more than 2% and not more than 10%, selecting the configuration information of the second level for coding; and when the final ratio is more than 10%, selecting the configuration information of the third level for coding.
Further, the detecting the content quality includes: counting whether the current picture has a problem or not, and if so, performing accumulation operation on error counting; the detecting the operation quality comprises the following steps: and judging whether the time spent by the user for triggering the keyboard, the mouse and the handle to complete the response exceeds a set threshold value, and if so, accumulating the time delay count.
A cloud game video coding parameter dynamic adjustment device comprises:
the parameter setting unit is used for setting the first-time coding parameter configuration information or the dynamically adjusted coding parameter configuration information;
the intelligent detection unit detects the content quality and the operation quality of the image frames in each time interval T in the data transmission process, and acquires the total frame number of problem frames and the total operation response time delay times; the content quality comprises packet loss, frame skipping, screen blooming, jamming, decoding delay and rendering delay; the quality of operation comprises an operation response delay;
the dynamic adjusting unit calculates the ratio according to the total frame number of the problem frame and the total times of the operation response time delay to obtain the final ratio, and selects corresponding coding parameter configuration information according to the final ratio;
and the negotiation setting unit negotiates with the server according to the first coding parameter or the dynamically adjusted coding parameter to complete the setting and effectiveness of the coding parameter.
The beneficial effect of this application lies in: by analyzing the two dimensions of the audio and video stream and the control stream of the cloud game, the audio and video stream is represented by content quality, the control stream is represented by operation quality, and the audio and video experience effect of the current terminal can be comprehensively embodied, so that the coding parameters are dynamically adjusted, the optimal effect is achieved, and the user experience is improved. Meanwhile, through monitoring and analysis of two dimensions of content quality and operation quality, the real experience of a user is closer, the decoding performance of the current terminal can be reflected most, and more favorable data support is provided for dynamically adjusting the encoding parameters.
Drawings
FIG. 1 is a flow chart of a method described herein;
fig. 2 is a schematic view of the apparatus described herein.
Detailed Description
The technical solution of the present application will be described in detail below with reference to the accompanying drawings.
As shown in fig. 1, the method for dynamically adjusting cloud game video coding parameters according to the present application includes:
101: after the terminal is started, the first coding parameter configuration information is set according to the terminal hardware conditions (CPU specification, GPU specification and the like) and the current network state, and data transmission is carried out through the first coding parameters. After the first encoding parameter configuration information is determined, negotiation with a server is needed, and the setting of the encoding parameters is completed and the encoding parameters are effective.
102: in the data transmission process, detecting the content quality and the operation quality of an image frame in each time interval T, and acquiring the total frame number of problem frames and the total number of operation response time delay times; the content quality comprises packet loss, frame skipping, screen blooming, blocking, decoding delay and rendering delay; the quality of operation includes an operation response delay.
Specifically, the detecting of the content quality includes: and counting whether the current picture has a problem or not, and if so, performing accumulation operation on the error count.
The detecting the operation quality comprises the following steps: and judging whether the time consumed by the user to trigger the keyboard, the mouse and the handle to complete the response exceeds a set threshold value, and if so, accumulating the time delay count.
103: and calculating the ratio according to the total frame number of the problem frame and the total number of the operation response time delay to obtain the final ratio, and selecting corresponding coding parameter configuration information according to the final ratio.
The occupation ratio comprises a content quality occupation ratio and an operation quality occupation ratio, and the larger one is selected as a final occupation ratio in the content quality occupation ratio and the operation quality occupation ratio.
104: and negotiating with the server side according to the dynamically adjusted coding parameters to complete the setting and effectiveness of the coding parameters.
Specifically, after the data transmission is started, the terminal device performs statistics and summarization on content quality (such as frame loss, frame skipping, screen splash, stuck, decoding delay, rendering delay and the like) and operation quality (operation response delay) at intervals of T. The content mass ratio calculation formula is
Wherein, error _ frame represents the total number of frames with problems in the current period T, and all _ frame represents the total number of frames co-played in the current period T. Formula for calculating ratio of operating mass
The delay _ handle represents the number of times that the operation response delay exceeds the set threshold in the current period T, and the all _ handle represents the total number of operations in the current period T. And selecting Max (content _ percentage, handle _ percentage) as a final ratio, configuring coding parameters according to the final ratio, and negotiating with the cloud game server to realize dynamic optimization and adjustment of the coding parameters.
The main indexes of the coding parameters comprise resolution, frame rate, maximum code rate, average code rate and coding speed, and each index is divided into 3 levels, wherein L0 represents the lowest level (corresponding to the third level), and L2 represents the highest level (corresponding to the first level). Forming a coding parameter configuration table according to the index combination, wherein when the final ratio is not more than 2%, the configuration information Config _ L2 is used to indicate that all coding indexes select the configuration with the highest L2 level; when the final ratio is greater than 2% and not greater than 10%, using configuration information Config _ L1; when the final occupancy is greater than 10%, the configuration information Config _ L0 is used.
Fig. 2 is a schematic diagram of a device for dynamically adjusting cloud game video coding parameters according to the present application, where the device includes a parameter setting unit, an intelligent monitoring unit, a dynamic adjustment unit, and a negotiation setting unit.
And the parameter setting unit is used for setting the first coding parameter configuration information or the coding parameter configuration information after dynamic adjustment.
The intelligent detection unit: the method mainly carries out periodic detection and summarization from two dimensions of content quality (frame loss, frame skipping, screen blooming, blocking, decoding delay and rendering delay) and operation quality (operation response delay). The content quality is mainly to count whether the current display picture has a problem, and if the current frame has a problem, the error count is accumulated. The evaluation of the operation quality mainly judges whether the time consumed by the user from triggering the operations of the keyboard, the mouse, the handle and the like to finishing the response exceeds a set threshold value, and if so, the delay count is accumulated.
And the dynamic adjusting unit calculates the ratio according to the total frame number of the problem frames and the total times of the operation response time delay to obtain the final ratio, and selects corresponding coding parameter configuration information according to the final ratio.
And the negotiation setting unit negotiates with the server according to the first coding parameter or the dynamically adjusted coding parameter to complete the setting and effectiveness of the latest coding parameter.
Specifically, after the terminal is started, the parameter setting unit sets the first encoding parameter configuration information according to the terminal hardware conditions (CPU specification, GPU specification, and the like) and the current network state, and after the negotiation setting unit completes setting and validation, the terminal performs data transmission through the first encoding parameter.
In the data transmission process, the intelligent detection unit detects the content quality and the operation quality of the image frames in each time interval T, and obtains the total frame number of problem frames and the total times of operation response time delay. The dynamic adjustment unit selects the coding parameter configuration information, the parameter setting unit sets the dynamically adjusted coding parameter configuration information, and the negotiation setting unit negotiates with the server according to the dynamically adjusted coding parameters to complete the setting and validation of the latest coding parameters.
The foregoing is an exemplary embodiment of the present application, and the scope of the present application is defined by the claims and their equivalents.
Claims (6)
1. A dynamic adjustment method for cloud game video coding parameters is characterized by comprising the following steps:
after the terminal is started, setting the configuration information of the first-time coding parameters according to the hardware condition of the terminal and the current network state, and performing data transmission through the first-time coding parameters; the coding parameters comprise resolution, frame rate, maximum code rate, average code rate and coding speed;
in the data transmission process, detecting the content quality and the operation quality of an image frame in each time interval T, and acquiring the total frame number of problem frames and the total number of operation response time delay times; the content quality comprises packet loss, frame skipping, screen blooming, blocking, decoding delay and rendering delay; the quality of operation comprises an operation response delay;
calculating the ratio according to the total frame number of the problem frames and the total times of the operation response time delay to obtain a final ratio, and selecting corresponding coding parameter configuration information according to the final ratio;
and negotiating with the server side according to the dynamically adjusted coding parameters to complete the setting and effectiveness of the coding parameters.
2. The dynamic adjustment method according to claim 1, wherein the duty ratio includes a content quality duty ratio and an operation quality duty ratio, and a larger one is selected as the final duty ratio in the content quality duty ratio and the operation quality duty ratio.
3. The dynamic adjustment method of claim 2, wherein the calculation of the content quality ratio is represented as:
the calculation of the operation quality ratio is represented as:
4. The dynamic adjustment method of claim 1, wherein the configuration information of the encoding parameter includes a first level, a second level, and a third level; when the final ratio is not more than 2%, selecting the configuration information of the first level for coding; when the final ratio is more than 2% and not more than 10%, selecting the configuration information of the second level for coding; and when the final ratio is more than 10%, selecting the configuration information of the third level for coding.
5. The dynamic adjustment method of claim 1, wherein detecting content quality comprises: counting whether the current picture has a problem or not, and if so, performing accumulation operation on error counts; the detecting the operation quality comprises the following steps: and judging whether the time consumed by the user to trigger the keyboard, the mouse and the handle to complete the response exceeds a set threshold value, and if so, accumulating the time delay count.
6. A dynamic adjustment device for cloud game video coding parameters is characterized by comprising:
the parameter setting unit is used for setting the first coding parameter configuration information or the coding parameter configuration information after dynamic adjustment;
the intelligent detection unit detects the content quality and the operation quality of the image frames in each time interval T in the data transmission process, and acquires the total frame number of problem frames and the total operation response time delay times; the content quality comprises packet loss, frame skipping, screen blooming, blocking, decoding delay and rendering delay; the quality of operation comprises an operation response delay;
the dynamic adjusting unit calculates the ratio according to the total frame number of the problem frame and the total times of the operation response time delay to obtain the final ratio, and selects corresponding coding parameter configuration information according to the final ratio;
and the negotiation setting unit negotiates with the server according to the first coding parameter or the dynamically adjusted coding parameter to complete setting and effectiveness of the coding parameter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210751371.8A CN115150641A (en) | 2022-06-28 | 2022-06-28 | Cloud game video coding parameter dynamic adjustment method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210751371.8A CN115150641A (en) | 2022-06-28 | 2022-06-28 | Cloud game video coding parameter dynamic adjustment method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115150641A true CN115150641A (en) | 2022-10-04 |
Family
ID=83410366
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210751371.8A Pending CN115150641A (en) | 2022-06-28 | 2022-06-28 | Cloud game video coding parameter dynamic adjustment method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115150641A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103945213A (en) * | 2013-01-22 | 2014-07-23 | 中兴通讯股份有限公司 | Video stream quality monitoring method and device |
| WO2015188678A1 (en) * | 2014-06-13 | 2015-12-17 | 珠海全志科技股份有限公司 | Transmission control method and system for video stream of mobile device |
| CN110812835A (en) * | 2019-11-06 | 2020-02-21 | 腾讯科技（深圳）有限公司 | Cloud game detection method and device, storage medium and electronic device |
| US20210093960A1 (en) * | 2019-10-01 | 2021-04-01 | Sony Interactive Entertainment Inc. | Scene change hint and client bandwidth used at encoder for handling video frames after a scene change in cloud gaming applications |
| CN113992987A (en) * | 2021-12-27 | 2022-01-28 | 北京蔚领时代科技有限公司 | Intelligent code rate adjusting system and method suitable for cloud game scene |
| CN114470749A (en) * | 2021-12-24 | 2022-05-13 | 炫彩互动网络科技有限公司 | Improved cloud game user card pause data quantization method |
-
2022
- 2022-06-28 CN CN202210751371.8A patent/CN115150641A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103945213A (en) * | 2013-01-22 | 2014-07-23 | 中兴通讯股份有限公司 | Video stream quality monitoring method and device |
| WO2015188678A1 (en) * | 2014-06-13 | 2015-12-17 | 珠海全志科技股份有限公司 | Transmission control method and system for video stream of mobile device |
| US20210093960A1 (en) * | 2019-10-01 | 2021-04-01 | Sony Interactive Entertainment Inc. | Scene change hint and client bandwidth used at encoder for handling video frames after a scene change in cloud gaming applications |
| CN110812835A (en) * | 2019-11-06 | 2020-02-21 | 腾讯科技（深圳）有限公司 | Cloud game detection method and device, storage medium and electronic device |
| CN114470749A (en) * | 2021-12-24 | 2022-05-13 | 炫彩互动网络科技有限公司 | Improved cloud game user card pause data quantization method |
| CN113992987A (en) * | 2021-12-27 | 2022-01-28 | 北京蔚领时代科技有限公司 | Intelligent code rate adjusting system and method suitable for cloud game scene |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2018177165A1 (en) | Method and system for optimizing quality network pushed stream | |
| CN110225420B (en) | Playing/decision-making method/system, medium, playing terminal and server terminal | |
| US20130304934A1 (en) | Methods and systems for controlling quality of a media session | |
| CN109996087B (en) | Code rate self-adaption method and device for live video broadcast based on finite state machine | |
| CN108347645B (en) | Method and device for decoding and displaying video frame | |
| US20140181266A1 (en) | System, streaming media optimizer and methods for use therewith | |
| KR101554387B1 (en) | Method and system for content-aware multimedia streaming | |
| CN106375790B (en) | A kind of multichannel HAS code rate self-adapting dispatching method of QoE driving | |
| WO2021088263A1 (en) | Method and device for controlling video transcoding code rate | |
| US9654770B2 (en) | Method and apparatus for evaluating media quality | |
| CN109729437B (en) | Streaming media self-adaptive transmission method, terminal and system | |
| WO2013159502A1 (en) | Video quality evaluation method and device | |
| CN106688239A (en) | Video downloading method, apparatus, and system | |
| US20170142029A1 (en) | Method for data rate adaption in online media services, electronic device, and non-transitory computer-readable storage medium | |
| CN111490983B (en) | Adaptive streaming media code rate selection system based on video perception quality | |
| US9432432B2 (en) | Streaming media segment preparation method and apparatus | |
| CN109803169B (en) | Method and system for realizing multi-path multicast based on network bandwidth | |
| CN112437321B (en) | Adaptive code rate calculation method based on live broadcast streaming media | |
| CN113037697A (en) | Video frame processing method and device, electronic equipment and readable storage medium | |
| CN112866746A (en) | Multi-path streaming cloud game control method, device, equipment and storage medium | |
| CN110099250B (en) | Monitoring video quality judgment method and play control device | |
| CN108124192B (en) | HLS streaming media playing method and system | |
| CN110545418A (en) | Self-adaptive video coding method based on scene | |
| WO2014066975A1 (en) | Methods and systems for controlling quality of a media session | |
| CN115150641A (en) | Cloud game video coding parameter dynamic adjustment method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |