CN117768448A - Streaming parameter adaptation-based audio and video streaming transmission method and system and cloud server - Google Patents

Streaming parameter adaptation-based audio and video streaming transmission method and system and cloud server Download PDF

Info

Publication number
CN117768448A
CN117768448A CN202311776628.6A CN202311776628A CN117768448A CN 117768448 A CN117768448 A CN 117768448A CN 202311776628 A CN202311776628 A CN 202311776628A CN 117768448 A CN117768448 A CN 117768448A
Authority
CN
China
Prior art keywords
cloud
streaming
parameters
cloud machine
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202311776628.6A
Other languages
Chinese (zh)
Other versions
CN117768448B (en
Inventor
吴志宏
刘志华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Suqi Technology Co ltd
Original Assignee
Guangzhou Suqi Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Suqi Technology Co ltd filed Critical Guangzhou Suqi Technology Co ltd
Priority to CN202311776628.6A priority Critical patent/CN117768448B/en
Publication of CN117768448A publication Critical patent/CN117768448A/en
Application granted granted Critical
Publication of CN117768448B publication Critical patent/CN117768448B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to an audio and video streaming transmission method and system based on streaming parameter adaptation, a cloud server of cloud machine end service and a computer readable storage medium, wherein the method comprises the following steps: identifying the currently running application process of the first cloud machine client; determining a current cloud application scene through a currently running application process; inquiring whether streaming parameters matched with the current cloud application scene exist or not from a back-end platform; if so, acquiring matched streaming parameters, updating coding parameters of the coder according to the matched streaming parameters, so that the coder codes the audio and video stream transmitted to the first cloud machine client based on the updated coding parameters, and transmitting the coded audio and video stream to the first cloud machine client according to the matched streaming parameters. The method can provide streaming parameters adapted to the cloud machine client based on the cloud application scene, optimize network parameters, avoid network congestion and network packet loss problems, and provide audio and video streams matched with requirements of users.

Description

Streaming parameter adaptation-based audio and video streaming transmission method and system and cloud server
Technical Field
The present invention relates to the field of audio and video stream processing, and in particular, to an audio and video stream transmission method and system based on stream parameter adaptation, a cloud server for cloud machine side service, and a computer readable storage medium.
Background
At present, cloud technology is mature and is applied to cloud computers, cloud desktops, cloud services and the like, and cloud mobile phones proposed for mobile phones are developed fully. The existing cloud mobile phone generally comprises a client and a cloud server, wherein the client can comprise a mobile phone, a tablet, a computer and the like, and the basic requirement is that the client APP can be installed and meanwhile a network is provided, and the client is connected to the cloud server through the network. When the cloud mobile phone cloud management system is used, the client runs the APP and can be connected to the cloud server, namely, on the basis of application of the cloud mobile phone, people can operate a plurality of cloud mobile phones by one client and control a plurality of mobile phone control interfaces by one client. Along with the different roles played by users, the daily life needs to process various different things, and many users carry multiple mobile phones to process different things according to different use requirements, for example, the carried multiple mobile phones comprise mobile phones specially used for receiving calls, mobile phones specially used for processing company transactions and mobile phones specially used for processing private life trivial matters. However, carrying multiple mobile phones according to different use requirements causes inconvenience to the user, and all required files and data cannot be obtained from one mobile phone at any time, and different mobile phones must be opened to obtain different files and data. Through cloud cell-phone, can improve user's use convenience, protect user data security.
When the cloud mobile phone is used currently, after the back-end platform provides equipment information and streaming parameters of cloud machine end service for cloud machine clients of users, the cloud machine clients are connected with the cloud machine end service through the equipment information, and the cloud machine end service provides audio and video streams for the cloud machine clients through the fixed streaming parameters for the cloud machine clients. However, when using the cloud machine client, the user often switches different applications, and the unused applications have different requirements for different networks. The cloud machine end service provides audio and video streams for users by using fixed streaming parameters, so that the problems of network congestion and network packet loss can be caused, the audio and video streams provided for the users are not matched with scene requirements of the users, and the user experience is poor.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, and provides an audio and video stream transmission method and system based on stream parameter adaptation, a cloud server for cloud machine end service and a computer readable storage medium.
In order to solve at least one of the above technical problems, an embodiment of the present invention provides an audio/video streaming method based on stream parameter adaptation, which is applied to a cloud terminal service, and the audio/video streaming method includes:
identifying the currently running application process of the first cloud machine client;
determining a current cloud application scene through the currently running application process;
inquiring whether streaming parameters matched with the current cloud application scene exist or not from a back-end platform;
if so, acquiring the matched streaming parameters, updating the coding parameters of the coder according to the matched streaming parameters, so that the coder codes the audio and video stream transmitted to the first cloud machine client based on the updated coding parameters, and transmitting the coded audio and video stream to the first cloud machine client according to the matched streaming parameters.
Preferably, when the back-end platform receives a cloud machine streaming service request of the first cloud machine client, equipment information and recommended streaming parameters of the cloud machine end service are returned to the first cloud machine client;
and the first cloud machine client initiates a connection request to the cloud machine end service according to the equipment information and the recommended streaming parameters of the cloud machine end service, so that the cloud machine end service encodes the audio and video stream according to the recommended streaming parameters and returns the encoded audio and video stream to the first cloud machine client.
Preferably, the stream parameters include a code rate, a resolution, and a frame rate;
the querying, by the backend platform, whether there is a streaming parameter matching the current cloud application scenario includes:
when the current cloud application scene is a video application, acquiring a first streaming parameter, wherein the first streaming parameter comprises a first code rate, a first resolution and a first frame rate;
when the current cloud application scene is a game application, acquiring a second streaming parameter, wherein the second streaming parameter comprises a second code rate, a second resolution and a second frame rate;
when the current cloud application scene is a tool application, acquiring a third streaming parameter, wherein the third streaming parameter comprises a third code rate, a third resolution and a third frame rate;
wherein the first resolution is greater than the second resolution and greater than the third resolution, the second code rate is greater than the first code rate and greater than the third code rate, the first frame rate is greater than the third frame rate, and the second frame rate is greater than the third frame rate.
Preferably, when the current cloud application scenario is a tool application, the audio/video streaming method further includes:
when the current network quality is detected to not meet the set condition, a fourth code rate and a fourth resolution are obtained, wherein the fourth code rate is smaller than the third code rate, and the fourth resolution is smaller than the third resolution;
and updating the coding parameters of the coder by using the fourth code rate, and transmitting the coded audio and video stream to the first cloud machine client based on the fourth resolution.
Preferably, the back-end platform obtains user non-sensitive network performance data reported by the first cloud machine client in real time, determines current optimal streaming parameters according to the user non-sensitive network performance data, and returns equipment information of the cloud machine end service and the current optimal streaming parameters to the second cloud machine client when receiving a cloud machine streaming service request of the second cloud machine client.
Preferably, the user insensitive network performance data includes time, ip, area, specification information, networking type, rtt, real-time code rate, frame rate, terminal decoding capability and cloud machine end service real-time coding parameters.
Preferably, the back-end platform receives a cloud machine streaming service request of the second cloud machine client, and when the networking type, the area and the specification information and the time of the second cloud machine client are matched with those of the first cloud machine client, returns the equipment information of the cloud machine end service and the current optimal streaming parameters to the second cloud machine client.
An audio and video streaming transmission system based on stream parameter adaptation comprises a cloud machine client, a cloud machine end service and a back-end platform;
the cloud machine client sends a cloud machine streaming service request to the back-end platform;
the back-end platform returns the equipment information and recommended streaming parameters of the cloud machine side service to the cloud machine client;
the cloud machine client initiates a connection request to the cloud machine end service according to the equipment information of the cloud machine end service and the recommended streaming parameters;
the cloud machine side service encodes the audio and video stream according to the recommended streaming parameters and returns the encoded audio and video stream to the cloud machine client;
the cloud machine side service identifier identifies a currently running application process of a machine client, determines a current cloud application scene through the currently running application process, and inquires the back-end platform whether streaming parameters matched with the current cloud application scene exist or not;
the back-end platform sends the matched streaming parameters to the cloud machine end service;
the cloud machine side service updates the coding parameters of the coder according to the matched streaming parameters, so that the coder codes the audio and video stream transmitted to the cloud machine client based on the updated coding parameters, and transmits the coded audio and video stream to the cloud machine client according to the matched streaming parameters.
The cloud server for cloud machine side service comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the steps of the method in any embodiment when executing the computer program.
A computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method of any of the embodiments described above.
The audio/video streaming transmission method and system based on stream parameter adaptation, the cloud server of the cloud machine side service and the computer readable storage medium comprise the steps of identifying the currently running application process of the first cloud machine client; determining a current cloud application scene through the currently running application process; inquiring whether streaming parameters matched with the current cloud application scene exist or not from a back-end platform; if so, acquiring the matched streaming parameters, updating the coding parameters of the coder according to the matched streaming parameters, so that the coder codes the audio and video stream transmitted to the first cloud machine client based on the updated coding parameters, and transmitting the coded audio and video stream to the first cloud machine client according to the matched streaming parameters. Therefore, streaming parameters matched with the cloud machine client can be provided for the cloud machine client based on the cloud application scene, network parameters are optimized, the problems of network congestion and network packet loss are avoided, an audio and video stream matched with the requirements of the user is provided for the user, and the user experience is improved.
Drawings
Fig. 1 is a schematic view of an application scenario of an audio/video streaming system based on stream parameter adaptation in an embodiment of the present invention;
fig. 2 is a flow chart of an audio/video streaming method based on stream parameter adaptation in an embodiment of the invention;
fig. 3 is a schematic view of an application scenario of an audio/video streaming system based on stream parameter adaptation according to another embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The embodiment of the invention provides an audio/video streaming transmission system based on streaming parameter adaptation. As shown in fig. 1, an audio/video streaming system based on stream parameter adaptation includes a cloud client, a cloud service, and a back-end platform. The cloud machine client sends a cloud machine streaming service request to the back-end platform; the back-end platform returns the equipment information and recommended streaming parameters of the cloud machine side service to the cloud machine client; the cloud machine client initiates a connection request to the cloud machine end service according to the equipment information of the cloud machine end service and the recommended streaming parameters; the cloud machine side service encodes the audio and video stream according to the recommended streaming parameters and returns the encoded audio and video stream to the cloud machine client; the cloud machine side service identifier identifies a currently running application process of a machine client, determines a current cloud application scene through the currently running application process, and inquires the back-end platform whether streaming parameters matched with the current cloud application scene exist or not; the back-end platform sends the matched streaming parameters to the cloud machine end service; the cloud machine side service updates the coding parameters of the coder according to the matched streaming parameters, so that the coder codes the audio and video stream transmitted to the cloud machine client based on the updated coding parameters, and transmits the coded audio and video stream to the cloud machine client according to the matched streaming parameters.
Specifically, information interaction of the cloud machine client, the cloud machine end service and the back-end platform is shown in fig. 1. When the cloud machine client switches different applications, the cloud machine service automatically detects the application process running in the foreground, inquires whether a stream parameter combination corresponding to the currently running application process exists or not from the back-end platform, and if so, performs stream parameter switching to achieve the purpose of scenerising code transmission. And the cloud machine side service performs corresponding encoder setting change and stream transmission control according to the matched stream parameter combination determined from the back-end platform.
The embodiment of the invention provides an audio/video streaming transmission method based on streaming parameter adaptation, which is applied to cloud machine side service as shown in fig. 1. As shown in fig. 2, an audio/video streaming method based on stream parameter adaptation includes the following steps:
s201, the currently running application process of the first cloud machine client is identified.
Specifically, when the first cloud machine client switches different applications, the cloud machine service automatically detects an application process running in the foreground of the first cloud machine client. The application processes include video class applications, game class applications, tool class applications, and the like.
In one example, before step S201, when the back-end platform receives a cloud machine streaming service request of the first cloud machine client, the back-end platform returns device information of the cloud machine end service and recommended streaming parameters to the first cloud machine client; the first cloud machine client initiates a connection request to the cloud machine end service according to the equipment information of the cloud machine end service and the recommended streaming parameters, so that the cloud machine end service encodes the audio and video stream according to the recommended streaming parameters and returns the encoded audio and video stream to the first cloud machine client.
Specifically, as shown in fig. 1, the back-end platform presets several sets of stream parameters, which may be stream coding parameters. When the cloud machine client sends the cloud mobile phone streaming service to the back-end platform, the back-end platform returns the equipment information of the cloud machine client service and the recommended streaming parameter information to the cloud machine client. The cloud machine client is connected with the cloud machine. And after the cloud machine side service sets the encoder parameters according to the recommended streaming parameters, the encoded audio and video streaming data is returned to the cloud machine client side. And the cloud machine client decodes the audio and video stream and plays the audio and video stream. Meanwhile, the cloud machine side service detects an application scene of a foreground running on the cloud machine client at regular time, and step S201 is executed.
S202, determining a current cloud application scene through the currently running application process.
Specifically, different application processes correspond to different cloud application scenarios. For example, the video application, the game application and the tool application correspond to different current cloud application scenes of the first cloud machine client.
S203, inquiring whether streaming parameters matched with the current cloud application scene exist or not to a back-end platform.
Specifically, the back-end platform prestores streaming parameters matched with various application scenes. The cloud machine side service inquires whether streaming parameters matched with the current cloud application scene exist or not from the back-end platform.
In one example, the stream parameters include a code rate, a resolution, and a frame rate; the querying, by the backend platform, whether there is a streaming parameter matching the current cloud application scenario includes: when the current cloud application scene is a video application, acquiring a first streaming parameter, wherein the first streaming parameter comprises a first code rate, a first resolution and a first frame rate; when the current cloud application scene is a game application, acquiring a second streaming parameter, wherein the second streaming parameter comprises a second code rate, a second resolution and a second frame rate; when the current cloud application scene is a tool application, acquiring a third streaming parameter, wherein the third streaming parameter comprises a third code rate, a third resolution and a third frame rate; wherein the first resolution is greater than the second resolution and greater than the third resolution, the second code rate is greater than the first code rate and greater than the third code rate, the first frame rate is greater than the third frame rate, and the second frame rate is greater than the third frame rate.
Specifically, the stream parameters include a combination of code rate, resolution, and frame rate. In different application scenarios, the requirements on the audio and video communication quality are different. For example, video applications have high definition requirements, game applications have high time-setting requirements, and tool applications have low frame rate requirements. Thus, i take different combinations of streaming parameters for different scenarios.
In one example, when the current cloud application scenario is a tool class application, the audio-video streaming method further includes: when the current network quality is detected to not meet the set condition, a fourth code rate and a fourth resolution are obtained, wherein the fourth code rate is smaller than the third code rate, and the fourth resolution is smaller than the third resolution; and updating the coding parameters of the coder by using the fourth code rate, and transmitting the coded audio and video stream to the first cloud machine client based on the fourth resolution.
Specifically, when the current cloud application scene is a tool application, if the current network condition is not good, the resolution and the code rate can be actively reduced, and the first cloud machine client is prevented from being blocked.
S204, if the matched streaming parameters exist, the matched streaming parameters are obtained, the coding parameters of the coder are updated according to the matched streaming parameters, so that the coder codes the audio and video stream transmitted to the first cloud machine client based on the updated coding parameters, and the coded audio and video stream is transmitted to the first cloud machine client according to the matched streaming parameters.
Specifically, if there is a streaming parameter matching the current cloud application scene, receiving the streaming parameter matching the current cloud application scene sent from the back-end platform, and updating the coding parameter of the encoder according to the matched streaming parameter. The encoder encodes the audio/video stream transmitted to the first cloud machine client based on the updated encoding parameters, and transmits the encoded audio/video stream to the first cloud machine client according to the matched streaming parameters.
The audio/video streaming transmission method based on stream parameter adaptation comprises the steps of identifying a currently running application process of a first cloud machine client; determining a current cloud application scene through the currently running application process; inquiring whether streaming parameters matched with the current cloud application scene exist or not from a back-end platform; if so, acquiring the matched streaming parameters, updating the coding parameters of the coder according to the matched streaming parameters, so that the coder codes the audio and video stream transmitted to the first cloud machine client based on the updated coding parameters, and transmitting the coded audio and video stream to the first cloud machine client according to the matched streaming parameters. Therefore, streaming parameters matched with the cloud machine client can be provided for the cloud machine client based on the cloud application scene, network parameters are optimized, the problems of network congestion and network packet loss are avoided, an audio and video stream matched with the requirements of the user is provided for the user, and the user experience is improved.
In one example, the back-end platform obtains user non-sensitive network performance data reported by the first cloud machine client in real time, determines a current optimal streaming parameter according to the user non-sensitive network performance data, and returns device information of the cloud machine end service and the current optimal streaming parameter to the second cloud machine client when receiving a cloud machine streaming service request of the second cloud machine client. The user non-sensitive network performance data comprise time, ip, area, specification information, networking type, rtt, real-time code rate, frame rate, terminal decoding capability and cloud machine end service real-time coding parameters.
Further, the back-end platform receives a cloud machine streaming service request of the second cloud machine client, and when the networking type, the area and the specification information and the time of the second cloud machine client are matched with those of the first cloud machine client, equipment information of the cloud machine end service and the current optimal streaming parameters are returned to the second cloud machine client.
Specifically, as shown in fig. 3, the first cloud client is a cloud client a, and the second cloud client is a cloud client B. During cloud streaming, all user-insensitive network performance data is collected from cloud client a. Such as time, ip, area, networking type, rtt, real-time code rate, frame rate, terminal decoding capability, cloud machine end real-time coding parameters, etc. And the cloud machine client A reports the data to a big data module of the back-end platform at regular time so as to store, classify and statistically analyze the data. The back-end platform can judge corresponding different specific networking types, areas and time based on the big data module, determines optimized streaming parameters, recommends the streaming parameters to a newly initiated client side streaming request, enables the cloud client side B to obtain proper coding transmission parameters, optimizes and deals with the situation that a network is congested, can timely sense and adjust streaming code rate, avoids congestion, reduces retransmission of lost packets and time delay rise caused by congestion, obtains an optimization balance from time delay, smoothness and definition, and improves user experience.
The embodiment of the invention provides a computer readable storage medium, on which an application program is stored, which when executed by a processor, implements an audio/video streaming method based on stream parameter adaptation in any one of the above embodiments. The computer readable storage medium includes, but is not limited to, any type of disk including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks, ROMs (Read-Only memories), RAMs (Random AcceSS Memory, random access memories), EPROMs (EraSable Programmable Read-Only memories), EEPROMs (Electrically EraSable ProgrammableRead-Only memories), flash memories, magnetic cards, or optical cards. That is, a storage device includes any medium that stores or transmits information in a form readable by a device (e.g., computer, cell phone), and may be read-only memory, magnetic or optical disk, etc.
The embodiment of the invention also provides a computer application program which runs on a computer and is used for executing the audio/video streaming transmission method based on the streaming parameter adaptation in any one of the embodiments.
The embodiment of the invention also provides a cloud server for cloud machine side service, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the steps of the streaming parameter adaptation-based audio/video streaming method when executing the computer program.
In addition, the foregoing describes in detail an audio and video streaming method and system based on stream parameter adaptation, a cloud server for cloud machine side service, and a computer readable storage medium according to embodiments of the present invention, and specific examples should be adopted herein to illustrate the principles and embodiments of the present invention, where the foregoing description of the embodiments is only for helping to understand the method and core idea of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims (10)

1.一种基于串流参数适配的音视频流传输方法,其特征在于,应用于云机端服务,所述音视频流传输方法包括:1. An audio and video streaming transmission method based on streaming parameter adaptation, characterized in that it is applied to cloud machine-side services. The audio and video streaming transmission method includes: 识别第一云机客户端的当前运行的应用进程;Identify the currently running application process of the first cloud machine client; 通过所述当前运行的应用进程确定当前云应用场景;Determine the current cloud application scenario through the currently running application process; 向后端平台查询是否存在与所述当前云应用场景匹配的串流参数;Query the backend platform to see if there are streaming parameters matching the current cloud application scenario; 若存在,则获取所述匹配的串流参数,根据所述匹配的串流参数更新编码器的编码参数,以使得所述编码器基于更新后的编码参数对传输到所述第一云机客户端的音视频流进行编码,以及根据所述匹配的串流参数将编码后的音视频流传输到所述第一云机客户端。If it exists, obtain the matching streaming parameters, and update the encoding parameters of the encoder according to the matching streaming parameters, so that the encoder transmits to the first cloud machine client based on the updated encoding parameter pair. Encoding the audio and video streams on the client, and transmitting the encoded audio and video streams to the first cloud machine client according to the matching streaming parameters. 2.根据权利要求1所述的音视频流传输方法,其特征在于,所述后端平台接收所述第一云机客户端的云机串流服务请求时,向所述第一云机客户端返回所述云机端服务的设备信息以及推荐的串流参数;2. The audio and video streaming transmission method according to claim 1, characterized in that when the back-end platform receives a cloud machine streaming service request from the first cloud machine client, it sends a request to the first cloud machine client. Return the device information and recommended streaming parameters of the cloud server service; 所述第一云机客户端根据所述云机端服务的设备信息以及推荐的串流参数向所述云机端服务发起连接请求,以使得所述云机端服务根据所述推荐的串流参数对音视频流进行编码后将编码的音视频流返回所述第一云机客户端。The first cloud computer client initiates a connection request to the cloud computer service according to the device information of the cloud computer service and the recommended streaming parameters, so that the cloud computer service responds to the recommended streaming parameters. The parameter encodes the audio and video stream and then returns the encoded audio and video stream to the first cloud machine client. 3.根据权利要求1所述的音视频流传输方法,其特征在于,所述串流参数包括码率、分辨率和帧率;3. The audio and video streaming transmission method according to claim 1, characterized in that the streaming parameters include code rate, resolution and frame rate; 所述向后端平台查询是否存在与所述当前云应用场景匹配的串流参数,包括:The query to the back-end platform whether there are streaming parameters matching the current cloud application scenario includes: 在所述当前云应用场景为视频类应用时,获取第一串流参数,所述第一串流参数包括第一码率、第一分辨率和第一帧率;When the current cloud application scenario is a video application, obtain first streaming parameters, where the first streaming parameters include a first code rate, a first resolution, and a first frame rate; 在所述当前云应用场景为游戏类应用时,获取第二串流参数,所述第二串流参数包括第二码率、第二分辨率和第二帧率;When the current cloud application scenario is a game application, obtain second streaming parameters, where the second streaming parameters include a second code rate, a second resolution, and a second frame rate; 在所述当前云应用场景为工具类应用时,获取第三串流参数,所述第三串流参数包括第三码率、第三分辨率和第三帧率;When the current cloud application scenario is a tool application, obtain third streaming parameters, where the third streaming parameters include a third code rate, a third resolution, and a third frame rate; 其中,所述第一分辨率大于所述第二分辨率以及大于所述第三分辨率,所述第二码率大于所述第一码率以及大于所述第三码率,所述第一帧率大于所述第三帧率,以及所述第二帧率大于所述第三帧率。Wherein, the first resolution is greater than the second resolution and greater than the third resolution, the second code rate is greater than the first code rate and greater than the third code rate, and the first The frame rate is greater than the third frame rate, and the second frame rate is greater than the third frame rate. 4.根据权利要求3所述的音视频流传输方法,其特征在于,在所述当前云应用场景为工具类应用时,所述音视频流传输方法还包括:4. The audio and video streaming transmission method according to claim 3, characterized in that when the current cloud application scenario is a tool application, the audio and video streaming transmission method further includes: 在检测到当前网络质量不满足设定条件时,获取第四码率和第四分辨率,所述第四码率小于所述第三码率,所述第四分辨率小于所述第三分辨率;When it is detected that the current network quality does not meet the set conditions, a fourth code rate and a fourth resolution are obtained. The fourth code rate is less than the third code rate, and the fourth resolution is less than the third resolution. Rate; 使用所述第四码率更新编码器的编码参数,以及基于所述第四分辨率将编码后的音视频流传输到所述第一云机客户端。Update encoding parameters of the encoder using the fourth code rate, and transmit the encoded audio and video stream to the first cloud machine client based on the fourth resolution. 5.根据权利要求1所述的音视频流传输方法,其特征在于,所述后端平台获得所述第一云机客户端实时上报的用户非敏感的网络性能数据,根据所述用户非敏感的网络性能数据确定当前的最优串流参数,并在接收到第二云机客户端的云机串流服务请求时,向所述第二云机客户端返回所述云机端服务的设备信息以及所述当前的最优串流参数。5. The audio and video streaming transmission method according to claim 1, characterized in that the back-end platform obtains user non-sensitive network performance data reported in real time by the first cloud machine client. According to the user non-sensitive The network performance data determines the current optimal streaming parameters, and when receiving a cloud machine streaming service request from the second cloud machine client, returns the device information of the cloud machine service to the second cloud machine client. and the current optimal streaming parameters. 6.根据权利要求5所述的音视频流传输方法,其特征在于,所述用户非敏感的网络性能数据包括时间、ip、区域、规格信息、联网类型、rtt、实时码率、帧率、终端解码能力以及云机端服务实时的编码参数。6. The audio and video streaming transmission method according to claim 5, characterized in that the user non-sensitive network performance data includes time, IP, region, specification information, networking type, rtt, real-time code rate, frame rate, Terminal decoding capabilities and real-time encoding parameters of cloud machine services. 7.根据权利要求6所述的音视频流传输方法,其特征在于,所述后端平台接收第二云机客户端的云机串流服务请求,识别出第二云机客户端的联网类型、区域、规格信息以及时间与所述第一云机客户端的联网类型、区域、规格信息以及时间匹配时,向所述第二云机客户端返回所述云机端服务的设备信息以及所述当前的最优串流参数。7. The audio and video streaming transmission method according to claim 6, characterized in that the back-end platform receives the cloud machine streaming service request of the second cloud machine client and identifies the networking type and area of the second cloud machine client. When the specification information and time match the networking type, area, specification information and time of the first cloud machine client, return the device information of the cloud machine service and the current cloud machine service to the second cloud machine client. Optimal streaming parameters. 8.一种基于串流参数适配的音视频流传输系统,其特征在于,包括云机客户端、云机端服务以及后端平台;8. An audio and video streaming transmission system based on streaming parameter adaptation, which is characterized by including a cloud computer client, a cloud computer service and a back-end platform; 所述云机客户端向所述后端平台发送云机串流服务请求;The cloud machine client sends a cloud machine streaming service request to the backend platform; 所述后端平台向所述云机客户端返回所述云机端服务的设备信息以及推荐的串流参数;The backend platform returns the device information of the cloud machine service and the recommended streaming parameters to the cloud machine client; 所述云机客户端根据所述云机端服务的设备信息以及推荐的串流参数向所述云机端服务发起连接请求;The cloud computer client initiates a connection request to the cloud computer service according to the device information and recommended streaming parameters of the cloud computer service; 所述云机端服务根据所述推荐的串流参数对音视频流进行编码后将编码的音视频流返回所述云机客户端;The cloud machine-side service encodes the audio and video streams according to the recommended streaming parameters and returns the encoded audio and video streams to the cloud machine client; 所述云机端服务识别机客户端的当前运行的应用进程,通过所述当前运行的应用进程确定当前云应用场景,向所述后端平台查询是否存在与所述当前云应用场景匹配的串流参数;The cloud machine service identifies the currently running application process of the machine client, determines the current cloud application scenario through the currently running application process, and queries the back-end platform whether there is a stream matching the current cloud application scenario. parameter; 所述后端平台向所述云机端服务发送匹配的串流参数;The backend platform sends matching streaming parameters to the cloud machine service; 所述云机端服务根据所述匹配的串流参数更新编码器的编码参数,以使得所述编码器基于更新后的编码参数对传输到所述云机客户端的音视频流进行编码,以及根据所述匹配的串流参数将编码后的音视频流传输到所述云机客户端。The cloud machine client service updates the encoding parameters of the encoder according to the matching streaming parameters, so that the encoder encodes the audio and video streams transmitted to the cloud machine client based on the updated encoding parameters, and according to The matched streaming parameters transmit the encoded audio and video streams to the cloud machine client. 9.一种云机端服务的云服务器,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至7中任一项所述方法的步骤。9. A cloud server for cloud machine-side services, including a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that when the processor executes the computer program, the claim is realized The steps of the method of any one of 1 to 7. 10.一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至7中任一项所述方法的步骤。10. A computer-readable storage medium with a computer program stored thereon, characterized in that when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.
CN202311776628.6A 2023-12-22 2023-12-22 Streaming parameter adaptation-based audio and video streaming transmission method and system and cloud server Active CN117768448B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311776628.6A CN117768448B (en) 2023-12-22 2023-12-22 Streaming parameter adaptation-based audio and video streaming transmission method and system and cloud server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311776628.6A CN117768448B (en) 2023-12-22 2023-12-22 Streaming parameter adaptation-based audio and video streaming transmission method and system and cloud server

Publications (2)

Publication Number Publication Date
CN117768448A true CN117768448A (en) 2024-03-26
CN117768448B CN117768448B (en) 2025-04-08

Family

ID=90321421

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311776628.6A Active CN117768448B (en) 2023-12-22 2023-12-22 Streaming parameter adaptation-based audio and video streaming transmission method and system and cloud server

Country Status (1)

Country Link
CN (1) CN117768448B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109640116A (en) * 2018-12-24 2019-04-16 广州微算互联信息技术有限公司 The coding method of cloud mobile phone network video and server
US20190253704A1 (en) * 2017-03-21 2019-08-15 Tencent Technology (Shenzhen) Company Limited Video encoding method, video decoding method, computer device and storage medium
WO2022021090A1 (en) * 2020-07-28 2022-02-03 深圳市大疆创新科技有限公司 Video transmission method, movable platform and computer-readable storage medium
WO2022048255A1 (en) * 2020-09-07 2022-03-10 华为云计算技术有限公司 Data processing method and system, cloud terminal, server, and computing device
CN114760309A (en) * 2022-04-11 2022-07-15 中国电信股份有限公司 Business interaction method, device, equipment and medium of terminal based on cloud service
WO2023045392A1 (en) * 2021-09-26 2023-03-30 华为技术有限公司 Cloud mobile phone implementation method and apparatus

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190253704A1 (en) * 2017-03-21 2019-08-15 Tencent Technology (Shenzhen) Company Limited Video encoding method, video decoding method, computer device and storage medium
CN109640116A (en) * 2018-12-24 2019-04-16 广州微算互联信息技术有限公司 The coding method of cloud mobile phone network video and server
WO2022021090A1 (en) * 2020-07-28 2022-02-03 深圳市大疆创新科技有限公司 Video transmission method, movable platform and computer-readable storage medium
WO2022048255A1 (en) * 2020-09-07 2022-03-10 华为云计算技术有限公司 Data processing method and system, cloud terminal, server, and computing device
WO2023045392A1 (en) * 2021-09-26 2023-03-30 华为技术有限公司 Cloud mobile phone implementation method and apparatus
CN114760309A (en) * 2022-04-11 2022-07-15 中国电信股份有限公司 Business interaction method, device, equipment and medium of terminal based on cloud service

Also Published As

Publication number Publication date
CN117768448B (en) 2025-04-08

Similar Documents

Publication Publication Date Title
CN111246033B (en) Data transmission method, device, equipment and readable storage medium
US11012342B2 (en) Systems and methods for regulating network resources to improve data-transmission quality
US7634574B2 (en) Communication control device, communication terminal device, server device, and communication control method
EP3963841A1 (en) Network nodes for joint mec host and upf selection
CN116405461A (en) Data processing method, network element equipment and readable storage medium
US20100069080A1 (en) Call Admission Control for Mobility-Capable Telecommunications Terminals
US20120096130A1 (en) Method, apparatus and system for bandwidth control
US10652297B2 (en) Method, system and apparatus for the transmission and adaption of data
WO2023035895A1 (en) Data processing method, device, readable storage medium, and program product
KR100723822B1 (en) Optimization of transmission parameters of a wireless interface based on communication type
CN111596940B (en) Version upgrading method and device, electronic equipment and storage medium
CN108347463A (en) A kind of terminal document method for uploading
CN105556922A (en) Dash representations adaptations in network
US20180124132A1 (en) Conducting a conference call over a computer network
CN113746602B (en) A network real-time communication method, device and system
WO2025055607A1 (en) Data transmission method and system for real-time audio and video transmission network
US20120102162A1 (en) Dynamic bandwidth adjustment for multiple service support
CN111617466B (en) Encoding format determination method, device and implementation method of cloud game
WO2023142716A1 (en) Encoding method and apparatus, real-time communication method and apparatus, device, and storage medium
CN117768448B (en) Streaming parameter adaptation-based audio and video streaming transmission method and system and cloud server
US20230396790A1 (en) Video encoding method and apparatus, electronic device, and storage medium
US8644138B2 (en) Method, computer program product, and apparatus for deriving intelligence from format change requests
JP2002359651A (en) System and method for codec selection
US20080031202A1 (en) Accounting for Telecommunications Terminal Mobility in Call Admission Control
US20220021920A1 (en) Communication entity and a method for transmitting a video data stream

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant