CN116708879A - Transmission method and device for reducing video conference network bandwidth - Google Patents

Transmission method and device for reducing video conference network bandwidth Download PDF

Info

Publication number
CN116708879A
CN116708879A CN202310518575.1A CN202310518575A CN116708879A CN 116708879 A CN116708879 A CN 116708879A CN 202310518575 A CN202310518575 A CN 202310518575A CN 116708879 A CN116708879 A CN 116708879A
Authority
CN
China
Prior art keywords
video stream
bandwidth
client
dynamic video
stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310518575.1A
Other languages
Chinese (zh)
Inventor
张哲明
张志昌
王钢
王飞
马宁
周扬帆
陈中东
罗通
陈翊豪
张蓓蓓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bnc Technologies Co ltd
Original Assignee
Bnc Technologies Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bnc Technologies Co ltd filed Critical Bnc Technologies Co ltd
Priority to CN202310518575.1A priority Critical patent/CN116708879A/en
Publication of CN116708879A publication Critical patent/CN116708879A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385Channel allocation; Bandwidth allocation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26208Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
    • H04N21/26216Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving the channel capacity, e.g. network bandwidth
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/64738Monitoring network characteristics, e.g. bandwidth, congestion level
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Abstract

The invention discloses a transmission method and a device for reducing the network bandwidth of a video conference, which relate to the technical field of computer communication and mainly aim to reduce the uplink and downlink bandwidth pressure of a device end and flexibly adapt to the conference demands of a mobile end of a main stream. The main technical scheme of the invention is as follows: when a pushing client communicates with a receiving client video conference, the pushing client pushes the audio stream, the static video stream and the dynamic video stream to a media forwarding server of an SFU architecture; when the receiving client performs video conference picture amplification, the receiving client switches the pulled static video stream into the dynamic video stream and notifies the pushing client by utilizing the media forwarding server; based on the event that the dynamic video stream is pulled, the pushing client modifies the bandwidth corresponding to the dynamic video stream into a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth. The invention is used for the video conference network.

Description

Transmission method and device for reducing video conference network bandwidth
Technical Field
The invention relates to the technical field of computer information, in particular to a transmission method and device for reducing video conference network bandwidth.
Background
The most basic architecture schemes in the existing video conference schemes based on WebRTC technology are Mesh, MCU, SFU. Among them, SFU architecture is commonly adopted to balance the client bandwidth occupation and the server processing capacity requirement in the case that enterprises cannot afford high server costs. Thus, optimization is required in terms of the upstream and downstream bandwidth requirements of the device side of the SFU architecture.
At present, through analyzing mainstream video conference software, the following strategies are basically adopted to perform video conference plug flow operation: the first technology is that a Simulcast technology is used, that is, a publisher pushes several different code streams to a server, and the server forwards corresponding code streams to a receiving user according to a network state of a receiving party. And in the second technology, a large-small stream (auxiliary stream) strategy is used, two paths of different code streams are pushed to a server at the same time, one path or two paths of the code streams are pulled by a client as required, and when network fluctuation occurs, compared with the first technology, the video stream cannot be received by a playing end due to active reduction of the code streams.
However, as soon as there is an obvious defect in the technology, specifically, the playing end is affected by the uplink client, if for some reason, the number of Simulcast layers is reduced to one layer for the uplink client, at this time, the playing end cannot receive the video stream if there is no special processing, and if the playing end is manually switched, the playing end feels a jam, so that the user experience is affected. Although the size stream strategy of the second technology is compared with the first technology, the problem that the playing end cannot receive the video stream due to active reduction of the code stream is solved, the small stream bandwidth requirement is increased compared with the single stream push strategy, and the bandwidth waste is caused by repeated push of the audio.
Disclosure of Invention
In view of the above problems, the present invention provides a transmission method and apparatus for reducing the bandwidth of a video conference network, which mainly aims to reduce the uplink and downlink bandwidth pressure of a device end, and flexibly adapt to the mobile end conference requirements of the mainstream.
In order to solve the technical problems, the invention provides the following scheme:
in a first aspect, the present invention provides a transmission method for reducing bandwidth of a video conference network, the method comprising:
when a pushing client is communicated with a video conference of a receiving client, the pushing client pushes an audio stream, a static video stream and a dynamic video stream to a media forwarding server of an SFU architecture through PeerConnection links respectively corresponding to the audio stream, the static video stream and the dynamic video stream, wherein initial bandwidths corresponding to the static video stream and the dynamic video stream are preset minimum bandwidths;
the receiving client pulls the audio stream and the static video stream from the media forwarding server of the SFU framework to play the video;
when the receiving client performs video conference picture amplification, the receiving client switches the pulled static video stream into the dynamic video stream, generates a dynamic video stream pulled event, and notifies the pushing client of the dynamic video stream pulled event by using the media forwarding server;
Based on the event that the dynamic video stream is pulled, the pushing client modifies the bandwidth corresponding to the dynamic video stream into a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth.
In a second aspect, the present invention provides a transmission apparatus for reducing the bandwidth of a videoconference network, the apparatus comprising:
the pushing unit is used for pushing the audio stream, the static video stream and the dynamic video stream to a media forwarding server of an SFU architecture through PeerConnection links respectively corresponding to the audio stream, the static video stream and the dynamic video stream when the pushing client is communicated with the video conference of the receiving client, wherein initial bandwidths corresponding to the static video stream and the dynamic video stream are preset minimum bandwidths;
the pulling unit is used for pulling the audio stream and the static video stream from the media forwarding server of the SFU framework to play the video when the receiving client does not amplify the video conference picture;
the switching unit is used for switching the pulled static video stream into the dynamic video stream by the receiving client when the video conference picture is amplified by the receiving client, generating a pulled event of the dynamic video stream, and notifying the pulled event of the dynamic video stream to the pushing client by the media forwarding server;
And the modifying unit is used for modifying the bandwidth corresponding to the dynamic video stream into a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth based on the event that the dynamic video stream is pulled.
In order to achieve the above object, according to a third aspect of the present invention, there is provided a storage medium including a stored program, wherein a device in which the storage medium is controlled to execute the transmission method for reducing the bandwidth of a video conference network according to the first aspect when the program runs.
To achieve the above object, according to a fourth aspect of the present invention, there is provided an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing all or part of the steps of the transmission means for reducing the bandwidth of a videoconference network according to the second aspect when the program is executed.
By means of the technical scheme, the transmission method and the device for reducing the video conference network bandwidth are characterized in that the problem of bandwidth waste caused by repeated audio push exists in the conventional method. When a pushing client communicates with a video conference of a receiving client, the pushing client pushes an audio stream, a static video stream and a dynamic video stream to a media forwarding server of an SFU architecture through PeerConnection links respectively corresponding to the audio stream, the static video stream and the dynamic video stream, wherein initial bandwidths corresponding to the static video stream and the dynamic video stream are preset minimum bandwidths; the receiving client pulls the audio stream and the static video stream from the media forwarding server of the SFU framework to play the video; when the receiving client performs video conference picture amplification, the receiving client switches the pulled static video stream into the dynamic video stream, generates a dynamic video stream pulled event, and notifies the pushing client of the dynamic video stream pulled event by using the media forwarding server; based on the event that the dynamic video stream is pulled, the pushing client modifies the bandwidth corresponding to the dynamic video stream into a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth. The invention can reduce the uplink bandwidth of the video to the minimum standard supported by hardware under the premise of ensuring the normal audio of the video conference, and simultaneously enables the streaming client to pull according to the primary and secondary requirements of the picture so as to save the flow. Therefore, the uplink and downlink bandwidth pressure of the equipment end is further reduced, and the mobile terminal meeting requirements of the main stream are flexibly adapted.
The foregoing description is only an overview of the present invention, and is intended to be implemented in accordance with the teachings of the present invention in order that the same may be more clearly understood and to make the same and other objects, features and advantages of the present invention more readily apparent.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
fig. 1 shows a flowchart of a transmission method for reducing a video conference network bandwidth according to an embodiment of the present invention;
fig. 2 is a flowchart of another transmission method for reducing bandwidth of a video conference network according to an embodiment of the present invention;
fig. 3 is a block diagram of a transmission device for reducing bandwidth of a video conference network according to an embodiment of the present invention;
fig. 4 is a block diagram of another transmission device for reducing bandwidth of a video conference network according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Term interpretation:
WebRTC: webRTC (Web Real-Time Communications) is a Real-time communication technology that allows Web applications or sites to establish Peer-to-Peer (Peer-to-Peer) connections between browsers without the aid of intermediaries, enabling the transmission of video and/or audio streams or any other data. These criteria, contained by WebRTC, make it possible for users to create Peer-to-Peer (Peer-to-Peer) data sharing and teleconferencing without having to install any plug-in or third party software.
SRS: SRS is a simple and efficient real-time video server supporting RTMP/WebRTC/HLS/HTTP-FLV/SRT/GB28181 protocol video stream.
Uplink bandwidth: the method refers to the flow generated by data externally sent by the client device, for example, online video call is carried out between two people, each person needs to upload own video flow to the Internet, each person generates 300KB flow per second, and when the flow is converted into a communication standard bandwidth unit M, the uplink bandwidth of the client per second is 3M.
Downlink bandwidth: the method refers to the flow generated by the data sent by the server, for example, online video call is carried out between two persons, each person needs to pull the video flow of the opposite party from the server to the client, each person downloads 300KB flow per second, and when the flow is converted into a communication standard bandwidth unit M, the downstream bandwidth of the client per second is 3M.
The most basic architecture schemes in the existing video conference schemes based on WebRTC technology are Mesh, MCU, SFU. Assuming a total of 4 parties, each party uploads a video stream with approximately 1M bandwidth. In the Mesh scheme, each device end needs to send its own stream to the other three ends, and adds up to 3M uplink bandwidth, and obtains video streams from the other three ends, adds up to 3M downlink bandwidth, and each end needs to bear 6M uplink and downlink bandwidth. In the MCU scheme, each device side uploads its own video stream to the server and pulls the video stream mixed by the server, and each side is required to bear 2M upstream and downstream bandwidths. Finally, in the SFU scheme, after each equipment side uploads the video stream of the equipment side to the server, the video streams of the other three sides are respectively pulled from the server, and each side bears 4M uplink and downlink bandwidths. The video conference architecture scheme comparison results are: 1. device-side bandwidth requirements: mesh (3M downlink+3m uplink) > SFU (1M uplink+3m downlink) > MCU (1M uplink+1m downlink); 2. the equipment end processing capacity requirement is mesh=SFU > MCU; 3. service side processing capability requirement: MCU > SFU > 0=mesh (no server); thus, the SFU architecture balances client bandwidth occupation and server processing power requirements without the enterprise being able to afford high server costs. There is thus a need to optimize the requirements for two aspects of the SFU architecture: firstly, the uplink and downlink bandwidth requirements of the equipment end are reduced, and secondly, the processing capacity requirements of the equipment end are reduced.
At present, through analyzing mainstream video conference software, the following strategies are basically adopted to perform video conference plug flow operation: the first technology is that a Simulcast technology is used, that is, a publisher pushes several different code streams to a server, and the server forwards corresponding code streams to a receiving user according to a network state of a receiving party. And in the second technology, a large-small stream (auxiliary stream) strategy is used, two paths of different code streams are pushed to a server at the same time, one path or two paths of the code streams are pulled by a client as required, and when network fluctuation occurs, compared with the first technology, the video stream cannot be received by a playing end due to active reduction of the code streams.
However, as soon as there is an obvious defect in the technology, specifically, the playing end is affected by the uplink client, if for some reason, the number of Simulcast layers is reduced to one layer for the uplink client, at this time, the playing end cannot receive the video stream if there is no special processing, and if the playing end is manually switched, the playing end feels a jam, so that the user experience is affected. Although the size stream strategy of the second technology is compared with the first technology, the problem that the playing end cannot receive the video stream due to active reduction of the code stream is solved, the small stream bandwidth requirement is increased compared with the single stream push strategy, and the bandwidth waste is caused by repeated push of the audio.
In view of the above problems, the inventors have conceived a strategy of bandwidth adjustment for a pusher according to the audience playing timing to reduce unnecessary bandwidth waste.
Therefore, the embodiment of the invention provides a transmission method for reducing the network bandwidth of a video conference, by which the video uplink bandwidth is reduced to the lowest standard of hardware support on the premise of ensuring the normal audio of the video conference, and simultaneously, a streaming client is pulled according to the primary and secondary requirements of a picture to save the flow, thereby further reducing the uplink and downlink bandwidth pressure of a device end, flexibly adapting to the requirements of a mainstream mobile conference, and specifically executing the steps are shown in fig. 1, and comprising the following steps:
101. when the pushing client communicates with the receiving client video conference, the pushing client pushes the audio stream, the static video stream and the dynamic video stream to the media forwarding server of the SFU architecture through PeerConnection links corresponding to the audio stream, the static video stream and the dynamic video stream respectively.
The initial bandwidths corresponding to the static video stream and the dynamic video stream are preset minimum bandwidths, for example: the preset minimum bandwidth may be set to 32Kbps; the present embodiment is not particularly limited. The push client is a client initiated by the video conference, and the receiving client is a client invited to join the video conference and is also a playing client. The audio stream, the still video stream and the dynamic video stream correspond to a PeerConnection link, respectively, for example: the audio stream corresponds to a first path of PeerConnection link, the static video stream corresponds to a second path of PeerConnection link, and the dynamic video stream corresponds to a third path of PeerConnection link, which is not specifically limited in this embodiment. The media forwarding server may be an SRS media forwarding server.
102. The receiving client pulls and sends the audio stream and the static video stream from the media forwarding server of the SFU framework for video playing.
Through step 101, the media forwarding server of the sfu architecture may obtain the audio stream, the still video stream, and the dynamic video stream pushed by the pushing client. The receiving client pulls the audio stream and the static video stream from the media forwarding server of the SFU architecture according to service requirements, at the moment, the bandwidth of the static video stream is preset minimum bandwidth and is generally 32Kbps, wherein the static video stream is a video stream consisting of minimum resolution supported by hardware and lower frame rate, and is suitable for pulling and playing in video conference picture preview of the receiving client, and at the moment, the receiving client only needs to bear the downlink bandwidth pressure of the audio stream and the static video stream.
103. When the receiving client performs video conference picture amplification, the receiving client switches the pulled static video stream into a dynamic video stream, generates a dynamic video stream pulled event, and notifies the pushing client of the dynamic video stream pulled event by using the media forwarding server.
The dynamic video stream is a video stream with resolution and frame rate affected by dynamic adjustment of bandwidth limitation by the push client, parameters of the dynamic video stream default to minimum resolution and lower frame rate when the push is started, and null data packets are used for replacing video data packets.
102, the receiving client may already pull the audio stream and the still video stream, and at this time, the receiving client links the peer connection links corresponding to the audio stream and the still video stream respectively; when a receiving client performs video conference picture amplification, cutting off a peerConnection link corresponding to the static video stream and linking the peerConnection link corresponding to the dynamic video stream, and at the moment, the SRS media forwarding server perceives that the dynamic video stream of the pushing client is pulled, namely the dynamic video stream is pulled, and notifies the pushing client of the pulling event of the dynamic video stream.
104. Based on the pulling event of the dynamic video stream, the pushing client modifies the bandwidth corresponding to the dynamic video stream into a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth.
Step 103, obtaining a pull event of the dynamic video stream, wherein the push client dynamically modifies parameters of the dynamic video stream from a preset minimum bandwidth to a preset low-definition bandwidth after receiving the pull event of the dynamic video stream, and restores normal video data packets; the preset low-definition bandwidth may be 90Kbps, which is not specifically limited in this embodiment; at this time, the push client and the receiving client transmit the dynamic video stream with a preset low-definition bandwidth requirement. It should be noted that: when the receiving client side is switched back to the static video stream because the video conference picture is not viewed in an enlarged mode any more due to service requirements, the SRS media forwarding server senses that the dynamic video stream of the pushing client side is finished to be played, and informs the pushing client side to reduce the dynamic video stream to the minimum resolution and lower frame rate, namely the preset minimum bandwidth, and the null data packet is used for replacing the video data packet.
Based on the implementation manner of the embodiment of fig. 1, the present invention provides a transmission method for reducing the bandwidth of a video conference network, where when a push client is in video conference communication with a receiving client, the push client pushes an audio stream, a static video stream and a dynamic video stream to a media forwarding server of an SFU architecture through PeerConnection links corresponding to the audio stream, the static video stream and the dynamic video stream respectively, where initial bandwidths corresponding to the static video stream and the dynamic video stream are preset minimum bandwidths; the receiving client pulls the audio stream and the static video stream from the media forwarding server of the SFU framework to play the video; when the receiving client performs video conference picture amplification, the receiving client switches the pulled static video stream into the dynamic video stream, generates a dynamic video stream pulled event, and notifies the pushing client of the dynamic video stream pulled event by using the media forwarding server; based on the event that the dynamic video stream is pulled, the pushing client modifies the bandwidth corresponding to the dynamic video stream into a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth. The invention can reduce the uplink bandwidth of the video to the minimum standard supported by hardware under the premise of ensuring the normal audio of the video conference, and simultaneously enables the streaming client to pull according to the primary and secondary requirements of the picture so as to save the flow. Therefore, the uplink and downlink bandwidth pressure of the equipment end is further reduced, and the mobile terminal meeting requirements of the main stream are flexibly adapted.
Further, as a refinement and extension to the embodiment shown in fig. 1, the embodiment of the present invention further provides another transmission method for reducing the bandwidth of the video conference network, as shown in fig. 2, which specifically includes the following steps:
201. when the pushing client communicates with the receiving client video conference, the pushing client pushes the audio stream, the static video stream and the dynamic video stream to the media forwarding server of the SFU architecture through PeerConnection links corresponding to the audio stream, the static video stream and the dynamic video stream respectively.
This step is described in conjunction with step 101 in the above method, and the same contents are not repeated here.
The pushing client divides the audio and video streams required by the video conference into independent audio streams, static video streams and dynamic video streams, the audio and video streams are respectively pushed to the SRS media forwarding server of the SFU framework through the PeerConnection link, and the receiving client pulls the audio streams, the static video streams and the dynamic video streams from the SRS media forwarding server according to the service logic requirements.
The online video conference product architecture applied to the invention comprises an SRS media forwarding server, a signaling server, a plurality of PC browser ends and a plurality of android clients; the SRS media forwarding server and the signaling server can perform SRS callback; a signaling channel is arranged between the signaling server and each browser end and each android client, and two-way stream pulling and three-way stream pushing are carried out between the SRS media forwarding server and each browser end and each android client;
Wherein the two streams are one audio stream, one static video stream or one dynamic video stream; the three-way pushing stream comprises one audio stream, one static video stream and one dynamic video stream; the signaling channel is a signaling that includes information informing the pusher to increase bandwidth limitation and decrease bandwidth limitation; the SRS callback refers to that when the SRS forwards a media stream, two callback notices of starting playing/ending playing are sent to a signaling server, and callback content comprises a pusher Id, a media stream type (audio, static video and dynamic video) and other information.
Illustrating: a meeting invitation is initiated by a user a (name: zhang one, id: a) to a user B (name: zhang three, id: B), which clicks on accepting the invitation, at which time the user a performs streaming of an audio stream, a still video stream (default uploading bandwidth limit 32 Kbps), and a dynamic video stream (default uploading bandwidth limit 32 Kbps).
Further, the initial default bandwidths of the static video stream and the dynamic video stream are preset to be preset minimum bandwidths, the preset minimum bandwidths are 32Kbps, and the preset low-definition bandwidths corresponding to the dynamic video stream are set to be 90Kbps and the preset high-definition bandwidths are set to be 300Kbps; the bandwidth corresponding to the dynamic video stream can be dynamically adjusted among the preset minimum bandwidth, the preset low-definition bandwidth and the preset high-definition bandwidth according to the requirement.
202. The receiving client pulls and sends the audio stream and the static video stream from the media forwarding server of the SFU framework for video playing.
This step is described in conjunction with step 102 in the above method, and the same contents are not repeated here.
203. When the receiving client performs video conference picture amplification, the receiving client switches the pulled static video stream into a dynamic video stream, generates a dynamic video stream pulled event, and notifies the pushing client of the dynamic video stream pulled event by using the media forwarding server.
This step is described in conjunction with step 103 in the above method, and the same contents are not repeated here.
When the receiving client performs video conference picture amplification by using a preset picture amplification action, the receiving client pulls the audio stream and the dynamic video stream of the push client by using a preset pulling rule to generate a pulling event of the dynamic video stream; and the preset picture amplifying action executed by the receiving client triggers a play starting callback of a media forwarding server of the SFU framework, and the signaling service informs the push client of the event of pulling the dynamic video stream to improve the upper bandwidth limit corresponding to the dynamic video stream.
When the receiving client performs video conference picture amplification by using a preset picture amplification action, the receiving client pulls the audio stream and the dynamic video stream of the push client by using a preset pulling rule, and generates a pulling event of the dynamic video stream, which comprises the following steps: when the receiving client performs video conference picture amplification by using a preset picture amplification action, the receiving client cuts off the peerConnection link corresponding to the static video stream and links the peerConnection link corresponding to the dynamic video stream, wherein a video data packet corresponding to the dynamic video stream is an empty data packet; and generating the dynamic video stream pulled event based on the receiving client-side links to the peerConnection links corresponding to the dynamic video stream.
Illustrating:
after receiving the invitation, the user B enters a conference, starts to pull the audio stream and the dynamic video stream of the user A, and the pull stream acts as a callback for triggering the start of the SRS to play, and informs the user A to improve the bandwidth upper limit through signaling service.
204. Based on the pulling event of the dynamic video stream, the pushing client modifies the bandwidth corresponding to the dynamic video stream into a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth.
This step is described in conjunction with step 104 in the above method, and the same contents are not repeated here.
Illustrating:
based on the pulling event of the dynamic video stream, the user A modifies the bandwidth corresponding to the dynamic video stream from 32Kbps to 90Kbps; as can be seen in the statistics of the pull-up bandwidth of user B, the actual downstream bandwidth is about 90 Kbps.
Further, the embodiment further includes: and based on the pulling event of the dynamic video stream, the pushing client restores the video data packet corresponding to the dynamic video stream from an empty data packet to a normal video data packet.
205. When the receiving client performs the operation of recovering the video conference picture from the amplifying operation, the receiving client cuts off the peerConnection link corresponding to the dynamic video stream and links the peerConnection link corresponding to the static video stream to generate a static video stream pulled event.
Wherein, the video data packet corresponding to the dynamic video stream is a normal video data packet;
illustrating:
and closing the picture of the user A in the palace picture of the user B, triggering the ending play callback of the SRS by the closing action, and notifying the user A to reduce the upper limit of the bandwidth through signaling service.
206. Based on the pulling event of the static video stream, the pushing client modifies the video data packet corresponding to the dynamic video stream from a normal video data packet to an empty data packet.
It should be noted that: when the pushing client ends pushing, three Peerconnection links need to be cut off and the number of audiences needs to be cleared.
Further, in another embodiment of the present invention, when the push client performs a video conference with a plurality of receiving clients, the media server of the SFU architecture may store a plurality of dynamic video stream pulled events corresponding to a plurality of receiving clients in a redis service; when the number of the dynamic video stream pulled events in the redis service is increased from 0 to 1, notifying the push client to promote the uplink bandwidth; and when the number of the dynamic video stream pulled events in the redis service is from n to 0, notifying the push client to reduce the uplink bandwidth, wherein the value of n is not less than 1.
Illustrating:
when the number of audiences increases from 0 to 1, the push client is informed to improve the uplink bandwidth, and repeatedly perceiving the event does not inform the push client. Likewise, the push client is notified to reduce the upstream bandwidth when the number of viewers is from 1 to 0.
Based on the implementation of fig. 2, the present invention provides a transmission method for reducing the bandwidth of a video conference network, and in the online video conference under the SFU architecture, the bandwidth of a push video is reduced when no audience is present. The invention can effectively save the uplink bandwidth of the student client side serving as the non-speaker because the ratio of the speaker to the non-speaker is greatly different in the similar online classroom service. In the similar multi-user video chat service, the playing end can freely control the picture to be enlarged, reduced, displayed and hidden, and the scheme can inform the pushing end to change the upper limit of the bandwidth at the moment of controlling the picture so as to play a role in saving the uplink bandwidth.
Further, as an implementation of the method shown in fig. 1, the embodiment of the present invention further provides a transmission device for reducing a bandwidth of a video conference network, which is configured to implement the method shown in fig. 1. The embodiment of the device corresponds to the embodiment of the method, and for convenience of reading, details of the embodiment of the method are not repeated one by one, but it should be clear that the device in the embodiment can correspondingly realize all the details of the embodiment of the method. As shown in fig. 3, the apparatus includes:
A pushing unit 31, configured to, when a pushing client is in video conference communication with a receiving client, push an audio stream, a still video stream and a dynamic video stream to a media forwarding server of an SFU architecture through PeerConnection links corresponding to the audio stream, the still video stream and the dynamic video stream, where initial bandwidths corresponding to the still video stream and the dynamic video stream are preset minimum bandwidths;
a pulling unit 32, configured to, when the receiving client does not perform video conference picture amplification, pull, by the receiving client, the audio-feed stream and the still video stream obtained from the pushing unit 31 from a media forwarding server of the SFU architecture to perform video playback;
a switching unit 33, configured to, when the receiving client performs video conference screen zoom-in, switch the still video stream pulled from the pulling unit 32 to the dynamic video stream obtained from the pushing unit 31, generate the dynamic video stream pulled event, and notify the pushing client of the dynamic video stream pulled event by using the media forwarding server;
And a modifying unit 34, configured to modify, by the pushing client, a bandwidth corresponding to the dynamic video stream to a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth, based on the event that the dynamic video stream obtained from the switching unit 33 is pulled.
Further, as an implementation of the method shown in fig. 2, the embodiment of the present invention further provides another transmission device for reducing the bandwidth of the video conference network, which is used for implementing the method shown in fig. 2. The embodiment of the device corresponds to the embodiment of the method, and for convenience of reading, details of the embodiment of the method are not repeated one by one, but it should be clear that the device in the embodiment can correspondingly realize all the details of the embodiment of the method. As shown in fig. 4, the apparatus includes:
a setting unit 36, configured to set initial default bandwidths of the still video stream and the dynamic video stream to a preset minimum bandwidth, where the preset minimum bandwidth is 32Kbps, and simultaneously set the preset low-definition bandwidth corresponding to the dynamic video stream to be 90Kbps and the high-definition bandwidth to be 300Kbps;
a pushing unit 31, configured to push, when a pushing client is in video conference communication with a receiving client, the audio stream, the still video stream, and the dynamic video stream obtained from the setting unit 36 to a media forwarding server of an SFU architecture through PeerConnection links corresponding to the audio stream, the still video stream, and the dynamic video stream, where initial bandwidths corresponding to the still video stream and the dynamic video stream are preset minimum bandwidths;
A pulling unit 32, configured to, when the receiving client does not perform video conference picture amplification, pull, by the receiving client, the audio-feed stream and the still video stream obtained from the pushing unit 31 from a media forwarding server of the SFU architecture to perform video playback;
a switching unit 33, configured to, when the receiving client performs video conference screen zoom-in, switch the still video stream pulled from the pulling unit 32 to the dynamic video stream obtained from the pushing unit 31, generate the dynamic video stream pulled event, and notify the pushing client of the dynamic video stream pulled event by using the media forwarding server;
a modifying unit 34, configured to modify, based on the event that the dynamic video stream obtained from the switching unit 33 is pulled, a bandwidth corresponding to the dynamic video stream to a preset low-definition bandwidth or a preset high-definition bandwidth by the push client due to the preset minimum bandwidth;
a first adjustment unit 35, configured to restore, based on the pull event of the dynamic video stream obtained from the switching unit 33, a video packet corresponding to the dynamic video stream from a null packet to a normal video packet by the push client;
A storage unit 37, configured to store, when the push client performs a video conference with a plurality of receiving clients, a plurality of dynamic video stream pulled events corresponding to the receiving clients in a redis service by a media server of the SFU architecture;
a second adjusting unit 38, configured to notify the push client to increase an upstream bandwidth when the number of the dynamic video stream pulled events in the redis service obtained from the storage unit 37 increases from 0 to 1;
a third adjustment unit 39, configured to notify the push client to reduce an upstream bandwidth when the number of the dynamic video stream pulled events in the redis service obtained from the storage unit 37 is from n to 0, where the value of n is not less than 1;
the switching unit 33 is further configured to, when the receiving client performs a recovery video conference frame amplifying operation, cut off a peerConnection link corresponding to the dynamic video stream, and link the peerConnection link corresponding to the static video stream, to generate the static video stream pulled event, where a video data packet corresponding to the dynamic video stream is a normal video data packet;
The first adjusting unit 35 is configured to, based on the still video stream pulled event obtained from the switching unit 33, modify, by the push client, a video packet corresponding to the dynamic video stream from a normal video packet to an empty packet.
Further, the switching unit 33 includes:
the generating module 331 is configured to, when the receiving client performs video conference picture amplification by using a preset picture amplification action, pull the audio stream and the dynamic video stream of the push client by using a preset pull rule, and generate a pull event of the dynamic video stream;
and a notification module 332, configured to trigger a play-starting callback of the media forwarding server of the SFU architecture by using a preset picture amplification action performed by the receiving client, notify, by using a signaling service, the push client of the event that the dynamic video stream obtained from the generating module 331 is pulled, where the push client is used to increase the bandwidth upper limit corresponding to the dynamic video stream.
Further, the generating module 331 includes:
a switching submodule 3311, configured to, when the receiving client performs video conference picture amplification by using a preset picture amplification action, cut off the peerConnection link corresponding to the still video stream and link the peerConnection link corresponding to the dynamic video stream, where a video packet corresponding to the dynamic video stream is an empty packet;
A generating sub-module 3312, configured to generate the dynamic video stream pulled event based on the receiving client obtained from the switching sub-module 3311 linking the peerConnection link corresponding to the dynamic video stream.
Further, an embodiment of the present invention further provides a processor, where the processor is configured to execute a program, where the program executes the transmission method for reducing the bandwidth of the video conference network described in fig. 1-2.
Further, an embodiment of the present invention further provides a storage medium, where the storage medium is configured to store a computer program, where when the computer program runs, control a device where the storage medium is located to execute the transmission method for reducing the bandwidth of the video conference network described in fig. 1-2.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.
It will be appreciated that the relevant features of the methods and apparatus described above may be referenced to one another. In addition, the "first", "second", and the like in the above embodiments are for distinguishing the embodiments, and do not represent the merits and merits of the embodiments.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, which are not repeated herein.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general-purpose systems may also be used with the teachings herein. The required structure for a construction of such a system is apparent from the description above. In addition, the present application is not directed to any particular programming language. It will be appreciated that the teachings of the present application described herein may be implemented in a variety of programming languages, and the above description of specific languages is provided for disclosure of enablement and best mode of the present application.
Furthermore, the memory may include volatile memory, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM), in a computer readable medium, the memory including at least one memory chip.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and variations of the present application will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. which come within the spirit and principles of the application are to be included in the scope of the claims of the present application.

Claims (10)

1. A transmission method for reducing video conferencing network bandwidth, the method comprising:
when a pushing client is communicated with a video conference of a receiving client, the pushing client pushes an audio stream, a static video stream and a dynamic video stream to a media forwarding server of an SFU architecture through PeerConnection links respectively corresponding to the audio stream, the static video stream and the dynamic video stream, wherein initial bandwidths corresponding to the static video stream and the dynamic video stream are preset minimum bandwidths;
the receiving client pulls the audio stream and the static video stream from the media forwarding server of the SFU framework to play the video;
when the receiving client performs video conference picture amplification, the receiving client switches the pulled static video stream into the dynamic video stream, generates a dynamic video stream pulled event, and notifies the pushing client of the dynamic video stream pulled event by using the media forwarding server;
based on the event that the dynamic video stream is pulled, the pushing client modifies the bandwidth corresponding to the dynamic video stream into a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth.
2. The method according to claim 1, wherein the receiving client switches the pulled still video stream to the dynamic video stream when the receiving client performs video conference screen enlargement, generates the dynamic video stream pulled event, and notifies the pushing client of the dynamic video stream pulled event using the media forwarding server, comprising:
when the receiving client performs video conference picture amplification by using a preset picture amplification action, the receiving client pulls the audio stream and the dynamic video stream of the push client by using a preset pulling rule to generate a pulling event of the dynamic video stream;
and the preset picture amplifying action executed by the receiving client triggers a play starting callback of a media forwarding server of the SFU framework, and the signaling service informs the push client of the event of pulling the dynamic video stream to improve the upper bandwidth limit corresponding to the dynamic video stream.
3. The method according to claim 2, wherein when the receiving client performs video conference picture enlargement using a preset picture enlargement action, the receiving client pulls the audio stream and the dynamic video stream of the push client using a preset pulling rule, and generating the dynamic video stream pulled event includes:
When the receiving client performs video conference picture amplification by using a preset picture amplification action, the receiving client cuts off the peerConnection link corresponding to the static video stream and links the peerConnection link corresponding to the dynamic video stream, wherein a video data packet corresponding to the dynamic video stream is an empty data packet;
and generating the dynamic video stream pulled event based on the receiving client-side links to the peerConnection links corresponding to the dynamic video stream.
4. The method of claim 3, wherein after the push client modifies the bandwidth corresponding to the dynamic video stream to a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth based on the dynamic video stream pulled event, the method further comprises:
and based on the pulling event of the dynamic video stream, the pushing client restores the video data packet corresponding to the dynamic video stream from an empty data packet to a normal video data packet.
5. The method of any of claims 1-4, wherein before the push client pushes the audio stream, the still video stream, and the dynamic video stream to a media forwarding server of the SFU fabric via a PeerConnection link corresponding to the audio stream, the still video stream, and the dynamic video stream, respectively, when the push client is in videoconference with a receiving client, the method further comprises:
Setting initial default bandwidths of the static video stream and the dynamic video stream as preset minimum bandwidths, wherein the preset minimum bandwidths are 32Kbps, and simultaneously setting the preset low-definition bandwidths corresponding to the dynamic video stream as 90Kbps and the high-definition bandwidths as 300Kbps.
6. The method according to claim 1, wherein the method further comprises:
when the pushing client performs video conference with a plurality of receiving clients, the media server of the SFU architecture stores a plurality of dynamic video stream pulled events corresponding to the receiving clients in a redis service;
when the number of the dynamic video stream pulled events in the redis service is increased from 0 to 1, notifying the push client to promote the uplink bandwidth;
and when the number of the dynamic video stream pulled events in the redis service is from n to 0, notifying the push client to reduce the uplink bandwidth, wherein the value of n is not less than 1.
7. The method according to claim 1, wherein the method further comprises:
when the receiving client performs a video conference restoration picture amplifying operation, the receiving client cuts off a peerConnection link corresponding to the dynamic video stream and links the peerConnection link corresponding to the static video stream to generate a static video stream pulled event, wherein a video data packet corresponding to the dynamic video stream is a normal video data packet;
Based on the pulling event of the static video stream, the pushing client modifies the video data packet corresponding to the dynamic video stream from a normal video data packet to an empty data packet.
8. A transmission apparatus for reducing the bandwidth of a videoconference network, comprising:
the pushing unit is used for pushing the audio stream, the static video stream and the dynamic video stream to a media forwarding server of an SFU architecture through PeerConnection links respectively corresponding to the audio stream, the static video stream and the dynamic video stream when the pushing client is communicated with the video conference of the receiving client, wherein initial bandwidths corresponding to the static video stream and the dynamic video stream are preset minimum bandwidths;
the pulling unit is used for pulling the audio stream and the static video stream from the media forwarding server of the SFU framework to play the video when the receiving client does not amplify the video conference picture;
the switching unit is used for switching the pulled static video stream into the dynamic video stream by the receiving client when the video conference picture is amplified by the receiving client, generating a pulled event of the dynamic video stream, and notifying the pulled event of the dynamic video stream to the pushing client by the media forwarding server;
And the modifying unit is used for modifying the bandwidth corresponding to the dynamic video stream into a preset low-definition bandwidth or a preset high-definition bandwidth due to the preset minimum bandwidth based on the event that the dynamic video stream is pulled.
9. A storage medium comprising a stored program, characterized in that the device in which the storage medium is controlled to execute the transmission method for reducing the bandwidth of a videoconference network according to any one of claims 1 to 7 when the program is run.
10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the transmission method of reducing video conferencing network bandwidth as claimed in any of claims 1 to 7 when the program is executed.
CN202310518575.1A 2023-05-09 2023-05-09 Transmission method and device for reducing video conference network bandwidth Pending CN116708879A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310518575.1A CN116708879A (en) 2023-05-09 2023-05-09 Transmission method and device for reducing video conference network bandwidth

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310518575.1A CN116708879A (en) 2023-05-09 2023-05-09 Transmission method and device for reducing video conference network bandwidth

Publications (1)

Publication Number Publication Date
CN116708879A true CN116708879A (en) 2023-09-05

Family

ID=87834824

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310518575.1A Pending CN116708879A (en) 2023-05-09 2023-05-09 Transmission method and device for reducing video conference network bandwidth

Country Status (1)

Country Link
CN (1) CN116708879A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117596234A (en) * 2023-09-28 2024-02-23 书行科技(北京)有限公司 Multi-person conversation method and device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117596234A (en) * 2023-09-28 2024-02-23 书行科技(北京)有限公司 Multi-person conversation method and device

Similar Documents

Publication Publication Date Title
US9591262B2 (en) Flow-control based switched group video chat and real-time interactive broadcast
JP3658087B2 (en) Terminal device and method for controlling terminal device
US10277865B2 (en) Data transmission method and system, and related devices
US6453336B1 (en) Video conferencing with adaptive client-controlled resource utilization
CN103733680B (en) Method and apparatus for controlling wireless uplink session
US9948889B2 (en) Priority of uplink streams in video switching
CN108462851A (en) The method and mobile terminal of data processing, server, the second mobile terminal
EP2989800B1 (en) Data communication system and method
CN110971863B (en) Multi-point control unit cross-area conference operation method, device, equipment and system
WO2020134761A1 (en) Video conference implementation method and device, video conference system, and storage medium
CN101521583B (en) Resource admission control method, system and device
CN113114688B (en) Multimedia conference management method and device, storage medium and electronic equipment
CN116708879A (en) Transmission method and device for reducing video conference network bandwidth
WO2018059209A1 (en) Multi-party video conference control method, apparatus and conference video server
JP2007194823A (en) Video and audio controller, video and audio adjustment system, video and audio adjusting method, and program
US20200329083A1 (en) Video conference transmission method and apparatus, and mcu
CN114598853A (en) Video data processing method and device and network side equipment
CN112291496A (en) Instant messaging method and system based on content
WO2013001276A1 (en) Apparatuses, methods and computing software products for operating real-time multiparty multimedia communications
JP2011172182A (en) Delivery server and delivery system
WO2016206391A1 (en) Method and system for controlling network traffic of video conference
CN113612728B (en) Streaming media playing method, transmission equipment and system
CN117356085A (en) Peer-to-peer conference system and method
WO2022060989A1 (en) Live streaming architecture with server-side stream mixing
CN115734028A (en) Media stream pushing method and system based on cascade coding

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination