CN110971862A - Video conference broadcasting method and device - Google Patents
Video conference broadcasting method and device Download PDFInfo
- Publication number
- CN110971862A CN110971862A CN201911068291.7A CN201911068291A CN110971862A CN 110971862 A CN110971862 A CN 110971862A CN 201911068291 A CN201911068291 A CN 201911068291A CN 110971862 A CN110971862 A CN 110971862A
- Authority
- CN
- China
- Prior art keywords
- media server
- data
- interactive
- broadcast
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a video conference broadcasting method and device. The method comprises the following steps: the method comprises the steps that an interactive media server is driven to decode and carry out mixed screen coding on first data uploaded by at least one interactive terminal to obtain second data; transmitting the second data to a broadcast media server through a unidirectional data channel; and driving the broadcast media server to decode and encode the second data to obtain third data, and transmitting the third data to at least one broadcast terminal. The invention can effectively reduce the pressure of data processing and reduce the resource consumption in a large-scale video conference, thereby ensuring the normal data broadcasting.
Description
Technical Field
The invention relates to the technical field of data broadcasting, in particular to a video conference broadcasting method and device.
Background
At present, a video conference generally adopts a pure video soft coding and de-mixing method to perform data broadcasting, that is, transmission data of each conference party is decoded first, and mixed screen coding is performed on the data obtained through decoding, so that the data obtained through mixed screen coding is broadcasted to each conference party. When a pure video soft coding/de-mixing method is adopted for data broadcasting in a large-scale video conference, if one thousand users participate in the conference, at least one thousand transmission data of the conference party needs to be decoded and subjected to screen mixing coding, so that the resource consumption is increased while the data processing pressure is increased, the data broadcasting can not be normally carried out, and obviously, the method is not suitable for the large-scale video conference.
Disclosure of Invention
The invention provides a video conference broadcasting method and device, which can effectively reduce the pressure of data processing and reduce the resource consumption in a large video conference, thereby ensuring the normal data broadcasting.
In order to solve the above technical problem, the present invention provides a video conference broadcasting method, including:
the method comprises the steps that an interactive media server is driven to decode and carry out mixed screen coding on first data uploaded by at least one interactive terminal to obtain second data;
transmitting the second data to a broadcast media server through a unidirectional data channel;
and driving the broadcast media server to decode and encode the second data to obtain third data, and transmitting the third data to at least one broadcast terminal.
Further, the driving interactive media server decodes and performs mixed screen coding on the first data uploaded by at least one interactive terminal to obtain second data, and further includes:
driving the interactive media server to issue fourth data to any interactive terminal; and the fourth data is obtained by decoding and mixed screen coding the first data uploaded by the rest of the interactive terminals.
Further, the interactive media server and the broadcast media server each include a plurality of shared encoders.
Further, the video conference broadcasting method further includes:
and stacking a plurality of interactive media servers on the interactive media server according to a pre-stored load distribution strategy.
Further, the video conference broadcasting method further includes:
and when the performance of the broadcast media server reaches an upper limit, establishing a unidirectional data channel from the interactive media server to another broadcast media server.
Further, the video conference broadcasting method further includes:
responding to an identity switching request initiated by the interactive terminal;
the interactive media server is driven by a signaling gateway to release interactive resources, and the broadcast media server is driven to return broadcast resources to the interactive terminal, so that the interactive terminal performs renegotiation according to the broadcast resources;
and when the renegotiation is successful, switching the interactive terminal into a new broadcast terminal, and establishing a unidirectional data channel from the broadcast media server to the interactive terminal.
Further, the video conference broadcasting method further includes:
responding to an identity switching request initiated by the broadcast terminal;
the broadcasting media server is driven to release broadcasting resources through a signaling gateway, and the interactive media server is driven to return interactive resources to the broadcasting terminal, so that the broadcasting terminal performs renegotiation according to the interactive resources;
and when the renegotiation is successful, switching the broadcast terminal into a new interactive terminal, and establishing a bidirectional data channel between the broadcast terminal and the interactive media server.
Further, the video conference broadcasting method further includes:
and responding to an identity switching request initiated by a third-party terminal, and connecting the third-party terminal to the interactive media server or the broadcast media server through Bypass.
The present invention also provides a video conference broadcasting apparatus, comprising:
the interactive media server driving module is used for driving the interactive media server to decode and mix screen coding for the first data uploaded by at least one interactive terminal to obtain second data;
the second data unidirectional transmission module is used for transmitting the second data to the broadcast media server through a unidirectional data channel;
and the broadcast media server driving module is used for driving the broadcast media server to decode and encode the second data to obtain third data, and transmitting the third data to at least one broadcast terminal.
Further, the interactive media server driving module is further configured to drive the interactive media server to issue fourth data to any of the interactive terminals; and the fourth data is obtained by decoding and mixed screen coding the first data uploaded by the rest of the interactive terminals.
The embodiment of the invention has the following beneficial effects:
the interactive media server decodes and screen-mixing codes the first data uploaded by at least one interactive terminal to obtain second data, the second data is transmitted to the broadcast media server through a unidirectional data channel, the broadcast media server decodes and codes the second data to obtain third data, and the third data is transmitted to at least one broadcast terminal. Compared with the prior art, the method and the system only allow the interactive terminal to upload the first data, broadcast the second data to the broadcast media server through the interactive media server, and further broadcast the third data to the broadcast terminal through the broadcast media server, which is equivalent to performing secondary broadcast on the first data. When a large number of users participate in the video conference, namely, the interactive media server is accessed to a large number of interactive terminals, and the broadcast media server is accessed to a large number of broadcast terminals, only the data uploaded by the interactive terminals need to be processed, so that the pressure of data processing can be effectively reduced, the resource consumption is reduced, and the normal data broadcasting is ensured.
Drawings
Fig. 1 is a flowchart illustrating a video conference broadcasting method according to a first embodiment of the present invention;
fig. 2 is another flowchart of a video conference broadcasting method according to the first embodiment of the present invention;
FIG. 3 is a schematic flow chart of a preferred embodiment of the first embodiment of the present invention;
FIG. 4 is a data flow diagram of a preferred embodiment of the first embodiment of the present invention;
FIG. 5 is a schematic flow chart of another preferred embodiment of the first embodiment of the present invention;
fig. 6 is a schematic structural diagram of a video conference broadcasting device according to a second embodiment of the present invention.
Detailed Description
The technical solutions in the present invention will be described clearly and completely with reference to the accompanying drawings, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that, the step numbers in the text are only for convenience of explanation of the specific embodiments, and do not serve to limit the execution sequence of the steps. The method provided by the embodiment can be executed by the relevant server, and the server is taken as an example for explanation below.
Please refer to fig. 1-5.
As shown in fig. 1, the first embodiment provides a video conference broadcasting method, including steps S1 to S3:
and S1, driving the interactive media server to decode and mix screen coding for the first data uploaded by at least one interactive terminal to obtain second data.
And S2, transmitting the second data to a broadcast media server through a unidirectional data channel.
And S3, driving the broadcast media server to decode and encode the second data to obtain third data, and sending the third data to at least one broadcast terminal.
In order to implement a multipoint video conference, an MCU must be set. The MCU is essentially a multimedia information switch, which performs multi-point calling and connection, implements functions of video broadcasting, video selection, audio mixing, data broadcasting, etc., and completes the tandem and switching of signals of each terminal. The MCU differs from the existing switches in that the switch performs point-to-point connection of signals, while the MCU performs multipoint-to-multipoint switching, tandem or broadcast.
The MCU may be divided into an access service, a media control server, an interactive media server, and a broadcast media server. The access service is responsible for accessing external signaling, the media control server is responsible for managing the interactive media server and the broadcast media server, the interactive media server is responsible for connecting the interactive terminal, and the broadcast media server is responsible for connecting the broadcast terminal.
And accessing at least one interactive terminal into the interactive media server through the media control server, and accessing at least one broadcast terminal into the broadcast media server. Once a broadcast terminal accesses the broadcast media server, the media control server applies for an internal channel from the interactive media server and the broadcast media server, and establishes a unidirectional data channel from the interactive media server to the broadcast media server.
Because the media control server is responsible for the allocation and scheduling of resources, the media control server preferentially accesses the interactive terminals participating in the same conference to the same interactive media server, and preferentially accesses the broadcast terminals participating in the same conference to the same broadcast media server.
It should be noted that the interactive terminal and the broadcast terminal both include a mobile phone, a computer, a tablet and other communication devices that can be connected to the server, and the first data includes data such as text data, image data, audio data, and video data.
It can be understood that, the interactive media server decodes and screen-mixing encodes the first data uploaded by the at least one interactive terminal to obtain the second data, so as to transmit the second data to the broadcast media server via the unidirectional data channel, and the broadcast media server decodes and encodes the second data to obtain the third data, so as to send the third data to the at least one broadcast terminal.
In this embodiment, the interactive terminal is only allowed to upload the first data, the second data is broadcasted to the broadcast media server through the interactive media server, and the third data is broadcasted to the broadcast terminal through the broadcast media server, which is equivalent to performing secondary broadcasting on the first data. When a large number of users participate in the video conference, namely, the interactive media server is accessed to a large number of interactive terminals, and the broadcast media server is accessed to a large number of broadcast terminals, only the data uploaded by the interactive terminals need to be processed, so that the pressure of data processing can be effectively reduced, the resource consumption is reduced, and the normal data broadcasting is ensured.
In a preferred embodiment, the step S1 further includes: driving the interactive media server to issue fourth data to any interactive terminal; and the fourth data is obtained by decoding and mixed screen coding the first data uploaded by the rest of the interactive terminals.
It can be understood that the interactive terminal may upload the first data to the interactive media server, and may also receive fourth data obtained by the interactive media server decoding and performing mixed screen encoding on the first data uploaded by other interactive terminals.
In a preferred embodiment, the interactive media server and the broadcast media server each comprise a plurality of shared encoders.
It can be understood that the second data can be shared to a plurality of broadcast media servers through the shared encoder in the interactive media server, and the third data can be shared to a plurality of broadcast terminals through the shared encoder in the broadcast media server, so that when a plurality of broadcast media servers or a plurality of broadcast terminals exist, the efficiency of data broadcasting can be effectively improved.
In a preferred implementation manner of this embodiment, the shared encoders in the broadcast media server include a 1080P, 720P, and 360P three-file shared encoder.
It can be understood that the broadcast media server will obtain a path of high-resolution second data from the interactive media server, and decode and encode the second data to obtain third data. By setting a plurality of shared encoders with different resolutions for the broadcast media server, the third data with high resolution, medium resolution or low resolution can be adaptively transmitted according to the receiving capability of the broadcast terminal, thereby ensuring that each broadcast terminal can accurately and timely receive the third data.
In a preferred embodiment, the video conference broadcasting method further includes: and stacking a plurality of interactive media servers on the interactive media server according to a pre-stored load distribution strategy.
It should be noted that the pre-stored load distribution policy includes: for the same conference, the first interactive terminal participating in the conference preferentially accesses the interactive media server with the lowest load, and the subsequent interactive terminal participating in the conference preferentially accesses the interactive media server to reduce stacking consumption; and for different conferences, correspondingly stacking a plurality of new interactive media servers on the interactive media servers according to the type number of the conferences.
It can be understood that, according to the pre-stored load distribution strategy, a plurality of same interactive media servers are stacked on the interactive media server, so that the plurality of interactive media servers cooperate with each other to broadcast the second data to the plurality of broadcast media servers, thereby improving the efficiency of data broadcasting.
By stacking a plurality of interactive media servers, each interactive media server is connected with at least one broadcast media server, the plurality of broadcast media servers can be transversely expanded, and thus, a large-scale video conference is supported.
In a preferred embodiment, the video conference broadcasting method further includes: and when the performance of the broadcast media server reaches an upper limit, establishing a unidirectional data channel from the interactive media server to another broadcast media server.
It should be noted that, for the same conference, the first broadcast terminal participating in the conference preferentially accesses the broadcast media server with the lowest load connected to the interactive media server processing the conference, and the subsequent broadcast terminal participating in the conference preferentially accesses the broadcast media server, and when the performance of the broadcast media server reaches the upper limit, that is, the load reaches the upper limit, a unidirectional data channel is established from the interactive media server to another broadcast media server with the lowest load, and so on.
It will be appreciated that when the performance of the broadcast media server reaches an upper limit, a unidirectional data channel is established from the interactive media server to the new broadcast media server. Because both unidirectional data channels transmit the second data from the same interactive media server to both broadcast media servers, i.e., both broadcast media servers are shared on the data source. When the performance of the broadcast media server reaches the upper limit, the broadcast media server is newly added and a unidirectional data channel is newly established, so that the normal operation of each broadcast media server can be ensured, and the efficiency of data broadcasting is improved.
By adding at least one broadcast media server, each broadcast media server is connected with at least one broadcast terminal, so that a plurality of broadcast terminals can be expanded transversely, and a large-scale conference is supported.
As shown in fig. 3-4, in a preferred embodiment, the method for broadcasting a video conference further includes steps S401 to S403:
s401, responding to the identity switching request initiated by the interactive terminal.
S402, the interactive media server is driven by a signaling gateway to release interactive resources, and the broadcast media server is driven to return broadcast resources to the interactive terminal, so that the interactive terminal performs renegotiation according to the broadcast resources.
S403, when the renegotiation is successful, switching the interactive terminal to a new broadcast terminal, and establishing a unidirectional data channel from the broadcast media server to the interactive terminal.
It should be noted that the identity switching request initiated by the interactive terminal switches the interactive terminal to the broadcast terminal, which is equivalent to converting the interactive right to the broadcast right.
As shown in fig. 5, in another preferred embodiment, the video conference broadcasting method further includes steps S501 to S503:
s501, responding to the identity switching request initiated by the broadcast terminal.
S502, the broadcast media server is driven to release broadcast resources through a signaling gateway, and the interactive media server is driven to return interactive resources to the broadcast terminal, so that the broadcast terminal performs renegotiation according to the interactive resources.
S503, when the renegotiation is successful, switching the broadcast terminal to a new interactive terminal, and establishing a bidirectional data channel between the broadcast terminal and the interactive media server.
It should be noted that the identity switching request initiated by the broadcast terminal switches the broadcast terminal to an interactive terminal, which is equivalent to converting the broadcast right to an interactive right.
It can be understood that the interactive terminal and the broadcast terminal can be switched with each other, so that in the video conference, each user can select to upload data or not to upload data through the conversion permission, and the user requirements are met.
In a preferred embodiment, the video conference broadcasting method further includes: and responding to an identity switching request initiated by a third-party terminal, and connecting the third-party terminal to the interactive media server or the broadcast media server through Bypass.
Because the third-party terminal does not support renegotiation, the third-party terminal adopts a temporary conference scheme when accessing, the temporary conference adopts a Bypass scheme, and the Bypass only encrypts, decrypts and repacks data without decoding and encoding. Therefore, the Bypass scheme is adopted, so that the energy consumption is not excessively increased.
One side of the Bypass is connected with a third party terminal, the other side of the Bypass can support switching to other media servers such as an IVR voice service, an interactive media server and a broadcast media server at any time, and the switching process needs to be carried out by renegotiation in the MCU. Therefore, the broadcast terminal and the interactive terminal can be switched at any time. And when the third-party terminal is used as a broadcast terminal, the broadcast media server is docked and only sends data to Bypass. Third party terminal access does not consume additional performance, similar to an account conference.
Please refer to fig. 6.
As shown in fig. 6, a second embodiment provides a video conference broadcasting device, which includes an interactive media server driving module 21, configured to drive an interactive media server to decode and mix screen encoding on first data uploaded by at least one interactive terminal, so as to obtain second data; a second data unidirectional transmission module 22, configured to transmit the second data to a broadcast media server through a unidirectional data channel; and a broadcast media server driving module 23, configured to drive the broadcast media server to decode and encode the second data to obtain third data, and send the third data to at least one broadcast terminal.
In order to implement a multipoint video conference, an MCU must be set. The MCU is essentially a multimedia information switch, which performs multi-point calling and connection, implements functions of video broadcasting, video selection, audio mixing, data broadcasting, etc., and completes the tandem and switching of signals of each terminal. The MCU differs from the existing switches in that the switch performs point-to-point connection of signals, while the MCU performs multipoint-to-multipoint switching, tandem or broadcast.
The MCU may be divided into an access service, a media control server, an interactive media server, and a broadcast media server. The access service is responsible for accessing external signaling, the media control server is responsible for managing the interactive media server and the broadcast media server, the interactive media server is responsible for accessing the interactive terminal, and the broadcast media server is responsible for accessing the broadcast terminal.
And accessing at least one interactive terminal into the interactive media server through the media control server, and accessing at least one broadcast terminal into the broadcast media server. Once a broadcast terminal accesses the broadcast media server, the media control server applies for an internal channel from the interactive media server and the broadcast media server, and establishes a unidirectional data channel from the interactive media server to the broadcast media server.
Because the media control server is responsible for the allocation and scheduling of resources, the media control server preferentially accesses the interactive terminals participating in the same conference to the same interactive media server, and preferentially accesses the broadcast terminals participating in the same conference to the same broadcast media server.
It should be noted that the interactive terminal and the broadcast terminal both include a mobile phone, a computer, a tablet and other communication devices that can be connected to the server, and the first data includes data such as text data, image data, audio data, and video data.
It can be understood that the interactive media server driving module 21 drives the interactive media server to decode and mix the screen to encode the first data uploaded by the at least one interactive terminal, so as to obtain the second data, the second data is transmitted to the broadcast media server through the unidirectional data channel by the second data unidirectional transmission module 22, and then the broadcast media server driving module 23 drives the broadcast media server to decode and encode the second data, so as to obtain the third data, so as to send the third data to the at least one broadcast terminal.
In this embodiment, only the interactive terminal is allowed to upload the first data, the interactive media server is driven by the interactive media server driving module 21 to broadcast the second data to the broadcast media server, and the broadcast media server is driven by the broadcast media server driving module 23 to broadcast the third data to the broadcast terminal, which is equivalent to performing secondary broadcast on the first data. When a large number of users participate in the video conference, namely, the interactive media server is accessed to a large number of interactive terminals, and the broadcast media server is accessed to a large number of broadcast terminals, only the data uploaded by the interactive terminals need to be processed, so that the pressure of data processing can be effectively reduced, the resource consumption is reduced, and the normal data broadcasting is ensured.
In this implementation, the interactive media server driving module 21 is further configured to drive the interactive media server to issue fourth data to any of the interactive terminals; and the fourth data is obtained by decoding and mixed screen coding the first data uploaded by the rest of the interactive terminals.
It can be understood that the interactive terminal may upload the first data to the interactive media server, and may also receive fourth data obtained by the interactive media server decoding and performing mixed screen encoding on the first data uploaded by other interactive terminals.
In a preferred embodiment, the interactive media server and the broadcast media server each comprise a plurality of shared encoders.
It can be understood that the second data can be shared to a plurality of broadcast media servers through the shared encoder in the interactive media server, and the third data can be shared to a plurality of broadcast terminals through the shared encoder in the broadcast media server, so that when a plurality of broadcast media servers or a plurality of broadcast terminals exist, the efficiency of data broadcasting can be effectively improved.
In a preferred implementation manner of this embodiment, the shared encoders in the broadcast media server include a 1080P, 720P, and 360P three-file shared encoder.
It can be understood that the broadcast media server will obtain a path of high-resolution second data from the interactive media server, and decode and encode the second data to obtain third data. By setting a plurality of shared encoders with different resolutions for the broadcast media server, the third data with high resolution, medium resolution or low resolution can be adaptively transmitted according to the receiving capability of the broadcast terminal, thereby ensuring that each broadcast terminal can accurately and timely receive the third data.
In a preferred embodiment, the video conference broadcasting device further includes an interactive media server stacking module, and the interactive media server stacking module is configured to stack a plurality of interactive media servers on the interactive media server according to a pre-stored load distribution policy.
It should be noted that the pre-stored load distribution policy includes: for the same conference, the first interactive terminal participating in the conference preferentially accesses the interactive media server with the lowest load, and the subsequent interactive terminal participating in the conference preferentially accesses the interactive media server to reduce stacking consumption; and for different conferences, correspondingly stacking a plurality of new interactive media servers on the interactive media servers through the interactive media server stacking module according to the types of the conferences.
It can be understood that, through the interactive media server stacking module, according to the pre-stored load distribution strategy, a plurality of same interactive media servers are stacked on the interactive media server, so that a plurality of interactive media servers cooperate together to broadcast the second data to a plurality of broadcast media servers, thereby improving the efficiency of data broadcasting.
By stacking a plurality of interactive media servers, each interactive media server is connected with at least one broadcast media server, the plurality of broadcast media servers can be transversely expanded, and thus, a large-scale video conference is supported.
In a preferred embodiment, the video conference broadcasting apparatus further includes a unidirectional data channel newly-building module, where the unidirectional data channel newly-building module is configured to build a unidirectional data channel from the interactive media server to another broadcast media server when the performance of the broadcast media server reaches an upper limit.
It should be noted that, for the same conference, the first broadcast terminal participating in the conference preferentially accesses the broadcast media server with the lowest load connected to the interactive media server processing the conference, and the subsequent broadcast terminal participating in the conference preferentially accesses the broadcast media server, when the performance of the broadcast media server reaches the upper limit, that is, the load reaches the upper limit, a unidirectional data channel is established from the interactive media server to another broadcast media server with the lowest load through the unidirectional data channel new creation module, and so on.
It can be understood that, through the unidirectional data channel new building module, when the performance of the broadcast media server reaches the upper limit, the unidirectional data channel from the interactive media server to the new broadcast media server is built. Because both unidirectional data channels transmit the second data from the same interactive media server to both broadcast media servers, i.e., both broadcast media servers are shared on the data source. When the performance of the broadcast media server reaches the upper limit, the broadcast media server is newly added and a unidirectional data channel is newly established, so that the normal operation of each broadcast media server can be ensured, and the efficiency of data broadcasting is improved.
By adding at least one broadcast media server, each broadcast media server is connected with at least one broadcast terminal, so that a plurality of broadcast terminals can be expanded transversely, and a large-scale conference is supported.
In a preferred embodiment, the video conference broadcasting device further includes an identity switching module, where the identity switching module is configured to respond to an identity switching request initiated by the interactive terminal; the interactive media server is driven by a signaling gateway to release interactive resources, and the broadcast media server is driven to return broadcast resources to the interactive terminal, so that the interactive terminal performs renegotiation according to the broadcast resources; and when the renegotiation is successful, switching the interactive terminal into a new broadcast terminal, and establishing a unidirectional data channel from the broadcast media server to the interactive terminal.
It should be noted that the identity switching request initiated by the interactive terminal switches the interactive terminal to the broadcast terminal, which is equivalent to converting the interactive right to the broadcast right.
In a preferred embodiment, the identity switching unit is further configured to respond to an identity switching request initiated by the broadcast terminal; the broadcasting media server is driven to release broadcasting resources through a signaling gateway, and the interactive media server is driven to return interactive resources to the broadcasting terminal, so that the broadcasting terminal performs renegotiation according to the interactive resources; and when the renegotiation is successful, switching the broadcast terminal into a new interactive terminal, and establishing a bidirectional data channel between the broadcast terminal and the interactive media server.
It should be noted that the identity switching request initiated by the broadcast terminal switches the broadcast terminal to an interactive terminal, which is equivalent to converting the broadcast right to an interactive right.
It can be understood that, through the identity switching module, the interactive terminal and the broadcast terminal can be switched with each other, so that in the video conference, each user can select to upload data or not to upload data through the conversion permission, and the user requirements are met.
In a preferred embodiment, the identity switching module is further configured to respond to an identity switching request initiated by a third party terminal, and connect the third party terminal to the interactive media server or the broadcast media server through Bypass.
Because the third-party terminal does not support renegotiation, the third-party terminal adopts a temporary conference scheme when accessing, the temporary conference adopts a Bypass scheme, and the Bypass only encrypts, decrypts and repacks data without decoding and encoding. Therefore, the Bypass scheme is adopted, so that the energy consumption is not excessively increased.
One side of the Bypass is connected with a third party terminal, the other side of the Bypass can support switching to other media servers such as an IVR voice service, an interactive media server and a broadcast media server at any time, and the switching process needs to be carried out by renegotiation in the MCU. Therefore, the broadcast terminal and the interactive terminal can be switched at any time. And when the third-party terminal is used as a broadcast terminal, the broadcast media server is docked and only sends data to Bypass. Third party terminal access does not consume additional performance, similar to an account conference.
In summary, the embodiments of the present invention have the following beneficial effects:
the interactive media server decodes and screen-mixing codes the first data uploaded by at least one interactive terminal to obtain second data, the second data is transmitted to the broadcast media server through a unidirectional data channel, the broadcast media server decodes and codes the second data to obtain third data, and the third data is transmitted to at least one broadcast terminal. Compared with the prior art, the method and the system only allow the interactive terminal to upload the first data, broadcast the second data to the broadcast media server through the interactive media server, and further broadcast the third data to the broadcast terminal through the broadcast media server, which is equivalent to performing secondary broadcast on the first data. When a large number of users participate in the video conference, namely, the interactive media server is accessed to a large number of interactive terminals, and the broadcast media server is accessed to a large number of broadcast terminals, only the data uploaded by the interactive terminals need to be processed, so that the pressure of data processing can be effectively reduced, the resource consumption is reduced, and the normal data broadcasting is ensured.
It will be understood by those skilled in the art that all or part of the processes of the above embodiments may be implemented by hardware related to instructions of a computer program, and the computer program may be stored in a computer readable storage medium, and when executed, may include the processes of the above embodiments. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (10)
1. A video conference broadcasting method, comprising:
the method comprises the steps that an interactive media server is driven to decode and carry out mixed screen coding on first data uploaded by at least one interactive terminal to obtain second data;
transmitting the second data to a broadcast media server through a unidirectional data channel;
and driving the broadcast media server to decode and encode the second data to obtain third data, and transmitting the third data to at least one broadcast terminal.
2. The video conference broadcasting method of claim 1, wherein the driving interactive media server decodes and screen-mixes the first data uploaded by the at least one interactive terminal to obtain the second data, and further comprising:
driving the interactive media server to issue fourth data to any interactive terminal; and the fourth data is obtained by decoding and mixed screen coding the first data uploaded by the rest of the interactive terminals.
3. The video conference broadcasting method of claim 1, wherein the interactive media server and the broadcast media server each comprise a plurality of shared encoders.
4. The video conference broadcasting method of claim 1, further comprising:
and stacking a plurality of interactive media servers on the interactive media server according to a pre-stored load distribution strategy.
5. The video conference broadcasting method of claim 1, further comprising:
and when the performance of the broadcast media server reaches an upper limit, establishing a unidirectional data channel from the interactive media server to another broadcast media server.
6. The video conference broadcasting method of claim 1, further comprising:
responding to an identity switching request initiated by the interactive terminal;
the interactive media server is driven by a signaling gateway to release interactive resources, and the broadcast media server is driven to return broadcast resources to the interactive terminal, so that the interactive terminal performs renegotiation according to the broadcast resources;
and when the renegotiation is successful, switching the interactive terminal into a new broadcast terminal, and establishing a unidirectional data channel from the broadcast media server to the interactive terminal.
7. The video conference broadcasting method of claim 1, further comprising:
responding to an identity switching request initiated by the broadcast terminal;
the broadcasting media server is driven to release broadcasting resources through a signaling gateway, and the interactive media server is driven to return interactive resources to the broadcasting terminal, so that the broadcasting terminal performs renegotiation according to the interactive resources;
and when the renegotiation is successful, switching the broadcast terminal into a new interactive terminal, and establishing a bidirectional data channel between the broadcast terminal and the interactive media server.
8. The video conference broadcasting method of claim 1, further comprising:
and responding to an identity switching request initiated by a third-party terminal, and connecting the third-party terminal to the interactive media server or the broadcast media server through Bypass.
9. A video conference broadcasting apparatus, comprising:
the interactive media server driving module is used for driving the interactive media server to decode and mix screen coding for the first data uploaded by at least one interactive terminal to obtain second data;
the second data unidirectional transmission module is used for transmitting the second data to the broadcast media server through a unidirectional data channel;
and the broadcast media server driving module is used for driving the broadcast media server to decode and encode the second data to obtain third data, and transmitting the third data to at least one broadcast terminal.
10. The video conference broadcasting device of claim 9, wherein the interactive media server driving module is further configured to drive the interactive media server to send down fourth data to any of the interactive terminals; and the fourth data is obtained by decoding and mixed screen coding the first data uploaded by the rest of the interactive terminals.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911068291.7A CN110971862B (en) | 2019-11-04 | 2019-11-04 | Video conference broadcasting method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911068291.7A CN110971862B (en) | 2019-11-04 | 2019-11-04 | Video conference broadcasting method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110971862A true CN110971862A (en) | 2020-04-07 |
| CN110971862B CN110971862B (en) | 2021-04-23 |
Family
ID=70030107
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911068291.7A Active CN110971862B (en) | 2019-11-04 | 2019-11-04 | Video conference broadcasting method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110971862B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112817913A (en) * | 2021-04-19 | 2021-05-18 | 浙江华创视讯科技有限公司 | Data transmission method and device, electronic equipment and storage medium |
| CN113259618A (en) * | 2021-05-12 | 2021-08-13 | 中移智行网络科技有限公司 | Audio and video session method and device, first terminal and session server |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101895718A (en) * | 2010-07-21 | 2010-11-24 | 杭州华三通信技术有限公司 | Video conference system multi-image broadcast method, and device and system thereof |
| CN105141884A (en) * | 2015-08-26 | 2015-12-09 | 苏州科达科技股份有限公司 | Control method, device and system for broadcasting audio and video code streams in hybrid conference |
| CN105763832A (en) * | 2014-12-16 | 2016-07-13 | 中国移动通信集团公司 | Video interaction and control method and device |
| US20170153865A1 (en) * | 2015-12-01 | 2017-06-01 | Shuhei TSUBONE | Communication terminal, communication system, communication control method, and recording medium |
| CN109561273A (en) * | 2018-10-23 | 2019-04-02 | 视联动力信息技术股份有限公司 | The method and apparatus for identifying video conference spokesman |
| US20190141291A1 (en) * | 2014-09-25 | 2019-05-09 | Steve H. McNelley | Configured transparent communication terminals |
| CN109873972A (en) * | 2019-02-13 | 2019-06-11 | 苏州科达科技股份有限公司 | Prevent the register method, method of calling, medium, equipment of negotiating DoS attack again |
| CN109889767A (en) * | 2019-04-22 | 2019-06-14 | 台州智必安科技有限责任公司 | A kind of remote audio-video conference system and processing method based on multi-chain circuit transmission |
| CN110392225A (en) * | 2018-04-23 | 2019-10-29 | 北京视联动力国际信息技术有限公司 | A kind of control method and view networked video conference system |
-
2019
- 2019-11-04 CN CN201911068291.7A patent/CN110971862B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101895718A (en) * | 2010-07-21 | 2010-11-24 | 杭州华三通信技术有限公司 | Video conference system multi-image broadcast method, and device and system thereof |
| US20190141291A1 (en) * | 2014-09-25 | 2019-05-09 | Steve H. McNelley | Configured transparent communication terminals |
| CN105763832A (en) * | 2014-12-16 | 2016-07-13 | 中国移动通信集团公司 | Video interaction and control method and device |
| CN105141884A (en) * | 2015-08-26 | 2015-12-09 | 苏州科达科技股份有限公司 | Control method, device and system for broadcasting audio and video code streams in hybrid conference |
| US20170153865A1 (en) * | 2015-12-01 | 2017-06-01 | Shuhei TSUBONE | Communication terminal, communication system, communication control method, and recording medium |
| CN110392225A (en) * | 2018-04-23 | 2019-10-29 | 北京视联动力国际信息技术有限公司 | A kind of control method and view networked video conference system |
| CN109561273A (en) * | 2018-10-23 | 2019-04-02 | 视联动力信息技术股份有限公司 | The method and apparatus for identifying video conference spokesman |
| CN109873972A (en) * | 2019-02-13 | 2019-06-11 | 苏州科达科技股份有限公司 | Prevent the register method, method of calling, medium, equipment of negotiating DoS attack again |
| CN109889767A (en) * | 2019-04-22 | 2019-06-14 | 台州智必安科技有限责任公司 | A kind of remote audio-video conference system and processing method based on multi-chain circuit transmission |
Non-Patent Citations (1)
| Title |
|---|
| 张红波: "嵌入式系统视频会议控制技术的研究与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112817913A (en) * | 2021-04-19 | 2021-05-18 | 浙江华创视讯科技有限公司 | Data transmission method and device, electronic equipment and storage medium |
| CN112817913B (en) * | 2021-04-19 | 2021-07-09 | 浙江华创视讯科技有限公司 | Data transmission method and device, electronic equipment and storage medium |
| CN113259618A (en) * | 2021-05-12 | 2021-08-13 | 中移智行网络科技有限公司 | Audio and video session method and device, first terminal and session server |
| CN113259618B (en) * | 2021-05-12 | 2022-06-10 | 中移智行网络科技有限公司 | Audio and video session method and device, first terminal and session server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110971862B (en) | 2021-04-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100583985C (en) | Method, apparatus and system for switching pictures in video service | |
| CN100454820C (en) | MCU cascade system and establishing and communication method for the same | |
| CN110971862B (en) | Video conference broadcasting method and device | |
| CN110943909A (en) | Audio and video fusion communication server | |
| KR20100086072A (en) | Audio processing method, system and control server | |
| AU2017298381A1 (en) | Methods and apparatus for use of compact concurrent codecs in multimedia communications | |
| CN104093028B (en) | A kind of method and apparatus that capacity of equipment is negotiated | |
| CN101645952A (en) | Conference telephone terminal, system and method for sharing data | |
| CN112019792A (en) | Conference control method, conference control device, terminal equipment and storage medium | |
| CN101646056A (en) | Method, device and system for realizing cooperative work between video conference and data conference | |
| US8872886B2 (en) | Method, apparatus, and system for establishing multi-cascade channel | |
| KR20130004263A (en) | Seamlessly transferring a communication | |
| CN101404748A (en) | Video data transmission system and method used for large-scale high-definition network video conference | |
| CN103595950A (en) | Method for carrying out video communication based on cable digital television set top box | |
| CN103843323A (en) | Method for implementing multimedia conference, related device and system | |
| CN107040458B (en) | Method and system for realizing intercommunication of video conference | |
| CN101350908A (en) | Video data transmission system and method for network video conference | |
| WO2016026336A1 (en) | Remote interaction method and system in audio/video conference and mcu | |
| US20200329083A1 (en) | Video conference transmission method and apparatus, and mcu | |
| CN113612857A (en) | Transmission device, receiving device, information transmission system and information transmission method | |
| CN100366080C (en) | Method of implementing switching of single picture and multi-pictures in conference television system | |
| CN112422880A (en) | Video conference method, terminal device and readable storage medium | |
| CN101252670A (en) | Apparatus and method for processing conference television | |
| CN112788429B (en) | Screen sharing system based on network | |
| US11431855B1 (en) | Encoder pools for conferenced communications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230506 Address after: Room 208-7, Hengye Building, No. 100 Xiangxing Road, Xiang'an Industrial Zone, Torch High tech Zone, Xiamen City, Fujian Province, 361100 Patentee after: Xiamen Yilian Communication Technology Co.,Ltd. Address before: 361009 Yilian R & D building, No.1 Lingxia North Road, hi tech park, Huli District, Xiamen City, Fujian Province Patentee before: YEALINK (XIAMEN) NETWORK TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |