CN118101885A

CN118101885A - Communication method and device for conference and conference system

Info

Publication number: CN118101885A
Application number: CN202410303473.2A
Authority: CN
Inventors: 何佳毅
Original assignee: Haoxin Cloud Beijing Network Communication Co ltd
Current assignee: Haoxin Cloud Beijing Network Communication Co ltd
Priority date: 2024-03-18
Filing date: 2024-03-18
Publication date: 2024-05-28

Abstract

The embodiment of the application provides a communication method, a device and a conference system for a conference, wherein the communication method comprises the steps of receiving a media stream sent by each conference terminal in a plurality of conference terminals, wherein the conference terminals comprise at least one telephone conference terminal; the method comprises the steps that media streams of all received conference terminals are sent to a media mixed stream server, so that the media mixed stream server mixes the media streams of all received conference terminals to obtain a unified media stream; receiving the unified media stream sent by the media mixed stream server; and sending the unified media stream to the at least one telephone conference terminal. In the embodiment of the application, the media mixed stream server and the media distribution server are decoupled, the media mixed stream server only carries out mixed stream, and the media distribution server only carries out media distribution, so that the communication efficiency and the quality of an audio-video conference can be improved.

Description

Communication method and device for conference and conference system

Technical Field

The present application relates to the field of communications, and in particular, to a communication method and apparatus for a conference, and a conference system.

Background

With the development and progress of society, people communicate and exchange more closely and frequently, and the demands for cross-region conferences are more and more, compared with the traditional communication mode, the video conference can improve the communication efficiency, can avoid the problem of cross-region, and can realize the demands of multi-party video communication coordination on line. Therefore, video conferences are receiving increasing attention.

Meanwhile, with the development of communication and internet technology, the devices for people to remotely communicate are expanded from traditional landline telephones and mobile phones to internet devices such as computers and smart phones. Currently, people hold a video conference, and the video conference is not limited to proprietary conference hardware and systems, and more traditional telephones and internet devices can be added into the video conference.

However, the conventional telephone and the mobile phone often have the problems of low efficiency, low quality and the like when accessing to the internet video conference, so how to provide a conference method capable of improving the response speed and the video quality becomes a problem to be solved urgently.

Disclosure of Invention

An embodiment of the application aims to provide a communication method, a communication device and a conference system for a conference, and the communication efficiency and the audio/video conference quality can be improved through the technical scheme of the embodiment of the application.

In a first aspect, an embodiment of the present application provides a communication method for a conference, which is applied to a media distribution server in a conference system, where the conference system includes a plurality of conference terminals, the media distribution server and a media mixed stream server, and the communication method includes: receiving a media stream sent by each conference terminal in the plurality of conference terminals, wherein the plurality of conference terminals comprise at least one teleconference terminal; the method comprises the steps that media streams of all received conference terminals are sent to a media mixed stream server, so that the media mixed stream server mixes the media streams of all received conference terminals to obtain a unified media stream; receiving the unified media stream sent by the media mixed stream server; and sending the unified media stream to the at least one telephone conference terminal.

According to the embodiment of the application, the media mixed stream server and the media distribution server are decoupled, the media mixed stream server only carries out mixed stream, and the media distribution server only carries out media distribution, so that the communication efficiency and the quality of an audio-video conference can be improved.

In one embodiment, the plurality of conference terminals further includes at least one network conference terminal, the method further comprising: and sending the media streams of other terminals to each of the at least one network conference terminal, wherein the media streams of other terminals corresponding to one network conference terminal comprise the media streams of all terminals except the one network conference terminal in all conference terminals.

In one embodiment, the conference system further comprises a conference control center server, the method further comprising: receiving a media distribution instruction sent by the conference control center server, wherein the media distribution instruction comprises a media stream number of each terminal in the plurality of conference terminals; the step of sending the received media streams of all the conference terminals to the media mixed stream server comprises the following steps: and sending the media streams corresponding to the media stream numbers of all the terminals to the media mixed stream server.

In a second aspect, an embodiment of the present application provides a communication method for a conference, applied to a media mixed stream server in a conference system, the conference system including a plurality of conference terminals, a media distribution server, and the media mixed stream server, wherein the plurality of conference terminals include at least one teleconference terminal, the communication method comprising: receiving a media stream of each conference terminal in the plurality of conference terminals sent by a media distribution server; mixing the received media streams of all the conference terminals to obtain a unified media stream; the unified media stream is sent to the media distribution server so that the media distribution server sends the unified media stream to the at least one teleconferencing terminal.

In one embodiment, the conference system further comprises a conference control center server, the method further comprising: receiving a media mixed stream instruction sent by the conference control center server, wherein the media mixed stream instruction comprises parameter information of the unified media stream; the step of mixing the received media streams of all the conference terminals to obtain a unified media stream comprises the following steps: and mixing the received media streams of all the conference terminals according to the parameter information of the unified media stream to obtain the unified media stream.

In a third aspect, an embodiment of the present application provides a communication method for a conference, applied to a conference control center server in a conference system including a plurality of conference terminals including at least one teleconference terminal, a media distribution server, a media mixed flow server, and the conference control center server, the communication method comprising: transmitting a media distribution instruction to the media distribution server, wherein the media distribution instruction comprises a media stream number of each terminal in the plurality of conference terminals, so that the media distribution server transmits media streams corresponding to the media stream numbers of all terminals to the media mixed stream server, receives and transmits a unified media stream to the at least one conference call terminal; and sending a media mixed stream instruction to the media mixed stream server, wherein the media mixed stream instruction comprises parameter information of the unified media stream, so that the media mixed stream server mixes the received media streams of all conference terminals according to the parameter information of the unified media stream to obtain the unified media stream and sends the unified media stream to the media distribution server. In a fourth aspect, an embodiment of the present application provides a communication device for a conference, which is applied to a media distribution server in a conference system, where the conference system includes a plurality of conference terminals, the media distribution server, and a media mixed stream server, and the communication device includes: a receiving unit, configured to receive a media stream sent by each of a plurality of conference terminals, where the plurality of conference terminals includes at least one teleconference terminal; the sending unit is used for sending the acquired media streams of all the conference terminals to the media mixed stream server so that the media mixed stream server can mix the received media streams of all the conference terminals to obtain a unified media stream; the receiving unit is further configured to receive the unified media stream sent by the media mixed stream server; the sending unit is further configured to send the unified media stream to the at least one teleconference terminal.

In one embodiment, the plurality of conference terminals further includes at least one network conference terminal, and the sending unit is further configured to send the media streams of other terminals to each of the at least one network conference terminal, where the media streams of other terminals corresponding to one network conference terminal include media streams of all terminals except the one network conference terminal.

In one embodiment, the conference system further includes a conference control center server, and the receiving unit is further configured to receive a media distribution instruction sent by the conference control center server, where the media distribution instruction includes a media stream number of each of the plurality of conference terminals; the sending unit is specifically configured to send media streams corresponding to media stream numbers of all terminals to the media mixed stream server.

In a fifth aspect, an embodiment of the present application provides a communication device for a conference, which is applied to a media mixed stream server in a conference system, where the conference system includes a plurality of conference terminals, a media distribution server, and the media mixed stream server, where the plurality of conference terminals includes at least one teleconference terminal, and the communication device includes: a receiving unit configured to receive a media stream of each of the plurality of conference terminals transmitted by a media distribution server; the processing unit is used for mixing the received media streams of all the conference terminals to obtain a unified media stream; and the sending unit is used for sending the unified media stream to the media distribution server so that the media distribution server can send the unified media stream to the at least one teleconference terminal.

In one embodiment, the conference system further includes a conference control center server, and the receiving unit is further configured to receive a media mixed stream instruction sent by the conference control center server, where the media mixed stream instruction includes parameter information of the unified media stream; the processing unit is specifically configured to mix media streams of all received conference terminals according to the parameter information of the unified media stream to obtain the unified media stream.

In a sixth aspect, an embodiment of the present application provides a communication device for a conference, applied to a conference control center server in a conference system including a plurality of conference terminals including at least one teleconference terminal, a media distribution server, a media mixed flow server, and the conference control center server, the communication device comprising: the generating unit is used for generating a media distribution instruction and a media mixed stream instruction; a sending unit, configured to send the media distribution instruction to the media distribution server, where the media distribution instruction includes a media stream number of each of the plurality of conference terminals, so that the media distribution server sends media streams corresponding to the media stream numbers of all terminals to the media mixed stream server, and receives and sends a unified media stream to the at least one teleconference terminal; the sending unit is further configured to send the media mixed stream instruction to the media mixed stream server, where the media mixed stream instruction includes parameter information of the unified media stream, so that the media mixed stream server mixes media streams of all received conference terminals according to the parameter information of the unified media stream to obtain the unified media stream and sends the unified media stream to the media distribution server.

In one embodiment, the conference system further includes a signaling proxy server, the plurality of conference terminals includes at least one conference call terminal, and the sending unit is further configured to send an invite-to-conference conversion signaling to the signaling proxy server, so that the signaling proxy server invites the at least one conference call terminal to join a conference according to the invite-to-conference patent signaling; or the device further comprises a receiving unit, configured to receive an active conference joining conversion signaling sent by the signaling proxy server, where the active conference joining conversion signaling is used to instruct the at least one teleconference terminal to actively join the conference.

In a seventh aspect, an embodiment of the present application provides a conference system, where the conference system includes a plurality of conference terminals, a media distribution server, a media mixed stream server, and a conference control center server, where the plurality of conference terminals includes at least one teleconferencing terminal; the conference terminals are used for sending media streams to the media distribution server; the conference control center is used for sending a media distribution instruction to the media distribution server, wherein the media distribution instruction comprises a media stream number of each terminal in the plurality of conference terminals; the media distribution server is used for sending media streams corresponding to the media stream numbers of all terminals to the media mixed stream server, receiving and sending unified media streams to the at least one teleconference terminal; the conference control center is further configured to send a media mixed stream instruction to the media mixed stream server, where the media mixed stream instruction includes parameter information of the unified media stream; and the media mixed stream server is used for mixing the received media streams of all the conference terminals according to the parameter information of the unified media stream to obtain the unified media stream and sending the unified media stream to the media distribution server.

In an eighth aspect, an embodiment of the present application provides a computer readable storage medium, on which a computer program is stored, the program when executed by a processor implementing a method according to any one of the first aspect and the implementation manners of the second aspect and any one of the implementation manners of the second aspect and the second aspect, or a method according to any one of the implementation manners of the third aspect and the second aspect.

In a ninth aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor, when executing the program, may implement the method according to any one of the first aspect and the implementation manners of the first aspect or any one of the second aspect and the implementation manners of the third aspect and the second aspect.

In a tenth aspect, an embodiment of the present application provides a computer program product, the computer program product comprising a computer program, wherein the computer program, when executed by a processor, is capable of implementing the method according to any one of the first aspect and the implementation manner of any one of the second aspect and the second aspect or the method according to any one of the third aspect and the implementation manner of the second aspect.

Drawings

In order to more clearly illustrate the technical solution of one embodiment of the present application, the following description will briefly explain the drawings required to be used in one embodiment of the present application, it being understood that the following drawings illustrate only some embodiments of the present application and are therefore not to be considered limiting of the scope, since other related drawings may be obtained by those skilled in the art without inventive effort.

FIG. 1 is a schematic illustration of a conference system;

FIG. 2 is a schematic diagram of another conference system;

FIG. 3 is a schematic diagram of another conference system;

FIG. 4 is a schematic diagram of another conference system;

FIG. 5 is a schematic diagram of a conference system according to one embodiment of the present application;

FIG. 6 is a flow chart of a communication method for a conference in accordance with one embodiment of the present application;

Fig. 7 is a flow chart of a conference call terminal active conference joining according to one embodiment of the present application;

FIG. 8 is a flow chart of inviting teleconferencing terminals to join according to one embodiment of the present application;

fig. 9 is a schematic diagram of a communication device for a conference according to an embodiment of the present application;

fig. 10 is a schematic view of a communication device for a conference according to another embodiment of the present application;

fig. 11 is a schematic view of a communication device for a conference according to another embodiment of the present application;

fig. 12 is a schematic diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application.

With the development of communication and internet technology, devices for people to remotely communicate are expanded from traditional landline telephones and mobile phones to internet devices such as computers and smart phones. Enterprises hold video conferences, are not limited to proprietary conference hardware and systems, and more traditional telephones and internet devices can be added into the video conferences. The inventors have found that there are often a variety of problems with conventional telephones and mobile telephones accessing internet video conferences. Four conference systems and problems thereof will be described below with reference to fig. 1 to 4.

As shown in fig. 1, fig. 1 is a schematic view of a conference system. The conference system shown in fig. 1 includes a teleconference terminal, a network conference terminal, a media proxy server, a media distribution server, a media mixed stream server, a conference control center server, and a signaling proxy server. The conference system shown in fig. 1 is a large conference system including a web conference terminal and a telephone conference terminal. As shown in fig. 2, fig. 2 is a schematic diagram of another conference system. The conference system shown in fig. 2 includes a teleconference terminal, a media proxy server, a media distribution server, a media mixed stream server, a conference control center server, and a signaling proxy server. The conference system shown in fig. 2 is a large conference system including a teleconference terminal, and as shown in fig. 1 and 2, an upstream media stream of the teleconference terminal is forwarded to a distribution server through a media proxy server; the downstream media stream is the media stream after the mixed stream of the pulled media mixed stream server. The existence of the primary media proxy server (namely the media proxy server) can cause the delay increase of the telephone conference terminal and slow response; meanwhile, the horizontal dynamic capacity expansion difficulty of the media proxy server and the media mixed stream server is not better than that of the media distribution server, and the conversation quality effect is poor.

As shown in fig. 3, fig. 3 is a schematic diagram of another conference system. The conference system shown in fig. 3 includes a teleconference terminal, a media server, a conference control center server, and a signaling proxy server. The conference system shown in fig. 3 is a large conference system including teleconferencing terminals. The system shown in fig. 3 may also include a network conference terminal. The conference system shown in fig. 3 is designed with media proxy, mixed stream, and distribution servers as unified media servers. The control center can be caused to be too complex in operation of the control center on the media server, meanwhile, the media server is too complex, when sudden meeting participants are in peak, automatic horizontal dynamic capacity expansion is difficult, and subsequent participants cannot join in a meeting.

Fig. 4 is a schematic diagram of another conference system. The conference system shown in fig. 4 includes a teleconference terminal, a media mixed stream server, a conference control center server, and a signaling proxy server. The conference system shown in fig. 4 is a large conference system including teleconferencing terminals. The system shown in fig. 4 may also include a network conference terminal. Too simple a conference system as shown in fig. 4 may result in poor network conference terminal experience. The system has no real media distribution server, and the uplink/downlink media streams of telephone and network conference terminals are processed in the same way, namely, the uplink media streams of all terminals participating in the same conference are directly pushed to a media mixed stream server, and then the mixed stream media streams are pulled. Because the network conference terminal can only accept the unified media stream after mixed stream, the independent media stream of each participant cannot be selected and controlled, and the conference experience is poor.

In summary, the conventional telephone and the mobile phone access to the internet video conference often have various problems of low efficiency, low quality, or too complex system, too high cost, difficult horizontal dynamic expansion and the like caused by slow response. It should be appreciated that the above is merely exemplary of four current conference systems provided, but that in practice there are other various variations of conference systems, however, the current conference systems suffer from the various problems described above, whether of the four types above or other conference systems. The inventor finds that one of the core reasons for these problems is caused by unreasonable media mixed stream and media distribution after analysis. The traditional telephone conference terminal has low bandwidth and low operation interaction requirement, which are very different from the internet conference terminal. According to the two points, the application correspondingly optimizes the interaction of the media mixed stream server, the media distribution server, the conference control center and the conference terminal in the video conference.

Specifically, the embodiment of the application decouples the media mixed stream server and the media distribution server, the media mixed stream server only carries out mixed stream, and the media distribution server only carries out media distribution, thereby improving the communication efficiency and the quality of the audio-video conference.

Hereinafter, for convenience of understanding and explanation, by way of example and not limitation, the execution process and actions of the communication method for conference of the present application in the conference system will be explained. Wherein figure 5 depicts a schematic of a conference system according to one embodiment of the application. Fig. 6-8 illustrate a specific communication method described in connection with the conference system shown in fig. 5. Fig. 9 to 12 illustrate devices in a conference system. Embodiments of the present application will be described in detail below with reference to the drawings.

Before describing, in order to make the solution of the present application more clear and easier to understand, the following terms of the embodiments of the present application are described as follows:

Teleconference terminal:

including normal telephones and general purpose hardware conference terminals. The bandwidth is very low, and the standard telephone terminal supporting video call can only receive one media stream in the downlink in the corresponding specification, so the media stream pushed to the telephone conference terminal by the conference system needs to be a unified media stream after the uplink media streams of all participants are mixed.

It should be understood that, in the embodiment of the present application, the conference call terminal may also be referred to as a user terminal, a user device, or a terminal device, and in the embodiment of the present application, the terminal device may include a smart phone, a tablet pc, (personal DIGITAL ASSISTANT, PDA) a computer, a game console, a wearable device, a tablet pc (portable android device, PAD), a phone base, and the like, which is not limited thereto.

It should be understood that the operating system running on the terminal device in the present application may be a Linux kernel-based operating system such as Android in a mobile version, wu Ban Tu (Ubuntu) mobile version, tazier (Tizen), and a desktop operating system such as Windows, mac OS, linux, but the present application is not limited thereto.

In the embodiment of the present application, a terminal device may refer to an access terminal, a User Equipment (UE), a subscriber unit, a subscriber station, a mobile station, a remote terminal, a mobile device, a User terminal, a wireless communication device, a User agent, or a User Equipment. An access terminal may be a cellular telephone, a cordless telephone, a session initiation protocol (Session Initia tion Protocol, SIP) phone, a wireless local loop (Wireless Local Loop, WLL) station, a Personal digital assistant (Personal DIGITAL ASSISTANT, PDA), a handheld device with wireless communication capabilities, a computing device or other processing device connected to a wireless modem, an in-vehicle device, a wearable device, a terminal device in a 5G network or a terminal device in a future evolved public land mobile network (Public Land Mobile Network, PLMN), etc.

And the network conference terminal:

Refers to online conference client software. The bandwidth is high, so the experience requirement is high, and the independent media streams of different participants can be controlled respectively: zoom in/out/close/drag video of a participant, etc., or re-layout the video of the participant. It should be understood that, in the embodiment of the present application, the specific form of the network conference terminal is not limited, and for example, the network conference terminal may be a fixed terminal, a mobile terminal, or a wearable terminal.

It should be noted that, in the embodiment of the present application, the network conference terminal may be a terminal of the customization software of the conference system in the present application, where the network conference terminal may also be referred to as a conference customization terminal or a conference dedicated terminal, the network conference terminal may support receiving multiple media streams, the network conference terminal may support Web Real-time communication (Web Real-Time Communications, webRTC), the network conference terminal may be installed with a browser, and may perform Real-time communication through the browser, or be installed with online conference client PC software or APP or applet, and perform Real-time communication through the PC software or APP or applet. The teleconference terminal is a universal conference hardware or a universal PC software terminal or a telephone terminal or a common smart phone or a common non-smart phone (in the case of a non-smart phone, only a voice data stream can be received), and typically the teleconference terminal can only receive one media stream, and in the embodiment of the present application, the teleconference terminal uses SIP or H323 protocol to perform conference communication.

Optionally, in some cases, identities of the network conference terminal and the teleconference terminal, that is, corresponding functions and interaction procedures with other members may be interchanged, which is not limited to the embodiment of the present application.

Media distribution server:

the media distribution server may also be called a data stream forwarding server or media server or selective forwarding unit (SELECTIVE FORWARDING UNIT, SFU) server. In the embodiment of the application, the media distribution server can receive the data streams sent by each terminal in the same conference room, send the data streams to the media mixed stream server, receive the unified media streams sent by the media mixed stream server, send the unified media streams to the teleconference terminal, and send the independent media streams to other terminals except the network conference terminal to the network conference terminal.

Media mixed stream server:

The media mixed stream server may also be called a mixed stream server or a multipoint conference unit (Multipoint Conferencing Unit, MCU) server, and in the embodiment of the present application, the media mixed stream server may receive media streams of each terminal in the same conference room sent by the media distribution server, and perform mixed stream (i.e. mixed encoding) on the media streams of all terminals, and send the unified media stream after mixed stream to the media distribution server.

Conference control center server:

the conference control center server may also be called a control end or control center or signaling server, etc. The conference control center server is used for mixing with the conference terminal and the media mixed stream server. The media distribution server performs signaling interaction to transfer necessary information required by conference establishment, and simultaneously controls the media mixed stream server to perform mixed stream and controls the media distribution server to perform media stream distribution.

Fig. 5 is a schematic view of a conference system according to an embodiment of the present application. The conference system shown in fig. 5 includes a plurality of conference terminals, a media distribution server, a media mixed stream server and a conference control center server, wherein the plurality of conference terminals include at least one conference call terminal, and optionally, as shown in fig. 5, the plurality of conference terminals may further include at least one network conference terminal, and it should be understood that only one conference call terminal and only one network conference terminal are illustrated in fig. 5, and in fact, the number of conference call terminals and network conference terminals is not limited in the embodiment of the present application and may be determined according to the actual situation. The conference terminals are used for sending media streams to the media distribution server; the conference control center is used for sending a media distribution instruction to the media distribution server, wherein the media distribution instruction comprises a media stream number of each terminal in the plurality of conference terminals; the media distribution server is used for sending media streams corresponding to the media stream numbers of all terminals to the media mixed stream server, receiving and sending unified media streams to the at least one teleconference terminal; the conference control center is further configured to send a media mixed stream instruction to the media mixed stream server, where the media mixed stream instruction includes parameter information of the unified media stream; and the media mixed stream server is used for mixing the received media streams of all the conference terminals according to the parameter information of the unified media stream to obtain the unified media stream and sending the unified media stream to the media distribution server.

It should be understood that the functions of each member and specific interaction contents between each member in the conference system assembly shown in fig. 5 may be referred to the following descriptions of fig. 6 to 8, and detailed descriptions thereof are omitted herein as appropriate.

It should be understood that the conference system in the embodiment of the present application may be used for communication between personnel inside an enterprise, may also be used for communication between personnel inside an enterprise and personnel outside an enterprise, may also be used for communication between a plurality of individuals or family members or a plurality of friends, and may also be used for communication between the interior or the interior and the exterior of various groups or organizations or schools or scientific institutions, etc., and the conference system in the embodiment of the present application may be used in various scenes as required, and the embodiment of the present application does not limit specific conference scenes.

It should be understood that, in the embodiment of the present application, a plurality of conference terminals included in the conference system may be non-fixed, and the plurality of conference terminals may be terminals participating in a conference at a time, and that a specific plurality of conference terminals include which terminals are determined according to an actual conference. Optionally, in some cases, the plurality of conference terminals may include only a teleconference terminal, only a netmeeting terminal, or both a teleconference terminal and a netmeeting terminal, which is not limited by the embodiment of the present application.

FIG. 6 is a flow chart of a communication method for a conference in accordance with one embodiment of the present application; applied to the conference system shown in fig. 5, the communication method includes:

each of the plurality of conference terminals sends a media stream to the media distribution server 610.

Correspondingly, the media distribution server receives a media stream sent by each of a plurality of conference terminals, wherein the plurality of conference terminals include at least one teleconference terminal. It should be appreciated that the plurality of conference terminals may include all terminals in the same room that join the conference.

620, The media distribution server sends the received media streams of all conference terminals to the media mixed stream server.

Optionally, the media distribution server further receives a media distribution instruction sent by the conference control center server, where the media distribution instruction includes a media stream number of each of the plurality of conference terminals;

In 620, the media distribution server sends the media streams corresponding to the media stream numbers of all the terminals to the media mixed stream server.

And 630, the media mixed stream server mixes the received media streams of all the conference terminals to obtain a unified media stream.

Optionally, the media mixed stream server further needs to receive a media mixed stream instruction sent by the conference control center server, where the media mixed stream instruction includes parameter information of the unified media stream;

In 630, the media mixed stream server mixes the received media streams of all the conference terminals according to the parameter information of the unified media stream to obtain the unified media stream.

640, The media mixed stream server sends the unified media stream to the media distribution server.

The media distribution server sends 650 the unified media stream to the teleconference terminal.

Optionally, the plurality of conference terminals further includes at least one network conference terminal, and the media distribution server further sends media streams of other terminals to each of the at least one network conference terminal, where the media streams of other terminals corresponding to one network conference terminal include media streams of all terminals except the one network conference terminal. In other words, the act as matchmaker body distribution server may also send the independent media streams of other terminals than the netmeeting terminal to the netmeeting terminal.

It should be understood that in the embodiment of the present application, the conference call terminal may enter into two situations, one is an active conference-entering situation, one is a passive conference-entering situation, i.e. an invite conference-entering situation,

The conference control center server also sends an invitation conference conversion signaling to the signaling proxy server for the invitation conference, so that the signaling proxy server invites the at least one telephone conference terminal to join the conference according to the invitation conference patent signaling.

The conference control center server also receives an active conference joining conversion signaling sent by the signaling proxy server, wherein the active conference joining conversion signaling is used for indicating the at least one telephone conference terminal to actively join the conference.

The following will describe in detail the flow of actively joining and inviting a conference call terminal in the conference system shown in fig. 5, with reference to fig. 7 and 8. It should be understood that the premise of the conference call flow shown in fig. 7 and 8 is that the user using the teleconference terminal is a registered user, that is, registered to the conference control center server.

Fig. 7 is a flow chart of a conference call terminal active conference joining according to one embodiment of the present application; as shown in fig. 7, the active meeting procedure includes:

the conference call terminal sends an active conference call to the signaling proxy server 710.

Specifically, after receiving the conference authentication information (i.e., the conference number, or the conference number and the password), the user uses the teleconference terminal to send the active conference entering signaling to the signaling proxy server. Wherein the active conference signaling includes conference authentication information and description information of session parameters for media negotiation.

The proactive admission signaling may be SIP protocol signaling, or H323 protocol signaling, for example. When the proactive session signaling is SIP protocol signaling, it may be an INVITE request message for requesting to establish a session, the INVITE request message containing therein a description of proposed session parameters, e.g. session description protocol (Session Description Protocol, SDP). The SDP is a protocol describing multimedia connection contents, which include, for example, an encoding format, a streaming protocol, a media stream number, an encryption algorithm, etc., and in WebRTC, media capabilities are finally presented through the SDP. Before transmitting media data, media capability negotiation is first performed to see which coding modes are supported by both parties. When the proactive session signaling is H323 protocol signaling, the information of the media negotiation may be H245 information. It should be appreciated that the active conference signaling may also include other information, and in particular reference may be made to the relevant descriptions in the SIP protocol and the H323 protocol, which will not be described in detail here.

The signaling proxy server sends a response message to the teleconference terminal 711.

Specifically, after receiving the response message sent by the conference control center server, the signaling proxy server performs format conversion and then sends the response message to the teleconference terminal. The response message may include a description of the accepted session parameters, accepting the session establishment request, and the like.

Optionally, after receiving the response message, the conference call terminal may also send an acknowledgement message to the signaling proxy server.

Optionally, in the case that the conference system includes a network conference terminal, the negotiation of corresponding media is also performed between the network conference terminal and the conference control center server, unlike the teleconference terminal, the network conference terminal and the conference control center server directly perform communication negotiation, which will not be described in detail herein.

The signaling proxy server sends 720 the proactive-in signaling transfer signaling to the conference control center server.

Specifically, the signaling proxy server converts the received active conference entering signaling into a conference control instruction, and then sends the conference control instruction to the conference control center server. So that the conference control center server judges the conference qualification of the user and sends the description of the accepted conference parameters to the conference call terminal through the signaling proxy server under the condition of confirming the conference qualification, and simultaneously, the conference control center server sends the response instruction to the media mixed flow server and the media distribution server to realize the conference call of the conference call terminal.

It should be appreciated that in step 720, the signaling proxy server will format the received active incoming signaling, i.e. convert SIP or H323 protocol signaling to GRPC (Google Remote Procedure Call ) protocol signaling, and then send it to the conference control center server.

721, The conference control center server sends a response message to the signaling proxy server.

Specifically, the response message is sent when the conference control center server determines the conference qualification of the user, and may include information such as descriptions of the accepted session parameters. The signaling proxy server receives the response message and then sends the response message to the teleconference terminal.

And 730, the teleconference terminal transmits the upstream media stream.

I.e. the conference call terminal sends the media streams collected from the cameras and/or microphones to the media distribution server.

740, The conference control center server sends a media distribution instruction to the media distribution server.

The media distribution instruction comprises the numbers of the independent media streams of all the participating conference terminals, and the media distribution instruction is used for instructing the media distribution server to send the independent media streams and the numbers of the conference terminals to the media mixed stream server, and simultaneously send the unified media stream to the telephone conference terminal and send the independent media streams of other terminals except the own media stream to the network conference terminal.

And 750, the media distribution server transmits the media streams of all the conference terminals to the media mixed stream server.

Specifically, the media distribution server sends all media numbers in the media distribution instruction and corresponding media streams to the media mixed stream server.

760, The conference control center server sends a media mixed stream instruction to the media mixed stream server.

The media mixed stream instruction includes parameter information of the unified media stream after mixed stream, for example, parameters including code rate, resolution, layout and the like. The media mixed stream instruction is used for instructing the media mixed stream server to mix the received media streams.

The media mixed stream server sends 770 the unified media stream to the media distribution server.

780, The media distribution server sends the unified media stream to the teleconference terminal.

Optionally, in the case that the conference system includes a network conference terminal, the network conference terminal may also uplink the media stream of the network conference terminal to the media distribution server. The media distribution server may send the media streams of the other terminals to the netmeeting terminal.

FIG. 8 is a flow chart of inviting teleconferencing terminals to join according to one embodiment of the present application; as shown in fig. 8, the invitation conference flow includes:

810, the conference control center server sends an invite-to-conference signaling conversion instruction to the signaling proxy server.

Specifically, the conference control center server sends an invitation conference command to the signaling proxy server after receiving the invitation conference commands of other conference terminals.

811, The signaling proxy server sends a response instruction to the conference control center server.

Specifically, after receiving a response instruction of the teleconference terminal, the signaling proxy server performs format conversion on the response instruction and sends the response instruction to the conference control center server.

820, The signaling proxy server sends an invite-to-conference instruction to the teleconference terminal.

Specifically, the signaling proxy server converts the received invitation-to-conference signaling conversion instruction into an invitation-to-conference instruction, and then sends the invitation-to-conference instruction to the teleconference terminal.

821, The teleconference terminal sends a response instruction to the signaling proxy server.

It should be understood that the contents of steps 810 to 821 are similar to the processes of 710 to 721 of fig. 7, except that the process of inviting the conference call terminal to join is shown in fig. 8, and the process of actively joining the conference call terminal is shown in fig. 7. The invitation signaling and the response signaling involved in the invitation session in fig. 8 also include information such as description information of session parameters, but the conference call terminal and the conference control center server in fig. 8 and fig. 7 are exchanged, and specific reference may be made to the above description, which is not repeated here.

830, The teleconference terminal sends an upstream media stream.

840, The conference control center server sends media distribution instructions to the media distribution server.

The media distribution server sends 850 the media streams of all conference terminals to the media mixed stream server.

The conference control center server sends 860 a media mixed stream instruction to the media mixed stream server.

870, The media mixed stream server sends the unified media stream to the media distribution server.

The media distribution server sends 880 a unified media stream to the teleconference terminal.

The embodiment of the application has the following advantages:

Firstly, optimizing a media proxy server through a conference system, and directly pushing an uplink media stream of a telephone conference terminal to a media distribution server to reduce delay of the telephone conference terminal; meanwhile, the media mixed stream server is focused on mixed streams, does not participate in media distribution any more, and the requirement for dynamic capacity expansion is obviously reduced. Thus, the communication quality of the audio and video can be improved.

In addition, the conference system of the embodiment of the application decomposes the media related tasks into a media distribution server and a media mixed stream server. The mixed flow server is focused on mixed flow, and although the mixed flow server can carry out tasks with high calculation amount, task control interaction is simple and controllable, the conference terminal can not have any influence on the mixed flow server when entering and leaving a conference room, and is insensitive to capacity expansion delay. Meanwhile, the media distribution server is focused on media distribution, no task with high calculation amount exists, although task control interaction is slightly complex, the conference terminal can control the media distribution server to start and stop sending media streams when entering and leaving a conference room, the media distribution server is only required to be expanded when the embodiment of the application is used for dynamically expanding the capacity, and the media distribution server is an independent distribution server and is stateless, so that when the capacity expansion is required, a machine can be flexibly increased as required, and the difficulty and the complexity of the capacity expansion are reduced.

And the telephone conference terminal receives the unified media stream, has no obvious influence on the bandwidth and has smoother conference process. The network conference terminal receives the independent media streams of all other participants and can flexibly control: zoom in/out/close/drag the video of a participant or re-layout the video of the participant. Therefore, the embodiment of the application can provide different media streams for the telephone conference terminal and the network conference terminal, and can meet the requirements of different terminals.

Referring to fig. 9, fig. 9 is a schematic diagram of a communication device for a conference according to an embodiment of the present application. The apparatus 900 shown in fig. 9 may be a media distribution server in the conference system shown in fig. 5, and it should be understood that the apparatus 900 corresponds to the media distribution server in the foregoing method embodiment, and is capable of executing the steps executed by the media distribution server related to the foregoing method embodiment, and specific functions of the apparatus 900 may be referred to the foregoing description, and detailed descriptions are omitted herein as appropriate to avoid redundancy.

The apparatus 900 shown in fig. 9 includes at least one software functional module that can be stored in a memory in the form of software or firmware or cured in the apparatus, and the apparatus 900 shown in fig. 9 includes: a receiving unit 910, configured to receive a media stream sent by each of a plurality of conference terminals, where the plurality of conference terminals includes at least one teleconference terminal; a sending unit 920, configured to send the acquired media streams of all the conference terminals to a media mixed stream server, so that the media mixed stream server mixes the received media streams of all the conference terminals to obtain a unified media stream; the receiving unit is further configured to receive the unified media stream sent by the media mixed stream server; the sending unit is further configured to send the unified media stream to the at least one teleconference terminal.

Referring to fig. 10, fig. 10 is a schematic diagram of a communication device for a conference according to an embodiment of the present application. The apparatus 1000 shown in fig. 10 may be a media mixed stream server in the conference system shown in fig. 5, and it should be understood that the apparatus 1000 corresponds to the media mixed stream server in the foregoing method embodiment, and is capable of executing the steps executed by the media mixed stream server related to the foregoing method embodiment, and specific functions of the apparatus 1000 may be referred to the foregoing description, and detailed descriptions are omitted herein as appropriate to avoid redundancy.

The apparatus 1000 shown in fig. 10 includes at least one software functional module that can be stored in a memory in the form of software or firmware or cured in the apparatus, and the apparatus 1000 shown in fig. 10 includes: a receiving unit 1010 configured to receive a media stream of each of the plurality of conference terminals transmitted by the media distribution server; a processing unit 1020, configured to mix the received media streams of all the conference terminals to obtain a unified media stream; and a transmitting unit 1030, configured to transmit the unified media stream to the media distribution server, so that the media distribution server transmits the unified media stream to the at least one teleconference terminal.

Referring to fig. 11, fig. 11 is a schematic diagram of a communication device for a conference according to an embodiment of the present application. The apparatus 1100 shown in fig. 11 may be a conference control center server in the conference system shown in fig. 5, and it should be understood that the apparatus 1100 corresponds to the conference control center server in the above method embodiment, and is capable of executing the steps executed by the conference control center server related to the above method embodiment, and specific functions of the apparatus 1100 may be referred to the above description, and detailed descriptions are omitted herein as appropriate to avoid redundancy.

The apparatus 1100 shown in fig. 11 includes at least one software functional module that can be stored in a memory in the form of software or firmware or cured in the apparatus, and the apparatus 1100 shown in fig. 11 includes: a generating unit 1110, configured to generate a media distribution instruction and a media mixed stream instruction; a sending unit 1120, configured to send a media distribution instruction to the media distribution server, where the media distribution instruction includes a media stream number of each of the plurality of conference terminals, so that the media distribution server sends media streams corresponding to the media stream numbers of all terminals to the media mixed stream server, and receives and sends a unified media stream to the at least one teleconference terminal; the sending unit is further configured to send a media mixed stream instruction to the media mixed stream server, where the media mixed stream instruction includes parameter information of the unified media stream, so that the media mixed stream server mixes media streams of all received conference terminals according to the parameter information of the unified media stream to obtain the unified media stream and sends the unified media stream to the media distribution server.

It will be clear to those skilled in the art that, for convenience and brevity of description, reference may be made to the corresponding procedure in the foregoing method for the specific working procedure of the apparatus described above, and this will not be repeated here.

As shown in fig. 12, one embodiment of the present application provides an electronic device 1200, the electronic device 1200 comprising: memory 1210, processor 1220, and computer program stored on memory 1210 and executable on processor 1220, wherein processor 1220, when reading the program from memory 1210 over bus 1230 and executing the program, may implement the method performed by the media distribution server or the media mixed stream server or the conference control center server as in any of the embodiments described above. Optionally, the device shown in fig. 12 may further comprise a transceiver, which may be used for transmission and/or reception of media streams, or for transmission and/or reception of signaling.

Processor 1220 may process the digital signals and may include various computing structures. Such as a complex instruction set computer architecture, a reduced instruction set computer architecture, or an architecture that implements a combination of instruction sets. In some examples, processor 1220 may be a microprocessor.

Memory 1210 may be used for storing instructions to be executed by processor 1220 or data related to execution of instructions. Such instructions and/or data may include code to implement some or all of the functions of one or more of the modules described in embodiments of the present application. Processor 1220 of embodiments of the present disclosure may be configured to execute instructions in memory 1210 to implement the methods described above as being performed by a control or client. Memory 1210 includes dynamic random access memory, static random access memory, flash memory, optical memory, or other memory known to those skilled in the art.

An embodiment of the present application also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, can implement a method performed by a media distribution server or a media mixed stream server or a conference control center server in any of the above-described methods as provided in the above-described embodiments.

An embodiment of the present application further provides a computer program product, where the computer program product includes a computer program, where the computer program when executed by a processor may implement a method performed by a media distribution server or a media mixed stream server or a conference control center server in any of the above methods provided by the above embodiments.

It should be noted that the processor (e.g., the processor of fig. 12) in embodiments of the present invention may be an integrated circuit chip with signal processing capabilities. In implementation, the steps of the above method embodiments may be implemented by integrated logic circuits of hardware in a processor or instructions in software form. The processor may be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (field programmable GATE ARRAY, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The software modules may be located in a random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, etc. as well known in the art. The storage medium is located in a memory, and the processor reads the information in the memory and, in combination with its hardware, performs the steps of the above method.

It will be appreciated that the memory in embodiments of the invention (e.g., the memory of FIG. 12) may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an erasable programmable ROM (erasable PROM), an electrically erasable programmable EPROM (EEPROM), or a flash memory. The volatile memory may be random access memory (random access memory, RAM) which acts as external cache memory. By way of example, and not limitation, many forms of RAM are available, such as static random access memory (STATIC RAM, SRAM), dynamic random access memory (DYNAMIC RAM, DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate synchronous dynamic random access memory (doubledata RATE SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (ENHANCED SDRAM, ESDRAM), synchronous link dynamic random access memory (SYNCHLINK DRAM, SLDRAM), and direct memory bus random access memory (direct rambus RAM, DR RAM). It should be noted that the memory of the systems and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.

Applications to which embodiments of the present application relate include any application installed on a requesting end, including but not limited to, browser, email, instant messaging service, word processing, keyboard virtualization, widgets (widgets), encryption, digital rights management, voice recognition, voice replication, positioning (e.g., functions provided by the global positioning system), music playback, and so forth.

It should be understood that the transceiver unit or transceiver in the embodiments of the present invention may also be referred to as a communication unit.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present invention are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a high-density digital video disc (digital video disc, DVD)), or a semiconductor medium (e.g., a solid-state disk (solid-state drive STATE DISK, SSD)), or the like.

As used in this specification, the terms "component," "module," "system," and the like are intended to refer to a computer-related entity, either hardware, firmware, a combination of hardware and software, or software in execution. For example, a component may be, but is not limited to being, a process running on a processor, an object, an executable, a thread of execution, a program, and/or a computer. By way of illustration, both an application running on a computing device and the computing device can be a component. One or more components may reside within a process and/or thread of execution and a component may be localized on one computer and/or distributed between 2 or more computers. Furthermore, these components can execute from various computer readable media having various data structures stored thereon. The components may communicate by way of local and/or remote processes such as in accordance with a signal having one or more data packets (e.g., data from two components interacting with one another in a local system, distributed system, and/or across a network such as the internet with other systems by way of the signal).

It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in various embodiments of the present invention, the sequence numbers of the foregoing processes do not mean the order of execution, and the order of execution of the processes should be determined by the functions and internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

In addition, the terms "system" and "network" are often used interchangeably herein. The term "and/or" is herein merely an association relationship describing an associated object, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.

It should be understood that in embodiments of the present invention, "B corresponding to a" means that B is associated with a, from which B may be determined. It should also be understood that determining B from a does not mean determining B from a alone, but may also determine B from a and/or other information.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps described in connection with the embodiments disclosed herein may be embodied in electronic hardware, in computer software, or in a combination of the two, and that the elements and steps of the examples have been generally described in terms of function in the foregoing description to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of elements is merely a logical functional division, and there may be additional divisions of actual implementation, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not performed. In addition, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices, or elements, or may be an electrical, mechanical, or other form of connection.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment of the present invention.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

In summary, the foregoing description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A communication method for a conference, characterized by being applied to a media distribution server in a conference system including a plurality of conference terminals, the media distribution server, and a media mixed stream server, the communication method comprising:

Receiving a media stream sent by each conference terminal in the plurality of conference terminals, wherein the plurality of conference terminals comprise at least one teleconference terminal;

The method comprises the steps that media streams of all received conference terminals are sent to a media mixed stream server, so that the media mixed stream server mixes the media streams of all received conference terminals to obtain a unified media stream;

receiving the unified media stream sent by the media mixed stream server;

And sending the unified media stream to the at least one telephone conference terminal.

2. The communication method of claim 1, wherein the plurality of conference terminals further comprises at least one web conference terminal, the method further comprising:

And sending the media streams of other terminals to each of the at least one network conference terminal, wherein the media streams of other terminals corresponding to one network conference terminal comprise the media streams of all terminals except the one network conference terminal in all conference terminals.

3. The communication method according to claim 1 or 2, wherein the conference system further comprises a conference control center server, the method further comprising:

Receiving a media distribution instruction sent by the conference control center server, wherein the media distribution instruction comprises a media stream number of each terminal in the plurality of conference terminals;

The step of sending the received media streams of all the conference terminals to the media mixed stream server comprises the following steps:

And sending the media streams corresponding to the media stream numbers of all the terminals to the media mixed stream server.

4. A communication method for a conference, characterized by being applied to a media mixed stream server in a conference system, the conference system comprising a plurality of conference terminals, a media distribution server and the media mixed stream server, wherein the plurality of conference terminals comprises at least one teleconference terminal, the communication method comprising:

receiving a media stream of each conference terminal in the plurality of conference terminals sent by a media distribution server;

Mixing the received media streams of all the conference terminals to obtain a unified media stream;

the unified media stream is sent to the media distribution server so that the media distribution server sends the unified media stream to the at least one teleconferencing terminal.

5. The communication method of claim 4, wherein the conference system further comprises a conference control center server, the method further comprising:

Receiving a media mixed stream instruction sent by the conference control center server, wherein the media mixed stream instruction comprises parameter information of the unified media stream;

The step of mixing the received media streams of all the conference terminals to obtain a unified media stream comprises the following steps:

And mixing the received media streams of all the conference terminals according to the parameter information of the unified media stream to obtain the unified media stream.

6. A communication method for a conference, characterized by being applied to a conference control center server in a conference system including a plurality of conference terminals including at least one teleconference terminal, a media distribution server, a media mixed stream server, and the conference control center server, the communication method comprising:

Transmitting a media distribution instruction to the media distribution server, wherein the media distribution instruction comprises a media stream number of each terminal in the plurality of conference terminals, so that the media distribution server transmits media streams corresponding to the media stream numbers of all terminals to the media mixed stream server, receives and transmits a unified media stream to the at least one conference call terminal;

And sending a media mixed stream instruction to the media mixed stream server, wherein the media mixed stream instruction comprises parameter information of the unified media stream, so that the media mixed stream server mixes the received media streams of all conference terminals according to the parameter information of the unified media stream to obtain the unified media stream and sends the unified media stream to the media distribution server.

7. A communication apparatus for a conference, characterized by being applied to a media distribution server in a conference system including a plurality of conference terminals, the media distribution server, and a media mixed stream server, the communication apparatus comprising:

A receiving unit, configured to receive a media stream sent by each of a plurality of conference terminals, where the plurality of conference terminals includes at least one teleconference terminal;

The sending unit is used for sending the acquired media streams of all the conference terminals to the media mixed stream server so that the media mixed stream server can mix the received media streams of all the conference terminals to obtain a unified media stream;

The receiving unit is further configured to receive the unified media stream sent by the media mixed stream server;

The sending unit is further configured to send the unified media stream to the at least one teleconference terminal.

8. A communication device for a conference, characterized by a media mixed stream server applied in a conference system comprising a plurality of conference terminals, a media distribution server and the media mixed stream server, wherein the plurality of conference terminals comprises at least one teleconference terminal, the communication device comprising:

A receiving unit configured to receive a media stream of each of the plurality of conference terminals transmitted by a media distribution server;

The processing unit is used for mixing the received media streams of all the conference terminals to obtain a unified media stream;

And the sending unit is used for sending the unified media stream to the media distribution server so that the media distribution server can send the unified media stream to the at least one teleconference terminal.

9. A communication apparatus for a conference, characterized by being applied to a conference control center server in a conference system including a plurality of conference terminals including at least one teleconference terminal, a media distribution server, a media mixed stream server, and the conference control center server, the communication apparatus comprising:

The generating unit is used for generating a media distribution instruction and a media mixed stream instruction;

A sending unit, configured to send the media distribution instruction to the media distribution server, where the media distribution instruction includes a media stream number of each of the plurality of conference terminals, so that the media distribution server sends media streams corresponding to the media stream numbers of all terminals to the media mixed stream server, and receives and sends a unified media stream to the at least one teleconference terminal;

The sending unit is further configured to send the media mixed stream instruction to the media mixed stream server, where the media mixed stream instruction includes parameter information of the unified media stream, so that the media mixed stream server mixes media streams of all received conference terminals according to the parameter information of the unified media stream to obtain the unified media stream and sends the unified media stream to the media distribution server.

10. A conference system comprising a plurality of conference terminals, a media distribution server, a media mixed stream server, and a conference control center server, wherein the plurality of conference terminals comprises at least one teleconference terminal;

The conference terminals are used for sending media streams to the media distribution server;

the conference control center is used for sending a media distribution instruction to the media distribution server, wherein the media distribution instruction comprises a media stream number of each terminal in the plurality of conference terminals;

the media distribution server is used for sending media streams corresponding to the media stream numbers of all terminals to the media mixed stream server, receiving and sending unified media streams to the at least one teleconference terminal;

The conference control center is further configured to send a media mixed stream instruction to the media mixed stream server, where the media mixed stream instruction includes parameter information of the unified media stream;

And the media mixed stream server is used for mixing the received media streams of all the conference terminals according to the parameter information of the unified media stream to obtain the unified media stream and sending the unified media stream to the media distribution server.