CN109862305B

CN109862305B - Method and device for adjusting stream during meeting of video network

Info

Publication number: CN109862305B
Application number: CN201910002656.XA
Authority: CN
Inventors: 杜小波; 亓娜; 袁占涛; 赵振华
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-01-02
Filing date: 2019-01-02
Publication date: 2021-09-21
Anticipated expiration: 2039-01-02
Also published as: CN109862305A

Abstract

The invention provides a method and a device for adjusting stream during meeting of a video network. The method comprises the following steps: the main domain video network server receives a first signaling, forwards the audio and video of the terminal in the main domain to the bridge server according to the first signaling, and the bridge server performs opposite-end operation and forwards the audio and video of the terminal in the main domain to the external domain video network server. The invention sends signaling to establish a channel through a client side provided with video networking conference control software, judges whether a virtual terminal number included in the signaling is a main domain virtual terminal number or an external domain virtual terminal number according to the content of the signaling, and then carries out audio and video data transmission according to the property of the virtual terminal number, thereby realizing that users in different domains can be in a meeting at the same time and any terminal in any domain can speak.

Description

Method and device for adjusting stream during meeting of video network

Technical Field

The invention relates to the field of video networking, in particular to a method and a device for adjusting stream during meeting of the video networking.

Background

The video networking is an important milestone for network development, is a higher-level form of the Internet, is a real-time network, can realize the real-time transmission of full-network high-definition videos which cannot be realized by the Internet at present, pushes a plurality of Internet applications to high-definition video, and finally realizes that the distance between people in the global range is only the distance of one screen.

The existing video network server can only mount 65535 video network terminals, but with the high-speed development of video network, the number of terminals which are put into use at present exceeds the number, and in order to solve the problem that the number of the existing terminals exceeds 65535, a plurality of video network servers are deployed, so that the problem is solved.

One domain in the video network refers to an independent video network, one domain is provided with a video network server and can mount 65535 video network terminals, when meetings need to be opened through the video network, users in the same domain can be realized very simply, but if the users needing to be opened are not in the same domain, meetings cannot be opened, because the video network servers cannot transmit data, and the data comprise signaling and video stream data, so when the users needing to be opened are respectively in different domains, meetings cannot be opened.

Disclosure of Invention

The invention provides a method and a device for adjusting stream when meeting is opened in a video network, which solve the problem that users in different domains cannot meet in the prior art.

In order to solve the above technical problem, embodiments of the present invention provide a method for adjusting streams when a video network is in a meeting,

if there are multiple video networks, the multiple video networks include: a main domain and an external domain, the external domain comprising: the method comprises the following steps that a main domain is connected with a first external domain through a first bridging server and is connected with a second external domain through a second bridging server, the main domain comprises a client side provided with video networking conference control software, the client side is connected with a main domain video networking server, and a speaker in the video networking conference speaks through a terminal in the video networking after the video networking conference is started up through the main domain and the external domain, and the method comprises the following steps:

if the current speaker is in the first external domain and the original speaker is in the second external domain, the first external domain video networking server receives a third signaling sent by the client;

the first external domain video networking server sends the audio and video of the current speaker to the virtual terminal corresponding to the first external domain virtual terminal number according to the third signaling;

the first bridging server forwards the audio and video of the current speaker to the main domain video network server;

the home domain video networking server receives a fourth signaling sent by the client;

the main domain video network server sends the audio and video of the current speaker to a terminal in the main domain video network and a second bridging server according to the fourth signaling;

the second bridging server forwards the audio and video of the current speaker to a second outside-domain video networking server;

the second outside-realm video networking server receives a fifth signaling sent by the client;

the second outside-domain video networking server sends the audio and video of the current speaker to a terminal in the second outside-domain video networking according to the fifth signaling;

the method for starting the video networking conference by the main domain and the external domain comprises the following steps:

the main domain video network server receives a first signaling sent by the client, the first signaling is used for establishing a channel from the main domain video network server to a bridge server, the channel is a transmission channel of audio and video, and the bridge server comprises: the first bridge server and the second bridge server;

the main domain video network server forwards the audio and video of the terminal in the main domain to the bridging server according to the first signaling and the main domain virtual terminal number, the main domain virtual terminal number is respectively registered in the main domain video network server and the bridging server and is used for the audio and video transmission between the main domain video network server and an external domain video network server, and the external domain video network server comprises: the first external domain video networking server is connected with the first bridge server, and the second external domain video networking server is connected with the second bridge server;

the bridge server carries out opposite-end operation according to a main domain virtual terminal number and an external domain virtual terminal number, and forwards the audio and the video of the terminal in the main domain to the external domain video networking server, wherein the external domain virtual terminal number is respectively registered in the external domain video networking server and the bridge server and is used for carrying out audio and video transmission between the main domain video networking server and the external domain video networking server.

Optionally, before the home domain video networking server receives the first signaling, the method further includes:

registering area codes for identifying a main domain and an external domain in a client side provided with video networking conference control software;

and registering a main domain virtual terminal number and an external domain virtual terminal number in the bridging server, wherein the main domain virtual terminal number and the external domain virtual terminal number are used for audio and video transmission between the main domain video networking server and the external domain video networking server, and meanwhile, registering the main domain virtual terminal number in the main domain video networking server and registering the external domain virtual terminal number in the external domain video networking server.

Optionally, the forwarding, by the home domain video networking server, the audio and video of the terminal in the home domain to the bridge server according to the first signaling and the home domain virtual terminal number includes:

parsing the first signaling, the first signaling comprising: the address of the terminal in the home domain and the number of the home domain virtual terminal;

and forwarding the audio and video of the terminal in the main domain to the bridging server according to the address of the terminal in the main domain and the number of the main domain virtual terminal, wherein the virtual terminal corresponding to the main domain virtual terminal number is the same virtual terminal as the virtual terminal corresponding to the main domain virtual terminal number in the bridging server.

Optionally, the bridge server performs an opposite-end operation according to a main domain virtual terminal number and an external domain virtual terminal number, and forwards the audio and video of the terminal in the main domain to the external domain video networking server, where the method includes:

a virtual terminal corresponding to a main domain virtual terminal number in the bridging server receives the audio and video of a terminal in a main domain;

and the bridge server carries out opposite-end operation, wherein the opposite-end operation is to forward the audio and video of the terminal in the main domain in the virtual terminal corresponding to the main domain virtual terminal number in the bridge server to the virtual terminal corresponding to the external domain virtual terminal number in the bridge server.

After the bridge server performs an opposite-end operation according to a main domain virtual terminal number and an external domain virtual terminal number and forwards the audio and video of the terminal in the main domain to the external domain video networking server, the method further comprises the following steps:

when a newly added terminal exists in the main domain, the newly added terminal receives a second signaling sent by the client, the second signaling is used for establishing a channel between the newly added terminal and an audio/video terminal sent out by the main domain, and the channel is an audio/video transmission channel;

the newly added terminal analyzes the second signaling, and receives the audio and video of the terminal in the main domain according to the second signaling, wherein the second signaling comprises: and sending out the address of the audio/video terminal and the address of the newly added terminal in the main domain.

Optionally, the sending, by the first external domain video networking server, the audio/video of the current speaker to the virtual terminal corresponding to the first external domain virtual terminal number according to the third signaling includes:

parsing the third signaling, the third signaling comprising: the address of the current speaker terminal and the number of the first external domain virtual terminal;

and sending the audio and video of the current speaker terminal to a first bridging server according to the address of the current speaker terminal and the number of a first external domain virtual terminal, wherein the virtual terminal corresponding to the number of the first external domain virtual terminal is the same virtual terminal as the virtual terminal corresponding to the number of the first external domain virtual terminal in the first bridging server.

Optionally, if the current speaker and the original speaker are both in the main domain, the method further includes:

the main domain video network server receives a sixth signaling sent by the client;

the main domain video network server sends the audio and video of the current speaker to a virtual terminal corresponding to the main domain virtual terminal number for audio and video transmission with the first external domain video network server and a virtual terminal corresponding to the main domain virtual terminal number for audio and video transmission with the second external domain video network server respectively according to the sixth signaling;

the first bridging server forwards the audio and video of the current speaker to the first external domain video networking server;

the second bridging server forwards the audio and video of the current speaker to the second outside-domain video networking server;

the first external domain video network server sends the audio and video of the current speaker to a terminal in the first external domain video network;

and the second outside-domain video networking server sends the audio and video of the current speaker to a terminal in the second outside-domain video networking.

Optionally, if the current speaker is in the first external domain and the original speaker is in the main domain, the method further includes:

the first external domain video networking server receives a seventh signaling sent by the client;

the first external domain video networking server sends the audio and video of the current speaker to the virtual terminal corresponding to the first external domain virtual terminal number according to the seventh signaling;

the home domain video network server receives an eighth signaling sent by the client;

the main domain video network server sends the audio and video of the current speaker to a terminal in the main domain video network and a virtual terminal corresponding to the main domain virtual terminal number and carrying out audio and video transmission with a second outside domain video network server according to the eighth signaling;

and the second bridging server forwards the audio and video of the current speaker to the second outside-domain video networking server.

The embodiment of the invention also provides a device for regulating the flow when the video network opens, if a plurality of video networks exist, the plurality of video networks comprise: a main domain and an external domain, the external domain comprising: the device comprises a first external domain and a second external domain, wherein a main domain is connected with the first external domain through a first bridge server and is connected with the second external domain through a second bridge server, the main domain comprises a client terminal provided with video networking conference control software, the client terminal is connected with a main domain video networking server, and a speaker in the video networking conference speaks through a terminal in the video networking after the video networking conference is started up by the main domain and the external domain, and the device comprises:

a first receiving and establishing module, configured to receive, by the home domain video networking server, a first signaling sent by the client, where the first signaling is used to establish a channel from the home domain video networking server to a bridge server, where the channel is a transmission channel of audio and video, and the bridge server includes: the first bridge server and the second bridge server;

a forwarding module, configured to forward, by the home domain video networking server, the audio and video of the terminal in the home domain to the bridge server according to the first signaling and a home domain virtual terminal number, where the home domain virtual terminal number is respectively registered in the home domain video networking server and the bridge server, and is used for the home domain video networking server and an external domain video networking server to perform audio and video transmission, and the external domain video networking server includes: the first external domain video networking server is connected with the first bridge server, and the second external domain video networking server is connected with the second bridge server;

the bridge server is used for performing an opposite-end operation according to a main domain virtual terminal number and an external domain virtual terminal number, and forwarding the audio and video of the terminal in the main domain to the external domain video networking server, wherein the external domain virtual terminal number is respectively registered in the external domain video networking server and the bridge server and is used for performing audio and video transmission between the main domain video networking server and the external domain video networking server;

the area code registration module is used for registering area codes for identifying a main domain and an external domain in a client side provided with video networking conference control software;

the terminal registration module is used for registering in the bridging server and is used for registering a main domain virtual terminal number and an external domain virtual terminal number for audio and video transmission between the main domain video networking server and the external domain video networking server, meanwhile, registering the main domain virtual terminal number in the main domain video networking server, and registering the external domain virtual terminal number in the external domain video networking server;

the second receiving and establishing module is used for receiving a second signaling sent by the client by the newly added terminal when the newly added terminal exists in the main domain, wherein the second signaling is used for establishing a channel between the newly added terminal and an audio and video terminal sent out by the main domain, and the channel is an audio and video transmission channel;

and the analysis receiving module is used for analyzing the second signaling by the newly added terminal and receiving the audio and video of the terminal in the main domain according to the second signaling, wherein the second signaling comprises: the address of the terminal in the home domain and the address of the newly added terminal;

and the second outside-domain video networking server sends the audio and video of the current speaker to a terminal in the second outside-domain video networking according to the fifth signaling.

Compared with the prior art, the method for adjusting the stream when the video network opens a meeting, provided by the invention, has the advantages that a user registers the virtual terminal numbers of the main domain and the external domain to the main domain video network server, the external domain video network server and the bridge server through the client side provided with video network meeting control software, the main domain video network server, the external domain video network server and the bridge server analyze the signaling according to the received signaling and video stream data, judge whether the virtual terminal number included in the signaling is the main domain virtual terminal number or the external domain virtual terminal number according to the signaling content, and then transmit audio and video data according to the property of the virtual terminal number, so that users in different domains can open the meeting at the same time and any terminal in any domain can speak.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

FIG. 1 is a flow chart of a video networking conferencing method according to an embodiment of the present invention;

FIG. 2 is a flowchart illustrating steps prior to step 101 in a method for providing a meeting over a video network according to an embodiment of the present invention;

FIG. 3 is a flowchart illustrating a specific step 102 of a method for providing a meeting over the Internet of view according to an embodiment of the present invention;

fig. 4 is a flowchart of a method for adjusting a stream when switching a speaker between two external domains during a meeting in an internet of view according to an embodiment of the present invention;

fig. 5 is a flowchart illustrating step 202 of a method for adjusting streaming when switching between two external domains for a speaker during a meeting in an internet of view according to an embodiment of the present invention;

fig. 6 is a flowchart illustrating steps of a flow adjustment method when switching speakers are all in the home domain during a meeting in the video network according to an embodiment of the present invention;

fig. 7 is a flowchart illustrating steps of a method for switching between speakers when a video network is in a meeting, wherein the speakers are in a home domain and the speakers are in a foreign domain;

FIG. 8 is a schematic view of a video network conference in accordance with an embodiment of the present invention;

fig. 9 is a block diagram of a video network conferencing device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Fig. 1 shows a flowchart of a video networking conferencing method according to an embodiment of the present invention. The method is applied to a plurality of video networks, the plurality of video networks comprise a main domain and an external domain, a main domain video network service is connected with an external domain video network server through a bridge server, the main domain comprises a client side provided with video network conference control software, the client side is connected with the video network server of the main domain, and the specific method for video network conference comprises the following steps:

step 101: the method comprises the steps that a main domain video network server receives a first signaling sent by a client, the first signaling is used for establishing a channel from the main domain video network server to a bridging server, and the channel is an audio and video transmission channel.

In the embodiment of the present invention, the plurality of video networks include a main domain and a plurality of external domains, the main domain refers to a complete video network, each external domain is also a complete video network, and a main domain video network service and an external domain video network server are connected through a bridge server, for example: as shown in fig. 8, the system comprises a main domain video network server s10, an external domain 1 video network server s20, an external domain 2 video network server s30 and an external domain 3 video network server s40, wherein the four domains need to be conferenced, the main domain comprises a client p10 equipped with video network conference control software, the client p10 is connected with the main domain video network server s10 through a chairman box p20, a user can send various control commands through the client p10, the commands are packaged into video network general signaling through the chairman box p20, the signaling is used for establishing a channel from the main domain video network server to a bridge server, the channel can be used for audio and video transmission, and when the conference is carried out, the user operates the video network conference control software to send the signaling to the main domain video network server. The embodiment of the present invention is not limited in detail, and may be set according to actual situations.

Optionally, referring to fig. 2, before step 101, the method for video networking conference may further comprise the steps of:

step 1001: area codes for identifying a main domain and an external domain are registered in a client equipped with video networking conference control software.

Step 1002: and registering a main domain virtual terminal number and an external domain virtual terminal number in the bridging server, wherein the main domain virtual terminal number and the external domain virtual terminal number are used for data transmission between the main domain video network server and the external domain video network server, and meanwhile, registering the main domain virtual terminal number in the main domain video network server and registering the external domain virtual terminal number in the external domain video network server.

Referring to fig. 8, in an embodiment of the present invention, in a client equipped with video networking conference control software, area codes for identifying a main domain and an external domain are registered, this region number is used to determine the unique identity of the main domain as well as the ectodomain, e.g., main domain region number 010, ectodomain 1 region number 020, ectodomain 2 region number 030, ectodomain 3 region number 040, according to the area code, it can be clear to which video network server the signaling needs to be sent, because the video network servers can not directly transmit the audio and video, therefore, the home domain video network server s10 also needs to register a home domain virtual terminal number 1 for audio/video data transmission with the external domain 1 video network server, a main domain virtual terminal number 2 for transmitting audio and video data with the external domain 2 video network server, and a main domain virtual terminal number 3 for transmitting audio and video data with the external domain 3 video network server, which can be regarded as the number of the virtual terminal of the main domain video network server.

An external domain 1 virtual terminal number for audio/video data transmission with the main domain video network server s10 is registered in the external domain 1 video network server s20, and the virtual terminal number may be considered as the number of a virtual terminal of the external domain 1 video network server s20, and similarly, an external domain 2 virtual terminal number and an external domain 3 virtual terminal number are respectively registered in the external domain 2 video network server s30 and the external domain 3 video network server s 40.

The main domain virtual terminal number 1 and the external domain 1 virtual terminal number are registered in a bridge server s201 connected to the external domain 1, the main domain virtual terminal number 2 and the external domain 2 virtual terminal number are registered in a bridge server s301 connected to the external domain 2, the main domain virtual terminal number 3 and the external domain 3 virtual terminal number are registered in a bridge server s401 connected to the external domain 3. The embodiment of the present invention is not limited in detail, and may be set according to actual situations.

Step 102: and the main domain video network server forwards the audio and video of the terminal in the main domain to the bridging server according to the first signaling and the main domain virtual terminal number, and the main domain virtual terminal number is respectively registered in the main domain video network server and the bridging server and is used for audio and video transmission between the main domain video network server and the external domain video network server.

Referring to fig. 8, in the video network, signaling for establishing an audio/video transmission channel is sent one by one, one signaling performs one step, when a meeting is opened, any terminal in the main domain can be used as a meeting initiator, a user can send the signaling through a client p10, and audio/video of a meeting initiator terminal in the main domain is sent to the other terminals in the main domain, so that all terminals in the main domain can view audio/video images of the meeting initiator terminal. A terminal user needing to start a meeting can send a signaling through a client p10, a channel of a conference initiator terminal and a main domain video network server s10 virtual terminal number is established, audio and video of the conference initiator terminal in the main domain are forwarded to a bridge server s201 connected with an external domain 1 through a main domain video network server s10, it can be simply inferred that the user can send the signaling through the client p10, and the audio and video of the conference initiator terminal can be forwarded to a bridge server s301 connected with an external domain 2 and a bridge server s401 connected with an external domain 3 through the main domain video network server s 10. The embodiment of the present invention is not limited in detail, and may be set according to actual situations.

Optionally, referring to fig. 3, step 102 may further include the following steps:

step 1021: parsing a first signaling, the first signaling comprising: the address of the terminal in the home domain and the home domain virtual terminal number.

Step 1022: and forwarding the audio and video of the terminal in the main domain to a bridging server according to the address of the terminal in the main domain and the number of the main domain virtual terminal, wherein the virtual terminal corresponding to the number of the main domain virtual terminal is the same virtual terminal as the virtual terminal corresponding to the number of the main domain virtual terminal in the bridging server.

Referring to fig. 8, in the embodiment of the present invention, for example, when only the main domain and the external domain 1 are required to be in a meeting, the user may send a first signaling through the client p10, where the signaling includes: the address of the terminal in the main domain and the main domain virtual terminal number 1, the signaling is analyzed, the conference initiator terminal in the main domain is determined according to the address of the terminal in the main domain, the audio and video source to be forwarded is determined, according to the main domain virtual terminal number 1, the audio and video are sent to the virtual terminal corresponding to the main domain virtual terminal number 1, the virtual terminal corresponding to the home domain virtual terminal number 1 in the bridge server s201 is the same virtual terminal, that is, the channel established by the first signaling enables the audio/video of the conference initiator terminal in the main domain to be transmitted to the virtual terminal corresponding to the main domain virtual terminal number 1 in the bridge server s201, and it can be inferred that the user can send the signaling through the client p10, and the audio/video of the conference initiator terminal in the main domain is transmitted to the virtual terminal corresponding to the main domain virtual terminal number 2 in the bridge server s301 and the virtual terminal corresponding to the main domain virtual terminal number 3 in the bridge server s 401. The embodiment of the present invention is not limited in detail, and may be set according to actual situations.

Step 103: and the bridging server performs opposite-end operation according to the main domain virtual terminal number and the external domain virtual terminal number, and forwards the audio and the video of the terminal in the main domain to the external domain video networking server, wherein the external domain virtual terminal number is respectively registered in the external domain video networking server and the bridging server and is used for the audio and video transmission between the main domain video networking server and the external domain video networking server.

Referring to fig. 8, in the embodiment of the present invention, after the audio and video of the conference initiator terminal in the main domain is transmitted to the bridge server s201, that is, after the virtual terminal corresponding to the main domain virtual terminal number 1 in the bridge server receives the audio and video of the terminal in the main domain, the bridge server s201, according to its own characteristics, connects the virtual terminal corresponding to the main domain virtual terminal number 1 with the virtual terminal corresponding to the external domain 1 virtual terminal number to form a channel, at this time, the audio and video in the virtual terminal corresponding to the main domain virtual terminal number 1 in the bridge server s201 are transmitted to the virtual terminal corresponding to the external domain 1 virtual terminal number in the bridge server s201, the virtual terminal is the same virtual terminal as the virtual terminal corresponding to the external domain 1 virtual terminal number in the external domain 1 video networking server s20, at this time, a channel from the terminal in the main domain to the external domain virtual terminal number 1 in the external domain 1 video networking server s20 is established, it can be easily inferred that the audio and video of the conference initiator terminal can be transmitted to the virtual terminal corresponding to the virtual terminal number of the external domain 2 in the external domain 2 video networking server s30 through the bridge server s301, and can be transmitted to the virtual terminal corresponding to the virtual terminal number of the external domain 3 in the external domain 3 video networking server s40 through the bridge server s 401. The embodiment of the present invention is not limited in detail, and may be set according to actual situations.

Through the steps, the audio and video of the conference initiator in the main domain are transmitted to the video networking servers of the external domain 1, the external domain 2 and the external domain 3, and the terminals needing to be conferred in the external domain 1, the external domain 2 and the external domain 3 receive the audio and video of the conference initiator on the virtual terminals in the video networking servers, so that the simultaneous conferences of the main domain, the external domain 1, the external domain 2 and the external domain 3 can be completed.

Optionally, after the conference is started, the method for holding the conference through the video network further comprises the following steps:

step 104: when a newly added terminal exists in the main domain, the newly added terminal receives a second signaling sent by the client, the second signaling is used for establishing a channel between the newly added terminal and an audio/video terminal sent out in the main domain, and the channel is an audio/video transmission channel.

In the embodiment of the invention, after the video networking conference is started, when a newly added terminal exists in the main domain, a user can send a second signaling to the newly added terminal through the client p10, and the second signaling is used for establishing a channel between the newly added terminal and an audio/video terminal sent out in the main domain.

Step 105: the newly added terminal analyzes the second signaling, and receives the audio and video of the terminal in the main domain according to the second signaling, wherein the second signaling comprises the following steps: and sending out the address of the audio/video terminal and the address of the newly added terminal in the main domain.

In the embodiment of the present invention, a newly added terminal parses a second signaling, where the second signaling includes: and according to the second signaling, the newly added terminal receives the audio and video of the audio and video terminal, so that the newly added terminal can also participate in the conference.

For example 1, referring to fig. 8, the plurality of viewerships includes a main domain viewership server s10, an external domain 1 viewership server s20, an external domain 2 viewership server s30, and an external domain 3 viewership server s40, the main domain, the external domain 1, the external domain 2, and the external domain 3 are each independent complete viewerships, and the external domain 1 viewership includes: an ectodomain 1 video networking server s20, a terminal 4, and a terminal 5, wherein the terminal 4 and the terminal 5 are both connected to an ectodomain 1 video networking server s20, the ectodomain 1 video networking server s20 is connected to a master domain video networking server s10 through a bridge server s201, and the ectodomain 2 video networking comprises: an ectodomain 2 video networking server s30, a terminal 6, and a terminal 7, wherein terminal 6 and terminal 7 are both connected to an ectodomain 2 video networking server s30, and an ectodomain 2 video networking server s30 is connected to a master domain video networking server s10 through a bridge server s301, and an ectodomain 3 video networking comprises: an external domain 3 video network server s40 and a terminal 8, wherein the terminal 8 is connected with an external domain 3 video network server s40, the external domain 3 video network server s40 is connected with a main domain video network server s10 through a bridge server s401, the main domain comprises a terminal 1, a terminal 2 and a terminal 3, wherein the terminal 1, the terminal 2 and the terminal 3 are respectively connected with the main domain video network server s10, the terminal 1 is provided with a video network conference control software client p10, the client p10 is connected with the main domain video network server s10 through a chairman box p20, a user can send various control commands through the client p10, the commands are packaged into a video network universal signaling channel through the chairman box p20 and are used for establishing an audio and video transmission channel, when a conference is carried out, the video network conference control software is operated by the user to send signaling to the main domain video network server s10, it should be noted that the client p10 can be installed on any terminal of the main domain, i.e. any terminal of the main domain can initiate a conference through the client p10, the embodiment of the present invention is illustrated with the client p10 installed on the terminal 1.

Before the four domains need to be conferenced, the user registers area numbers for identifying the main domain and the external domains 1, 2 and 3 in the client p10, this region number is used to determine the unique identity of the main domain as well as the ectodomain, e.g., main domain region number 010, ectodomain 1 region number 020, ectodomain 2 region number 030, ectodomain 3 region number 040, according to the area code, it can be clear to which domain video network server the signaling needs to be sent, because the video network servers can not directly transmit the audio and video, therefore, the home domain video network server s10 also needs to register a home domain virtual terminal number 1 for audio/video data transmission with the external domain 1 video network server, a main domain virtual terminal number 2 for transmitting audio and video data with the external domain 2 video network server, and a main domain virtual terminal number 3 for transmitting audio and video data with the external domain 3 video network server, which can be regarded as the number of the virtual terminal of the main domain video network server. An external domain 1 virtual terminal number for audio/video data transmission with the main domain video network server s10 is registered in the external domain 1 video network server s20, and the virtual terminal number may be considered as the number of a virtual terminal of the external domain 1 video network server s20, and similarly, an external domain 2 virtual terminal number and an external domain 3 virtual terminal number are respectively registered in the external domain 2 video network server s30 and the external domain 3 video network server s 40. A main domain virtual terminal number 1 and an external domain 1 virtual terminal number are registered in a bridge server s201 connected to the external domain 1, a main domain virtual terminal number 2 and an external domain 2 virtual terminal number are registered in a bridge server s301 connected to the external domain 2, a main domain virtual terminal number 3 and an external domain 3 virtual terminal number are registered in a bridge server s401 connected to the external domain 3.

In the video network, the signaling for establishing the audio/video transmission channel is sent one by one, one signaling executes a step, when a meeting is opened, the terminal 1 in the main domain can be used as a conference initiator, a user can send the signaling through the client p10, a channel between the terminal 1 of the conference initiator and the other terminals in the main domain is established, the audio/video of the terminal 1 of the conference initiator in the main domain is sent to the terminal 2 and the terminal 3 in the main domain, so that all the terminals in the main domain can check the audio/video of the terminal 1 of the conference initiator, the user can send the signaling through the client p10, a channel of virtual terminal numbers of the terminal 1 of the conference initiator and the video networking server s10 in the main domain is established, the audio/video of the terminal 1 of the conference initiator in the main domain is forwarded to the bridge server s201 through the video networking server s10, it can be easily inferred that the user can send the signaling through the client p10, the audio and video of the conference initiator terminal 1 may be forwarded to the bridge server s301, as well as the bridge server s401, through the primary domain video networking server s 10. The audiovisual transmission when the main domain and the external domain 1 are in a meeting is illustrated below, and it can be understood that the audiovisual transmission when the main domain and the external domain 1, the external domain 2 and the external domain 3 are in a meeting is the same, for example: the user may send a first signaling via client p10, the signaling comprising: the address of the conference initiator terminal 1 in the main domain and the main domain virtual terminal number 1 are analyzed, the signaling is analyzed, the conference initiator terminal 1 in the main domain is determined according to the address of the conference initiator terminal 1 in the main domain, the source of the audio and video to be forwarded is determined, the audio and video is sent to the virtual terminal corresponding to the main domain virtual terminal number 1 according to the main domain virtual terminal number 1, the virtual terminal and the virtual terminal corresponding to the main domain virtual terminal number 1 in the bridge server s201 are the same virtual terminal, namely a channel established by the first signaling, so that the audio and video of the conference initiator terminal in the main domain are transmitted to the virtual terminal corresponding to the main domain virtual terminal number 1 in the bridge server s201, the signaling can be simply inferred from the above that a user can send the signaling through the client p10, the audio and video of the conference initiator terminal 1 in the main domain are transmitted to the virtual terminal corresponding to the main domain virtual terminal number 2 in the bridge server s301, and a virtual terminal corresponding to the home domain virtual terminal number 3 in the bridge server s 401.

When the audio and video of the terminal 1 of the conference initiator in the main domain is transmitted to the bridge server s201, that is, after the virtual terminal corresponding to the virtual terminal number 1 of the main domain in the bridge server receives the audio and video of the terminal 1 in the main domain, the bridge server 201 butt-joints the virtual terminal corresponding to the virtual terminal number 1 of the main domain with the virtual terminal corresponding to the virtual terminal number of the external domain 1 according to the characteristics thereof to form a channel, at this time, the audio and video in the virtual terminal corresponding to the virtual terminal number 1 of the main domain in the bridge server s201 are transmitted to the virtual terminal corresponding to the virtual terminal number of the external domain 1 in the bridge server s201, the virtual terminal is the same virtual terminal as the virtual terminal corresponding to the virtual terminal number 1 of the external domain 1 in the external domain 1 video networking server s20, at this time, the channel from the terminal 1 of the main domain to the virtual terminal number 1 of the external domain 1 in the external domain 1 video networking server s20 is established, it can be easily inferred that the audio and video of the conference initiator terminal 1 can be transmitted to the virtual terminal corresponding to the virtual terminal number of the external domain 2 in the external domain 2 video networking server s30 through the bridge server s301, and transmitted to the virtual terminal corresponding to the virtual terminal number of the external domain 3 in the external domain 3 video networking server s40 through the bridge server s 401.

After the audio and video of the terminal 1 of the conference initiator in the main domain is transmitted to the video networking server s20 of the external domain 1, the terminal 4 and the terminal 5 which need to be opened in the external domain 1 receive the audio and video of the conference initiator on the virtual terminal in the video networking server s20 of the external domain 1, so that the external domain 1 establishes a conference with the main domain, namely the establishment of a channel from the terminal 1 in the main domain to the virtual terminal in the video networking server s20 of the external domain 1 is completed, and the signaling sent by the client p10 can be forwarded to the video networking server of the external domain 1 by the bridge server s201 so as to control the audio and video in the video networking server s20 of the external domain 1. From the above, it can be easily inferred that the external domain 2 and the external domain 3 also establish a conference with the main domain, so that the conference of the main domain with the external domain 1, the external domain 2 and the external domain 3 can be completed simultaneously. After the video networking conference is started, when a newly added terminal exists in the main domain, for example, the terminal 3 is a newly added terminal, the user may send a second signaling to the terminal 3 through the client p10, where the second signaling is used to establish a channel between the terminal 3 and the main domain, where the channel sends out the audio/video terminal 1, and the terminal 3 parses the second signaling, where the second signaling includes: and sending out the address of the audio/video terminal 1 and the address of the terminal 3 in the main domain, wherein according to the second signaling, the terminal 3 receives the audio/video sent out by the audio/video terminal 1, so that the terminal 3 can also participate in the conference, and after establishing connection with the video networking server of the external domain where the terminal needs to be added into the conference, the terminal receives the audio/video of a conference initiator on the virtual terminal in the video networking server of the external domain where the terminal is located, as with the terminal which is added into the conference.

To sum up, the main domain, the external domain 1, the external domain 2, and the external domain 3 may be in a meeting at the same time, but after the meeting is opened, only the conference initiator may speak, that is, only the terminal 1 may speak, and when the terminal 2 needs to speak, other terminals of the main domain video network, the external domain 1, the external domain 2, and the external domain 3 cannot receive the speech of the terminal 2, so that a method for tuning streams during the meeting is needed, so that after the terminal 1 establishes the meeting, the terminal 2 or the terminal 3 may speak, and a terminal of the external domain may also speak, and thus, the method for tuning streams during the meeting opening of the video network in the embodiment of the present invention may specifically include the following steps, as shown in fig. 4:

step 201: and if the current speaker is in the first external domain and the original speaker is in the second external domain, the first external domain video networking server receives a third signaling sent by the client.

Referring to fig. 8, in the embodiment of the present invention, it is assumed that the original speaker is the terminal 6 of the external domain 2, and the terminal 5 of the external domain 1 needs to speak, and the external domain 1 video network server s20 receives a signaling sent by the client p10, where the signaling is sent by the user on the main domain terminal 1 and forwarded by the main domain video network server s10 and the bridge server s201, because the channel from the main domain to the external domain 1 is already established after the conference is started, the channel needs not to be established by signaling again.

Step 202: and the first external domain video network server sends the audio and video of the current speaker to the virtual terminal corresponding to the first external domain virtual terminal number according to the third signaling.

Referring to fig. 8, in the embodiment of the present invention, after receiving the signaling, the external domain 1 video network server s20 may send the audio/video of the speaker in the terminal 5 to the virtual terminal corresponding to the virtual terminal number of the external domain 1 in the external domain 1 video network server s20 according to the content of the signaling.

Optionally, referring to fig. 5, step 202 includes:

step 2021: parsing the third signaling, the third signaling comprising: the address of the current speaker terminal and the first external domain virtual terminal number.

Step 2022: and sending the audio and video of the current speaker terminal to a first bridging server according to the address of the current speaker terminal and the number of the first external domain virtual terminal, wherein the virtual terminal corresponding to the number of the first external domain virtual terminal is the same virtual terminal as the virtual terminal corresponding to the number of the first external domain virtual terminal in the first bridging server.

Referring to fig. 8, in the embodiment of the present invention, after receiving a signaling, an external domain 1 video networking server s20 parses the signaling, where the signaling includes an address of a current speaker terminal 5 and an external domain 1 virtual terminal number, and according to the content of the signaling, the external domain 1 video networking server s20 may send an audio/video of a speaker at the terminal 5 to a virtual terminal corresponding to the external domain 1 virtual terminal number in the external domain 1 video networking server s20, and at this time, another terminal of the external domain 1, for example, the terminal 4, may receive the audio/video of the speaker at the terminal 5 on the virtual terminal corresponding to the external domain 1 virtual terminal number.

Step 203: and the first bridging server forwards the audio/video of the current speaker to the main domain video network server.

Referring to fig. 8, in the embodiment of the present invention, the virtual terminal corresponding to the virtual terminal number of the external domain 1 in the bridge server s201 and the virtual terminal corresponding to the virtual terminal number of the external domain 1 in the external domain 1 video networking server s20 are the same virtual terminal, after the bridge server s201 performs an opposite-end operation, the audio and video of the terminal 5 may be forwarded to the bridge server s201, the virtual terminal corresponding to the virtual terminal number 1 of the main domain is the same virtual terminal as the virtual terminal corresponding to the virtual terminal number 1 of the main domain in the main domain video networking server s10, so that the bridge server s201 may forward the audio and video of the terminal 5 to the main domain video networking server s 10.

Step 204: and the main domain video network server receives the fourth signaling sent by the client.

Referring to fig. 8, in the embodiment of the present invention, the home domain video network server s10 receives signaling sent by the client p10, where the signaling includes: and a terminal address, a main domain virtual terminal number 2 and a main domain virtual terminal number 3 of the terminal 5 audio and video are required to be received in the main domain.

Step 205: and the main domain video network server sends the audio and video of the current speaker to a terminal in the main domain video network and a second bridging server according to the fourth signaling.

Referring to fig. 8, in the embodiment of the present invention, the home domain video network server s10, according to the terminal address of the terminal 5 that needs to receive the audio and video, the home domain virtual terminal number 2 and the home domain virtual terminal number 3, the audio and video of the terminal 5 can be sent to the address of the terminal in the main domain, which needs to receive the audio and video of the terminal 5, if the terminal 3 does not need to receive the audio and video of the terminal 5, the signaling does not include the address of the terminal 3, so that only the terminal 1 and the terminal 2 can receive the audio and video of the terminal 5, the audio and video of the terminal 5 is sent to the virtual terminal corresponding to the domain virtual terminal number 2, the virtual terminal corresponding to the domain virtual terminal number 3, the virtual terminal corresponding to the domain virtual terminal number 2, and the bridge server s301, the virtual terminal corresponding to the home domain virtual terminal number 2 is the same virtual terminal, so the audio and video of the terminal 5 is sent to the bridge server s301, and similarly, can be sent to the bridge server s 401.

Step 206: and the second bridging server forwards the audio and video of the current speaker to a second outside-domain video networking server.

Referring to fig. 8, in the embodiment of the present invention, after the bridge server s301 performs peer-to-peer operation, the audio and video of the terminal 5 may be forwarded to the bridge server s301, where the virtual terminal corresponding to the virtual terminal number of the external domain 2 is on the same virtual terminal as the virtual terminal corresponding to the virtual terminal number of the external domain 2 in the external domain 2 video network server s30, so that the bridge server s301 may forward the audio and video of the terminal 5 to the external domain 2 video network server s30, and similarly, the bridge server s401 may forward the audio and video of the terminal 5 to the external domain 3 video network server s 40.

Step 207: and the second outside-realm video networking server receives the fifth signaling sent by the client.

Referring to fig. 8, in the embodiment of the present invention, the external domain 2 video network server s30 receives a signaling sent by the client p10, where the signaling is sent by the user on the main domain terminal 1 and is forwarded by the main domain video network server s10 and the bridge server s301, and since the channel from the main domain to the external domain 2 is already established after the conference is started, the channel does not need to be established by signaling again.

Step 208: and the second outside-domain video network server sends the audio and video of the current speaker to a terminal in the second outside-domain video network according to the fifth signaling.

Referring to fig. 8, in the embodiment of the present invention, the external domain 2 video networking server s30 parses a signaling, where the signaling includes a terminal that needs to receive the audio and video of the terminal 5 in the external domain 2, and if the terminal 7 does not need to receive, the signaling does not include an address of the terminal 7, and at this time, only the terminal 6 receives the audio and video of the terminal 5, and the terminal 8 in the external domain 3 also receives the audio and video of a virtual terminal corresponding to the virtual terminal number of the external domain 3 in the external domain 3 video networking server s40, but the audio and video is changed from the original audio and video of the terminal 6 to the audio and video of the terminal 5.

The above case is a case where the original speaker is in one external domain and the current speaker is in the other external domain, but there are actually cases where the current speaker and the original speaker are both in the main domain, where the current speaker and the original speaker are both in the same external domain, where the current speaker is in the external domain, where the original speaker is in the main domain, where the current speaker is in the main domain, and where the original speaker is in the external domain, which will be described in detail below:

optionally, as shown in fig. 6, if the current speaker and the original speaker are both in the main domain, the method for regulating the flow includes the following steps:

step 301: and the main domain video network server receives a sixth signaling sent by the client.

Referring to fig. 8, in the embodiment of the present invention, if the original speaker is terminal 1, the current speaker is terminal 2, and a virtual terminal corresponding to the external domain virtual terminal number in terminal 2 and the main domain video network server s10 has no channel, so that when the terminal 2 speaker is switched, a channel needs to be established, and the main domain video network server s10 receives a signaling sent by the client p 10.

Step 302: and the main domain video network server respectively sends the audio and video of the current speaker to the virtual terminal corresponding to the main domain virtual terminal number for audio and video transmission with the first external domain video network server and the virtual terminal corresponding to the main domain virtual terminal number for audio and video transmission with the second external domain video network server according to the sixth signaling.

Referring to fig. 8, in the embodiment of the present invention, the main domain video network server s10 receives a signaling sent by the client p10, where the signaling includes an external domain 1 virtual terminal number and an external domain 2 virtual terminal number, and if the external domain 3 also requires a terminal 2 audio/video, the signaling may also include an external domain 3 virtual terminal number, and the main domain video network server s10 sends the terminal 2 audio/video to the external domain 1 virtual terminal number, the external domain 2 virtual terminal number, and the external domain 3 virtual terminal number.

Step 303: and the first bridging server forwards the audio/video of the current speaker to the first external domain video networking server.

Referring to fig. 8, in the embodiment of the present invention, a bridge server s201 facilitates peer-to-peer operation, and forwards an audio/video of a terminal 2 to an external domain 1 video network server s 20.

Step 304: and the second bridging server forwards the audio and video of the current speaker to a second outside-domain video networking server.

Referring to fig. 8, in the embodiment of the present invention, similarly, the bridge server s301 facilitates peer-to-peer operation and forwards the terminal 2 audio/video to the external domain 2 video network server s30, and in the same way, the bridge server s401 facilitates peer-to-peer operation and forwards the terminal 2 audio/video to the external domain 3 video network server s 40.

Step 305: and the first external domain video network server sends the audio and video of the current speaker to a terminal in the first external domain video network.

Referring to fig. 8, in the embodiment of the present invention, the external domain 1 video network server s20 sends the terminal 2 audio/video to the external domain 1, and the terminal 4 and the terminal 5 in the external domain 1 may receive the terminal 2 audio/video.

Step 306: and the second outside-domain video network server sends the audio and video of the current speaker to a terminal in the second outside-domain video network.

Referring to fig. 8, in the embodiment of the present invention, the external domain 2 video networking server s30 sends the terminal 2 audio and video to the terminal in the external domain 2, the terminal 6 and the forwarding 7 in the external domain 2 may receive the terminal 2 audio and video, similarly, the external domain 3 video networking server s40 sends the terminal 2 audio and video to the terminal in the external domain 3, and the terminal 8 in the external domain 3 may receive the terminal 2 audio and video.

If the original speaker and the current speaker are both in the external domain 1, the method for adjusting the stream is that the client p10 sends a signaling to the external domain 1 video network server s20, the audio and video of the current speaker is sent to the virtual terminal corresponding to the external domain 1 virtual terminal number, the current speaker audio and video is forwarded to the main domain video network server s10 through the bridge server s201, the main domain video network server s10 sends the current speaker audio and video to the main domain virtual terminal number 2 and the main domain virtual terminal number 3, the bridge server s301 performs an opposite-end operation, the current speaker audio and video is sent to the external domain 2 video network server s30, the bridge server s401 performs an opposite-end operation, the current speaker audio and video is sent to the external domain 3 video network server s40, and if the original speaker and the current speaker are both in the external domain 2 or the external domain 3, the same principle is adopted to realize switching of the speaker in the same external domain to.

Optionally, as shown in fig. 7, if the current speaker is in the first external domain and the original speaker is in the main domain, the method for adjusting the flow includes the following steps:

step 401: and the first external domain video networking server receives a seventh signaling sent by the client.

Referring to fig. 8, in the embodiment of the present invention, if the original speaker is terminal 1, the switching current speaker is terminal 5, and the external domain 1 video network server s20 receives a signaling sent by the client p10, where the signaling includes an address of terminal 5 and an external domain 1 virtual terminal number.

Step 402: and the first external domain video networking server sends the audio and video of the current speaker to the virtual terminal corresponding to the first external domain virtual terminal number according to the seventh signaling.

Referring to fig. 8, in the embodiment of the present invention, the external domain 1 video network server s20 sends, according to the signaling content, the terminal 5 audio and video to the virtual terminal corresponding to the virtual terminal number of the external domain 1, where the virtual terminal is the same terminal as the virtual terminal corresponding to the virtual terminal number of the external domain 1 in the bridge server s 201.

Step 403: and the first bridging server forwards the audio/video of the current speaker to the main domain video network server.

Referring to fig. 8, in the embodiment of the present invention, the bridge server s201 facilitates peer-to-peer operation, and sends the audio and video of the terminal 5 to the home domain internet of view server s 10.

Step 404: and the main domain video network server receives the eighth signaling sent by the client.

Referring to fig. 8, in the embodiment of the present invention, a home domain video network server s10 receives a signaling sent by a client p10, where the signaling includes a terminal address of a terminal that needs to receive an audio and a video of a terminal 5 in a home domain, a home domain virtual terminal number 2, and a home domain virtual terminal number 3.

Step 405: and the main domain video network server sends the audio and video of the current speaker to a terminal in the main domain video network and a virtual terminal corresponding to the main domain virtual terminal number and carrying out audio and video transmission with the second outside domain video network server according to the eighth signaling.

Referring to fig. 8, in the embodiment of the present invention, the home domain video network server s10 sends the audio and video of the terminal 5 to the terminals in the home domain video network according to the signaling content, where the virtual terminal corresponding to the home domain virtual terminal number 2, the virtual terminal corresponding to the home domain virtual terminal number 3, the virtual terminal corresponding to the home domain virtual terminal number 2, and the bridge server s301 are the same virtual terminal, and the virtual terminal corresponding to the home domain virtual terminal number 2, the virtual terminal corresponding to the home domain virtual terminal number 3, and the virtual terminal corresponding to the home domain virtual terminal number 3 in the bridge server s401 are the same virtual terminal.

Step 406: and the second bridging server forwards the audio and video of the current speaker to a second outside-domain video networking server.

Referring to fig. 8, in the embodiment of the present invention, the bridge server s301 facilitates peer-to-peer operation, and forwards the terminal 5 audio/video to the external domain 2 video network server s30, and the bridge server s401 facilitates peer-to-peer operation, and forwards the terminal 5 audio/video to the external domain 3 video network server s 40.

If the original speaker ectodomain 1 and the current speaker are in the main domain, the method for adjusting the flow is that a client p10 sends a signal to a main domain video network server s10, the audio and video of the current speaker is sent to a virtual terminal corresponding to a main domain virtual terminal number 1, virtual terminals corresponding to a main domain virtual terminal number 2 and a main domain virtual terminal number 3, a bridge server s201 performs an opposite-end operation, the current speaker audio and video is forwarded to an ectodomain 1 video network server s20, the bridge server s301 performs an opposite-end operation, the current speaker audio and video is sent to an ectodomain 2 video network server s30, a bridge server s401 performs an opposite-end operation, the current speaker audio and video is sent to an ectodomain 3 video network server s40, the ectodomain 1 video network server s20 sends the current speaker audio and video to a terminal in the ectodomain 1, and the ectodomain 2 video network server s30 sends the current speaker audio and video to a terminal in the ectodomain 2, and the external domain 3 video network server s40 sends the current speaker audio and video to the terminal in the external domain 3, so that the switching of the speaker to open a meeting is realized.

For example 2, referring to fig. 8, the main, external 1, external 2 and external 3 domains are in the process of a conference, for example: the terminal 1 in the main domain is an original speaker, the terminal 2 needs to be switched to be the speaker, and the main domain video network server s10 receives a signaling sent by the client p10, wherein the signaling comprises: an external domain 1 virtual terminal number, an external domain 2 virtual terminal number, an external domain 3 virtual terminal number, a main domain video network server s10 sends a terminal 2 audio and video to the external domain 1 virtual terminal number, the external domain 2 virtual terminal number and the external domain 3 virtual terminal number, a bridge server s201 facilitates an opposite-end operation, forwards the terminal 2 audio and video to an external domain 1 video network server s20, a bridge server s301 facilitates an opposite-end operation, forwards the terminal 2 audio and video to an external domain 2 video network server s30, a bridge server s401 facilitates an opposite-end operation, forwards the terminal 2 audio and video to an external domain 3 video network server s40, the external domain 1 video network server s20 sends the terminal 2 audio and video to a terminal in the external domain 1, a terminal 4 and a terminal 5 in the external domain 1 can receive the terminal 2, the external domain 2 video network server s30 sends the terminal 2 audio and video to a terminal in the external domain 2, a terminal 6 and a terminal 7 in the external domain 2 can receive the terminal 2 audio and video, similarly, the ectodomain 3 video network server s40 sends the terminal 2 audio/video to the terminal in the ectodomain 3, and the terminal 8 in the ectodomain 3 can receive the terminal 2 audio/video, so that the stream regulation for switching the conference of the terminal 2 is completed, and the process of switching the speech from the terminal 1 to the speech of the terminal 2 is realized.

After a terminal 2 speaks, when a terminal 5 in an external domain 1 needs to be switched to speak, an external domain 1 video networking server s20 receives a signaling sent by a client p10, the signaling is forwarded to an external domain 1 video networking server s20 through a main domain video networking server s10 and a bridge server s201, the signaling comprises an address of the terminal 5 and an external domain 1 virtual terminal number, the external domain 1 video networking server s20 sends a terminal 5 audio/video to a virtual terminal corresponding to the external domain 1 virtual terminal number according to the content of the signaling, a terminal 4 in the external domain 1 receives a terminal 5 audio/video in a virtual terminal corresponding to the external domain 1 virtual terminal number, the virtual terminal and the virtual terminal corresponding to the external domain 1 virtual terminal number in the bridge server s201 are the same terminal, the bridge server s201 is favorable for opposite-end operation, the terminal 5 audio/video is sent to the main domain video networking server s10, and the main domain video networking server s10 receives the signaling sent by the client p10, the signaling comprises a terminal address which needs to receive the audio and video of the terminal 5 in a main domain, a main domain virtual terminal number 2 and a main domain virtual terminal number 3, wherein the main domain video network server s10 sends the audio and video of the terminal 5 to the terminal in the main domain video network according to the signaling content, the virtual terminal corresponding to the main domain virtual terminal number 2, the virtual terminal corresponding to the main domain virtual terminal number 3, the virtual terminal corresponding to the main domain virtual terminal number 2 in the bridge server s301, the virtual terminal corresponding to the main domain virtual terminal number 3 in the bridge server s401, the virtual terminal corresponding to the main domain virtual terminal number 3 is the same virtual terminal, the bridge server s301 is favorable for opposite-end operation, the audio and video of the terminal 5 are forwarded to an external domain 2 video network server s30, the bridge server s401 is favorable for opposite-end operation, and the audio and video of the terminal 5 are forwarded to the external domain 3 video network server s40, in this way, the switching of the traffic in the conference by terminal 5 is completed, and the process of switching the speech from terminal 2 to terminal 5 is realized.

After a terminal 5 speaks, when a terminal 6 in an external domain 2 needs to be switched to speak, an external domain 2 video network server s30 receives a signaling sent by a client p10, an external domain 2 video network server s30 receives the signaling and then can send the audio and video of a speaker of the terminal 6 to an external domain 2 video network server s30 according to the content of the signaling, a terminal 7 in the external domain 2 receives the audio and video of a terminal 6 in a virtual terminal corresponding to the virtual terminal number of the external domain 2, a virtual terminal corresponding to the virtual terminal number of the external domain 2 in a bridge server s301 is the same as the virtual terminal corresponding to the virtual terminal number of the external domain 2 in an external domain 2 video network server s30, and the bridge server s301 can forward the audio and video of the terminal 6 to the bridge server s301 after performing opposite-end operation, and forward the virtual terminal corresponding to a main domain virtual terminal number 2, and the virtual terminal corresponding to the main domain virtual terminal number 2 is the same virtual terminal as the virtual terminal corresponding to the main domain virtual terminal number 2 in the main domain video network server s10, so the bridge server s301 can forward the audio and video of the terminal 6 to the main domain video network server s10, the main domain video network server s10 receives the signaling sent by the client p10, the signaling comprises the terminal address of the audio and video of the terminal 6 required to be received in the main domain, the main domain virtual terminal number 1 and the main domain virtual terminal number 3, the main domain video network server s10 can send the audio and video of the terminal 6 to the terminal address of the audio and video of the terminal 6 required to be received in the main domain according to the terminal address of the audio and video of the terminal 6 required to be received in the main domain, if the terminal 3 does not need to receive the audio and video of the terminal 6, the signaling does not comprise the address of the terminal 3, thus only the terminal 1 and the terminal 2 can receive the terminal 6, the audio and video of the terminal 6 are sent to the virtual terminal corresponding to the virtual terminal number 1 of the main domain, the virtual terminal corresponding to the virtual terminal number 3 of the main domain, the virtual terminal corresponding to the virtual terminal number 1 of the main domain and the virtual terminal corresponding to the virtual terminal number 1 of the main domain are the same virtual terminal through the bridge server s201, so the audio and video of the terminal 6 are sent to the bridge server s201, similarly, the audio and video of the terminal 6 can be sent to the bridge server s401, after the bridge server s201 performs the opposite-end operation, the audio and video of the terminal 6 can be transmitted to the bridge server s201, the virtual terminal corresponding to the virtual terminal number of the external domain 1 is the same virtual terminal as the virtual terminal corresponding to the virtual terminal number of the external domain 1 in the external domain 1 video networking server s20, so the bridge server s201 can transmit the audio and video of the terminal 6 to the external domain 1 video networking server s20, similarly, the bridge server s401 may forward the audio and video of the terminal 6 to the external domain 3 video networking server s40, the external domain 1 video networking server s20 receives the signaling sent by the client p10, the external domain 1 video networking server s20 analyzes the signaling, the signaling includes the terminal that needs to receive the audio and video of the terminal 6 in the external domain 1, if the terminal 7 does not need to receive the signaling, the terminal 7 does not include the address of the terminal 7, and the terminal 8 in the external domain 3 video networking server s40 still receives the audio and video of the virtual terminal corresponding to the external domain 3 virtual terminal number in the external domain 3 video networking server s40, but the audio and video is changed from the original terminal 5 audio and video to the terminal 6 audio and video, so that the stream switching opened by the terminal 6 is completed, and the process of switching from the terminal 5 to the speaking terminal 6 is realized.

It should be noted that the above-mentioned building process of multiple video networks for meeting and the number of terminals and terminals described in the process of switching between talkers during meeting are simple examples for better explaining the embodiments of the present invention, and in practical applications, there may be 65535 terminals in one video network.

It should be further noted that, in practical applications, the main domain, the external domain 1, the external domain 2, and the external domain 3 …, the external domain N is not fixed, the video networking servers of the domains are all provided with a bridge server to form a neural network structure, if the external domain 1 includes a client equipped with video networking conference control software, the external domain 1 may also be changed into the main domain through setting, and at this time, the original main domain is changed into the external domain 1, which is not specifically limited in the embodiment of the present invention.

Optionally, referring to a block diagram of a video networking conferencing device shown in fig. 9, the device comprises:

the first receiving and establishing module 310 is configured to receive a first signaling sent by a client by a home domain video networking server, where the first signaling is used to establish a channel from the home domain video networking server to a bridge server, and the channel is an audio/video transmission channel;

the forwarding module 320 is configured to forward, by the main domain video networking server, the audio and video of the terminal in the main domain to the bridge server according to the first signaling and the main domain virtual terminal number, where the main domain virtual terminal number is respectively registered in the main domain video networking server and the bridge server, and is used for audio and video transmission between the main domain video networking server and the external domain video networking server;

the opposite-end forwarding module 330 is used for the bridge server to perform opposite-end operation according to the main domain virtual terminal number and the external domain virtual terminal number, and forward the audio and video of the terminal in the main domain to the external domain video networking server, wherein the external domain virtual terminal number is respectively registered in the external domain video networking server and the bridge server and is used for audio and video transmission between the main domain video networking server and the external domain video networking server;

an area code registration module 340, configured to register, in a client equipped with video networking conference control software, an area code for identifying a main domain and an external domain;

a terminal registration module 350, configured to register in the bridge server, and configured to register a main domain virtual terminal number and an external domain virtual terminal number for audio and video transmission between the main domain video networking server and the external domain video networking server, and at the same time, register the main domain virtual terminal number in the main domain video networking server, and register the external domain virtual terminal number in the external domain video networking server;

a second receiving establishing module 360, configured to receive, by a newly added terminal, a second signaling sent by the client when the newly added terminal exists in the main domain, where the second signaling is used to establish a channel between the newly added terminal and an audio/video terminal in the main domain, where the channel is an audio/video transmission channel;

the parsing receiving module 370 is configured to parse a second signaling by the newly added terminal, and receive the audio and video of the terminal in the main domain according to the second signaling, where the second signaling includes: the address of the terminal in the home domain and the address of the newly joined terminal.

Through the embodiment, the client side provided with the video networking conference control software controls the audio and video transmission of the speaking party, so that a conference can be carried out among a plurality of video networking networks simultaneously, any terminal in any one video networking network can speak, and the speed and quality of the audio and video transmission are greatly improved compared with those of the existing Internet due to the characteristics of the video networking networks.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A method for adjusting stream when video network opens is characterized in that if a plurality of video networks exist, the plurality of video networks comprise: a main domain and an external domain, the external domain comprising: the method comprises the following steps that a main domain is connected with a first external domain through a first bridging server and is connected with a second external domain through a second bridging server, the main domain comprises a client side provided with video networking conference control software, the client side is connected with a main domain video networking server, and a speaker in the video networking conference speaks through a terminal in the video networking after the video networking conference is started up through the main domain and the external domain, and the method comprises the following steps:

2. The method of claim 1, wherein before the primary domain video networking server receives the first signaling, the method further comprises:

3. The method according to claim 1, wherein the home domain video networking server forwards the audio and video of the terminal in the home domain to the bridge server according to the first signaling and a home domain virtual terminal number, and the method comprises:

4. The method of claim 1, wherein the bridge server performs an opposite-end operation according to a main domain virtual terminal number and an external domain virtual terminal number, and forwards the audio/video of the terminal in the main domain to the external domain video networking server, and the method comprises the following steps:

5. The method of claim 1, wherein after the bridge server performs an opposite-end operation according to a main domain virtual terminal number and an external domain virtual terminal number, and forwards an audio/video of a terminal in the main domain to the external domain video networking server, the method further comprises:

6. The method of claim 1, wherein the sending, by the first external domain video networking server, the audio/video of the current speaker to the virtual terminal corresponding to the first external domain virtual terminal number according to the third signaling comprises:

7. The method of claim 1, wherein if the current speaker and the original speaker are both in the home domain, the method further comprises:

8. The method of claim 1, wherein if the current speaker is in the first external domain and the original speaker is in the main domain, the method further comprises:

9. A device for adjusting stream when video network opens, if there are multiple video networks, the multiple video networks include: a main domain and an external domain, the external domain comprising: the device comprises a first external domain and a second external domain, wherein a main domain is connected with the first external domain through a first bridge server and is connected with the second external domain through a second bridge server, the main domain comprises a client terminal provided with video networking conference control software, the client terminal is connected with a main domain video networking server, and a speaker in the video networking conference speaks through a terminal in the video networking after the video networking conference is started up by the main domain and the external domain, and the device comprises: