CN111131252B

CN111131252B - Monitoring and broadcasting method and device, electronic equipment and storage medium

Info

Publication number: CN111131252B
Application number: CN201911351503.2A
Authority: CN
Inventors: 王雷雷; 赵铎; 赵磊; 杨春晖
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-12-24
Filing date: 2019-12-24
Publication date: 2022-08-26
Anticipated expiration: 2039-12-24
Also published as: CN111131252A

Abstract

The invention provides a broadcast monitoring method, a broadcast monitoring device, electronic equipment and a storage medium. The method comprises the following steps: receiving a broadcast monitoring request sent by a client, and analyzing to obtain a broadcast monitoring terminal identifier and a target meeting participating terminal identifier; after the target participating terminal is determined to be positioned in the second video conference, acquiring a first virtual terminal number and a second virtual terminal number from the bridging server; adding the first virtual terminal number into the first video conference, and informing a second conference management server of adding a second virtual terminal number into a second video conference; informing a second conference management server to switch the audio and video stream of the target participant terminal to a second virtual terminal number, and switching the audio and video stream to the first virtual terminal number by a bridging server; and after the second conference management server is determined to be successfully switched, adding the audio/video stream of the first virtual terminal number into the monitoring terminal. The method and the device can monitor the conference terminal in the second video conference by the monitor terminal in the first video conference.

Description

Monitoring and broadcasting method and device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of data processing technologies, and in particular, to a monitoring method, an apparatus, an electronic device, and a storage medium.

Background

With the rapid development of network technologies, bidirectional communications such as video conferences and video teaching are widely popularized in the aspects of life, work, learning and the like of users. Video conferencing refers to a conference in which people at two or more locations have a face-to-face conversation via a communication device and a network. Video conferences can be divided into point-to-point conferences and multipoint conferences according to different numbers of participating places. In the video conference, a monitoring and broadcasting terminal can be set, and audio and video streams of other participant terminals are added into the monitoring and broadcasting terminal, so that the monitoring and broadcasting terminal can perform audio mixing and screen combination on the added audio and video streams to synthesize one or more paths of audio and video for output.

For some large video conferences, which may include different types of video conferences, such video conferences are referred to as converged meetings. For example, 16-bit video conference and 64-bit video conference belong to different types of video conference, and a converged conference may include 16-bit video conference and 64-bit video conference. Because different types of video conferences belong to different network environments in the converged conference, if a monitoring terminal is arranged in a certain type of video conference, the monitoring terminal can only monitor the participating terminals in the same type of video conference, but cannot monitor the participating terminals in the different types of video conferences.

Disclosure of Invention

In view of the above problems, embodiments of the present invention are proposed to provide a monitoring method, apparatus, electronic device and storage medium that overcome or at least partially solve the above problems.

In a first aspect, an embodiment of the present invention discloses a monitoring method, which is applied to a converged conference including a first video conference and a second video conference of different types, where the method is executed by a first conference management server in the first video conference, and the method includes: receiving a broadcast monitoring request sent by a client, and analyzing to obtain a broadcast monitoring terminal identifier and a target conference participating terminal identifier carried by the broadcast monitoring request; after determining that the target participating terminal corresponding to the target participating terminal identification is located in the second video conference, acquiring a first virtual terminal number and a second virtual terminal number from a bridging server; adding the first virtual terminal number to the first video conference, and informing a second conference management server in the second video conference to add the second virtual terminal number to the second video conference; the second conference management server is informed to switch the audio and video stream of the target conference participating terminal to the second virtual terminal number, so that the bridging server switches the audio and video stream to the first virtual terminal number after detecting that the audio and video stream exists in the second virtual terminal number; and after the second conference management server is determined to be successfully switched, adding the audio/video stream of the first virtual terminal number into the monitoring terminal corresponding to the monitoring terminal identification.

Optionally, the obtaining the first virtual terminal number and the second virtual terminal number from the bridge server includes: generating a virtual terminal number acquisition request carrying the identification of the bridge server, an operation code representing conference transparent transmission information and an operation code representing the virtual terminal number acquisition based on a video internet transparent transmission protocol, and transmitting the virtual terminal number acquisition request to the bridge server through a first video internet server; and receiving a virtual terminal number acquisition response returned by the bridge server and transmitted through the first video network server, wherein the virtual terminal number acquisition response carries the first virtual terminal number and the second virtual terminal number.

Optionally, the generating, based on the video networking transparent transmission protocol, a virtual terminal number obtaining request carrying the identifier of the bridge server, an operation code representing conference transparent transmission information, and an operation code representing a virtual terminal number obtaining operation code includes: taking the identifier of the bridge server as a first field, taking the operation code representing the conference transparent transmission information as a second field, and generating the request for obtaining the virtual terminal number by using the subsequent field of the operation code representing the virtual terminal number; and after the first field and the second field are analyzed, the video network server transparently transmits the request for acquiring the virtual terminal number to the bridge server.

Optionally, the first conference management server stores a conference participating terminal identifier corresponding to the second video conference; after the broadcast monitoring terminal identification and the target participant terminal identification carried by the broadcast monitoring request are obtained through analysis, the method further comprises the following steps: searching whether the target conference participating terminal identification exists in the conference participating terminal identification corresponding to the second video conference; and when the target participating terminal exists, determining that the target participating terminal corresponding to the target participating terminal identification is positioned in the second video conference.

Optionally, the notifying the second conference management server to add the second virtual terminal number to the second video conference includes: generating an conference entering instruction carrying the second virtual terminal number, and sending the conference entering instruction to the second conference management server through TCP connection; the conference joining instruction is used for instructing the second conference management server to add the second virtual terminal number to the second video conference.

Optionally, the notifying the second conference management server to switch the audio/video stream of the target participant terminal to the second virtual terminal number includes: generating a switching instruction carrying the target conference participating terminal identification and the second virtual terminal number, and sending the switching instruction to the second conference management server through TCP connection; and the switching instruction is used for indicating the second conference management server to switch the audio and video stream of the target conference participating terminal to the second virtual terminal number.

In a second aspect, an embodiment of the present invention discloses a monitoring device, which is applied to a converged conference including a first video conference and a second video conference of different types, and the monitoring device is applied to a first conference management server in the first video conference, and the monitoring device includes: the analysis module is used for receiving a broadcast monitoring request sent by a client and analyzing to obtain a broadcast monitoring terminal identifier and a target participant terminal identifier carried by the broadcast monitoring request; the acquisition module is used for acquiring a first virtual terminal number and a second virtual terminal number from the bridging server after determining that the target participating terminal corresponding to the target participating terminal identification is positioned in the second video conference; the adding module is used for adding the first virtual terminal number to the first video conference; a first notification module, configured to notify a second conference management server in the second video conference to add the second virtual terminal number to the second video conference; the second notification module is used for notifying the second conference management server to switch the audio and video stream of the target conference participating terminal to the second virtual terminal number, so that the bridging server switches the audio and video stream to the first virtual terminal number after detecting that the audio and video stream exists in the second virtual terminal number; and the monitoring and broadcasting module is used for adding the audio and video stream of the first virtual terminal number into the monitoring and broadcasting terminal corresponding to the monitoring and broadcasting terminal identification after the second conference management server is determined to be successfully switched.

Optionally, the obtaining module includes: a generating unit, configured to generate, based on a video internet transparent transmission protocol, a virtual terminal number acquisition request carrying an identifier of the bridge server, an operation code indicating conference transparent transmission information, and an operation code indicating an operation code for acquiring a virtual terminal number, and transmit the virtual terminal number acquisition request to the bridge server via a first video internet server; and the receiving unit is used for receiving a virtual terminal number acquisition response returned by the bridge server and transmitted through the first video network server, wherein the virtual terminal number acquisition response carries the first virtual terminal number and the second virtual terminal number.

Optionally, the generating unit is specifically configured to use the identifier of the bridge server as a first field, use the operation code representing the conference transparent transmission information as a second field, and generate the request for obtaining the virtual terminal number using the subsequent field of the operation code representing the virtual terminal number to be obtained; and after the first field and the second field are analyzed, the video network server transparently transmits the request for acquiring the virtual terminal number to the bridge server.

Optionally, the first conference management server stores a conference participating terminal identifier corresponding to the second video conference; the device further comprises: the searching module is used for searching whether the target conference participating terminal identification exists in the conference participating terminal identification corresponding to the second video conference; and the determining module is used for determining that the target participating terminal corresponding to the target participating terminal identification is positioned in the second video conference when the target participating terminal identification exists.

Optionally, the first notification module is specifically configured to generate a conference entry instruction carrying the second virtual terminal number, and send the conference entry instruction to the second conference management server through a TCP connection; the conference joining instruction is used for instructing the second conference management server to add the second virtual terminal number to the second video conference.

Optionally, the second notification module is specifically configured to generate a switching instruction carrying the target conference participating terminal identifier and the second virtual terminal number, and send the switching instruction to the second conference management server through a TCP connection; and the switching instruction is used for indicating the second conference management server to switch the audio and video stream of the target conference participating terminal to the second virtual terminal number.

In a third aspect, an embodiment of the present invention discloses an electronic device, including: one or more processors; and one or more machine-readable media having instructions stored thereon; the instructions, when executed by the one or more processors, cause the processors to perform the method of supervising as described in any of the above.

In a fourth aspect, an embodiment of the present invention discloses a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the monitoring method as described in any one of the above.

In the embodiment of the invention, in a convergence conference comprising different types of first video conferences and second video conferences, a first conference management server in the first video conference receives a monitoring request sent by a client, and analyzes the monitoring request to obtain a monitoring terminal identifier and a target participating terminal identifier carried by the monitoring request; after determining that the target participating terminal corresponding to the target participating terminal identification is located in the second video conference, acquiring a first virtual terminal number and a second virtual terminal number from a bridging server; adding the first virtual terminal number to the first video conference, and informing a second conference management server in the second video conference to add the second virtual terminal number to the second video conference; the second conference management server is informed to switch the audio and video stream of the target conference participating terminal to the second virtual terminal number, so that the bridging server switches the audio and video stream to the first virtual terminal number after detecting that the audio and video stream exists in the second virtual terminal number; and after the second conference management server is determined to be successfully switched, adding the audio/video stream of the first virtual terminal number into the monitoring terminal corresponding to the monitoring terminal identification. Therefore, in the embodiment of the present invention, the bridge server serves as a bridge between the first video conference and the second video conference, and may allocate virtual terminal numbers to the first video conference and the second video conference, where the conference management servers in the first video conference and the second video conference respectively add the virtual terminal numbers to their respective video conferences. And the bridging server switches the audio and video stream between the two virtual terminal numbers, so that the monitoring and broadcasting terminal in the first video conference monitors and broadcasts the participating terminal in the second video conference.

Drawings

Fig. 1 is a flowchart illustrating steps of a broadcast monitoring method according to a first embodiment of the present invention.

Fig. 2 is a flowchart illustrating steps of a broadcast monitoring method according to a second embodiment of the present invention.

Fig. 3 is a schematic diagram of device interaction in a third embodiment of the present invention.

Fig. 4 is a schematic diagram of a broadcast monitoring process according to a third embodiment of the present invention.

Fig. 5 is a block diagram of a monitoring device according to a fourth embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

The monitoring and broadcasting method in the embodiment of the invention can be applied to a convergence conference comprising different types of first video conferences and second video conferences, wherein the first video conference can be a main conference in the convergence conference, and the second video conference can be a branch conference in the convergence conference. Wherein, different types can refer to different device types and different network environment types. For example, the devices in the 16-bit video conference are developed based on 16 bits, the network environment is a 16-bit network environment, the devices in the 64-bit video conference are developed based on 64 bits, and the network environment is a 64-bit network environment, so that the 16-bit video conference and the 64-bit video conference belong to different types of video conferences.

The first video conference and the second video conference belong to two different network environments, so that the devices in the two video conferences are independent from each other. The first video conference may include a first conference management server, a first participant terminal, and the like. The second video conference may include a second conference management server, a second participant terminal, and the like. The first conference management server may be in communicative connection with the client. The client may be conference control software, such as pamir software on a PC (personal computer) side, APP (application program) on a mobile terminal, a Web side (Web side), and the like. The first conference management server and the second conference management server may pass through a bridge server therebetween. The bridge server can be understood as a bridge between the first video conference and the second video conference, and can switch the audio and video stream of the first video conference and the audio and video stream of the second video conference.

Several major roles in video conferencing are as follows:

a chairman: it can be understood that the video conference initiator and leader, and all participants will always receive the audio and video information of the chairman during the whole conference period.

The speaking party 1: the first speaker in the conference can be switched through the client, and all participants can receive the audio and video information of the speaker 1.

And the speaking party 2: the second speaker in the conference can be switched through the client, all participants can receive the audio information of the speaker 2, and cannot receive the video information.

The chairperson watching party: the chairman views the video of the chairman viewing party.

The common ginseng prescription: the screen of the chairman and the speaker 1 is displayed, and the voices of the chairman, the speaker 1 and the speaker 2 are heard.

The monitoring and broadcasting terminal: the method is also a role type of terminals in video networking conferences, and the main realized function is a sound mixing and screen combining function, namely, the multi-path input of the audio and the video of a plurality of participant terminals is combined into one path of audio and one path of video output, and the main screen division for monitoring and broadcasting comprises 4 paths, 9 paths, 13 paths, 64 paths and the like (several screen division can be understood as the maximum combination of several paths of audio and video).

Example one

Referring to fig. 1, a flowchart illustrating steps of a broadcast monitoring method according to a first embodiment of the present invention is shown. The monitoring and broadcasting method of the embodiment of the invention can be applied to a first conference management server in a first video conference.

The monitoring and broadcasting method of the embodiment of the invention can comprise the following steps:

step 101, receiving a broadcast monitoring request sent by a client, and analyzing to obtain a broadcast monitoring terminal identifier and a target participating terminal identifier carried by the broadcast monitoring request.

When a monitoring terminal in a first video conference needs to be set, and audio and video streams of a target participant terminal in a second video conference are added to the monitoring terminal in the first video conference, a user can set related parameters on a client. For example, the client may provide an input box, and the user may input the relevant parameters such as the monitoring terminal identifier and the target conference participating terminal identifier in the input box, or the client may provide a selection list, and the user may select the relevant parameters such as the monitoring terminal identifier and the target conference participating terminal identifier in the list. After the user sets the relevant parameters, the client is triggered to generate a monitoring request, the monitoring request carries relevant parameters such as monitoring terminal identification and target meeting participating terminal identification, and the client sends the monitoring request to the first meeting management server.

After receiving the monitoring request sent by the client, the first conference management server analyzes the monitoring request to obtain relevant parameters such as monitoring terminal identification and target participating terminal identification carried in the monitoring request.

And step 102, after the target participating terminal corresponding to the target participating terminal identification is determined to be located in the second video conference, acquiring a first virtual terminal number and a second virtual terminal number from a bridging server.

And the first conference management server determines whether the target participant terminal corresponding to the target participant terminal identification is positioned in the second video conference.

If the target participant terminal is located in the second video conference, the audio/video stream of the target participant terminal cannot be directly added into the monitoring terminal because the target participant terminal and the monitoring terminal are located in different types of video conferences. In this case, the first conference management server may obtain the first virtual terminal number and the second virtual terminal number from the bridge server by using a bridge function of the bridge server. The participating terminals all have corresponding terminal numbers, and the terminal numbers are used as the identifications of the participating terminals in the video conference. The bridge server allocates a first virtual terminal to the first video conference, the terminal number corresponding to the first virtual terminal is the first virtual terminal number, a second virtual terminal is allocated to the second video conference, and the terminal number corresponding to the second virtual terminal is the second virtual terminal number. The virtual terminal numbers can be used as identifications of the virtual terminals in the video conference, and each virtual terminal number can correspond to one path of audio and video stream channel.

If the target participant terminal is positioned in the first video conference, the target participant terminal and the monitoring terminal are positioned in the same video conference, so that the audio and video stream of the target participant terminal can be added into the monitoring terminal without adopting the method of the embodiment of the invention.

Step 103, adding the first virtual terminal number to the first video conference, and notifying a second conference management server in the second video conference to add the second virtual terminal number to the second video conference.

The bridging server allocates a first virtual terminal number to the first video conference and allocates a second virtual terminal number to the second video conference. And after the first conference management server acquires the first virtual terminal number and the second virtual terminal number, adding the first virtual terminal number into the first video conference, and informing a second conference management server in the second video conference to add the second virtual terminal number into the second video conference.

And 104, informing a second conference management server to switch the audio and video stream of the target conference terminal to the second virtual terminal number, so that the bridging server switches the audio and video stream to the first virtual terminal number after detecting that the audio and video stream exists in the second virtual terminal number.

And after the first virtual terminal number and the second virtual terminal number are both successfully added to the corresponding video conference. And the first conference management server informs the second conference management server of switching the audio and video stream of the target participant terminal to the second virtual terminal number.

The bridging server can automatically detect whether audio and video streams exist in the first virtual terminal number and the second virtual terminal number in real time. After the second conference management server successfully switches the audio and video stream of the target conference terminal to the second virtual terminal number, the bridge server can detect that the audio and video stream exists in the second virtual terminal number, so that the bridge server can switch the audio and video stream from the second virtual terminal number to the first virtual terminal number.

And 105, after determining that the second conference management server is successfully switched, adding the audio/video stream of the first virtual terminal number into the broadcast monitoring terminal corresponding to the broadcast monitoring terminal identifier.

The first conference management server determines whether the second conference management server is successfully switched. After the second conference management server is successfully switched, the first conference management server can know that the audio and video stream of the target conference participating terminal is switched to the first virtual terminal number. Therefore, the first conference management server adds the audio and video stream of the first virtual terminal number into the monitoring terminal corresponding to the monitoring terminal identification, and the audio and video stream of the target participant terminal can be added into the monitoring terminal.

In the embodiment of the invention, the bridging server is used as a bridge between the first video conference and the second video conference, virtual terminal numbers can be allocated to the first video conference and the second video conference, and the conference management servers in the first video conference and the second video conference respectively add the virtual terminal numbers into the respective video conferences. And the bridging server switches the audio and video stream between the two virtual terminal numbers, so that the monitoring and broadcasting terminal in the first video conference monitors and broadcasts the participating terminal in the second video conference.

Example two

The embodiment of the invention takes a fusion conference based on the video networking as an example for introduction. In the video network, the service is centrally controlled by the video network server. The conference management server can realize the communication function between the client and the video network server and realize the video conference function. The first video conference can comprise a first conference management server, a first video network server, a first participating terminal and the like. The second video conference can comprise a second conference management server, a second video network server, a second conference terminal and other devices.

Referring to fig. 2, a flowchart illustrating steps of a broadcast monitoring method according to a second embodiment of the present invention is shown. The monitoring and broadcasting method of the embodiment of the invention can be applied to a first conference management server in a first video conference.

step 201, receiving a broadcast monitoring request sent by a client, and analyzing to obtain a broadcast monitoring terminal identifier and a target participating terminal identifier carried by the broadcast monitoring request.

When a user wants to add the audio and video stream of the target conference participating terminal in the second video conference into the monitoring terminal in the first video conference, the monitoring terminal identifier and the target conference participating terminal identifier can be set on the client, and certainly, the first video conference identifier can also be set. After the user sets the relevant parameters, the client is triggered to generate a monitoring request, and the monitoring request carries the monitoring terminal identification and the target participating terminal identification and can also carry the relevant parameters such as the first video conference identification.

The client and the first conference management server interact with each other based on a TCP (Transmission Control Protocol). The client encapsulates the parameters set by the user into a monitoring request based on a TCP protocol, and sends the monitoring request to the first conference management server through a TCP connection. And the conference management server receives the monitoring request sent by the client, and analyzes the monitoring request to obtain a monitoring terminal identifier, a target conference participating terminal identifier, a first video conference identifier and the like carried by the monitoring request.

Step 202, searching whether the target participating terminal identification exists in the participating terminal identification corresponding to the second video conference.

And the first conference management server determines whether the target participating terminal corresponding to the target participating terminal identification is positioned in the second video conference.

In implementation, the first video conference is a main conference in the converged conference, and the second video conference is a sub-conference in the converged conference. After the convergence conference starts, all the conference terminal identifiers corresponding to the first video conference and all the conference terminal identifiers corresponding to the second video conference are stored in the first conference management server of the main conference. Therefore, after the first conference management server obtains the target participating terminal identification through analysis, whether the target participating terminal identification exists in the participating terminal identification corresponding to the second video conference stored by the first conference management server is searched.

Step 203, when the target participating terminal exists, determining that the target participating terminal corresponding to the target participating terminal identifier is located in the second video conference.

And if the first conference management server finds that the target conference terminal identification exists in the conference terminal identification corresponding to the second video conference stored by the first conference management server, the first conference management server can determine that the target conference terminal corresponding to the target conference terminal identification is positioned in the second video conference, and in this case, the subsequent steps can be continuously executed. If the target participating terminal identification does not exist in the participating terminal identification corresponding to the second video conference stored by the terminal identification search device, and the target participating terminal identification does not exist in the participating terminal identification corresponding to the first video conference stored by the terminal identification search device, the target participating terminal corresponding to the target participating terminal identification can be determined to be located in the first video conference.

And 204, after the target participating terminal corresponding to the target participating terminal identifier is determined to be located in the second video conference, acquiring a first virtual terminal number and a second virtual terminal number from a bridging server.

The process that the first conference management server acquires the first virtual terminal number and the second virtual terminal number from the bridge server may include: the first conference management server generates a virtual terminal number acquisition request carrying the identification of the bridge server, an operation code representing conference pass-through information and an operation code representing the virtual terminal number acquisition based on a video internet pass-through protocol, and the virtual terminal number acquisition request is passed through the first video internet server to the bridge server; and receiving a virtual terminal number acquisition response returned by the bridge server and transmitted through the first video network server, wherein the virtual terminal number acquisition response carries the first virtual terminal number and the second virtual terminal number.

In implementation, the first conference management server uses the identifier of the bridge server as a first field, uses the operation code representing the conference transparent transmission information as a second field, and uses the subsequent field representing the operation code of the virtual terminal number to be obtained, and of course, the subsequent field may also include the area code of the bridge server and the identifier of the first video conference, so as to generate the request for obtaining the virtual terminal number.

And the first conference management server sends a request for acquiring the virtual terminal number to the first video network server. After receiving the request for acquiring the virtual terminal number, the first video network server starts to analyze from the first field of the request for acquiring the virtual terminal number. And after the first field and the second field are analyzed, the identifier of the bridge server and the operation code representing the conference transparent transmission information are obtained. The request for acquiring the virtual terminal number needs to be transmitted transparently according to the operation code representing the conference transparent transmission information, and a corresponding bridge server in the video network can be found according to the identification of the bridge server (after the bridge server successfully logs in the video network server, the video network server stores the identification of the bridge server corresponding to the login information, and the video network server can find the specified bridge server through the identification of the bridge server). Therefore, after the first field and the second field are analyzed, the first video network server does not continue to analyze the subsequent fields, and can transparently transmit the request for acquiring the virtual terminal number to the bridge server corresponding to the identifier of the bridge server.

The bridge server receives the request for acquiring the virtual terminal number, analyzes the request, and can know that the terminal numbers are required to be allocated to the first video conference and the second video conference according to the operation code representing the acquired virtual terminal number, so that the bridge server allocates the matched first virtual terminal number for the first video conference and allocates the matched second virtual terminal number for the second video conference. And the bridging server generates a virtual terminal number acquisition response carrying the first virtual terminal number and the second virtual terminal number based on the video networking transparent transmission protocol.

In the implementation, the bridge server uses the identifier of the first conference management server as a first field, uses the operation code representing the conference transparent transmission information as a second field, and uses the operation code representing the virtual terminal number acquisition, the first virtual terminal number and the second virtual terminal number as subsequent fields, where of course the subsequent fields may also include the first video conference identifier and the acquisition indication information (the acquisition indication information is used to indicate whether the acquisition is successful), and generates a virtual terminal number acquisition response.

And the bridge server sends the response of acquiring the virtual terminal number to the first video network server. And after receiving the response of acquiring the virtual terminal number, the first video network server starts to analyze from the first field of the response of acquiring the virtual terminal number. And after the first field and the second field are analyzed, the identifier of the first conference management server and an operation code representing the conference transparent transmission information are obtained. And knowing that the response of the acquired virtual terminal number needs to be transparently transmitted according to the operation code representing the conference transparent transmission information, and finding the corresponding first conference management server in the video network according to the identification of the first conference management server. Therefore, after the first video network server analyzes the first field and the second field, the first video network server does not continue to analyze the subsequent fields, and can transmit the response of the obtained virtual terminal number to the first conference management server.

And after receiving the response of acquiring the virtual terminal number, the first conference management server analyzes the response to acquire the first virtual terminal number and the second virtual terminal number.

Step 205, adding the first virtual terminal number to the first video conference, and notifying a second conference management server in the second video conference to add the second virtual terminal number to the second video conference.

The first conference management server adds the first virtual terminal number to the first video conference.

In the implementation, the first conference management server generates a first adding request carrying a first virtual terminal number based on the video networking protocol, and of course, the first adding request may also carry a first video conference identifier, and sends the first adding request to the first video networking server. And after receiving the first adding request, the first video networking server adds the first virtual terminal number to the first video conference corresponding to the first video conference identifier. And if the adding is successful, setting the first adding indication information as success, if the adding is failed, setting the first adding indication information as failure, and the first video network server replies a first adding response carrying the first adding indication information to the first conference management server. And the first conference management server receives the first adding response and analyzes the first adding response to obtain first adding indication information. And if the first adding indication information is successful, determining that the first virtual terminal number is successfully added into the first video conference. And if the first adding indication information is failed, determining that the first virtual terminal number is not successfully added into the first video conference, finishing the binding process, and returning a failure response to the client.

And the first conference management server also informs a second conference management server of adding the second virtual terminal number to the second video conference. In an implementation, the first conference management server and the second conference management server may interact based on a TCP connection. Therefore, the first conference management server may generate a conference entering instruction carrying the second virtual terminal number based on the TCP protocol, and send the conference entering instruction to the second conference management server through the TCP connection. The conference joining instruction is used for instructing the second conference management server to add the second virtual terminal number to the second video conference.

And after receiving the conference entering instruction, the second conference management server adds the second virtual terminal number to the second video conference.

In implementation, the second conference management server generates a second addition request carrying a second virtual terminal number based on the video networking protocol, and of course, the second addition request may also carry a second video conference identifier, and sends the second addition request to the second video networking server. And after receiving the second adding request, the second video networking server adds the second virtual terminal number to a second video conference corresponding to the second video conference identifier. And if the adding is successful, setting the second adding indication information as success, if the adding is failed, setting the second adding indication information as failure, and replying a second adding response carrying the second adding indication information to the second conference management server by the second video network server. And the second conference management server receives the second adding response and analyzes the second adding response to obtain second adding indication information. And if the second adding indication information is successful, determining that the second virtual terminal number is successfully added to the second video conference. And if the second adding indication information is failed, determining that the second virtual terminal number is not successfully added to the second video conference.

The second conference management server also notifies the first conference management server whether the second virtual terminal number is successfully added to the second video conference. In implementation, if it is determined that the second virtual terminal number is successfully added to the second video conference, the second conference management server sets the conference joining indication information as successful conference joining, and if it is determined that the second virtual terminal number is not successfully added to the second video conference, the second conference management server sets the conference joining indication information as failed conference joining. The second conference management server may generate a conference entry response carrying the conference entry indication information based on the TCP protocol, and send the conference entry response to the first conference management server through the TCP connection. The first conference management server can know whether the second virtual terminal number is successfully added to the second video conference or not according to the conference entering indication information. And if the conference entering indication information is that the conference entering is successful, determining that the second virtual terminal number is successfully added into the second video conference. And if the conference entering indication information is that the conference entering fails, determining that the second virtual terminal number is unsuccessfully added into the second video conference, ending the binding process, and returning a failure response to the client.

Step 206, notifying the second conference management server to switch the audio/video stream of the target conference terminal to the second virtual terminal number, so that the bridging server switches the audio/video stream to the first virtual terminal number after detecting that the audio/video stream exists at the second virtual terminal number.

And if the first conference management server determines that the first virtual terminal number is not successfully added to the first video conference and the second virtual terminal number is not successfully added to the second video conference, the first conference management server can inform the second conference management server of switching the audio and video stream of the target participant terminal to the second virtual terminal number.

In implementation, the first conference management server may generate a switching instruction carrying the target participating terminal identifier and the second virtual terminal number based on a TCP protocol, and send the switching instruction to the second conference management server through a TCP connection. And the switching instruction is used for indicating the second conference management server to switch the audio and video stream of the target participant terminal to the second virtual terminal number.

And after receiving the switching instruction, the second conference management server finds the target participating terminal according to the target participating terminal identifier, acquires the audio and video stream of the target participating terminal, switches the audio and video stream of the target participating terminal to a second virtual terminal number, and after the switching is successful, the audio and video stream of the target participating terminal exists in a channel corresponding to the second virtual terminal number.

The second conference management server also notifies the first conference management server whether the switching is successful. In the implementation, if the second conference management server successfully switches the audio/video stream of the target conference participating terminal to the second virtual terminal number, the switching indication information is set as successful switching, and if the audio/video stream of the target conference participating terminal is not successfully switched to the second virtual terminal number, the switching indication information is set as failed switching. The second conference management server may generate a switching response carrying the switching indication information based on the TCP protocol, and send the switching response to the first conference management server through the TCP connection. The first conference management server can know whether the second conference management server is successfully switched or not according to the switching indication information. And if the switching indication information is successful, determining that the audio and video stream of the target participating terminal is successfully switched to the second virtual terminal number. And if the switching indication information is switching failure, determining that the audio and video stream of the target participant terminal is not successfully switched to the second virtual terminal number, finishing the binding process, and returning a failure response to the client.

After the second conference management server successfully switches the audio and video stream of the target conference terminal to the second virtual terminal number, the bridge server can detect that the audio and video stream exists in the second virtual terminal number, so that the bridge server can switch the audio and video stream from the second virtual terminal number to the first virtual terminal number.

And step 207, after determining that the second conference management server is successfully switched, adding the audio/video stream of the first virtual terminal number into the broadcast monitoring terminal corresponding to the broadcast monitoring terminal identifier.

After the first conference management server determines that the second conference management server is successfully switched, the first conference management server can know that the audio and video stream of the target participant terminal is switched to the first virtual terminal number. Therefore, the first conference management server adds the audio and video stream of the first virtual terminal number into the monitoring terminal corresponding to the monitoring terminal identifier, and the audio and video stream of the target participant terminal can be added into the monitoring terminal.

The embodiment of the invention can realize that the monitoring terminal in the first video conference can monitor the participant terminal in the second video conference.

EXAMPLE III

In video conferencing based on video networking, there are two architectures, one designed based on a 16-bit system and the other designed based on a 64-bit system. The 16-bit system is a video conference system of the video network which appears first, but with the development of the video network, especially with the increase of point number, the original 16-bit system can not meet the actual demand (in the 16-bit system, the unique identification of the terminal in the video network, that is, the terminal number is int type, that is, the terminal supports 65535 at most), so that a 64-bit system appears further (the terminal number in the 64-bit system is a 20-bit number consisting of 5 int). The video conference of 16 bit system and the video conference of 64 bit system, the corresponding conference management server, the video network server and the terminal are all in respective video network environment. In the video conference, a converged conference including 2 sets of video conferences in a video networking environment, namely a 16-bit video conference and a 64-bit video conference, often occurs, so that the participating terminals have both a 16-bit system and a 64-bit system. However, the two video conferences belong to different video networking environments, so that the conference participating terminal in one video conference cannot be added into the monitoring terminal in the other video conference, and the functions of mixing sound and combining screens cannot be realized. The embodiment of the invention realizes the interconnection and intercommunication between two different types of video conferences in a fusion conference.

The embodiment of the invention can add the audio and video stream of the participant terminal in the 16-bit video conference into the monitoring terminal in the 64-bit video conference. In this case, the 64-bit video conference serves as a first video conference, the 64-bit conference management server serves as a first conference management server, the 64-bit video network server serves as a first video network server, the 16-bit video conference serves as a second video conference, the 16-bit conference management server serves as a second conference management server, and the 16-bit video network server serves as a second video network server. Or adding the audio and video stream of the participant terminal in the 64-bit video conference into the monitoring terminal in the 16-bit video conference, wherein in this case, the 16-bit video conference is used as a first video conference, the 16-bit conference management server is used as a first conference management server, the 16-bit video networking server is used as a first video networking server, the 64-bit video conference is used as a second video conference, the 64-bit conference management server is used as a second conference management server, and the 64-bit video networking server is used as a second video networking server. The process of adding the audio and video stream of the participant terminal in the 16-bit video conference into the monitoring terminal in the 64-bit video conference is basically the same as the process of adding the audio and video stream of the participant terminal in the 64-bit video conference into the monitoring terminal in the 16-bit video conference. In the embodiment of the present invention, a process of adding audio and video streams of a participant terminal in a 16-bit video conference to a monitoring terminal in a 64-bit video conference is described as an example.

Fig. 3 is a schematic diagram of device interaction according to a third embodiment of the present invention. As shown in fig. 3, the client performs bidirectional interaction with the 64-bit conference management server, the 64-bit conference management server performs bidirectional interaction with the 64-bit video network server, the 16-bit conference management server performs bidirectional interaction with the 16-bit video network server, and the 64-bit conference management server performs bidirectional interaction with the 16-bit conference management server based on TCP connection. Of course, both the 64-bit and 16-bit video network servers may interact bi-directionally with the bridge server, not shown in FIG. 5.

Fig. 4 is a schematic diagram of a broadcast monitoring process according to a third embodiment of the present invention. The monitoring process of the embodiment of the invention can comprise the following steps:

1. the converged conference begins.

A 64-bit video conference is started while a 16-bit video conference is started. The 64-bit video conference is a main conference, the 16-bit video conference is a sub-conference, the main conference sends an instruction through TCP connection, and the sub-conference receives the instruction to perform corresponding operation.

2. The participant terminal a in the 16-bit video conference to the supervisor terminal b in the 64-bit video conference are set.

And the user sets the monitoring terminal as b and the target participating terminal as a through the client, and triggers the client to generate a monitoring request. And the 64-bit conference management server receives a broadcast monitoring request sent by the client, wherein the broadcast monitoring terminal is carried as b, and the target conference participating terminal is carried as a.

3. A data check is requested.

And the 64-bit conference management server judges whether the a is a participant terminal in the 16-bit video conference. After the convergence conference is started successfully, the 64-bit conference management server stores the information of all the participating terminals in the main conference and the branch conference, and judges whether a is a 16-bit terminal according to the information. If yes, executing the process 4; if not, the process is finished.

4. If a is a participant terminal in the 16-bit video conference, the virtual terminal number is acquired.

And the 64-bit conference management server generates a request for acquiring the virtual terminal number, sends the request for acquiring the virtual terminal number to the 64-bit video network server, and then transparently transmits the request for acquiring the virtual terminal number to the bridge server by the 64-bit video network server. The 64-bit video networking server is not shown in fig. 4.

For example, the internet of view transparent transmission protocol may be a 0x2102 protocol, and the format of the protocol corresponding to the virtual terminal number request is shown in table one:

get virtual terminal number request (conference management server → video network server → bridge server)

Watch 1

Wherein, 0x8405 is an operation code representing the conference transparent transmission information, the operation code representing the conference transparent transmission information is a type identifier of the signaling between the conference management server and the video network server, and when the video network server receives the signaling, the video network server does not analyze the signaling content and is only responsible for forwarding. 0x3061 is an operation code indicating that the virtual terminal number is acquired. area _ id identifies the area code of the bridge server, different area codes can be arranged under the same bridge server number, and the bridge server assigns the area code to obtain information. The meet _ id and the global _ meet _ id may be corresponding identifiers of the first video conference, and the conference identifier and the global conference identifier are used to uniquely determine one video conference.

After receiving the request for acquiring the virtual terminal number, the bridge server allocates a 64-bit virtual terminal number for the 64-bit video conference and allocates a 16-bit virtual terminal number for the 16-bit video conference. The bridge server generates a response of acquiring the virtual terminal number, sends the response of acquiring the virtual terminal number to the 64-bit video network server, and the 64-bit video network server transmits the response of acquiring the virtual terminal number to the 64-bit conference management server.

For example, the video networking transparent transmission protocol may be a 0x2102 protocol, and the format of the protocol corresponding to the virtual terminal number response is shown in table two:

get virtual terminal number response (bridge server → conference management service)

Watch two

5. A 64-bit virtual terminal number a _64 and a 16-bit virtual terminal number a _16 are received.

The 64-bit conference management service analyzes the virtual terminal number acquiring response returned by the bridge server, and the 64-bit virtual terminal number a _64 and the 16-bit virtual terminal number a _16 can be acquired by analyzing the virtual terminal number acquiring response.

6. and a _64 joins the 64-bit video conference and sends an a _16 conference joining instruction.

The 64-bit conference management server adds a 64-bit virtual terminal number a _64 to the current 64-bit video conference. The 64-bit conference management server also transmits an a _16 conference instruction for instructing to add a 16-bit virtual terminal number a _16 to the 16-bit video conference to the 16-bit conference management server.

In an implementation, the format of the a _16 conference instruction may be represented as follows:

requesting:

Cmd:kDistributorCmdAddDev＝33

data:

7. it is determined whether the a _64 join 64-bit videoconference was successful.

The 64-bit conference management server determines whether a _64 successfully joined the 64-bit video conference. If yes, waiting for the 16-bit conference management server to reply the conference joining response; if not, the process is finished.

8. a _16 joins the 16-bit video conference.

And after receiving the a _16 conference entering instruction, the 16-bit conference management server adds the 16-bit virtual terminal number a _16 to the 16-bit video conference.

9. It is determined whether a _16 joining the 16-bit videoconference was successful.

The 16-bit conference management server determines whether a _16 is successfully joined to the 16-bit video conference and replies a conference-in response to the 64-bit conference management server.

In an implementation, the format of the conferenced response may be represented as follows:

and (3) recovering:

Cmd:kDistributorCmdAddDevAck＝34

data:

10. and sending a switching instruction.

And when the a _64 and the a _16 are successfully added into respective video conferences, the 64-bit conference management server sends a switching instruction for instructing the 16-bit conference management server to switch the audio and video stream of the terminal a to the 16-bit virtual terminal number a _16 to the 16-bit conference management server.

In the implementation, a TCP socket mode is adopted between the 64-bit conference management server and the 16-bit conference management server for data transmission. The data format of the switch instruction is as follows:

switching instruction (64 bit conference management server → 16 bit conference management server)

The Socket data format is as follows:

11. and receiving a switching instruction, and switching the audio and video stream of the terminal a to a _ 16.

And after receiving the switching instruction, the 16-bit conference management server analyzes the identifier of the terminal a and the 16-bit virtual terminal number a _16, and switches the audio and video stream of the terminal a to the 16-bit virtual terminal number a _ 16.

12. And determining whether the audio and video stream of the terminal a is successfully switched. The 16-bit conference management server determines whether the audio and video stream of the terminal a is successfully switched to a _ 16.

13. A handover response is replied. And the 16-bit conference management server replies a switching response to the 64-bit conference management server to inform the 64-bit conference management server whether the audio/video stream of the terminal a is successfully switched to a _ 16.

In an implementation, the data format of the handover response is as follows:

switching response (16-bit conference management server → 64-bit conference management server)

The Socket data format is as follows:

after the 16-bit conference management server successfully switches the audio and video stream of the terminal a to the 16-bit virtual terminal number a _16, the bridge server may detect that the audio and video stream exists in the 16-bit virtual terminal number a _16, so that the bridge server switches the audio and video stream from the 16-bit virtual terminal number a _16 to the 64-bit virtual terminal number a _ 64.

14. A handover response is received.

And the 64-bit conference management server receives the switching response returned by the 16-bit conference management server and determines whether the switching of the 16-bit conference management server is successful. If the handover is successful, process 15 is performed; if the handover fails, it is completed.

15. And (5) setting monitoring and broadcasting, and adding the audio and video stream of the 64-bit virtual terminal number a _64 into a monitoring and broadcasting terminal b.

And the 64-bit conference management server adds the audio and video stream of the a _64 into the monitoring terminal b, and at the moment, the audio and video stream of the terminal a can be displayed on the monitoring terminal b, so that the function from the 16-bit conference participation terminal to the 64-bit monitoring terminal is realized.

The above-mentioned a and a _16 all belong to 16-bit video network systems, a _64 and b all belong to 64-bit video network systems, the two sets of video network systems are mutually independent, and audio and video stream conversion is carried out through virtual terminal numbers a _16 and a _64 of bridge service.

Example four

The monitoring and broadcasting device is applied to a converged conference including different types of a first video conference and a second video conference, and the device is applied to a first conference management server in the first video conference.

Referring to fig. 5, a block diagram of a broadcast monitoring apparatus according to a fourth embodiment of the present invention is shown.

The monitoring and broadcasting device of the embodiment of the invention can comprise the following modules:

the analysis module 501 receives a broadcast monitoring request sent by a client, and analyzes the broadcast monitoring request to obtain a broadcast monitoring terminal identifier and a target participant terminal identifier carried by the broadcast monitoring request;

an obtaining module 502, configured to obtain a first virtual terminal number and a second virtual terminal number from a bridge server after determining that the target conference terminal corresponding to the target conference terminal identifier is located in the second video conference;

an adding module 503, configured to add the first virtual terminal number to the first video conference;

a first notification module 504, configured to notify a second conference management server in the second video conference to add the second virtual terminal number to the second video conference;

a second notification module 505, configured to notify the second conference management server to switch the audio/video stream of the target conference participating terminal to the second virtual terminal number, so that the bridge server switches the audio/video stream to the first virtual terminal number after detecting that the audio/video stream exists in the second virtual terminal number;

and the monitoring module 506 is configured to add the audio/video stream of the first virtual terminal number to the monitoring terminal corresponding to the monitoring terminal identifier after it is determined that the second conference management server is successfully switched.

Optionally, the obtaining module includes: a generating unit, configured to generate, based on a video internet transparent transmission protocol, a virtual terminal number acquisition request carrying an identifier of the bridge server, an operation code indicating conference transparent transmission information, and an operation code indicating an operation code for acquiring a virtual terminal number, and transmit the virtual terminal number acquisition request to the bridge server via a first video internet server; and the receiving unit is used for receiving a virtual terminal number acquisition response which is returned by the bridge server and is transmitted through the first video network server, wherein the virtual terminal number acquisition response carries the first virtual terminal number and the second virtual terminal number.

Optionally, the generating unit is specifically configured to use the identifier of the bridge server as a first field, use the operation code representing the conference pass-through information as a second field, and use the subsequent field of the operation code representing the virtual terminal number to generate the virtual terminal number obtaining request; and after the first field and the second field are analyzed, the video network server transparently transmits the request for acquiring the virtual terminal number to the bridge server.

In the embodiment of the invention, the bridging server is used as a bridge between the first video conference and the second video conference, virtual terminal numbers can be allocated to the first video conference and the second video conference, and the conference management servers in the first video conference and the second video conference respectively add the virtual terminal numbers into the respective video conferences. The bridging server switches the audio and video stream between the two virtual terminal numbers, so that the monitoring terminal in the first video conference can monitor the participant terminal in the second video conference.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

In an embodiment of the invention, an electronic device is also provided. The electronic device may include one or more processors and one or more machine-readable media having instructions, such as an application program, stored thereon. The instructions, when executed by the one or more processors, cause the processors to perform the above-described method of supervising.

In an embodiment of the present invention, there is also provided a non-transitory computer-readable storage medium having a computer program stored thereon, the program being executable by a processor of an electronic device to perform the above-mentioned monitoring method. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, in this document, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "include", "including" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or terminal device including a series of elements includes not only those elements but also other elements not explicitly listed or inherent to such process, method, article, or terminal device. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The foregoing detailed description is provided for a broadcast monitoring method, apparatus, electronic device and storage medium, and specific examples are applied herein to explain the principles and embodiments of the present invention, and the descriptions of the foregoing examples are only used to help understanding the method and its core ideas of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A monitoring method applied to a converged conference including a first video conference and a second video conference of different types, wherein the different types refer to different device types and different network environment types, the method being performed by a first conference management server in the first video conference, the method comprising:

receiving a broadcast monitoring request sent by a client, and analyzing to obtain a broadcast monitoring terminal identifier and a target conference participating terminal identifier carried by the broadcast monitoring request;

after determining that the target participating terminal corresponding to the target participating terminal identification is located in the second video conference, acquiring a first virtual terminal number and a second virtual terminal number from a bridging server;

adding the first virtual terminal number to the first video conference, and informing a second conference management server in the second video conference to add the second virtual terminal number to the second video conference;

the second conference management server is informed to switch the audio and video stream of the target conference participating terminal to the second virtual terminal number, so that the bridging server switches the audio and video stream to the first virtual terminal number after detecting that the audio and video stream exists in the second virtual terminal number;

and after the second conference management server is determined to be successfully switched, adding the audio/video stream of the first virtual terminal number into the monitoring terminal corresponding to the monitoring terminal identifier.

2. The method according to claim 1, wherein the obtaining the first virtual terminal number and the second virtual terminal number from the bridge server comprises:

generating a virtual terminal number acquisition request carrying the identification of the bridge server, an operation code representing conference transparent transmission information and an operation code representing the virtual terminal number acquisition based on a video internet transparent transmission protocol, and transmitting the virtual terminal number acquisition request to the bridge server through a first video internet server;

and receiving a virtual terminal number acquisition response returned by the bridge server and transmitted through the first video network server, wherein the virtual terminal number acquisition response carries the first virtual terminal number and the second virtual terminal number.

3. The method according to claim 2, wherein the generating a request for obtaining a virtual terminal number, which carries the identifier of the bridge server, the operation code representing the conference pass-through information, and the operation code representing the virtual terminal number, based on the video networking pass-through protocol comprises:

taking the identifier of the bridge server as a first field, taking the operation code representing the conference transparent transmission information as a second field, and generating the request for obtaining the virtual terminal number by using the subsequent field of the operation code representing the virtual terminal number;

and after the video network server analyzes the first field and the second field, the request for acquiring the virtual terminal number is transmitted to the bridge server.

4. The method according to claim 1, wherein the first conference management server stores therein a participant terminal identifier corresponding to the second video conference; after the broadcast monitoring terminal identification and the target participating terminal identification carried by the broadcast monitoring request are obtained through analysis, the method further comprises the following steps:

searching whether the target conference participating terminal identification exists in the conference participating terminal identification corresponding to the second video conference;

and when the target participating terminal exists, determining that the target participating terminal corresponding to the target participating terminal identification is positioned in the second video conference.

5. The method of claim 1, wherein the notifying the second conference management server to add the second virtual terminal number to the second video conference comprises:

generating an conference entering instruction carrying the second virtual terminal number, and sending the conference entering instruction to the second conference management server through TCP connection;

the conference joining instruction is used for instructing the second conference management server to add the second virtual terminal number to the second video conference.

6. The method according to claim 1, wherein the notifying the second conference management server to switch the audio/video stream of the target participant terminal to the second virtual terminal number includes:

generating a switching instruction carrying the target participating terminal identification and the second virtual terminal number, and sending the switching instruction to the second conference management server through TCP connection;

and the switching instruction is used for indicating the second conference management server to switch the audio and video stream of the target conference participating terminal to the second virtual terminal number.

7. A monitoring and broadcasting apparatus, applied to a converged conference including a first video conference and a second video conference of different types, wherein the different types refer to different device types and different network environment types, the apparatus being applied to a first conference management server in the first video conference, the apparatus comprising:

the analysis module is used for receiving a broadcast monitoring request sent by a client and analyzing to obtain a broadcast monitoring terminal identifier and a target participant terminal identifier carried by the broadcast monitoring request;

the acquisition module is used for acquiring a first virtual terminal number and a second virtual terminal number from the bridging server after determining that the target participating terminal corresponding to the target participating terminal identification is positioned in the second video conference;

the adding module is used for adding the first virtual terminal number to the first video conference;

a first notification module, configured to notify a second conference management server in the second video conference to add the second virtual terminal number to the second video conference;

the second notification module is used for notifying the second conference management server to switch the audio and video stream of the target conference participating terminal to the second virtual terminal number, so that the bridging server switches the audio and video stream to the first virtual terminal number after detecting that the audio and video stream exists in the second virtual terminal number;

and the monitoring and broadcasting module is used for adding the audio and video stream of the first virtual terminal number into the monitoring and broadcasting terminal corresponding to the monitoring and broadcasting terminal identification after the second conference management server is determined to be successfully switched.

8. The apparatus of claim 7, wherein the obtaining module comprises:

a generating unit, configured to generate, based on a video internet transparent transmission protocol, a virtual terminal number acquisition request carrying an identifier of the bridge server, an operation code indicating conference transparent transmission information, and an operation code indicating an operation code for acquiring a virtual terminal number, and transmit the virtual terminal number acquisition request to the bridge server via a first video internet server;

and the receiving unit is used for receiving a virtual terminal number acquisition response returned by the bridge server and transmitted through the first video network server, wherein the virtual terminal number acquisition response carries the first virtual terminal number and the second virtual terminal number.

9. An electronic device, comprising:

one or more processors; and

one or more machine-readable media having instructions stored thereon;

the instructions, when executed by the one or more processors, cause the processors to perform the method of any of claims 1 to 6.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method of supervising a broadcast according to any one of claims 1 to 6.