CN111131747A - Method and device for determining data channel state, electronic equipment and storage medium - Google Patents

Abstract

The application discloses a method, a device, electronic equipment and a storage medium for determining the state of a data channel, wherein the method is applied to a data channel detection system in communication connection with main control equipment, and the main control equipment is also in communication connection with a plurality of terminals; the method comprises the following steps: when detecting that a speaking terminal is switched in a video conference which is taken over currently, sending a first channel information acquisition signaling to the main control equipment so as to acquire first local channel information corresponding to the switched speaking terminal and second local channel information corresponding to a target terminal; sending a second channel information acquisition signaling to the master control equipment to acquire server channel information and conference member information corresponding to the target terminal; comparing the second local channel information with the server channel information and the conference member information respectively; and determining the state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

Description

Method and device for determining data channel state, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of data channel detection technologies, and in particular, to a method and an apparatus for determining a data channel status, an electronic device, and a storage medium.

Background

In the process of the video networking conference, after terminals speaking in the video networking conference are switched, some terminals cannot acquire audio and video data collected by the switched terminals, but at present, whether all participating members correctly receive video and audio services of a speaking party cannot be known, so that service recovery cannot be timely performed, and normal operation of the whole video networking conference cannot be guaranteed.

Disclosure of Invention

In view of the above, embodiments of the present application are proposed to provide a method, an apparatus, an electronic device and a storage medium for determining a data channel status, which overcome or at least partially solve the above problems.

In a first aspect, an embodiment of the present application provides a method for determining a data channel state, where the method is applied to a data channel detection system communicatively connected to a master control device, where the master control device is further communicatively connected to a plurality of terminals; the method comprises the following steps:

when detecting that a speaking terminal is switched in a currently taken-over video conference, sending a first channel information acquisition signaling to a main control device, wherein the main control device is used for responding to the first channel information acquisition signaling, acquiring first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and acquiring second local channel information corresponding to a target terminal from the target terminal participating in the video conference;

receiving the first local channel information and the second local channel information returned by the main control equipment, and sending a second channel information acquisition signaling to the main control equipment; the main control equipment is used for responding to the second channel information acquisition signaling and acquiring server channel information and conference member information corresponding to the target terminal from the main control equipment;

comparing the second local channel information with the server channel information and the conference member information respectively to obtain comparison results;

and determining the state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

In a second aspect, an embodiment of the present application provides another method for determining a data channel state, so as to implement the method on a master control device side, where the method is applied to a master control device in communication connection with a data channel detection system, and the master control device is further in communication connection with a plurality of terminals, respectively, where the method includes:

receiving a first channel information acquisition signaling sent by the data channel detection system, wherein the first channel information acquisition signaling is sent by the data channel detection system when detecting that a speaking terminal is switched in a video conference which is currently taken over;

responding to the first channel information acquisition signaling, acquiring first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and acquiring second local channel information corresponding to a target terminal from the target terminal participating in the video conference;

sending the first local channel information and the second local channel information to the data channel detection system, and receiving a second channel information acquisition signaling sent by the data channel detection system;

responding to the second channel information acquisition signaling, and acquiring server channel information and conference member information corresponding to the target terminal from the main control equipment;

and sending the server channel information and the conference member information to the data channel detection system, wherein the data channel detection system is used for comparing the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result, and determining the state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

In a third aspect, an embodiment of the present application provides an apparatus for determining a data channel state, so as to implement the method for determining a data channel state in the first aspect, where the apparatus is applied to a data channel detection system communicatively connected to a main control device, and the main control device is further communicatively connected to a plurality of terminals; the device comprises:

a first channel information obtaining signaling sending module, configured to send a first channel information obtaining signaling to the main control device when detecting that a speaking terminal is switched in a currently-taken video conference, where the main control device is configured to, in response to the first channel information obtaining signaling, obtain, from the switched speaking terminal, first local channel information corresponding to the switched speaking terminal, and obtain, from a target terminal participating in the video conference, second local channel information corresponding to the target terminal;

a local channel information obtaining module, configured to receive the first local channel information and the second local channel information returned by the master control device;

a second channel information acquisition signaling sending module, configured to send a second channel information acquisition signaling to the master control device; the main control equipment is used for responding to the second channel information acquisition signaling and acquiring server channel information and conference member information corresponding to the target terminal from the main control equipment;

the information comparison module is used for comparing the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result;

and a state determining module, configured to determine, according to the first local channel information and the comparison result, a state of a data channel used for data transmission between the target terminal and the switched speaking terminal.

In a fourth aspect, an embodiment of the present application provides another apparatus for determining a data channel state, so as to implement the method for determining a data channel state in the second aspect, where the apparatus is applied to a main control device in communication connection with a data channel detection system, and the main control device is further in communication connection with a plurality of terminals, respectively, and the apparatus includes:

a first channel information acquisition signaling receiving module, configured to receive a first channel information acquisition signaling sent by the data channel detection system, where the first channel information acquisition signaling is sent by the data channel detection system when it detects that a speaking terminal is switched in a currently-taken video conference;

a local channel information obtaining module, configured to, in response to the first channel information obtaining signaling, obtain, from a switched origination terminal, first local channel information corresponding to the switched origination terminal, and obtain, from a target terminal participating in the video conference, second local channel information corresponding to the target terminal;

a local channel information sending module, configured to send the first local channel information and the second local channel information to the data channel detection system, and receive a second channel information acquisition signaling sent by the data channel detection system;

a second channel information acquisition signaling response module, configured to respond to the second channel information acquisition signaling and acquire server channel information and conference member information corresponding to the target terminal from the master control device;

and the conference information sending module is used for sending the server channel information and the conference member information to the data channel detection system, the data channel detection system is used for comparing the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result, and determining the state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

In a fifth aspect, an embodiment of the present application provides an electronic device, including: one or more processors; and one or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the apparatus to perform the method of determining a data channel state of the first aspect or the second aspect.

In a fourth aspect, the present application provides a computer-readable storage medium storing a computer program for causing a processor to execute the method for determining a data channel status according to the first aspect or the second aspect.

The embodiment of the application has the following advantages:

in the embodiment of the application, when the speaking terminal is switched, first local channel information corresponding to the speaking terminal, and second local channel information, server channel information and conference member information corresponding to a target terminal participating in a video conference can be acquired, and the second local channel information is compared with the server channel information and the conference member information respectively to obtain a comparison result, so that the state of a data channel between the target terminal and the switched speaking terminal can be determined according to the comparison result and the first local channel information. Therefore, whether each target terminal participating in the video conference can receive the audio and video data of the switched speaking terminal or not can be determined according to the state of the data channel, so that a worker can repair the data channel with the abnormal state of the data channel in a targeted manner, and the normal operation of the video networking conference is maintained.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.

FIG. 1 is a networking schematic of a video network of the present application;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present application;

fig. 3 is a schematic diagram of a hardware architecture of an access switch of the present application;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present application;

FIG. 5 is a communication environment diagram of a method of determining a data channel status of the present application;

FIG. 6 is a flow chart of steps of a method of determining a data channel status of the present application;

FIG. 7 is a schematic diagram illustrating a conversion of conference member information in a method for determining a data channel status according to the present application;

FIG. 8 is a schematic overall flow chart of the method of determining the status of a data channel of the present application;

FIG. 9 is a flow chart of steps of another method of determining a data channel status of the present application;

FIG. 10 is a block diagram of an apparatus for determining the status of a data channel according to the present application;

FIG. 11 is a block diagram of another apparatus for determining the status of a data channel according to the present application.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present application, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved the traditional Ethernet (Ethernet) to face the potentially huge first video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server signaling is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present application can be mainly classified into 3 types: server, exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, code board, memory, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node server, access exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, coding board, memory, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the incoming data packet of the CPU module 304 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues and may include two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 308 is configured by the CPU module 304, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol gateway:

as shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MACSA of the ethernet coordination gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present application: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

Based on the characteristics of the video network, when the audio and video conference is carried out in the video network, operators in the video network can manage the audio and video conference. For example, during a conference, a speaker is switched, a chairman terminal is set, the conference is opened and closed, and the like. Because the audio and video conference is managed, the main control device and the sub-control device in the video networking can correspondingly change the transmission of the audio and video data along with the change of a speaker or the change of a chairman terminal in the conference process.

Therefore, in the process of the audio-video conference, after the speakers are switched, the participating terminals cannot correctly receive the audio-video data sent by the switched speakers. Based on this, the applicant proposes the technical idea of the embodiment of the present application: after switching speakers, local channel information on the participant terminals, local channel information on the speaker terminals, conference member information on the main control equipment and channel information on the main control equipment are respectively obtained, and the information is compared to determine whether the participant terminals can correctly receive audio and video data of the speaker terminals.

Specifically, a method for determining the data channel status of the present application is explained in detail by the following embodiments.

Referring to fig. 5, a communication environment diagram applied to a method for determining a data channel state according to an embodiment of the present application is shown, and as shown in fig. 5, the communication environment diagram includes a data channel detection system 501 and a 64-bit autonomous service system 502, the 64-bit autonomous service system 502 may include a main control device, a plurality of sub-control devices (sub-control device 1 to sub-control device n, respectively), and a plurality of terminals (terminal a to terminal n3, respectively), where the data channel detection system 501 is in communication connection with the main control device, and the main control device is in communication connection with the plurality of sub-control devices, that is, one sub-control device may connect to the plurality of terminals. In this way, the main control device can communicate with a plurality of terminals through the sub-control devices.

Specifically, the main control device is a core device of the entire 64-bit autonomous service system 502, and may have an internet port and a video network port, where the internet port may receive a service instruction (such as starting a conference, stopping a conference, and the like), and the main control device obtains the service instruction by analyzing an internet packet, and then sends the relevant service instruction to the video network through the video network port. And the sub-control equipment transmits and receives the service data in the video network. And a boundary router is connected between the main control device and the branch control device, and the boundary router can be used as the bridge connection of the main control device and the branch control device. The terminal may be a computer, a camera monitoring device, a video network terminal device, and the like, which is not limited herein.

The data channel detection system can operate at a computer end and can be in video networking service communication with the master control server, and in practice, a user can log in the data channel detection system to take over a video conference and detect the data channel.

Referring to fig. 6, a flowchart illustrating steps of a method for determining a data channel status according to an embodiment of the present application is shown, where the method may be applied to a data channel detection system communicatively connected to a master device. As shown in fig. 6, the method may specifically include the following steps:

step S601, when detecting that the speaking terminal is switched in the currently-hosted video conference, sending a first channel information acquisition signaling to the main control device.

The main control device is configured to, in response to the first channel information acquisition signaling, acquire, from the switched origination terminal, first local channel information corresponding to the switched origination terminal, and acquire, from a target terminal participating in the video conference, second local channel information corresponding to the target terminal.

In this embodiment of the application, the data channel detection system may perform a TCP (transmission control Protocol) communication connection with the master device, and specifically, may establish a TCP socket (web socket) communication connection between the data channel detection system and the master device. In practice, the video conference performed on the main control device may be taken over by the data channel detection system, and after the video conference is taken over by the data channel detection system, the data channel detection system may control the video conference, detect the state of the video conference, and the like.

Specifically, when the data channel detection system detects an operation of switching the talker terminal, it may be determined that the talker terminal is switched, and then a first channel information acquisition signaling may be generated, where the first channel information acquisition signaling may include a talker terminal identifier of the switched talker terminal and a target terminal identifier of a target terminal participating in the video conference. In practice, if there are more than 2 participating terminals of the video conference, there may be more than 1 participating terminal in addition to the currently speaking terminal, and in practice, the method described in the present application may be executed on more than 1 participating terminal, that is, channel detection may be performed on each participating terminal.

After the first channel information acquisition signaling is sent to the master control device, the master control device may determine the switched speaking terminal according to the speaking terminal identifier, determine the target terminal according to the target terminal identifier, determine the first sub-control device connected to the switched speaking terminal, and determine the second sub-control device connected to the target terminal, so that the first channel information acquisition signaling may be sent to the switched speaking terminal via the first sub-control device, and the first channel information acquisition signaling may be sent to the target terminal via the second sub-control device. And then, the first local channel information can be acquired from the switched speaking terminal, and the second local channel information can be acquired from the switched target terminal.

In this embodiment of the application, the first local channel information may refer to channel information of a channel for performing audio and video data transmission, which is recorded by the switched speaking terminal, and the second local channel information may refer to channel information of a channel for performing audio and video data transmission, which is recorded by the target terminal.

Optionally, the first local channel information may include first data sink information, first data source information, and a multicast address, and the second local channel information may include second data sink information, second data source information, and a multicast address. The data source information represents coding channel information of the terminal, each coding channel corresponds to a multicast address, the multicast address is a multicast address automatically distributed to each coding and decoding channel of the equipment by the main control equipment after successful access, and the multicast address is unique in the video network. The data sink information represents decoding channel information of the terminal, and the decoding channel is a channel for decoding received audio and video data, so that one decoding channel can also correspond to one multicast address so as to decode the audio and video data uploaded by the coding channel corresponding to the multicast address.

In the following, local channel information of the terminal is described by taking table 1-1 as an example:

70001 in Table 1-1 may be the terminal identification of the terminal. In table 1-1, the terminal of 70001 has 5 encoding channels and 8 decoding channels, and when 70001 transmits audio and video data, any two encoding channels can be adopted to encode audio and video respectively, and when receiving audio and video data, the audio and video data can be watched through any two decoding channels of 8 decoding channels. For example, video encoding may be performed through the encoding channel No. 0, audio encoding may be performed through the encoding channel No. 1, and video data may be viewed through the decoding channel No. 1, where each encoding channel corresponds to a multicast address, and the encoding channel No. 0 may correspond to the multicast address 10 and the encoding channel No. 1 may correspond to the multicast address 11. Assuming that the terminal 70001 is a speaking terminal currently, when viewing audio and video data, the decoding channel # 1 of the terminal 70001 corresponds to the multicast address 11 (viewing the video of the terminal), and the decoding channel # 0 may not correspond to any multicast address (i.e. it is not necessary to listen to the audio of the terminal).

TABLE 1-1

Taking table 1-2 as an example, local path information of the terminal is described, and 70002 in table 1-2 may be a terminal identifier of the terminal. In table 1-2, the 70002 terminal has 5 encoding channels and 8 decoding channels, and can perform video encoding through the encoding channel No. 0, and perform audio encoding through the encoding channel No. 1, so that the encoding channel No. 0 can correspond to the multicast address 15, and the encoding channel No. 1 corresponds to the multicast address 16. And the decoding channel No. 0 corresponds to a multicast address 10, the decoding channel No. 1 corresponds to a multicast address 11, because the multicast address 10 corresponds to the coding channel No. 0 of the terminal 70001, and the multicast address 11 corresponds to the coding channel No. 1 of the terminal 70001, the terminal 70002 can watch the audio data of the terminal 70001 through the decoding channel No. 0, and watch the video data of the terminal 70001 through the decoding channel No. 1.

Tables 1 to 2

Step S602, receiving the first local channel information and the second local channel information returned by the main control device, and sending a second channel information acquisition signaling to the main control device.

The main control device is configured to respond to the second channel information acquisition signaling and acquire server channel information and conference member information corresponding to the target terminal from the main control device.

After receiving the first local channel information and the second local channel information, the current local channel information of the switched speaking terminal and the local channel information of the target terminal can be determined. Because the video conference of the video network needs to be set and managed by the conference control platform on the main control device, after the speaking terminal is switched, the main control device needs to set the source terminal of the audio and video currently watched by other participating terminals as the switched speaking terminal, for example, when the speaking terminal is switched to 70001, the main control device sets the source terminal of the audio and video data currently watched by the terminal 70002 as 70001, so that the terminal 70002 can watch the audio and video of the terminal 70001.

Therefore, the communication state to the entire communication link from the origination terminal to the destination terminal after the handover cannot be determined only from the first local channel information and the second local channel information. In the embodiment of the application, after receiving the first local channel information and the second local channel information, the data channel detection system may generate a second channel information acquisition signaling, so as to acquire the server channel information and the conference member information corresponding to the target terminal. The server channel information can represent the channel state of audio and video data to be watched by a target terminal currently set by the main control equipment, and the conference member information can represent the current role state of the target terminal set by the main control equipment in the video conference.

In specific implementation, the second channel information acquisition signaling may include a local conference identifier, a global conference identifier, and a target terminal identifier of the video conference. The global conference identifier can uniquely identify the video conference in the full video network. The local conference identifier can identify the video conference in the autonomous video networking system, so that the main control device can determine the video conference of the application from a plurality of conferences controlled by the main control device according to the local conference identifier, and the main control device can return server channel information and conference member information which are recorded by the main control device and correspond to the target terminal to the data channel detection system in the determined video conference.

The server channel information may be information as shown in table 1-1 or table 1-2, among others.

The following describes the conference member information by taking tables 1 to 3 as examples:

70002 in table 1-3 is the terminal id of the terminal, the channel number refers to the decoding channel number of 70002, corresponding to the data sink information in table 1-1, the subscript of the watched member in the conference refers to the label of the source terminal of the currently watched audio/video data of 70002 in the video conference. For example, only the terminal 70001 and the terminal 70002 in the video conference, the subscript 0 may be set for the terminal of 70001 and the subscript 1 may be set for the terminal of 70002 in the video conference. The channel number of the watched member is the coded channel number of the watched terminal and corresponds to the data source information in 1-1. This table 1-3 indicates that the decoding channel number 0 of the terminal 70002 set by the main control device needs to view the audio encoded by the channel number 0 of the terminal with the subscript of 0, and the decoding channel number 1 needs to view the video encoded by the channel number 1 of the terminal with the subscript of 0.

Tables 1 to 3

It should be noted that the subscript in tables 1-3 is-1, which indicates that the channel does not watch audio-video data of any terminal.

Step S603, comparing the second local channel information with the server channel information and the conference member information, respectively, to obtain a comparison result.

In this embodiment of the application, since the second local channel information represents current data channel information recorded by the target terminal itself, and the server channel information and the conference member information represent information for setting a conference for the target terminal in the video conference by the main control device, a communication state of the entire communication link from the switched speaking terminal to the target terminal can be determined according to the three information.

Specifically, the three pieces of information may be compared with each other two by two to determine whether the source terminals of the audio and video data currently watched by the target terminal represented by the three pieces of information are all the same terminal.

Optionally, in an optional embodiment, the step S603 may specifically include the following steps:

step S31, obtaining the first multicast source address from the second local channel information, and obtaining the second multicast source address from the server channel information.

In practice, when the target terminal receives the audio/video data, the audio/video data may include a source address, where the source address represents an address where a source terminal of the audio/video data is located. In this embodiment of the present application, the source address may be carried in the second local channel information to serve as the first multicast source address, or may be carried in the server channel information to serve as the second multicast source address. In this way, the data channel detection system can resolve the first multicast source address from this information. Similarly, the second multicast source address may also be obtained from the server channel information.

The first multicast source address is 11, as shown in table 1-1, and 10 and 11, as shown in table 1-2. Where 10 is the multicast source address of the audio data and 11 is the multicast source address of the video data.

Step S32, obtaining the watched terminal identifier from the conference member information, and determining the third multicast source address corresponding to the watched terminal identifier.

In practice, the watched terminal id may refer to a subscript of the watched terminal in the video conference, as shown in tables 1 to 3, where the subscript of the watched member in the video conference is the watched terminal id. Because the conference member represents the role of the target terminal in the conference set by the conference control system on the main control device, after the identification of the watched terminal is obtained, the terminal corresponding to the identification of the watched terminal can be determined, and the multicast source address currently used by the terminal, namely the third multicast source address, is determined according to the channel number of the watched terminal.

For example, as shown in tables 1 to 3, if the watched member is a terminal with a subscript of 0 in the conference, the terminal 70001 corresponds to the terminal 70001, the coded channel numbers of the terminal 70001 are 0 and 1, it can be determined that the multicast source address corresponding to the coded channel number 0 is 10, the multicast source address corresponding to the coded channel number 1 is 11, and the third multicast source address is 10 and 11.

Alternatively, in practice, the conference member information may be converted into conference channel information in accordance with the format of the server channel information, as shown in fig. 7, which shows a comparison chart of converting the conference member information shown in tables 1 to 3 into the conference channel information shown in tables 1 to 4. As shown in fig. 7, the third multicast source address may be determined according to the converted conference channel information. In practice, recorded in the conference member information is information that one terminal watches audio and video data, which indicates the relation between watching and being watched between the target terminal and other terminals in the video conference. After the conference member information is converted, the conference member information can be converted into the conference channel information of the current audio and video data watched by the target terminal, and the multicast address of the watched terminal can be included in the conference channel information.

Step S33, comparing the first multicast source address with the second multicast source address and the third multicast source address, respectively, to obtain a comparison result.

In practice, comparing the first multicast source address with the second multicast source address and the third multicast source address respectively means: and carrying out consistency comparison on the first multicast source address and the second multicast source address, carrying out consistency comparison on the first multicast source address and the third multicast source address, and then obtaining a final comparison result according to two consistency comparison results.

Illustratively, taking the destination terminal as the 70002 terminal shown in table 1-2 as an example, the first multicast source addresses are 10 and 11, and the third multicast source addresses are 10 and 11 determined from the information shown in table 1-3; if the second multicast source addresses are also 10 and 11, the three multicast source addresses are consistent, and the comparison result can be determined to be consistent, so that the source terminal of the audio and video data watched by the 70002 arranged on the main control equipment and the source terminal of the audio and video data recorded by the 70002 are the same. If the second multicast source address is not 10 or 11, the first multicast source address and the third multicast source address, but the second multicast source address is inconsistent with the first multicast source address, the source terminal of the audio and video data watched by the 70002 and the source terminal of the audio and video data recorded by the 70002 are not the same.

Step S604, determining a state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

After the comparison result is obtained, whether the source terminal of the audio and video data watched by the target terminal arranged on the main control device and the source terminal of the audio and video data recorded by the target terminal are the same terminal can be determined according to the comparison result, and whether the source terminal of the audio and video data watched by the target terminal is the switched speech terminal can be determined according to the first local channel information. Further, the state of the complete communication link between the target terminal and the origination terminal after being switched can be comprehensively determined.

Specifically, when the comparison result represents that the source terminal of the audio and video data watched by the target terminal set on the main control device is the same terminal as the source terminal of the audio and video data recorded by the target terminal, and the same terminal and the switched speech terminal corresponding to the first local channel information are the same terminal, the state of the data channel can be determined to be normal, otherwise, the state of the data channel can be determined to be abnormal.

Correspondingly, since the comparison result may be obtained by comparing the first multicast source address with the second multicast source address and the third multicast source address, the step S604 may specifically include the following steps:

step S41, obtaining the local multicast source address from the first local channel information.

In practice, the local multicast source address refers to an address used by the switched speaking terminal to send audio/video data to other terminals currently in the video conference. Taking table 1-1 as an example, if the channel currently performing audio data encoding is channel No. 0 and the channel performing video encoding is channel No. 1, the local multicast source addresses are 10 and 11, that is, the terminal 70002 currently sends audio and video data through the multicast source addresses 10 and 11.

Step S42, when the comparison result indicates that the first multicast source address, the second multicast source address, and the third multicast source address are all the same multicast source address, and any one of the first multicast source address, the second multicast source address, and the third multicast source address is consistent with the local multicast source address, determining that the status of the data channel is normal.

In practice, when the first multicast source address, the second multicast source address, the third multicast source address and the local multicast source address are all the same multicast source address, it indicates that the source terminal of the audio and video data currently watched by the target terminal, the source terminal of the audio and video data currently watched by the target terminal set by the main control device, and the switched speaking terminal are all the same terminal. The communication link between the switched speaking terminal and the target terminal is smooth, so that the target terminal can be ensured to normally watch the audio and video data of the switched speaking terminal, and the state of the data channel is determined to be normal.

Step S43, when the comparison result is that the first multicast source address, the second multicast source address, and the third multicast source address are not the same multicast source address, determining that the status of the data channel is abnormal.

In practice, when the first multicast source address, the second multicast source address, the third multicast source address and the local multicast source address are not the same multicast source address, it indicates that the source terminal of the audio and video data currently watched by the target terminal, the source terminal of the audio and video data currently watched by the target terminal set by the main control device, and the switched speaking terminal are not the same terminal. Because the terminal is not the same terminal, the target terminal cannot be guaranteed to watch the audio and video data of the switched speaking terminal, and therefore the state of the data channel can be determined to be abnormal.

Accordingly, in order to prepare to locate the node with the abnormality when the data channel has the abnormality, in an alternative embodiment, in step S43, while determining that the state of the data channel is abnormal, the method may further include the following steps:

step S431, determining a target multicast source address inconsistent with the local multicast source address among the first multicast source address, the second multicast source address, and the third multicast source address.

Step S432, determining target information corresponding to the target multicast source address in the second local channel information, the server channel information, and the conference member information.

And the target multicast source address is an address which is inconsistent with the local multicast source address in the first multicast source address, the second multicast source address and the third multicast source address. If the first multicast source address is inconsistent with the local multicast source address, it indicates that the target terminal does not view the audio and video data of the switched speaking terminal, and if the second multicast source address or the third multicast source address is inconsistent with the local multicast source address, it may indicate that the master control device does not set the switched speaking terminal as the terminal to be viewed by the target terminal.

Specifically, the target information carrying the target multicast source address can be determined in a reverse direction in the second local channel information, the server channel information and the conference member information according to the target multicast source address, and the abnormal node can be located through the target information. The node may be a node for managing and setting audio and video data transmission in a video conference, for example, the master control device sets a role of a target terminal in the conference as one node, and the target terminal itself is a node.

In practice, if the target information is server channel information, it may indicate that a node in which an abnormality occurs is a master device, and a specific reason for the abnormality may be an error in setting the server channel information of the master device. If the target information is conference member information, it may also indicate that the node in which the abnormality occurs is the master control device, and the specific reason for the abnormality may be that the master control device sets an error to the role of the target terminal in the conference. If the target information is the second local channel information, it can indicate that an error occurs when the target terminal receives the audio/video data.

Step S433, based on the target information, generating channel abnormal information, and displaying the channel abnormal information.

In the embodiment of the application, when the target information is determined, the channel abnormal information including the target information can be generated, and the channel abnormal information is displayed. Therefore, the target information can be included in the channel abnormal information, so that the manager can conveniently look up the target information to locate the node with the abnormal channel, and the node with the abnormal channel can be quickly repaired.

In specific implementation, the channel abnormal information can be reported to the meeting management staff, specifically, the channel abnormal information can be sent to the main control device, and the main control device sends the channel abnormal information to the meeting management staff who is in meeting control, so that the abnormal information is conveniently checked and repaired.

According to the embodiment of the application, when the speaking terminal is switched, the first local channel information corresponding to the speaking terminal, the second local channel information corresponding to the target terminal participating in the video conference, the server channel information and the conference member information can be obtained, the second local channel information is compared with the server channel information and the conference member information respectively, and a comparison result is obtained, so that the state of a data channel between the target terminal and the switched speaking terminal can be determined according to the comparison result and the first local channel information. Therefore, whether each target terminal participating in the video conference normally receives the audio and video data of the switched speaking terminal can be determined according to the state of the data channel, and therefore workers can repair nodes with abnormal data channel states in a targeted manner, and the video networking conference can be maintained normally.

In combination with the above embodiment, in an optional example, before step S601, a step of taking over the video conference may further be included, specifically, the following steps are included:

step S01, sending an acquisition conference list data packet to the master control device, where the master control device is configured to acquire conference list information in response to the acquisition conference list data packet.

The conference list data packet is a data packet conforming to the video networking protocol, and the data packet may include, but is not limited to, the following information: operation codes (operation codes for acquiring a conference list), local conference identifiers and global conference identifiers. The local conference identifier and the global conference identifier may be referred to in the description of step S603.

The local conference identifier and the global conference identifier may represent an identifier of a video conference to be taken over by the data channel detection system, and the master control device may obtain conference list information of the video conference in response to the obtained conference list data packet, where the conference list information may include, but is not limited to, the following information: local conference identification, global conference identification, participant terminal information, conference state information (in conference, not in conference or conference ending), and response results.

Step S02, receiving the conference list information returned by the master control device, and generating a conference control right acquisition signaling based on the conference list information, where the conference control right acquisition signaling includes a conference identifier.

After receiving the meeting list information, the data channel detection system may further generate a signaling for obtaining the meeting control right according to the response result, and if the response result is a success result, the signaling for obtaining the meeting control right may be generated according to the success result. The conference control right signaling may include a conference identifier, which may be a local conference identifier or a global conference identifier.

Step S03, sending the conference control right acquisition signaling to the master control device, where the master control device is configured to determine, in response to the conference control right signaling, a video conference corresponding to the conference identifier, and generate a conference control result signaling based on the determined video conference.

Step S04, receiving the conference control result signaling sent by the master control device, and taking over the video conference based on the conference control result signaling.

In practice, the following information may be carried in the conference control result signaling: operation codes (for taking over video conferences), a local conference identification list, a global conference identification list, response results, a participant attribute list, a participant state list and the like. The above information may represent information that the data channel detection system can take over the video conference.

After the conference control result signaling is obtained, the data channel detection system can take over the video conference successfully, that is, the control right of the video conference is obtained, and then the video conference can be controlled, so that the data channel can be detected after the speaking terminal is switched.

Referring to fig. 8, a schematic overall flow chart of the method for determining the data channel state is shown, and in fig. 8, when the data channel detection system obtains the conference control right result, the video conference may be taken over. And then, detecting the data channel, wherein the acquired terminal channel information is the first channel information acquisition signaling, the terminal channel information is the first local channel information or the second local channel information, and the acquired terminal information on the server is the server channel information of the acquired terminal to acquire the information of the conference members. Furthermore, the acquired conference member information, the information of the server terminal on the server and the terminal channel information can be compared, so that channel detection is carried out, and the detection result is displayed on the interface.

Referring to fig. 9, a flowchart illustrating steps of another method for determining a data channel status according to the present application is shown, where a communication environment of the method may be as shown in fig. 5, the method may be applied to a master device communicatively connected to a data channel detection system, and the master device is further communicatively connected to a plurality of terminals, respectively, as shown in fig. 9, and specifically may include the following steps:

step S901, receiving a first channel information acquisition signaling sent by the data channel detection system.

And the first channel information acquisition signaling is sent by the data channel detection system when detecting that the speaking terminal is switched in the video conference which is currently taken over.

In this embodiment, the main control device may receive a first channel information acquisition signaling sent by the data channel detection system through the TCP socket. The first channel information acquisition signaling may include an originating terminal identifier of the switched originating terminal and a target terminal identifier of a target terminal participating in the video conference.

Step S902, in response to the first channel information acquisition signaling, acquiring, from the switched origination terminal, first local channel information corresponding to the switched origination terminal, and acquiring, from a target terminal participating in the video conference, second local channel information corresponding to the target terminal.

In this embodiment, the main control device may analyze the first channel information acquisition signaling, thereby acquiring the utterance terminal identifier and the target terminal identifier, and determining the utterance terminal and the target terminal after being switched, and further determining the first sub-control device connected to the utterance terminal after being switched, and the second sub-control device connected to the target terminal. And respectively sending the first channel information acquisition signaling to the switched speaking terminal through the first sub-control device, and sending the first channel information acquisition signaling to the target terminal through the second sub-control device.

In this way, the switched speaking terminal can return the first local channel information of the speaking terminal to the main control device through the first branch control device according to the first channel information acquisition signaling, and the target terminal can return the second local channel information of the speaking terminal to the main control device through the second branch control device according to the first channel information acquisition signaling.

Step S903, sending the first local channel information and the second local channel information to the data channel detection system, and receiving a second channel information acquisition signaling sent by the data channel detection system.

Step S904, in response to the second channel information acquisition signaling, acquires server channel information and conference member information corresponding to the target terminal from the main control device.

The second channel information acquisition signaling can include a local conference identifier, a global conference identifier and a target terminal identifier of the video conference, so that the main control device can analyze the second channel information acquisition signaling to determine the video conference corresponding to the local conference identifier and the global conference identifier, and return server channel information and conference member information which are recorded by the main control device and correspond to the target terminal to the data channel detection system.

Step S905, sending the server channel information and the conference member information to the data channel detection system.

The data channel detection system is configured to compare the second local channel information with the server channel information and the conference member information, respectively, to obtain a comparison result, and determine, according to the first local channel information and the comparison result, a state of a data channel used for data transmission between the target terminal and the switched speaking terminal.

The specific process of the data channel status for data transmission in this step may refer to the descriptions of step S603 and step S604, and is not described herein again.

In practice, before the step S901, the following steps may be specifically included:

step S01', receive the acquisition conference list data packet sent by the data channel detection system, and acquire conference list information in response to the acquisition conference list data packet.

The process of step S01' may be as described in step S01, and will not be repeated here.

Step S02', sending the conference list information to the data channel detection system, and receiving a conference control right acquisition signaling sent by the data channel detection system based on the conference list information, where the conference control right acquisition signaling includes a conference identifier.

The process of step S02' may be as described in step S02, and will not be repeated here.

Step S03', in response to the conference control right acquisition signaling, determining a video conference corresponding to the conference identifier, and generating a conference control result signaling based on the determined video conference.

The process of step S03' may be as described in step S03, and will not be repeated here.

Step S04', sending the conference control result signaling to the data channel detection system, where the data channel detection system is configured to take over the video conference based on the conference control result signaling.

The process of step S04' may be as described in step S04, and will not be repeated here.

In this embodiment of the application, when a speaking terminal is switched, the conference control device may obtain, according to a first channel information obtaining signaling and a second channel information obtaining signaling sent by the data channel detection system, first local channel information corresponding to the speaking terminal, and second local channel information, server channel information, and conference member information corresponding to a target terminal participating in a video conference, and send the information to the data channel detection system, so that the data channel detection system may determine, according to the information, a state of a data channel between the target terminal and the switched speaking terminal. Therefore, whether each target terminal participating in the video conference normally receives the audio and video data of the switched speaking terminal can be determined according to the state of the data channel, and therefore workers can repair nodes with abnormal data channel states in a targeted manner, and the video networking conference can be maintained normally.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the embodiments. Further, those skilled in the art will also appreciate that the embodiments described in the specification are presently preferred and that no particular act is required of the embodiments of the application.

Referring to fig. 10, a schematic diagram of a framework of an apparatus for determining a data channel status according to an embodiment of the present application is shown, where the apparatus may be applied to a data channel detection system communicatively connected to a master device, so that the data channel detection system may implement the above method for determining a data channel status, where the master device is further communicatively connected to a plurality of terminals; the device may specifically include the following modules:

a first channel information obtaining signaling sending module 1001, configured to send a first channel information obtaining signaling to the main control device when detecting that a talk spurt terminal is switched in a currently-taken video conference, where the main control device is configured to, in response to the first channel information obtaining signaling, obtain, from a switched talk spurt terminal, first local channel information corresponding to the switched talk spurt terminal, and obtain, from a target terminal participating in the video conference, second local channel information corresponding to the target terminal;

a local channel information obtaining module 1002, configured to receive the first local channel information and the second local channel information returned by the master device;

a second channel information acquisition signaling sending module 1003, configured to send a second channel information acquisition signaling to the master control device; the main control equipment is used for responding to the second channel information acquisition signaling and acquiring server channel information and conference member information corresponding to the target terminal from the main control equipment;

an information comparison module 1004, configured to compare the second local channel information with the server channel information and the conference member information, respectively, to obtain a comparison result;

a state determining module 1005, configured to determine, according to the first local channel information and the comparison result, a state of a data channel used for data transmission between the target terminal and the switched speaking terminal.

Optionally, the information comparing module 1006 may specifically include the following units:

a multicast source address obtaining unit, configured to obtain a first multicast source address from the second local channel information, and obtain a second multicast source address from the server channel information;

a multicast source address determining unit, configured to obtain a watched terminal identifier from the conference member information, and determine a third multicast source address corresponding to the watched terminal identifier;

and the address comparison unit is used for comparing the first multicast source address with the second multicast source address and the third multicast source address respectively to obtain a comparison result.

Optionally, the state determining module 1005 may specifically include the following units:

a local multicast source address obtaining unit, configured to obtain a local multicast source address from the first local channel information;

a normal state determining unit, configured to determine that the state of the data channel is normal when the comparison result indicates that the first multicast source address, the second multicast source address, and the third multicast source address are the same multicast source address, and any one of the first multicast source address, the second multicast source address, and the third multicast source address is consistent with the local multicast source address;

a status exception determining unit, configured to determine that the status of the data channel is an exception when the comparison result indicates that the first multicast source address, the second multicast source address, and the third multicast source address are not the same multicast source address.

Optionally, the apparatus may further specifically include the following modules:

a target multicast source address determining module, configured to determine, from the first multicast source address, the second multicast source address, and the third multicast source address, a target multicast source address that is inconsistent with the local multicast source address;

a target information determining module, configured to determine target information corresponding to the target multicast source address in the second local channel information, the server channel information, and the conference member information;

and the channel abnormal information generating module is used for generating channel abnormal information based on the target information and displaying the channel abnormal information.

Optionally, the apparatus may further specifically include the following modules:

the system comprises an acquisition conference list data packet sending module, a main control device and a conference list information acquiring module, wherein the acquisition conference list data packet sending module is used for sending an acquisition conference list data packet to the main control device, and the main control device is used for responding to the acquisition conference list data packet and acquiring conference list information;

the conference list information receiving module is used for receiving the conference list information returned by the main control equipment;

a conference control right signaling generation module, configured to generate a conference control right acquisition signaling based on the conference list information, where the conference control right acquisition signaling includes a conference identifier;

a conference control right signaling sending module, configured to send the conference control right obtaining signaling to the master control device, where the master control device is configured to determine, in response to the conference control right signaling, a video conference corresponding to the conference identifier, and generate a conference control result signaling based on the determined video conference;

and the conference taking-over module is used for receiving the conference control result signaling sent by the main control equipment and taking over the video conference based on the conference control result signaling.

Referring to fig. 11, a schematic diagram of another framework of an apparatus for determining a data channel state is shown, where the apparatus may be applied to a main control device in communication connection with a data channel detection system, so that the main control device may implement the method for determining a data channel state, where the main control device is further in communication connection with a plurality of terminals, and the apparatus may specifically include the following modules:

a first channel information obtaining signaling receiving module 1101, configured to receive a first channel information obtaining signaling sent by the data channel detection system, where the first channel information obtaining signaling is sent by the data channel detection system when it detects that a speaking terminal is switched in a currently-taken video conference;

a local channel information obtaining module 1102, configured to, in response to the first channel information obtaining signaling, obtain, from a switched origination terminal, first local channel information corresponding to the switched origination terminal, and obtain, from a target terminal participating in the video conference, second local channel information corresponding to the target terminal;

a local channel information sending module 1103, configured to send the first local channel information and the second local channel information to the data channel detection system, and receive a second channel information acquisition signaling sent by the data channel detection system;

a second channel information obtaining signaling response module 1104, configured to respond to the second channel information obtaining signaling, and obtain server channel information and conference member information corresponding to the target terminal from the main control device;

a conference information sending module 1105, configured to send the server channel information and the conference member information to the data channel detection system, where the data channel detection system is configured to compare the second local channel information with the server channel information and the conference member information, respectively, to obtain a comparison result, and determine, according to the first local channel information and the comparison result, a state of a data channel used for data transmission between the target terminal and the switched speaking terminal.

Optionally, the apparatus may further specifically include the following modules:

the acquisition conference list data packet response module is used for receiving an acquisition conference list data packet sent by the data channel detection system and responding to the acquisition conference list data packet to acquire conference list information;

a conference list information sending module, configured to send the conference list information to the data channel detection system, and receive a conference control right obtaining signaling sent by the data channel detection system based on the conference list information, where the conference control right obtaining signaling includes a conference identifier;

a conference control right acquisition signaling response module, configured to determine, in response to the conference control right acquisition signaling, a video conference corresponding to the conference identifier, and generate a conference control result signaling based on the determined video conference;

and the conference control result signaling sending module is used for sending the conference control result signaling to the data channel detection system, and the data channel detection system is used for taking over the video conference based on the conference control result signaling.

For the embodiment of the apparatus for determining the data channel status, since it is basically similar to the embodiment of the method for determining the data channel status, the description is simple, and for relevant points, refer to the partial description of the embodiment of the method for determining the data channel status.

An embodiment of the present application further provides an electronic device, including: one or more processors; and one or more machine readable media having signaling stored thereon that, when executed by the one or more processors, cause the apparatus to perform one or more methods of determining a data channel state as described in embodiments of the application.

Embodiments of the present application further provide a computer-readable storage medium storing a computer program for causing a processor to execute the method for determining a data channel status according to the embodiments of the present application.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one of skill in the art, embodiments of the present application may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program signaling. These computer program signals may be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing terminal device to produce a machine, such that the signals executed by the processor of the computer or other programmable data processing terminal device produce means for implementing the functions specified in the flow diagram flow or flows and/or block diagram block or blocks.

These computer program signals may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the signals stored in the computer-readable memory produce an article of manufacture including signaling means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program signals may also be loaded onto a computer or other programmable data processing terminal device to cause a series of operational steps to be performed on the computer or other programmable terminal device to produce a computer implemented process such that the signals that execute on the computer or other programmable terminal device provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the true scope of the embodiments of the application.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The method, the apparatus, the electronic device, and the storage medium for determining a data channel state provided by the present application are introduced in detail above, and a specific example is applied in the present application to explain the principle and the implementation of the present application, and the description of the above embodiment is only used to help understand the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (11)

1. A method for determining the state of a data channel is characterized in that the method is applied to a data channel detection system which is in communication connection with a main control device, and the main control device is also in communication connection with a plurality of terminals; the method comprises the following steps:

when detecting that a speaking terminal is switched in a currently taken-over video conference, sending a first channel information acquisition signaling to a main control device, wherein the main control device is used for responding to the first channel information acquisition signaling, acquiring first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and acquiring second local channel information corresponding to a target terminal from the target terminal participating in the video conference;

receiving the first local channel information and the second local channel information returned by the main control equipment, and sending a second channel information acquisition signaling to the main control equipment; the main control equipment is used for responding to the second channel information acquisition signaling and acquiring server channel information and conference member information corresponding to the target terminal from the main control equipment;

comparing the second local channel information with the server channel information and the conference member information respectively to obtain comparison results;

and determining the state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

2. The method of claim 1, comparing the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result, comprising:

acquiring a first multicast source address from the second local channel information, and acquiring a second multicast source address from the server channel information;

acquiring a watched terminal identifier from the conference member information, and determining a third multicast source address corresponding to the watched terminal identifier;

and comparing the first multicast source address with the second multicast source address and the third multicast source address respectively to obtain a comparison result.

3. The method according to claim 2, wherein determining, according to the first local channel information and the comparison result, a state of a data channel used for data transmission between the target terminal and the switched origination terminal includes:

acquiring a local multicast source address from the first local channel information;

when the comparison result indicates that the first multicast source address, the second multicast source address and the third multicast source address are the same multicast source address, and any one of the first multicast source address, the second multicast source address and the third multicast source address is consistent with the local multicast source address, determining that the state of the data channel is normal;

and when the comparison result indicates that the first multicast source address, the second multicast source address and the third multicast source address are not the same multicast source address, determining that the state of the data channel is abnormal.

4. The method of claim 3, while determining that the state of the data channel is abnormal, the method further comprising:

determining a target multicast source address inconsistent with the local multicast source address from the first multicast source address, the second multicast source address and the third multicast source address;

determining target information corresponding to the target multicast source address in the second local channel information, the server channel information and the conference member information;

and generating channel abnormal information based on the target information, and displaying the channel abnormal information.

5. The method according to claim 1, before sending a first channel information acquisition signaling to the master device when detecting that a talk spurt terminal is switched in a currently-hosted video conference, the method further comprising:

sending a conference list acquisition data packet to the master control device, wherein the master control device is used for responding to the conference list acquisition data packet and acquiring conference list information;

receiving the conference list information returned by the main control equipment, and generating a conference control right acquisition signaling based on the conference list information, wherein the conference control right acquisition signaling comprises a conference identifier;

sending the conference control right acquiring signaling to the main control equipment, wherein the main control equipment is used for responding to the conference control right signaling, determining a video conference corresponding to the conference identifier, and generating a conference control result signaling based on the determined video conference;

and receiving the conference control result signaling sent by the main control equipment, and taking over the video conference based on the conference control result signaling.

6. A method for determining a data channel state is applied to a main control device which is in communication connection with a data channel detection system, wherein the main control device is also in communication connection with a plurality of terminals respectively, and the method comprises the following steps:

receiving a first channel information acquisition signaling sent by the data channel detection system, wherein the first channel information acquisition signaling is sent by the data channel detection system when detecting that a speaking terminal is switched in a video conference which is currently taken over;

responding to the first channel information acquisition signaling, acquiring first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and acquiring second local channel information corresponding to a target terminal from the target terminal participating in the video conference;

sending the first local channel information and the second local channel information to the data channel detection system, and receiving a second channel information acquisition signaling sent by the data channel detection system;

responding to the second channel information acquisition signaling, and acquiring server channel information and conference member information corresponding to the target terminal from the main control equipment;

and sending the server channel information and the conference member information to the data channel detection system, wherein the data channel detection system is used for comparing the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result, and determining the state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

7. The method of claim 6, wherein before receiving the first channel information acquisition signaling sent by the data channel detection system, the method further comprises:

receiving an acquisition conference list data packet sent by the data channel detection system, and responding to the acquisition conference list data packet to acquire conference list information;

sending the conference list information to the data channel detection system, and receiving a conference control right acquisition signaling sent by the data channel detection system based on the conference list information, wherein the conference control right acquisition signaling comprises a conference identifier;

responding to the conference control right acquisition signaling, determining a video conference corresponding to the conference identification, and generating a conference control result signaling based on the determined video conference;

and sending the conference control result signaling to the data channel detection system, wherein the data channel detection system is used for taking over the video conference based on the conference control result signaling.

8. The device for determining the state of the data channel is characterized in that the device is applied to a data channel detection system which is in communication connection with a main control device, and the main control device is also in communication connection with a plurality of terminals; the device comprises:

a first channel information obtaining signaling sending module, configured to send a first channel information obtaining signaling to the main control device when detecting that a speaking terminal is switched in a currently-taken video conference, where the main control device is configured to, in response to the first channel information obtaining signaling, obtain, from the switched speaking terminal, first local channel information corresponding to the switched speaking terminal, and obtain, from a target terminal participating in the video conference, second local channel information corresponding to the target terminal;

a local channel information obtaining module, configured to receive the first local channel information and the second local channel information returned by the master control device;

a second channel information acquisition signaling sending module, configured to send a second channel information acquisition signaling to the master control device; the main control equipment is used for responding to the second channel information acquisition signaling and acquiring server channel information and conference member information corresponding to the target terminal from the main control equipment;

the information comparison module is used for comparing the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result;

and a state determining module, configured to determine, according to the first local channel information and the comparison result, a state of a data channel used for data transmission between the target terminal and the switched speaking terminal.

9. An apparatus for determining a data channel state, the apparatus being applied to a main control device communicatively connected to a data channel detection system, the main control device being further communicatively connected to a plurality of terminals, respectively, the apparatus comprising:

a first channel information acquisition signaling receiving module, configured to receive a first channel information acquisition signaling sent by the data channel detection system, where the first channel information acquisition signaling is sent by the data channel detection system when it detects that a speaking terminal is switched in a currently-taken video conference;

a local channel information obtaining module, configured to, in response to the first channel information obtaining signaling, obtain, from a switched origination terminal, first local channel information corresponding to the switched origination terminal, and obtain, from a target terminal participating in the video conference, second local channel information corresponding to the target terminal;

a local channel information sending module, configured to send the first local channel information and the second local channel information to the data channel detection system, and receive a second channel information acquisition signaling sent by the data channel detection system;

a second channel information acquisition signaling response module, configured to respond to the second channel information acquisition signaling and acquire server channel information and conference member information corresponding to the target terminal from the master control device;

and the conference information sending module is used for sending the server channel information and the conference member information to the data channel detection system, the data channel detection system is used for comparing the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result, and determining the state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

10. An electronic device, comprising: one or more processors; and one or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the apparatus to perform the method of determining a data channel state of one or more of claims 1 to 5 or 6-7.

11. A computer-readable storage medium storing a computer program for causing a processor to perform a method of determining a status of a data channel according to one or more of claims 1 to 5 or 6 to 7.

Images