CN115529433A - Cross-domain polling method and device for cascading video conference and electronic equipment - Google Patents

Cross-domain polling method and device for cascading video conference and electronic equipment Download PDF

Info

Publication number
CN115529433A
CN115529433A CN202211181565.5A CN202211181565A CN115529433A CN 115529433 A CN115529433 A CN 115529433A CN 202211181565 A CN202211181565 A CN 202211181565A CN 115529433 A CN115529433 A CN 115529433A
Authority
CN
China
Prior art keywords
video stream
network side
target network
side device
list
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211181565.5A
Other languages
Chinese (zh)
Inventor
孙俊伟
王克彦
曹亚曦
俞鸣园
费敏健
吕少卿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Huachuang Video Signal Technology Co Ltd
Original Assignee
Zhejiang Huachuang Video Signal Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Huachuang Video Signal Technology Co Ltd filed Critical Zhejiang Huachuang Video Signal Technology Co Ltd
Priority to CN202211181565.5A priority Critical patent/CN115529433A/en
Publication of CN115529433A publication Critical patent/CN115529433A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/152Multipoint control units therefor

Abstract

The invention discloses a cross-domain round-robin method, a cross-domain round-robin device and electronic equipment for a cascaded video conference, wherein a first target network side device receives a round-robin video stream request carrying a video stream list sent by a second target network side device, the first target network side device takes the intersection of the video stream list and a video stream request list corresponding to the first target network side device as a target video stream list, so that the second target network side device obtains a target video stream according to the target video stream list and displays the target video stream on a corresponding terminal according to a multi-picture round-robin layout, and the first target network side device obtains the target video stream based on the intersection of the video stream list and the video stream request list, so that the on-demand uplink of the video stream is realized, the bandwidth overhead between an upper level and a lower level is saved, the media stream obtaining calculation overhead is reduced, and the requirement of the cross-domain multi-picture round-robin of the multistage cascaded conference is further realized.

Description

Cross-domain polling method and device for cascading video conferences and electronic equipment
Technical Field
The invention relates to the technical field of communication, in particular to a cross-domain polling method and device for a cascading video conference and electronic equipment.
Background
The video conference system refers to individuals or groups in two or more different places, and the individuals or groups transmit sound, images and file data to each other through a transmission line and multimedia equipment to realize real-time and interactive communication so as to realize a teleconference. A video conference system usually includes a Multipoint Control Unit (MCU) (i.e., a video conference server), a software terminal, a hardware terminal, and a recording and broadcasting server, and the terminals collect images and sounds and encode the images and sounds to send to the MCU, and the MCU fuses or does not fuse the images sent by the terminals according to conference requirements, and sends the sounds to each participant terminal after mixing or not mixing, thereby implementing audio and video calls of multiple participants.
In some video conference application scenarios, the conference system generally needs to be deployed and managed in a hierarchical and decentralized manner according to the region or organization structure, that is, each level of units deploys, maintains and uses its own video conference system, and meanwhile, the conference systems of each level of units can perform cross-domain cascading based on a tree network to hold multi-level cascading conferences across domains.
The prior art has realized the cascaded cross-domain conference system of multichannel, namely, can carry out multichannel main video stream exchange between higher level conference system and subordinate conference system, and based on this, the user has proposed the many pictures of cross-domain in the cascaded conference and has walked round the demand, but because the structural constraint of tree network, only can realize the network intercommunication between the subordinate and the immediate subordinate, that is to say, subordinate terminal can't go up the video stream to the higher level as required and carry out round the patrol, then, how to realize the many pictures of cross-domain in the cascaded conference and walked round the demand and become the problem that awaits the solution urgently.
Disclosure of Invention
The embodiment of the invention provides a cross-domain polling method and device for a cascade video conference and electronic equipment, which are used for solving the problem that the cross-domain multi-picture polling of a multistage cascade conference cannot be performed in a tree network in the prior art.
In a first aspect, an embodiment of the present invention provides a cross-domain polling method for a cascaded video conference, which is applied to a tree network cascaded video conference system, and the method includes:
a first target network side device receives a first polling video stream request which is sent by a second target network side device and carries a video stream list;
the first target network side device takes the intersection of the video stream list and the video stream request list corresponding to the first target network side device as a target video stream list, so that the second target network side device obtains a target video stream according to the target video stream list and displays the target video stream on a corresponding terminal according to multi-picture round-robin layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device performs periodic multi-picture polling, and the video stream request list is all video stream lists corresponding to the direct terminal belonging to the first target network side device and the subordinate terminal entering the multi-picture polling layout of the second target network side device.
In the cross-domain round robin method for the cascaded video conference, a first target network side device receives a first round robin video stream request carrying a video stream list sent by a second target network side device, uses an intersection of the video stream list and the video stream request list corresponding to the first target network side device as a target video stream list, and based on the target video stream list, obtains a target video stream, and sends the target video stream to the second target network side device, so that the second target network side device displays the target video stream on a corresponding terminal according to a multi-picture round robin layout, wherein the video stream list is a terminal video stream list which is obtained as needed when the second target network side device performs periodic multi-picture round robin, the video stream request list is a video stream list corresponding to all direct and subordinate terminals entering the multi-picture round robin layout of the second target network side device, and the first target network side device obtains the target video stream according to the target video stream list. Because the target video stream list is the intersection of the video stream list carried in the polling video stream request and the video stream request list corresponding to the first target network side device, the number of the target video streams required to be acquired by the first target network side device is reduced through the intersection operation of the video stream list and the video stream request list, the calculation overhead of a central processing unit for identification judgment when the video streams are forwarded is saved, meanwhile, the logic of the signaling service in the cascade video conference is simplified, and the reliability of the signaling service in the video conference system is ensured. In addition, the second target network side equipment only needs to acquire the target video stream from the first target network side equipment as required instead of acquiring all the video streams of the first target network side equipment according to the multi-picture polling layout and the conference system organization structure every time, so that the network bandwidth between the upper and lower-level target network side equipment is saved, the requirement of multi-picture polling of a multi-level cascading conference across domains is met, and the performance of the video conference system is improved.
In a possible implementation manner, before the first target network side device receives a first polling video stream request carrying a video stream list sent by a second target network side device, the method further includes:
after receiving the conference creating request, the first target network side equipment creates a first main field simulation terminal and a first passenger field simulation terminal corresponding to third target network side equipment;
the first target network side equipment configures a corresponding video stream request list for the third target network side equipment according to a conferee list, multi-picture polling layout and a conference system organization structure carried in the conference creating request;
the first target network side device sends the conference creating request to the third target network side device, so that the third target network side device creates a current-level conference according to the conference creating request;
the first passenger-field simulation terminal is used for acquiring a target video stream from a third target network-side device according to a target video stream list of the third target network-side device, the first main-field simulation terminal is used for sending the video stream acquired by the first passenger-field simulation terminal to a media service of the first target network-side device, and the third target network-side device is a subordinate lower-level network-side device of the first target network-side device.
In the embodiment of the present invention, after receiving a conference creation request, a first target network side device creates a current-level conference, and directly belongs to a subordinate network side device, that is, a third target network side device, configures a venue simulation terminal for acquiring a target video stream from the third target network side device according to a target video stream list of the third target network side device, configures a main venue simulation terminal for transmitting the video stream acquired by the first venue simulation terminal to a media service of the first target network side device, and configures a corresponding video stream request list for the third target network side device according to a conferee list, a multi-picture polling layout and a conference system organization structure carried in the conference creation request, and transmits the conference creation request to the third target network side device. Because the first target network side device generates a pair of first main field simulation terminal and first passenger field simulation terminal in the cascade gateway service, wherein the first passenger field simulation terminal is owned by the third target network side device and added into the participator list corresponding to the third target network side device, and the first main field simulation terminal is owned by the first target network side device and added into the participator list corresponding to the first target network side device, the first target network side device can obtain the video stream from the third target network side device through the first main field simulation terminal and the first passenger field simulation terminal, so that the uploading of the video stream in the video conference system is more stable.
In a possible implementation manner, after the first target network-side device receives a polling video stream request carrying a video stream list sent by a second target network-side device, before the first target network-side device uses an intersection of the video stream list and a video stream request list corresponding to the first target network-side device as a target video stream list, the method further includes:
the first target network side equipment determines the third network side equipment according to the participant list and the conference system organization structure;
the first target network side device takes the conference number of the third network side device as a target conference number;
and the first target network side equipment sends the polling video stream request to the third target network side equipment according to the target conference number.
In the embodiment of the invention, the first target network side equipment determines the directly subordinate network side equipment thereof, namely the third network side equipment according to the participant list and the conference system organization structure, and takes the conference number of the third network side equipment as the target conference number so as to send the polling video stream request to the network side equipment corresponding to the target conference number.
In a second aspect, an embodiment of the present invention further provides a cross-domain polling method for a cascaded video conference, which is applied to a tree network cascaded video conference system, and the method includes:
after the second target network side equipment reaches a polling period, sending a polling video stream request to first target network side equipment, so that the first target network side equipment determines a target video stream list according to a video stream list carried in the polling video stream request and a video stream request list corresponding to the first target network side equipment;
the second target network side equipment acquires a target video stream according to the target video stream list and displays the target video stream on a corresponding terminal according to the multi-picture polling layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device performs periodic multi-picture polling, and the video stream request list is all video stream lists corresponding to the direct terminal belonging to the first target network side device and the subordinate terminal entering the multi-picture polling layout of the second target network side device.
In one possible embodiment, the method further comprises:
the second target network side equipment receives a conference creating request;
the second target network side equipment configures a second main field simulation terminal and a second passenger field simulation terminal for the first target network side equipment;
the second target network side equipment configures a corresponding video stream request list for the first target network side equipment according to a participant list, a multi-picture polling layout and a conference system organization structure carried in the conference creating request;
and the second target network side equipment sends the conference creating request to the first target network side equipment so that the first target network side equipment creates the current-level conference according to the conference creating request.
In a possible implementation manner, the acquiring, by the second target network device, a target video stream according to the target video stream list includes:
the second target network side equipment acquires a target video stream from the first target network side equipment through the second passenger field simulation terminal according to the target video stream list;
and the second target network side equipment sends the target video stream of the first target network side equipment acquired by the second passenger field simulation terminal to the media service of the second target network side equipment through the second main field simulation terminal.
In a third aspect, an embodiment of the present invention further provides a cross-domain polling device for a cascading video conference, where the cross-domain polling device includes:
the first receiving module is used for receiving a first polling video stream request which is sent by second target network side equipment and carries a video stream list;
a determining module, configured to use an intersection of the video stream list and a video stream request list corresponding to the first target network-side device as a target video stream list, so that the second target network-side device obtains a target video stream according to the target video stream list and displays the target video stream on a corresponding terminal according to a multi-picture round-robin layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device performs periodic multi-picture polling, and the video stream request list is all video stream lists corresponding to the direct terminal belonging to the first target network side device and the subordinate terminal entering the multi-picture polling layout of the second target network side device.
In a fourth aspect, an embodiment of the present invention further provides a cross-domain polling device for a cascaded video conference, including:
a second receiving module, configured to send a polling video stream request to a first target network side device after a polling period is reached, so that the first target network side device determines a target video stream list according to a video stream list carried in the polling video stream request and a video stream request list corresponding to the first target network side device;
the third receiving module is used for acquiring the target video stream according to the target video stream list and displaying the target video stream on the corresponding terminal according to the multi-picture polling layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device performs periodic multi-picture polling, and the video stream request list is a list of all direct and subordinate video streams which enter the multi-picture polling layout of the second target network side device and belong to the first target network side device.
In a fifth aspect, an embodiment of the present invention further provides an electronic device, including a processor; a memory for storing processor-executable instructions; wherein the processor implements the steps of the cascading video conference cross-domain polling method according to any one of the first aspect or the second aspect by executing the executable instructions.
In a sixth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when the program is executed by a processor, the step of the cross-domain polling method for a cascading video conference in any of the first aspect and the second aspect is implemented.
For technical effects that can be achieved by the cascading video conference cross-domain polling device disclosed in the third aspect, the cascading video conference cross-domain polling device disclosed in the fourth aspect, the electronic device disclosed in the fifth aspect, and the computer-readable storage medium disclosed in the sixth aspect, please refer to the above description of technical effects that can be achieved by various possible schemes in the first aspect or the first aspect and various possible schemes in the second aspect or the second aspect, and details are not repeated here.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required to be used in the description of the embodiments will be briefly introduced below, and it is apparent that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings may be obtained according to the drawings without inventive labor.
Fig. 1 is a schematic structural diagram of a network-side device in a video conference system according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a cascading video conference system according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a cascading gateway service of a video conference system according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an embodiment of a video conference system according to the present invention;
FIG. 5 is a schematic structural diagram of a multi-screen layout according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a conference control service in an embodiment of a video conference system according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a signaling service according to an embodiment of a video conference system provided in an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a cascading gateway service in an embodiment of a video conference system according to the present invention;
fig. 9 is a schematic structural diagram of a cross-domain polling device for a cascading video conference according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of another cross-domain polling device for a cascading video conference according to an embodiment of the present invention;
fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 12 is a flowchart of a cross-domain polling method for a cascading video conference according to an embodiment of the present invention;
fig. 13 is a flowchart of another cross-domain polling method for a cascading video conference according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
The application scenario described in the embodiment of the present invention is for more clearly illustrating the technical solution of the embodiment of the present invention, and does not form a limitation on the technical solution provided in the embodiment of the present invention, and it can be known by a person skilled in the art that with the occurrence of a new application scenario, the technical solution provided in the embodiment of the present invention is also applicable to similar technical problems. In the description of the present invention, the term "plurality" means two or more unless otherwise specified.
Some terms in the embodiments of the present invention are explained below to facilitate understanding by those skilled in the art.
(1) As shown in fig. 1, the video conference system includes a MCU11 and various participating devices such as terminals 12, where the MCU11 is also a video conference server, and the network side device in this embodiment of the present invention, where the MCU11 includes a WEB browser 111, an conference control service 112, a signaling service 113, a media service 114, and a cascade gateway service 115. The WEB browser 111 is in communication connection with the control service 112, the conference control service 112 is also in communication connection with the signaling service 113, the signaling service 113 is in communication connection with the media service 114, the cascade gateway service 115 is in communication connection with the signaling service 113 and the media service 114, respectively, and the terminal 12 is in communication connection with the signaling service 113 and the media service 114, respectively, where the terminal 12 may include n terminals, and n is a positive integer. In the video conference system, the terminals 12 collect images and sounds, encode the images and the sounds and transmit the encoded images to the MCU11, and the MCU11 fuses or does not fuse, mix or mix the sounds of the images transmitted from the terminals 12 according to the conference requirements and then transmits the fused images and the mixed sounds to each participant terminal, thereby implementing audio and video communication between the participants.
(2) The multi-screen layout means that a video screen includes a plurality of display areas, and each display area is used to display a screen of a conference terminal, that is, the multi-screen layout includes the size and position of the plurality of display areas divided in the video screen, and a screen of the conference terminal corresponding to each display area.
As shown in fig. 2, a multi-stage cascading video conference system provided in an embodiment of the present invention includes a multi-stage video conference system, a top-stage video conference system 21, a two-stage video conference system 22, \8230 \ 8230 \ n, and an n-stage video conference system 2n, where n is greater than or equal to 2, where each stage of video conference system includes a network-side device and a terminal.
In this embodiment of the present invention, the first target network-side device may be a network-side device corresponding to a conference system other than the top-level video conference system in fig. 2, and the second target network-side device may be a network-side device corresponding to a video conference system other than the last-level video conference system in fig. 2.
For example, in fig. 2, if the network side device corresponding to the top-level video conference system is a second target network side device, the first target network side device may be a network side device corresponding to the secondary video conference system 1, and may also be a network side device corresponding to the secondary video conference system 2; if the network side device corresponding to the secondary video conference system 1 is the second target network side device, the first target network side device may be a network side device corresponding to the tertiary video conference system 1, and may also be a network side device corresponding to the tertiary video conference system 2. That is to say, the network side device corresponding to the second-level video conference system 1 is a directly subordinate network side device of the network side device corresponding to the top-level video conference system, the network side device corresponding to the third-level video conference system 1 is a directly subordinate network side device of the network side device corresponding to the second-level video conference system 1, and is a non-directly subordinate network side device of the network side device corresponding to the top-level video conference system.
The multistage cascade video conference system shown in fig. 2 is a tree network video conference system, and the cascade video conference cross-domain round robin method provided by the embodiment of the invention is applied to the tree network cascade video conference system.
The invention provides a cross-domain polling method for a video conference, which is applied to a tree network cascade video conference system, wherein:
the first target network side equipment is used for receiving a first round of patrol video stream request which is sent by the second target network side equipment and carries a video stream list; and taking the intersection of the video stream list and the video stream request list corresponding to the first target network side equipment as a target video stream list, so that the second target network side equipment acquires a target video stream according to the target video stream list and displays the target video stream on a corresponding terminal according to multi-picture round-robin layout.
The second target network side device is used for sending a polling video stream request to the first target network side device after a polling period is reached, so that the first target network side device determines a target video stream list according to a video stream list carried in the polling video stream request and a video stream request list corresponding to the first target network side device; and acquiring a target video stream according to the target video stream list, and displaying on a corresponding terminal according to the multi-picture polling layout.
The first target network side device is a subordinate network side device of a direct type of the second target network side device, the video stream list is a terminal video stream list acquired as required when the second target network side device executes periodic multi-picture polling, and the video stream request list is a video stream list corresponding to the direct type and subordinate terminals of the first target network side device, wherein all the video stream lists enter the multi-picture polling layout of the second target network side device.
In the embodiment of the invention, after a second target network side device reaches a polling period, a polling video stream request is sent to a first target network side device, the first target network side device receives the polling video stream request carrying a video stream list sent by the second target network side device, an intersection of the video stream list and a video stream request list corresponding to the first target network side device is used as a target video stream list, and based on the target video stream request, a target video stream is obtained and sent to the second target network side device, after the second target network side device receives the target video stream, the target video stream is displayed on a corresponding terminal according to a multi-picture polling layout, wherein the video stream lists are terminal video stream lists which are obtained as required when the second target network side device performs periodic multi-picture polling, the video stream request lists are all the video stream lists which belong to the first target network side device and are video stream lists corresponding to a subordinate terminal when the second target network side device performs periodic multi-picture polling, and the first target network side device obtains the target video stream request according to the intersection of the target video stream list. Because the target video stream list is the intersection of the video stream list carried in the polling video stream request and the video stream request list corresponding to the first target network side device, the number of the target video streams required to be acquired by the first target network side device is reduced through intersection operation of the video stream list and the video stream request list, the calculation overhead of a central processing unit for identification judgment when the video streams are forwarded is saved, meanwhile, the logic of the signaling service in the cascade video conference is simplified, and the reliability of the signaling service in the video conference system is ensured. In addition, the second target network side equipment only needs to acquire the target video stream from the first target network side equipment as required instead of acquiring all the video streams of the first target network side equipment according to the multi-picture polling layout and the conference system organization structure every time, so that the network bandwidth between the upper and lower-level target network side equipment is saved, the requirement of multi-picture polling of a multi-level cascading conference across domains is met, and the performance of the video conference system is improved.
In specific implementation, the second target network-side device may be a network-side device corresponding to a top-level video conference system, and may also be a network-side device corresponding to another video conference system, if the second target network-side device is a network-side device corresponding to the top-level video conference system, the round-robin video stream request received by the second target network-side device is a round-robin video stream request triggered by the user, and if the second target network-side device is another video conference system, the round-robin video stream request is a round-robin video stream request sent by a higher-level network-side device of the second target network-side device, and the round-robin video stream request carries a video stream list.
For example, if the second target network device is a network device corresponding to the secondary video conference system 1 in fig. 2, the polling video stream request received by the second target network device is a polling video stream request sent by a network device corresponding to the top-level video conference system.
In specific implementation, before the second target network side device sends the polling video stream request to the first target network side device, the second target network side device also sends a conference creation request to the first target network side device, and after receiving the conference creation request, the first target network side device creates a first main field simulation terminal and a first passenger field simulation terminal corresponding to the third target network side device; the first target network side equipment configures a corresponding video stream request list for the third target network side equipment according to a participant list, a multi-picture polling layout and a conference system organization structure carried in the conference creating request; the first target network side equipment sends a conference creating request to the third target network side equipment so that the third target network side equipment creates the current-level conference according to the conference creating request; the first passenger field simulation terminal is used for acquiring a target video stream from third target network side equipment according to a target video stream list of the third target network side equipment, the first main field simulation terminal is used for sending the video stream acquired by the first passenger field simulation terminal to media service of the first target network side equipment, and the third target network side equipment is directly subordinate lower-level network side equipment of the first target network side equipment.
For example, after receiving a conference creation request sent by a network side device corresponding to the top-level video conference system, a network side device corresponding to the second-level video conference system 1 creates a main-field simulation terminal and a passenger-field simulation terminal corresponding to a network side device corresponding to the third-level video conference system 1, and creates a main-field simulation terminal and a passenger-field simulation terminal corresponding to a network side device corresponding to the third-level video conference system 2.
In the embodiment of the invention, after receiving a conference creating request, a first target network side device creates a current-level conference, and directly belongs to a subordinate network side device, namely a third target network side device, configures a passenger field simulation terminal for acquiring a video stream corresponding to the third target network side device and a main field simulation terminal for transmitting the video stream acquired by the first passenger field simulation terminal to a media service of the first target network side device, and configures a corresponding video stream request list for the third target network side device according to a conferee list, a multi-picture round-of-tour layout and a conference system organization structure carried in the conference creating request, and transmits the conference creating request to the third target network side device. Because the first target network side device generates a pair of first main field simulation terminal and first passenger field simulation terminal in the cascade gateway service, wherein the first passenger field simulation terminal is owned by the third target network side device and added into the participator list corresponding to the third target network side device, and the first main field simulation terminal is owned by the first target network side device and added into the participator list corresponding to the first target network side device, the first target network side device can obtain the video stream from the third target network side device through the first main field simulation terminal and the first passenger field simulation terminal, so that the uploading of the video stream in the video conference system is more stable.
In a specific implementation, after the first target network-side device receives the polling video stream request carrying the video stream list sent by the second target network-side device, before the first target network-side device uses an intersection of the video stream list and a video stream request list corresponding to the first target network-side device as the target video stream list, the method further includes: the first target network side equipment determines third network side equipment according to the participant list and the conference system organization structure; the first target network side equipment takes the conference number of the third network side equipment as a target conference number; and the first target network side equipment sends a polling video stream request to the third target network side equipment according to the target conference number.
In the embodiment of the invention, the first target network side equipment determines the directly subordinate network side equipment thereof, namely the third network side equipment according to the participant list and the conference system organization structure, and takes the conference number of the third network side equipment as the target conference number so as to send the polling video stream request to the network side equipment corresponding to the target conference number.
In a specific implementation, the acquiring, by a first target network device, a target video stream according to a target video stream list includes: the first passenger field simulation terminal obtains a target video stream from the third target network side device according to the target video stream list of the third target network side device; and the first target network side equipment sends the target video stream acquired by the first passenger field simulation terminal to the media service of the first target network side equipment through the first main field simulation terminal.
In the embodiment of the present invention, the first passenger field simulation terminal obtains the target video stream from the third target network side device according to the target video stream list of the third target network side device, and the first target network side device sends the target video stream obtained by the first passenger field simulation terminal to the media service of the first target network side device through the first main field simulation terminal. Because the target video stream list is the intersection of the video stream list carried in the polling video stream request and the video stream request list corresponding to the first target network side device, the number of the target video streams required to be acquired by the first passenger field simulation terminal to the third target network side device is reduced through the intersection operation of the video stream list and the video stream request list, the calculation overhead of a Central Processing Unit (CPU) for identification judgment when the video streams are forwarded is saved, meanwhile, the logic of the signaling service in the cascade video conference is simplified, and the reliability of the signaling service in the video conference system is ensured.
In specific implementation, the second target network side device receives a conference creating request and configures a second main field simulation terminal and a second passenger field simulation terminal for the first target network side device; the second target network side equipment configures a corresponding video stream request list for the first target network side equipment according to a participant list, a multi-picture polling layout and a conference system organization structure carried in the conference creating request; and the second target network side equipment sends a conference creation request to the first target network side equipment so that the first target network side equipment creates the current-level conference according to the conference creation request.
In the embodiment of the invention, a second target network side device creates a local-level conference, configures a second passenger field simulation terminal for obtaining a video stream corresponding to the first target network side device and a second main field simulation terminal for sending the video stream obtained by the second passenger field simulation terminal to a media service of the second network side device for the first target network side device, configures a corresponding video stream request list for a directly subordinate network side device according to a participant list, a multi-picture round-robin layout and a conference system organization structure carried in a conference creating request, and sends the conference creating request to the first target network side device. Because the second target network side device generates a pair of second main field simulation terminal and second passenger field simulation terminal in the cascade gateway service, wherein the second passenger field simulation terminal is owned by the first target network side device and added into the participator list corresponding to the first target network side device, and the second main field simulation terminal is owned by the second target network side device and added into the participator list corresponding to the second target network side device, the second target network side device can obtain the video stream from the first target network side device through the second main field simulation terminal and the second passenger field simulation terminal, so that the uploading of the video stream in the video conference system is more stable.
In specific implementation, the second passenger field simulation terminal obtains a target video stream from the first target network side device according to the target video stream list; and the second target network side equipment sends the target video stream of the first target network side equipment acquired by the second passenger field simulation terminal to the media service of the second target network side equipment through the second main field simulation terminal.
The cross-domain polling method for the cascading video conference provided by the embodiment of the invention is described in detail below with reference to fig. 1 and fig. 2.
After receiving a conference creating request, the conference control service 112 of the second target network side device creates a current-level conference, where the conference creating request includes information such as a current-level participant list and a multi-screen polling layout, and it should be noted that if the second target network side device is a network side device corresponding to the top-level conference system, the conference control service 112 in the second target network side device receives the conference creating request from the WEB browser 111, that is, the conference creating request triggered by the user; if the second target network-side device is a network-side device corresponding to the non-top-level conference system, the conference control service 112 in the second target network-side device receives a conference creation request sent by a superior network-side device from the second target network-side device; after the conference is established, the conference control service 112 of the second target network side device traverses the current-level conferee list, and if the lower-level conferee terminal is not involved, the conference control service is ended; if a lower-level conferee terminal is involved, configuring a main field simulation terminal 1151 and a passenger field simulation terminal 1152 for the directly subordinate lower-level network side equipment according to the organization structure condition of the distribution of the conferees in the current-level conferee list, as shown in fig. 3, and adding the main field simulation terminal 1151 to the conferee list of the upper-level network side equipment; configuring a privateLayoutSSRCs video stream request list for a passenger field simulation terminal 1152, wherein the privateLayoutSSRCs video stream request list is a static list which is a video stream list corresponding to all direct members which enter a multi-picture polling layout of equipment on a superior network side and belong to equipment on a subordinate network side and video stream lists corresponding to subordinate terminals; removing irrelevant conferee terminals, and initiating a conference creation request to the conference control service 112 of the directly subordinate network side equipment; and ending the conference control service.
For example, in the cascading video conference system shown in fig. 2, the network-side device corresponding to the top-level video conference system is used as the second target network-side device, the network-side device corresponding to the second-level video conference system 1 is used as the first target network-side device, and the conference control service 112 of the network-side device corresponding to the top-level video conference system creates the current-level conference after receiving the conference creation request from the WEB browser 111; configuring a main field simulation terminal 1151 and a passenger field simulation terminal 1152 for network side equipment corresponding to the secondary video conference system 1, adding the main field simulation terminal 1151 into a participant list of the network side equipment corresponding to the top-level video conference system, and configuring a privateLayoutSSRCs video stream request list for the passenger field simulation terminal 1152; irrelevant conferees are removed, a room simulation terminal 1152 is added to the conferee list of the network side equipment corresponding to the secondary video conference system 1, a conference creation request is initiated to the conference control service 112 of the network side equipment corresponding to the secondary video conference system 1, and the conference control service of the network side equipment corresponding to the top-level video conference system is ended.
After receiving a conference creation request from the conference control service 112 of the second target network side device, the conference creation service 112 of the first target network side device creates a current-level conference, where the conference creation request includes information such as a current-level participant list and a multi-picture polling layout; after the conference is created, the conference control service 112 of the first target network side device traverses the current-level participant list, and if the lower-level participant terminal is not involved, the conference control service is ended; if a subordinate participant terminal is involved, configuring a main field simulation terminal 1151 and a passenger field simulation terminal 1152 for the directly subordinate network side equipment according to the organization structure condition of the distribution of the participants in the current-level participant list, as shown in fig. 3, and adding the main field simulation terminal 1151 to the current-level participant list; configuring a privateLayoutSSRCs video stream request list for the passenger field simulation terminal 1152, wherein the privateLayoutSSRCs video stream request list is a static list and comprises all video streams entering a multi-picture polling layout under an organization sub-tree of the passenger field simulation terminal 1152 belonging to lower-level network side equipment; removing irrelevant conferee terminals, adding a passenger field simulation terminal 1152 into the conferee list of the directly subordinate network side equipment, and initiating a conference creation request to the conference control service 112 of the directly subordinate network side equipment; and ends the conference service.
For example, in the cascade video conference system shown in fig. 2, after receiving a conference creation request sent by the conference control service 112 of the network side device corresponding to the top-level video conference system, the conference control service 112 of the network side device corresponding to the secondary video conference system 1 creates a current-level conference; configuring a main field simulation terminal 1151 and a passenger field simulation terminal 1152 for the subordinate network side equipment of the secondary video conference system 1, namely configuring a main field simulation terminal A1 and a passenger field simulation terminal B1 for the tertiary video conference system 1, configuring a main field simulation terminal A2 and a passenger field simulation terminal B2 for the tertiary video conference system 2, adding the main field simulation terminal A1 and the main field simulation terminal A2 into a corresponding current-level conferee list of the secondary video conference system 1, configuring a privateLayoutSSRcSA for the passenger field simulation terminal B1, and configuring a privateLayoutSSRcB for the passenger field simulation terminal B2; irrelevant participant terminals in the current-level participant list are removed, a field simulation terminal B1 is added into the current-level participant list corresponding to the third-level video conference system 1, a field simulation terminal B2 is added into the current-level participant list corresponding to the third-level video conference system 2, a conference creating request is initiated to directly subordinate network side equipment of the second-level video conference system 1, namely, a conference control service 112 of the third-level video conference system 1 and a conference control service 112 of the third-level video conference system 2 in the third-level video conference system 23, and conference control service of the second-level video conference system 1 is ended.
After sending a conference creating request to a first target network side device, a second target network side device sends a first round-robin video stream request of switchcyclesrcs to the first target network side device, and a signaling service 113 of the first target network side device receives the first round-robin video stream request of switchcyclesrcs carrying a video stream list, which is sent by the signaling service 113 of the second target network side device, wherein the first round-robin video stream request of switchcyclesrcs is a dynamic list; the signaling service 113 of the first target network side device traverses the list of conferees corresponding to the lower level network side device of the first target network side device, determines a main field simulation terminal 1151 of each lower level network side device, and determines a conference number, a signaling service address and a port of each lower level network side device; the signaling service 113 of the first target network side device uses the signaling service address and port of the lower network side device of each main field analog terminal 1151, and sends a first round-robin video stream request of the switchcyclesrcs to the signaling service 113 of the directly subordinate network device, wherein the first round-robin video stream request of the switchcyclesrcs includes a video stream list and a lower conference number; the signaling service 113 of the first target network side device determines a passenger field simulation terminal 1152 corresponding to the lower-level network side device, and acquires a private layouts ssrcs video stream request list; the signaling service 113 of the first target network side device traverses the video stream list in the first round of patrol video stream requests of the switchcyclesrcs, and simultaneously traverses the privateLayoutSSRCs video stream request list of the passenger field simulation terminal 1152 corresponding to the lower-level network side device, obtains the intersection of the two lists, and generates a ssrcsToMS target video stream list; the signaling service 113 of the first target network device initiates a setprivatelayout beyond ssrc video stream switching request to the passenger simulation terminal 1152 by using the ssrcsToMS target video stream list, so that the signaling service requests the list video stream to obtain a target video stream; the signaling service 113 of the first target network side device receives a requestvideosrcs video stream request signaling from the passenger field simulation terminal 1152, and sends a RequestStreams video stream forwarding request to the media service 114 corresponding to the lower-level network side device, and requests to update a privatelayouttssrcs video stream request list of the passenger field simulation terminal 1152; the signaling service 113 of the first target network side device saves the ssrcsToMS target video stream list, and when the ssrcsToMS target video stream list generated by the next switching cssrcs polling video stream request is not changed, it is not necessary to send a RequestStreams video stream forwarding request to the present-level media service 114, that is, it is not necessary to request to update the private layout ssrcs video stream request list of the customer premise simulation terminal 1152; when the signaling service 113 of the first target network side device adds the passenger field simulation terminal 1152 to the current-level conference participant list, it determines whether there is polling in the current-level conference, and if not, sends a privatelayoutsrcs video stream request list to the passenger field simulation terminal 1152 corresponding to the next-level network side device.
In specific implementation, the passenger field simulation terminal 1152 obtains a video stream from the lower network side device terminal 12 of the first target network side device, and the first target network side device uses the main field simulation terminal 1151 to send the video stream obtained by the passenger field simulation terminal 1152 to the media service of the first target network side device; receiving a RequestStreams video stream request from the signaling service 113 of the lower-level network side device, updating a privatelayoutsrcs video stream request list stored in the requesting server, and sending the obtained video stream to the second target network side device through the cascade gateway service 115 by using the passenger field simulation terminal 1152.
For example, in the cascade video conference system shown in fig. 2, a network side device corresponding to the third-level video conference system 1 in the third-level video conference system 23 is used as a first target network side device, a network side device corresponding to the second-level video conference system 1 in the second-level video conference system 22 is used as a second target network side device, a network side device corresponding to the fourth-level video conference system 1 in the fourth-level video conference system 24 is used as a third target network side device, the second-level video conference system 1 configures a main field simulation terminal A1 and a passenger field simulation terminal B1 for the third-level video conference system 1, and the third-level video conference system 1 configures a main field simulation terminal A2 and a passenger field simulation terminal B2 for the fourth-level video conference system 1. Network side equipment corresponding to the four-level video conference system 1 acquires a video stream from the current-level terminal 12 through a passenger field simulation terminal B2, the passenger field simulation terminal B2 copies the acquired video stream to a main field simulation terminal A2 of the three-level video conference system 1, and the main field simulation terminal A2 sends the video stream from the passenger field simulation terminal B2 to a media service 114 of the three-level video conference system 1; network side equipment corresponding to the third-level video conference system 1 acquires a video stream from the current-level terminal 12 through a passenger field simulation terminal B1, the passenger field simulation terminal B1 copies the acquired video stream to a main field simulation terminal A1 of the second-level video conference system 1, and the main field simulation terminal A1 sends the video stream from the passenger field simulation terminal B1 to a media service 114 of the second-level video conference system 1; receiving a RequestStreams video stream request from the signaling service 113 of the network side device corresponding to the three-level video conference system 1, and updating a privatelayoutsrcs video stream request list stored in the client.
In a specific implementation, the media service 114 of the second target network-side device is configured to receive the video stream from the home terminal 12, and receive the video stream from the first target network-side device by using the main field simulation terminal 1151 of the second target network-side device; providing a multi-picture polling layout interface for the signaling service 113 of the superior network side device of the second target network side device, and performing multi-picture video stream fusion according to the multi-picture polling layout; when the set round-robin period is reached, a RequestStreams video stream request is initiated to the signaling service 113 according to the multi-picture round-robin layout, and the requested video stream list is a collection of the round-robin video stream list and the next round-robin video stream list, wherein the RequestStreams video stream request is a dynamic list; and when the next round of video stream switching time arrives, triggering picture switching, switching from the current round of video pictures to the next round of video pictures, and respectively triggering switching aiming at each layout grid.
For example, in the cascading video conference system shown in fig. 2, the network-side device corresponding to the top-level video conference system is used as the second target network-side device, the network-side device corresponding to the secondary video conference system 1 is used as the first target network-side device, the media service 114 of the network-side device corresponding to the secondary video conference system 1 is used to receive the video stream from the local terminal 12, and the main-field analog terminal 1151 of the network-side device corresponding to the secondary video conference system 1 is used to receive the video stream from the network-side device corresponding to the top-level video conference system; providing a multi-picture polling layout interface for a signaling service 113 of network side equipment corresponding to the top-level video conference system, and performing multi-picture video stream fusion according to the multi-picture polling layout; when the set polling period is reached, a RequestStreams video stream request is initiated to the signaling service 113 according to the multi-picture polling layout, that is, when the next round of video stream switching time is reached, picture switching is triggered, the current round of video pictures is switched to the next round of video pictures, and switching is triggered for each layout grid.
In a specific implementation, the signaling service 113 of the second target network-side device is configured to receive a RequestStreams video stream request initiated when the media service 114 of the upper network-side device of the second target network-side device performs multi-picture polling; traversing the corresponding local-level participant list of the superior network side equipment of the second target network side equipment, determining a main field simulation terminal 1151 of each inferior network side equipment, and determining a conference number, a signaling service address and a port of each inferior network side equipment; using the signaling service address and port of the lower level network side device of each main field analog terminal 1151, the switching cycle srcs polling video stream request is sent to the signaling service 113 of its immediate lower level network device, where the video stream list and the lower level conference number in the RequestStreams video stream request are included.
In the multi-level cascaded cross-domain polling method provided by the embodiment of the invention, the superior network side device can receive video streams sent by all the inferior network side devices according to the multi-picture polling layout as required, and all the inferior network side devices comprise the directly inferior network side device and also comprise the non-directly inferior network side device.
For example, as shown in fig. 2, the second-level video conference system 1 is a directly subordinate network-side device of the top-level video conference system, the third-level video conference system 1 is a non-directly subordinate network-side device of the top-level video conference system, and similarly, the fourth-level video conference system 1 is also a non-directly subordinate network-side device of the top-level video conference system.
In order that the invention may be better understood, specific examples are set forth below.
A provincial-level conference system holds a provincial-level cascading video conference, the cascading video conference structure of which is shown in fig. 4, the provincial-level video conference system, the city-level video conference system 1 and the city-level video conference system 2 can be used as second target network side equipment, and the city-level video conference system 1, the city-level video conference system 2, the county-level video conference system 1, the county-level video conference system 2, the county-level video conference system 3 and the county-level video conference system 4 can be used as first target network side equipment.
The system shown in fig. 4 includes 7 terminals, which are respectively terminals 1 corresponding to a provincial video conference system, where the terminal 1 may be used as a chairman, and a terminal 2 corresponding to the city video conference system 1, a terminal 3 corresponding to the city video conference system 2, a terminal 4 corresponding to the county video conference system 1, a terminal 5 corresponding to the county video conference system 2, a terminal 6 corresponding to the county video conference system 3, and a terminal 7 corresponding to the county video conference system 4, in this embodiment of the present invention, a multi-screen layout is set as two screens, a left-side screen is filled (the city 1 terminal 2, the county 1 terminal 4, and the county 2 terminal 5), a right-side screen is filled (the city 2 terminal 3, the county 3 terminal 6, and the county 4 terminal 7), and as shown in fig. 5, a round patrol period is set to 10 seconds.
Fig. 6 is a schematic diagram illustrating a conference service in a provincial conference system. The conference control service 112 of the provincial video conference system receives a conference creation request from the local WEB browser 111, and creates the local conference, wherein the conference creation request includes information such as a complete participant list of the provincial cascading video conference, a multi-picture polling layout and the like, and the complete participant list of the provincial cascading video conference is as follows: province level terminal 1, city level 1 terminal 2, city level 2 terminal 3, county level 1 terminal 4, county level 2 terminal 5, county level 3 terminal 6, county level 4 terminal 7, the multi-screen polling layout is two screens.
The conference control service 112 of the provincial video conference system traverses the complete conferee list of the provincial cascading video conference, and configures a main field simulation terminal 1151 and a guest field simulation terminal 1152 for the subordinate network side devices according to the organization structure condition of the distribution of the conferees, that is, a first main field simulation terminal 11511 and a first guest field simulation terminal 11521 are generated for the municipal video conference system 1, a second main field simulation terminal 11512 and a second guest field simulation terminal 11522 are generated for the municipal video conference system 2, as shown in fig. 8, and the first main field simulation terminal 11511 and the second main field simulation terminal 11512 are added to the conferee list of the provincial video conference system, and the added local conference conferee list is: provincial terminal 1, city level 1 terminal 2, city level 2 terminal 3, county level 1 terminal 4, county level 2 terminal 5, county level 3 terminal 6, county level 4 terminal 7, first main farm simulation terminal 11511, and second main farm simulation terminal 11512.
The conference control service 112 of the provincial video conference system configures a privatelayoutsrcs video stream request list for the first room simulation terminal 11521 and the second room simulation terminal 11522, that is, the privatelayoutsrcs video stream request list of the first room simulation terminal 11521 includes video streams of the city level 1 terminal 2, the county level 1 terminal 4, and the county level 2 terminal 5, and the privatelayoutsrcs video stream request list of the second room simulation terminal 11522 includes video streams of the city level 2 terminal 3, the county level 3 terminal 6, and the county level 4 terminal 7, as shown in table 1.
Figure BDA0003865704470000211
Figure BDA0003865704470000221
TABLE 1
Removing irrelevant conference participants, adding corresponding passenger field simulation terminals to the conference participant list of the subordinate video conference system, and initiating a conference creation request to the conference control service 112 of the urban video conference system 1 and the urban video conference system 2, that is, in the conference creation request initiated to the conference control service 112 of the urban video conference system 1, the first conference participant list includes: a city level 1 terminal 2, a county level 1 terminal 4, a county level 2 terminal 5 and a first passenger space simulation terminal 11521; in the conference creation request initiated to the conference control service 112 of the urban videoconference system 2, the secondary participant list includes: a city level 2 terminal 3, a county level 3 terminal 6, a county level 4 terminal 7, and a second customer premises simulation terminal 11522.
The media service 114 of the provincial video conference system receives a video stream from the provincial terminal 1, receives video streams from the lower network-side equipment terminals through the first main-farm simulation terminal 11511 and the second main-farm simulation terminal 11512, that is, receives video streams from the city-level 1 terminal 2, the county-level 1 terminal 4 and the county-level 2 terminal 5 through the first main-farm simulation terminal 11511, and receives video streams from the city-level 2 terminal 3, the county-level 3 terminal 6 and the county-level 4 terminal 7 through the second main-farm simulation terminal 11512;
the media service 114 of the provincial video conference system provides a multi-picture polling layout interface for the local signaling service 113, and performs multi-picture video stream fusion according to the multi-picture polling layout;
when the media service 114 of the provincial videoconference system reaches a preset polling period, for example, 10s, a RequestStreams video stream request is initiated to the signaling service 113 according to a multi-picture polling layout, and the requested video stream list is a collection of the current polling video stream list and the next polling video stream list, for example, when the first polling period of 10s reaches, the requested video stream list is a video stream of the city 1 terminal 2, a video stream of the city 2 terminal 3, a video stream of the county 1 terminal 4, and a video stream of the county 3 terminal 6, and when the second polling period of 10s reaches, the requested video stream list is a video stream of the county 1 terminal 4, a video stream of the county 3 terminal 6, a video stream of the county 2 terminal 5, and a video stream of the county 4 terminal 7;
the media service 114 of the provincial video conference system triggers the switching of pictures when the next video stream switching time arrives, switches from the current video picture to the next video picture, and triggers the switching for each layout grid. For example, if the current time is 0s, the current video frames are the video stream of the terminal 2 at city level 1 and the video stream of the terminal 3 at city level 2, and when the next video stream switching time arrives, that is, the current time is 10s, the video frames are switched to the video stream of the terminal 4 at prefecture level 1 and the video stream of the terminal 6 at prefecture level 3.
Fig. 7 is a schematic diagram of a signaling service in a provincial conference system. A signaling service 113 of the provincial video conference system receives a request stream video request initiated when a media service 114 of the provincial video conference system performs multi-picture polling;
the signaling service 113 of the provincial video conference system traverses the complete participant list of the provincial cascading video conference:
determining a third main field simulation terminal 11513 and a fourth main field simulation terminal 11514 of the city-level video conference system 1, a fifth main field simulation terminal 11515 and a sixth main field simulation terminal 11516 of the city-level video conference system 2, and determining a conference number, a signaling service address and a port of the conference;
the provincial video conference system sends a switchcyclesrcs polling video stream request (dynamic list) to the urban video conference system 1 and the urban video conference system 2 through the signaling service 113; the city-level video conference system 1 sends a switching cycle SRCs polling video stream request to the county-level video conference system 1 and the county-level video conference system 2 through the signaling service 113; the city-level videoconference system 2 sends the switchcyclesrcs polling video stream request to the county-level videoconference system 3 and the county-level videoconference system 4 through the signaling service 113, so that the step-by-step recursive transmission of the switchcyclesrcs polling video stream request is realized. As shown in table 2, the parameters of the SwitchCycleSSRCs polling video stream request include a video stream list in RequestStreams and a lower conference number.
Figure BDA0003865704470000231
Figure BDA0003865704470000241
TABLE 2
The conference control service 112 of the urban video conference system 1 receives a conference creation request sent by the conference control service 112 of the provincial video conference system, and creates a local conference; the conference creating request comprises information such as a first conferee list, multi-picture polling layout and the like;
the conference control service 112 of the municipal video conference system 1 traverses the first conferee list, generates a third main site simulation terminal 11513 and a third guest site simulation terminal 11523 for the county video conference system 1 and a fourth main site simulation terminal 11514 and a fourth guest site simulation terminal 11524 for the county video conference system 2 according to the organization structure condition of the distribution of the conferees, and adds the third main site simulation terminal 11513 and the fourth main site simulation terminal 11514 to the conferee list of the municipal video conference system 1 as shown in fig. 8, and the added local conference conferee list is the county 1 terminal 2, the county 1 terminal 4, the county 2 terminal 5, the third main site simulation terminal 11513 and the fourth main site simulation terminal 11514;
the conference control service 112 of the city-level video conference system 1 configures a privatelayoutsrcs video stream request list for the third and fourth venue simulation terminals 11523 and 11524, that is, the privatelayoutsrcs video stream request list of the third venue simulation terminal 11523 includes the video stream of the county-level 1 terminal 4, and the privatelayoutsrcs video stream request list of the fourth venue simulation terminal 11524 includes the video stream of the county-level 2 terminal 5, as shown in table 1;
removing irrelevant participants, adding corresponding passenger field simulation terminals to the participant list of the subordinate video conference system, and then initiating a conference creation request to the conference control service 112 of the county-level video conference system 1 and the county-level video conference system 2, that is, in the conference creation request initiated to the conference control service 112 of the county-level video conference system 1, the third participant list comprises: county level 1 terminal 4, third passenger area simulation terminal 11523; in the conference creation request initiated by the conference control service 112 of the county-level video conference system 2, the fourth conferee list includes: county level 2 terminal 5, fourth venue simulation terminal 11524.
The media service 114 of the system 1 receives the video stream from the terminal 2 at the city level 1, acquires the video stream from the terminal 4 at the county level 1 acquired by the third room simulation terminal 11523 through the third main room simulation terminal 11513, and acquires the video stream from the terminal 5 at the county level 2 acquired by the fourth room simulation terminal 11524 through the fourth main room simulation terminal 11514;
the media service 114 of the municipal video conference system 1 receives the RequestStreams video stream request from the signaling service 113, updates the privatelayouts ssrcs video stream request list for the municipal terminal 2, and forwards the video streams for the municipal terminal 2, the prefecture terminal 3, and the prefecture terminal 4 to the cascade gateway service 115 of the provincial video conference system using the first venue simulation terminal 11521.
The signaling service 113 of the urban video conference system 1 receives a switch cycle srcs polling video stream request from the signaling service 113 of the provincial video conference system, and traverses the first conferee list;
determining the conference number, the signaling service address and the port of a county-level video conference system 1 and a county-level video conference system 2;
the city-level video conference system 1 sends a switchcyclesrcs polling video stream request to the county-level video conference system 1 and the county-level video conference system 2 through the signaling service 113, wherein, as shown in table 2, parameters of the switchcyclesrcs polling video stream request include a video stream list and a subordinate conference number;
the signaling service 113 of the market-level video conference system 1 determines a first passenger field simulation terminal 11521 and acquires a video stream request list of privateLayoutSSRCs thereof;
the signaling service 113 of the system 1 traverses the video stream list in the first round of patrol video stream requests of the switchcyclesrcs, traverses the privatelayout ssrcs video stream request list of the first passenger field simulation terminal 11521, and takes the intersection of the two lists to generate a ssrcsToMS target video stream list, as shown in table 3;
the signaling service 113 of the system 1 initiates a setprivatelayout layout ssrc video stream switching request to the first passenger-hall simulation terminal 11521 by using the ssrcsToMS target video stream list, so that the signaling service requests the video stream of the ssrcsToMS target video stream list;
the signaling service 113 of the market-level video conference system 1 receives a requestvideosrcs video stream request signaling from the first passenger-field simulation terminal 11521, sends a RequestStreams video stream request to the media service 114 of the market-level conference system 1, and updates the video stream request list of the first passenger-field simulation terminal 11521;
saving a list of ssrcsToMS target video streams;
when the first passenger field simulation terminal 11521 enters a meeting, the signaling service 113 determines whether the polling exists in the market-level video conference system 1, and because the polling exists in the market-level video conference system 1, the original privatelayout ssrcs video stream request list is not issued to the third passenger field simulation terminal 11523 and the fourth passenger field simulation terminal 11524.
The conference control service 112 of the urban video conference system 2 receives a conference creation request sent by the conference control service 112 from the provincial video conference system, and creates a local conference; the conference creating request comprises information such as a second participant list, a multi-picture polling layout and the like;
the conference control service 112 of the municipal video conference system 2 traverses the secondary conference participant list, generates a fifth main field simulation terminal 11515 and a fifth passenger field simulation terminal 11525 for the county-level video conference system 3 and a sixth main field simulation terminal 11516 and a sixth passenger field simulation terminal 11526 for the county-level video conference system 4 according to the organization structure condition of the distribution of the conference participants, as shown in fig. 8, adds the fifth main field simulation terminal 11515 and the sixth main field simulation terminal 11516 to the conference participant list, and the added conference participant list of the current stage is: a city level 2 terminal 3, a county level 3 terminal 6, a county level 4 terminal 7, a fifth main field simulation terminal 11515 and a sixth main field simulation terminal 11516;
the conference control service 112 of the city-level video conference system 2 configures a privatelayoutsrcs video stream request list for the fifth and sixth venue simulation terminals 11525 and 11526, that is, the privatelayoutsrcs video stream request list of the fifth venue simulation terminal 11525 includes the video stream of the county-level 3 terminal 6, and the privatelayoutsrcs video stream request list of the sixth venue simulation terminal 11526 includes the video stream of the county-level 4 terminal 7, as shown in table 1;
removing irrelevant participants, adding corresponding room simulation terminals to the participant list of the subordinate video conference system, and initiating a conference creation request to the conference control service 112 of the county-level video conference system 3 and the county-level video conference system 4, that is, in the conference creation request initiated to the conference control service 112 of the county-level video conference system 3, the fifth participant list includes: a county level 3 terminal 6 and a fifth passenger space simulation terminal 11525; in the conference creation request initiated by the conference control service 112 of the county-level video conference system 4, the sixth conferee list includes: county level 4 terminal 7, sixth place of sale simulation terminal 11526.
The media service 114 of the city-level video conference system 2 receives the video stream from the city-level 2 terminal 3, acquires the video stream from the county-level 3 terminal 6 acquired by the fifth room simulation terminal 11525 through the fifth main room simulation terminal 11515, and acquires the video stream from the county-level 4 terminal 7 acquired by the sixth room simulation terminal 11526 through the sixth main room simulation terminal 11516;
the media service 114 of the city level videoconference system 2 receives the RequestStreams request from the signaling service 113, updates the privatelayoutsrcs video stream request list of the city level 2 terminal 3, and forwards the video streams of the city level 2 terminal 3, the county level 3 terminal 6, and the county level 4 terminal 7 to the cascade gateway service 115 of the provincial videoconference system through the second venue simulation terminal 11522.
The signaling service 113 of the urban video conference system 2 receives a switch cycle srcs polling video stream request from the signaling service 113 of the provincial video conference system 11, and traverses the second conferee list;
determining a fifth main site simulation terminal 11515 of the county-level video conference system 3 and a sixth main site simulation terminal 11516 of the county-level video conference system 4, and determining conference numbers, signaling service addresses and ports of the county-level video conference system 3 and the county-level video conference system 4;
the city-level video conference system 2 sends a switching cycle srcs polling video stream request to the county-level video conference system 3 and the county-level video conference system 4 through the signaling service 113, wherein as shown in table 2, parameters of a first polling video stream request of the switching cycle srcs include a video stream list and a lower-level conference number in a second polling video stream request of the switching cycle srcs;
the signaling service 113 of the system 2 determines the second room simulation terminal 11522 and obtains its privateLayoutSSRCs video stream request list;
the signaling service 113 of the market-level video conference system 2 traverses the video stream list in the first round-robin video stream request of the switchcyclesrcs, and simultaneously traverses the privatelayout ssrcs video stream request list of the second passenger field simulation terminal 11522, and takes the intersection of the two lists to generate a ssrcsToMS target video stream list, as shown in table 3;
the signaling service 113 of the system 2 initiates a setprivatelayout layout ssrc video stream switching request to the second passenger-hall simulation terminal 11522 by using the ssrcsToMS target video stream list, so that the second passenger-hall simulation terminal requests the video stream of the ssrcsToMS target video stream list;
the signaling service 113 of the market-level video conference system 2 receives the requestvideosrcs video stream request signaling from the second passenger-field simulation terminal 11522, sends a RequestStreams video stream request to the media service 114 of the market-level conference system 2, and updates the video stream request list of the second passenger-field simulation terminal 11522;
saving a list of ssrcsToMS target video streams;
when the second passenger field simulation terminal 11522 enters a meeting, the signaling service 113 determines whether there is polling in the municipal video conference system 2, and because there is polling in the municipal video conference system 2, the original privateLayoutSSRCs video stream request list is not delivered to the fifth passenger field simulation terminal 11525 and the sixth passenger field simulation terminal 11526.
The conference control service 112 of the county-level video conference system 1 receives a conference creation request sent by the conference control service 112 of the city-level video conference system 1, and creates a current-level conference; the conference creating request comprises information such as a third participant list, a multi-picture polling layout and the like;
the conference service 112 of the county-level videoconference system 1 traverses the list of the third conferees, and if the subordinate conferee terminal is not involved, ends the creation.
The media service 114 of the county level conference system 1 receives the video stream from the county level 1 terminal 4;
the media service 114 of the prefecture-level conference system 1 receives the RequestStreams request from the signaling service 113, updates the privateLayoutSSRCs video stream request list of the prefecture-level 1 terminal 4, and forwards the video stream of the prefecture-level 1 terminal 4 to the cascade gateway service 115 of the prefecture-level video conference system 1 through the third venue simulation terminal 11523.
The signaling service 113 of the county-level video conference system 1 receives the switch cycle srcs polling video stream request from the signaling service 113 of the city-level video conference system 1, traverses the third conferee list, and if no lower-level video conference system exists, ends the traversal;
the signaling service 113 of the county-level video conference system 1 determines the third venue simulation terminal 11523 and obtains the list of the private layouts ssrcs video stream requests thereof, as shown in table 1;
the signaling service 113 of the county-level video conference system 1 traverses the video stream list in the switchcyclesrcs polling video stream request, traverses the privateLayoutSSRCs video stream request list of the third passenger space simulation terminal 11523, and takes the intersection of the two lists to generate a ssrcsToMS target video stream list, as shown in table 3;
the signaling service 113 of the county-level video conference system 1 initiates a setprivatelayout source ssrc video stream switching request to the third venue simulation terminal 11523 through the ssrcsToMS target video stream list, so that the signaling service requests the video stream of the ssrcsToMS target video stream list;
saving a list of ssrcsToMS target video streams;
when the third passenger-yard simulation terminal 11523 enters a meeting, the signaling service 113 determines whether there is polling in the county-level video conference system 1, and since there is no polling in the county-level video conference system 1, the signaling service is ended.
The conference control service 112 of the county-level video conference system 2 receives a conference creation request from the conference control service 112 of the city-level video conference system 1, and creates a current-level conference; the conference creating request comprises information such as a fourth participant list, a multi-picture polling layout and the like;
the conference service 112 of the county-level videoconference system 2 traverses the fourth conferee list, and if the subordinate conferee terminal is not involved, ends the creation.
The media service 114 of the county level conferencing system 2 receives the video stream from the county level 2 terminal 5;
the media service 114 of the prefecture-level conference system 2 receives the RequestStreams request from the signaling service 113, updates the privateLayoutSSRCs video stream request list of the prefecture-level 2 terminal 5, and accordingly forwards the video stream of the prefecture-level 2 terminal 5 to the cascade gateway service 115 of the prefecture-level video conference system 1 through the fourth venue simulation terminal 11524.
The signaling service 113 of the county-level video conference system 2 receives the switching cycle srcs polling video stream request from the signaling service 113 of the city-level video conference system 1, traverses the fourth conferee list, and if no subordinate video conference system exists, ends the traversal;
the signaling service 113 of the county-level video conference system 2 determines the fourth venue simulation terminal 11524 and obtains the private layouts ssrcs video stream request list thereof, as shown in table 1;
the signaling service 113 of the county-level video conference system 2 traverses the video stream list in the switchcyclesrcss round-robin video stream request, traverses the privateLayoutSSRCs video stream request list of the fourth yard simulation terminal 11524 at the same time, and takes the intersection of the two lists to generate a ssrcsToMS target video stream list, as shown in table 3;
the signaling service 113 of the county-level video conference system 2 initiates a setprivatelayout source ssrc video stream switching request to the fourth venue simulation terminal 11524 through the ssrcsToMS target video stream list, so that the signaling service requests the video stream of the ssrcsToMS target video stream list;
saving a list of ssrcsToMS target video streams;
when the fourth passenger-yard simulation terminal 11524 enters a meeting, the signaling service 113 determines whether there is polling in the county-level video conference system 2, and ends the signaling service if there is no polling in the county-level video conference system 2.
The conference control service 112 of the county-level video conference system 3 receives a conference creation request sent by the conference control service 112 of the city-level video conference system 2, and creates a current-level conference; the conference creating request comprises information such as a fifth participant list, a multi-picture polling layout and the like;
the conference service 112 of the county-level videoconference system 3 traverses the fifth conferee list and ends the creation if a subordinate conferee terminal is not involved.
The media service 114 of the county level conferencing system 3 receives the video stream from the county level 3 terminal 6;
the media service 114 of the prefecture-level conference system 3 receives the RequestStreams request from the signaling service 113, updates the privateLayoutSSRCs video stream request list of the prefecture-level 3 terminal 6, and accordingly forwards the video stream of the prefecture-level 3 terminal 6 to the cascade gateway service 115 of the prefecture-level video conference system 2 through the fifth venue simulation terminal 11525.
The signaling service 113 of the county-level video conference system 3 receives the switching cycle srcs polling video stream request from the signaling service 113 of the city-level video conference system 3, traverses the fifth conferee list, and if no lower-level video conference exists, ends the traversal;
the signaling service 113 of the county-level video conference system 3 determines the fifth room simulation terminal 11525, and obtains the video stream request list of privatelayoutsrcs thereof, as shown in table 1;
the signaling service 113 of the county-level video conference system 3 traverses the video stream list in the switchcyclesrcs polling video stream request, traverses the privatelayout ssrcs video stream request list of the fifth passenger field simulation terminal 11525, and takes the intersection of the two lists to generate a ssrcsToMS target video stream list, as shown in table 3;
the signaling service 113 of the county-level video conference system 3 initiates a setprivatelayout source ssrc video stream switching request to the fifth passenger field simulation terminal 11525 through the ssrcsToMS target video stream list, so that the fifth passenger field simulation terminal requests the video stream of the ssrcsToMS target video stream list;
saving a list of ssrcsToMS target video streams;
when the fifth passenger-yard simulation terminal 11525 enters a meeting, the signaling service 113 determines whether there is a round trip for the county-level videoconference system 3, and ends the signaling service if there is no round trip for the county-level videoconference system 3.
The conference control service 112 of the county-level video conference system 4 receives a conference creation request sent by the conference control service 112 from the city-level video conference system 2, and creates a local-level conference; the conference creating request comprises information such as a sixth participant list, a multi-picture polling layout and the like;
the conference control service 112 of the county-level videoconference system 4 traverses the sixth participant list and ends the conference if a subordinate participant terminal is not involved.
The media service 114 of the county level conference system 4 receives the video stream from the county level 4 terminal 7;
the media service 114 of the prefecture conference system 4 receives the RequestStreams video stream request from the signaling service 113, updates the privatelayoutsrcs video stream request list of the prefecture 4 terminal 7, and forwards the video stream of the prefecture 4 terminal 7 to the cascade gateway service 115 of the prefecture video conference system 2 through the sixth venue simulation terminal 11526.
The signaling service 113 of the county-level video conference system 4 receives the switch cycle srcs polling video stream request from the signaling service 113 of the city-level video conference system 2, traverses the sixth conferee list, and if no lower-level video conference exists, ends the traversal;
the signaling service 113 of the county-level video conference system 4 determines the sixth venue simulation terminal 11526, and obtains the video stream request list of privatelayoutsrcs thereof, as shown in table 1;
the signaling service 113 of the county-level video conference system 4 traverses the video stream list in the switchcyclesrcs polling video stream request, traverses the privatelayout ssrcs video stream request list of the sixth passenger field simulation terminal 11526, and takes the intersection of the two lists to generate a ssrcsToMS target video stream list, as shown in table 3;
the signaling service 113 of the county-level video conference system 4 initiates a setprivatelayout layout ssrc video stream switching request to the sixth venue analog terminal 11526 through the ssrcsToMS target video stream list, so that the sixth venue analog terminal requests a video stream of the ssrcsToMS target video stream list;
saving a list of ssrcsToMS target video streams;
when the sixth passenger-yard simulation terminal 11526 enters a meeting, the signaling service 113 determines whether there is polling in the county-level video conference system 4, and ends the signaling service if there is no polling in the county-level video conference system 4.
Figure BDA0003865704470000321
TABLE 3
As shown in fig. 9, a cross-domain polling device for a cascading video conference provided in an embodiment of the present invention includes:
a first receiving module 901, configured to receive a polling video stream request carrying a video stream list sent by a second target network device;
a determining module 902, configured to use an intersection of the video stream list and the video stream request list corresponding to the first target network-side device as a target video stream list, so that the second target network-side device obtains a target video stream according to the target video stream list and displays the target video stream on a corresponding terminal according to a multi-picture round-robin layout;
the first target network side device is a subordinate network side device of a second target network side device, the video stream list is a terminal video stream list acquired as required when the second target network side device executes periodic multi-picture polling, and the video stream request list is a video stream list corresponding to all the subordinate and subordinate terminals belonging to the first target network side device and entering the multi-picture polling layout of the second target network side device.
Optionally, before receiving a polling video stream request carrying a video stream list sent by a second target network device, the first receiving module 901 is further configured to:
after receiving a conference creating request, creating a first main field simulation terminal and a first passenger field simulation terminal corresponding to a third target network side device;
the first target network side equipment configures a corresponding video stream request list for the third target network side equipment according to a conferee list, multi-picture polling layout and a conference system organization structure carried in the conference creating request;
the first target network side equipment sends a conference creating request to the third target network side equipment so that the third target network side equipment creates the current-level conference according to the conference creating request;
the first passenger field simulation terminal is used for acquiring a target video stream from third target network side equipment according to a target video stream list of the third target network side equipment, the first main field simulation terminal is used for sending the video stream acquired by the first passenger field simulation terminal to media service of the first target network side equipment, and the third target network side equipment is directly subordinate lower-level network side equipment of the first target network side equipment.
Optionally, the determining module 902 is further configured to:
determining a third network side device according to the participant list and the conference system organization structure;
determining a corresponding conference number of the third network side equipment in the cascade conference as a target conference number;
and sending a polling video stream request to third target network side equipment according to the target meeting number.
As shown in fig. 10, a cross-domain polling device for a cascading video conference provided in an embodiment of the present invention includes:
a second receiving module 1001, configured to send a polling video stream request to a first target network side device after a polling period is reached, so that the first target network side device determines a target video stream list according to a video stream list carried in the first polling video stream request and a video stream request list corresponding to the first target network side device;
the third receiving module 1002 is configured to obtain a target video stream according to the target video stream list, and display the target video stream on a corresponding terminal according to a multi-picture polling layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device executes periodic multi-picture polling, and the video stream request list is a video stream list corresponding to all the directly belonging first target network side devices and subordinate terminals entering the multi-picture polling layout of the second target network side device.
Optionally, the second receiving module 1001 is further configured to:
receiving a request for establishing a conference;
configuring a second main field simulation terminal and a second passenger field simulation terminal for the first target network side equipment;
configuring a corresponding video stream request list for the first target network side equipment according to a participant list, a multi-picture polling layout and a conference system organization structure carried in the conference creating request;
and sending a conference creating request to the first target network side equipment so that the first target network side equipment creates the current-level conference according to the conference creating request.
Optionally, the third receiving module 1002 is specifically configured to:
acquiring a target video stream from first target network side equipment according to the target video stream list;
and sending the target video stream of the first target network side equipment acquired by the second passenger field simulation terminal to the media service of the second target network side equipment through the second main field simulation terminal.
As shown in fig. 11, an electronic device 110 is further provided for the embodiment of the present invention, and the electronic device 110 shown in fig. 11 is only an example and should not bring any limitation to the function and the application range of the embodiment of the present disclosure.
As shown in fig. 11, the electronic device 110 may be embodied in the form of a general purpose computing device, which may be a server, for example. The components of the electronic device 111 may include, but are not limited to: the at least one processor 111, the at least one memory 112 storing instructions executable by the processor 111, and the bus 113 connecting the various system components (including the memory 112 and the processor 111), the processor 111 being a processor of an electronic device.
The processor 111 executes executable instructions to implement any one of the cross-domain polling methods for the cascading video conference in the above embodiments.
Bus 113 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a processor, or a local bus using any of a variety of bus architectures.
The memory 112 may include readable media in the form of volatile memory, such as Random Access Memory (RAM) 1121 and/or cache memory 1122, and may further include Read Only Memory (ROM) 1123.
Memory 112 may also include a program/utility 1125 having a set (at least one) of program modules 1124, such program modules 1124 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Electronic device 110 may also communicate with one or more external devices 114 (e.g., keyboard, pointing device, etc.), with one or more devices that enable a user to interact with electronic device 110, and/or with any devices (e.g., router, modem, etc.) that enable electronic device 110 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 115. Also, the electronic device 110 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 116. As shown in FIG. 11, the network adapter 116 communicates with the other modules of the electronic device 110 via the bus 113. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 110, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, to name a few.
An embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the computer program implements any of the steps of the cross-domain polling method for a cascading video conference.
Based on the same inventive concept, the embodiment of the present invention further provides a cross-domain polling method for a cascading video conference, and because the device corresponding to the method is the first target network side device in the multi-stage cascading video conference system in the embodiment of the present invention, and the principle of solving the problem of the method is similar to that of the device, the implementation of the method can refer to the implementation of the system, and the repeated parts are not described again.
As shown in fig. 12, a cross-domain polling method for a cascading video conference provided in an embodiment of the present invention is applied to a tree network cascading video conference system, and the method includes the following steps:
s1201, a first target network side device receives a polling video stream request which is sent by a second target network side device and carries a video stream list;
s1202, the first target network side device takes the intersection of the video stream list and the video stream request list corresponding to the first target network side device as a target video stream list, so that the second target network side device obtains a target video stream according to the target video stream list and displays the target video stream on a corresponding terminal according to multi-picture polling layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device executes periodic multi-picture polling, and the video stream request list is a video stream list corresponding to all the directly belonging first target network side devices and subordinate terminals entering the multi-picture polling layout of the second target network side device.
Optionally, before the first target network side device receives the first polling video stream request carrying the video stream list sent by the second target network side device, the method further includes:
after receiving the conference creating request, the first target network side equipment creates a first main field simulation terminal and a first passenger field simulation terminal corresponding to the third target network side equipment;
the first target network side equipment configures a corresponding video stream request list for the third target network side equipment according to a participant list, a multi-picture polling layout and a conference system organization structure carried in the conference creating request;
the first target network side equipment sends a conference creating request to the third target network side equipment so that the third target network side equipment creates the current-level conference according to the conference creating request;
the first passenger field simulation terminal is used for acquiring a target video stream of a third target network side device according to a target video stream list of the third target network side device, the first main field simulation terminal is used for sending the video stream acquired by the first passenger field simulation terminal to a media service of the first target network side device, and the third target network side device is a directly subordinate lower network side device of the first target network side device.
Optionally, after the first target network side device receives the polling video stream request carrying the video stream list sent by the second target network side device, before the first target network side device uses the intersection of the video stream list and the video stream request list corresponding to the first target network side device as the target video stream list, the method further includes:
the first target network side equipment determines third network side equipment according to the participant list and the conference system organization structure;
the first target network side equipment determines a corresponding conference number of the third network side equipment in the cascade conference as a target conference number;
and the first target network side equipment sends a polling video stream request to the third target network side equipment according to the target conference number.
Based on the same inventive concept, the embodiment of the present invention further provides a cross-domain polling method for a cascading video conference, and because the device corresponding to the method is the second target network side device in the multi-stage cascading video conference system in the embodiment of the present invention, and the principle of solving the problem in the method is similar to that of the device, the implementation of the method can refer to the implementation of the system, and the repeated parts are not described again.
As shown in fig. 13, an embodiment of the present invention further provides a cross-domain polling method for a cascaded video conference, which is applied to a tree network cascaded video conference system, and the method includes the following steps:
s1301, after the second target network side equipment reaches a polling period, sending a first polling video stream request to the first target network side equipment, so that the first target network side equipment determines a target video stream list according to a video stream list carried in the first polling video stream request and a video stream request list corresponding to the first target network side equipment;
s1302, the second target network side device obtains a target video stream according to the target video stream list and displays the target video stream on the corresponding terminal according to the multi-picture polling layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device executes periodic multi-picture polling, and the video stream request list is a video stream list corresponding to all the directly belonging first target network side devices and subordinate terminals entering the multi-picture polling layout of the second target network side device.
Optionally, the method further includes:
the second target network side equipment receives a conference creating request;
the second target network side equipment configures a second main field simulation terminal and a second passenger field simulation terminal for the first target network side equipment;
the second target network side equipment configures a corresponding video stream request list for the first target network side equipment according to a participant list, a multi-picture polling layout and a conference system organization structure carried in the conference creating request;
and the second target network side equipment sends a conference creating request to the first target network side equipment so that the first target network side equipment creates the current-level conference according to the conference creating request.
Optionally, the obtaining, by the second target network device, the target video stream according to the target video stream list includes:
the second target network side equipment acquires the target video stream from the first target network side equipment through the second passenger room simulation terminal according to the target video stream list;
and the second target network side equipment sends the target video stream of the first target network side equipment acquired by the second passenger field simulation terminal to the media service of the second target network side equipment through the second main field simulation terminal.
The present application is described above with reference to block diagrams and/or flowchart illustrations of methods, apparatus (systems) and/or computer program products according to embodiments of the application. It will be understood that one block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, and/or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer and/or other programmable data processing apparatus, create means for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks.
Accordingly, the subject application may also be embodied in hardware and/or in software (including firmware, resident software, micro-code, etc.). Furthermore, the present application may take the form of a computer program product on a computer-usable or computer-readable storage medium having computer-usable or computer-readable program code embodied in the medium for use by or in connection with an instruction execution system. In the context of this application, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. A cross-domain polling method for a cascade video conference is characterized by being applied to a tree network cascade video conference system, and the method comprises the following steps:
a first target network side device receives a polling video stream request which is sent by a second target network side device and carries a video stream list;
the first target network side device takes the intersection of the video stream list and the video stream request list corresponding to the first target network side device as a target video stream list, so that the second target network side device obtains a target video stream according to the target video stream list and displays the target video stream on a corresponding terminal according to multi-picture polling layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device performs periodic multi-picture polling, and the video stream request list is a list of all direct and subordinate video streams which enter the multi-picture polling layout of the second target network side device and belong to the first target network side device.
2. The method of claim 1, wherein before the first target network-side device receives the polling video stream request carrying the video stream list sent by the second target network-side device, the method further includes:
after receiving the conference creating request, the first target network side equipment creates a first main field simulation terminal and a first passenger field simulation terminal corresponding to third target network side equipment;
the first target network side equipment configures a corresponding video stream request list for the third target network side equipment according to a participant list, a multi-picture polling layout and a conference system organization structure carried in the conference creating request;
the first target network side device sends the conference creating request to the third target network side device, so that the third target network side device creates a current-level conference according to the conference creating request;
the first passenger field simulation terminal is used for acquiring a target video stream from a third target network side device according to a target video stream list of the third target network side device, the first main field simulation terminal is used for sending the video stream acquired by the first passenger field simulation terminal to a media service of the first target network side device, and the third target network side device is a subordinate network side device of the first target network side device.
3. The method according to claim 2, wherein after the first target network-side device receives a round-robin video stream request carrying a video stream list sent by a second target network-side device, before the first target network-side device uses an intersection of the video stream list and a video stream request list corresponding to the first target network-side device as a target video stream list, the method further includes:
the first target network side equipment determines the third network side equipment according to the conferee list and the conference system organization structure;
the first target network side equipment determines a corresponding conference number of the third network side equipment in the cascade conference as a target conference number;
and the first target network side equipment sends the polling video stream request to the third target network side equipment according to the target conference number.
4. A cross-domain polling method for a cascade video conference is characterized by being applied to a tree network cascade video conference system, and the method comprises the following steps:
after the second target network side equipment reaches a polling period, sending a polling video stream request to first target network side equipment, so that the first target network side equipment determines a target video stream list according to a video stream list carried in the polling video stream request and a video stream request list corresponding to the first target network side equipment;
the second target network side equipment acquires a target video stream according to the target video stream list and displays the target video stream on a corresponding terminal according to the multi-picture polling layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device performs periodic multi-picture polling, and the video stream request list is all video stream lists corresponding to the direct terminal belonging to the first target network side device and the subordinate terminal entering the multi-picture polling layout of the second target network side device.
5. The method of claim 4, further comprising:
the second target network side equipment receives a conference creating request;
the second target network side equipment configures a second main field simulation terminal and a second passenger field simulation terminal for the first target network side equipment;
the second target network side equipment configures a corresponding video stream request list for the first target network side equipment according to a participant list, a multi-picture polling layout and a conference system organization structure carried in the conference creating request;
and the second target network side equipment sends the conference creating request to the first target network side equipment so that the first target network side equipment creates the current-level conference according to the conference creating request.
6. The method of claim 5, wherein the second target network-side device obtaining the target video stream according to the target video stream list comprises:
the second target network side equipment acquires the target video stream from the first target network side equipment through the second passenger space simulation terminal according to the target video stream list;
and the second target network side equipment sends the target video stream of the first target network side equipment acquired by the second passenger field simulation terminal to the media service of the second target network side equipment through the second main field simulation terminal.
7. The utility model provides a cascade video conference cross-domain round robin device which characterized in that includes:
the first receiving module is used for receiving a polling video stream request which is sent by second target network side equipment and carries a video stream list;
a determining module, configured to use an intersection of the video stream list and a video stream request list corresponding to the first target network device as a target video stream list, so that the second target network device obtains a target video stream according to the target video stream list, and displays the target video stream on a corresponding terminal according to a multi-picture round-robin layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device performs periodic multi-picture polling, and the video stream request list is a list of all direct and subordinate video streams which enter the multi-picture polling layout of the second target network side device and belong to the first target network side device.
8. The utility model provides a cascade video conference cross-domain round robin device which characterized in that includes:
a second receiving module, configured to send a polling video stream request to a first target network side device after a polling period is reached, so that the first target network side device determines a target video stream list according to a video stream list carried in the polling video stream request and a video stream request list corresponding to the first target network side device;
the third receiving module is used for acquiring the target video stream according to the target video stream list and displaying the target video stream on the corresponding terminal according to the multi-picture polling layout;
the first target network side device is a subordinate network side device to which the second target network side device directly belongs, the video stream list is a terminal video stream list acquired as required when the second target network side device performs periodic multi-picture polling, and the video stream request list is a list of all direct and subordinate video streams which enter the multi-picture polling layout of the second target network side device and belong to the first target network side device.
9. An electronic device, comprising a processor; a memory for storing processor-executable instructions; wherein the processor implements the steps of the cascading video conference cross-domain polling method of any one of claims 1-3 or 4-6 by executing the executable instructions.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the cross-domain polling method for a cascading video conference according to any one of claims 1 to 3 or 4 to 6.
CN202211181565.5A 2022-09-27 2022-09-27 Cross-domain polling method and device for cascading video conference and electronic equipment Pending CN115529433A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211181565.5A CN115529433A (en) 2022-09-27 2022-09-27 Cross-domain polling method and device for cascading video conference and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211181565.5A CN115529433A (en) 2022-09-27 2022-09-27 Cross-domain polling method and device for cascading video conference and electronic equipment

Publications (1)

Publication Number Publication Date
CN115529433A true CN115529433A (en) 2022-12-27

Family

ID=84700047

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211181565.5A Pending CN115529433A (en) 2022-09-27 2022-09-27 Cross-domain polling method and device for cascading video conference and electronic equipment

Country Status (1)

Country Link
CN (1) CN115529433A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117119140A (en) * 2023-10-24 2023-11-24 浙江华创视讯科技有限公司 Method and device for realizing control operation, storage medium and electronic device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117119140A (en) * 2023-10-24 2023-11-24 浙江华创视讯科技有限公司 Method and device for realizing control operation, storage medium and electronic device
CN117119140B (en) * 2023-10-24 2024-02-02 浙江华创视讯科技有限公司 Method and device for realizing control operation, storage medium and electronic device

Similar Documents

Publication Publication Date Title
US9571793B2 (en) Methods, systems and program products for managing resource distribution among a plurality of server applications
CN106162040A (en) The method and apparatus that video conference accesses in many ways
CN101291417B (en) Polling method and system for videoconference system
CN106331581A (en) Method and device for communication between mobile terminal and video networking terminal
US9210200B1 (en) Methods, systems and program products for connecting users to operating nodes
CN110213526B (en) Video conference creation method, video conference system, storage medium, and electronic apparatus
CN102934425A (en) Unified communication based multi-screen video system
CN110035256B (en) Processing method and device for monitoring resource permission
CN104284132A (en) Video communication method and device
CN109314760A (en) Video conferencing system, application server, equipment, video-meeting method and the non-transitory computer-readable medium for storing videoconference program
CN115529433A (en) Cross-domain polling method and device for cascading video conference and electronic equipment
CN113542660A (en) Method, system and storage medium for realizing conference multi-picture high-definition display
CN112637671A (en) Screen sharing method and system
CN109698818B (en) Method and device for acquiring online user and cross-streaming media communication
WO2004098125A1 (en) Distributed multimedia conference system based on ip web
Wu et al. Towards multi-site collaboration in tele-immersive environments
CN108156413A (en) Transmission method and device, the MCU of video conference
CN105191295B (en) Method and apparatus for managing Media Stream in video conference
VÁPENíK et al. Secured web oriented videoconferencing system for educational purposes using WebRTC technology
CN203984568U (en) A kind ofly can be turned by point to point call the video conferencing system of tripartite talks
CN203984565U (en) A kind of video conferencing system of integrated management
CN110636244B (en) Video conference server, system, control method and storage medium
CN109743585B (en) Method and device for collecting monitoring videos and cloning favorites
US9912910B2 (en) Media content updating method, apparatus, and system
CN110674421A (en) Data query method and system for video conference

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination