CN111131754A

CN111131754A - Control split screen method and device of conference management system

Info

Publication number: CN111131754A
Application number: CN201911361448.5A
Authority: CN
Inventors: 安玉; 吴芳华; 张楠松; 王艳辉
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-12-25
Filing date: 2019-12-25
Publication date: 2020-05-08

Abstract

The embodiment of the invention provides a screen splitting control method and a screen splitting control device for a conference management system, wherein the conference management system comprises a conference management server, a video network core server and a video network soft terminal, the video network soft terminal is provided with a screen splitting component, the conference management server is used for generating a conference entering instruction and a screen splitting instruction and sending the conference entering instruction and the screen splitting instruction to the video network core server, and the method comprises the following steps: the video network soft terminal receives the conference access instruction forwarded by the video network core server; the video networking soft terminal accesses a conference according to the conference entering instruction and calls the screen switching component to receive the screen splitting instruction; the video networking soft terminal adopts the screen switching component to determine a screen splitting mode based on the screen splitting instruction; and the video network soft terminal adopts the screen switching component to adjust a video display interface according to the screen splitting mode. Therefore, the screen switching component realizes the dynamic switching of the split screen mode.

Description

Control split screen method and device of conference management system

Technical Field

The invention relates to the technical field of video networking, in particular to a screen control splitting method of a conference management system and a screen control splitting device of the conference management system.

Background

The Vision networking adopts Vision Vera real-time high-definition video exchange technology, realizes the real-time transmission of the whole network high-definition video which can not be realized by the prior Internet, integrates dozens of services such as high-definition video conference, video monitoring, remote training, intelligent monitoring and analysis, emergency command, video telephone, live broadcast, television mail, information distribution and the like into a system platform, and realizes the real-time interconnection and intercommunication of high-definition quality video communication through various terminal devices.

At present, when a video networking soft terminal participates in a conference, because the conference has at most four participants (participant terminals), the prior art can only realize that video pictures are displayed in a four-screen mode no matter a few participants (participant terminals), and the screens can not be dynamically switched when the participants (participant terminals) are dynamically increased or decreased.

Disclosure of Invention

In view of the above problems, embodiments of the present invention are provided to provide a control split screen method of a conference management system, and a control split screen apparatus of a corresponding conference management system, which overcome or at least partially solve the above problems.

In order to solve the above problems, an embodiment of the present invention discloses a screen splitting control method for a conference management system, where the conference management system includes a conference management server, a video network core server, and a video network soft terminal, where the video network soft terminal has a screen splitting component, and the conference management server is configured to generate a conference entering instruction and a screen splitting instruction, and send the conference entering instruction and the screen splitting instruction to the video network core server, and the method includes:

the video network soft terminal receives the conference access instruction forwarded by the video network core server;

the video networking soft terminal accesses a conference according to the conference entering instruction and calls the screen switching component to receive the screen splitting instruction;

the video networking soft terminal adopts the screen switching component to determine a screen splitting mode based on the screen splitting instruction;

and the video network soft terminal adopts the screen switching component to adjust a video display interface according to the screen splitting mode.

Optionally, the screen splitting instruction carries a video networking number, and the video networking soft terminal adopts the screen switching component to determine the screen splitting mode based on the screen splitting instruction, including:

the video networking soft terminal extracts the video networking number in the screen splitting instruction by adopting the screen cutting component;

and the video networking soft terminal determines a screen splitting mode according to the video networking number in the screen splitting instruction by adopting the screen switching component.

Optionally, the video networking soft terminal adopts the screen switching component to adjust a video display interface according to the split screen mode, including:

the video network soft terminal determines the number of display controls according to the split screen mode by adopting the screen switching component;

the video networking soft terminal adopts the screen switching component to determine a target participant terminal and a video display sequence corresponding to the target participant terminal according to the video networking number;

and the video network soft terminal adopts the screen switching component to adjust a video display interface according to the display control number, the target participating terminal and the video display sequence corresponding to the target participating terminal.

Optionally, the conference management system further comprises a video networking hard terminal and a streaming media server,

the video networking hard terminal is used for sending video data based on a video networking protocol to the video networking core server;

the streaming media server is used for receiving the video data based on the video networking protocol forwarded by the video networking core server, converting the video data based on the video networking protocol into video data based on the internet protocol, and sending the video data based on the internet protocol to the video networking soft terminal;

and the video data based on the Internet protocol carries a video networking number corresponding to the video networking hard terminal.

Optionally, the method further comprises:

the video network soft terminal adopts the screen switching component to determine a target video display position corresponding to the video network hard terminal according to the video network number in the video data based on the Internet protocol;

and the video networking soft terminal renders the video data based on the Internet protocol on the video display interface by adopting the screen switching component according to the target video display position.

The embodiment of the invention also discloses a screen splitting control device of a conference management system, the conference management system comprises a conference management server, a video network core server and a video network soft terminal, the video network soft terminal is provided with a screen splitting component, the conference management server is used for generating a conference entering instruction and a screen splitting instruction and sending the conference entering instruction and the screen splitting instruction to the video network core server, and the video network soft terminal comprises:

the conference entrance instruction receiving module is used for receiving the conference entrance instruction forwarded by the video network core server;

the screen splitting instruction receiving module is used for accessing a conference according to the conference entering instruction and calling the screen switching component to receive the screen splitting instruction;

the screen splitting mode determining module is used for determining a screen splitting mode based on the screen splitting instruction by adopting the screen cutting component;

and the interface adjusting module is used for adjusting a video display interface by adopting the screen cutting component according to the screen splitting mode.

Optionally, the screen splitting instruction carries a video networking number, and the screen splitting mode determining module includes:

the video networking number extraction sub-module is used for extracting the video networking number in the screen splitting instruction by adopting the screen cutting component;

and the screen splitting mode determining submodule is used for determining the screen splitting mode according to the video networking number in the screen splitting instruction by adopting the screen cutting assembly.

Optionally, the interface adjusting module includes:

the display control number determining submodule is used for determining the number of display controls according to the split screen mode by adopting the screen cutting assembly;

the target participant terminal determining submodule is used for determining a target participant terminal and a video display sequence corresponding to the target participant terminal according to the video networking number by adopting the screen switching component;

and the interface adjusting submodule is used for adjusting a video display interface by adopting the screen switching component according to the display control number, the target participating terminals and the video display sequence corresponding to the target participating terminals.

Optionally, the apparatus further comprises:

the target video display position determining module is used for determining a target video display position corresponding to the video network hard terminal by the video network soft terminal according to the video network number in the video data based on the Internet protocol by adopting the screen switching component;

and the rendering module is used for rendering the video data based on the Internet protocol on the video display interface by the video networking soft terminal according to the target video display position by adopting the screen cutting component.

The embodiment of the invention also discloses an electronic device, which comprises:

one or more processors; and

one or more machine-readable media having instructions stored thereon, which when executed by the one or more processors, cause the electronic device to perform one or more of the method steps as described in embodiments of the invention.

The embodiment of the invention also discloses a computer readable storage medium, which stores a computer program for enabling a processor to execute the steps of the method according to the embodiment of the invention.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, the conference-entering instruction forwarded by the core server of the video network is received through the soft terminal of the video network, the conference is accessed according to the conference-entering instruction, and the screen-switching component is called to receive the screen-splitting instruction; determining a screen splitting mode based on a screen splitting instruction by adopting a screen cutting component; and adjusting the video display interface by adopting the screen cutting component according to the screen splitting mode. Therefore, the screen switching component realizes dynamic switching of the split screen mode, the number and the display positions of the video pictures can be changed along with the change of the split screen mode, and the effects of real-time switching of the video display interface, smooth pictures and no delay are achieved.

Drawings

Fig. 1 is a flowchart illustrating steps of an embodiment of a method for controlling split screens of a conference management system according to an embodiment of the present invention;

FIG. 2A is a schematic view of a split-screen mode according to an embodiment of the present invention;

FIG. 2B is a schematic view of another split screen mode of an embodiment of the present invention;

FIG. 2C is a schematic view of another split screen mode of an embodiment of the present invention;

fig. 3 is a flowchart illustrating steps of an embodiment of a method for controlling split screens of a conference management system according to an embodiment of the present invention;

fig. 4 is a block diagram of an embodiment of a control split-screen device of a conference management system according to the present invention;

FIG. 5 is a networking schematic of a video network of the present invention;

FIG. 6 is a schematic diagram of a hardware architecture of a node server according to the present invention;

fig. 7 is a schematic diagram of a hardware structure of an access switch of the present invention;

fig. 8 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

Referring to fig. 1, a flowchart illustrating steps of an embodiment of a method for controlling split screens of a conference management system according to an embodiment of the present invention is shown, where the conference management system includes a conference management server, a video network core server, and a video network soft terminal, the video network soft terminal has a screen switching component, and the conference management server is configured to generate a conference entering instruction and a split screen instruction, and send the conference entering instruction and the split screen instruction to the video network core server.

The conference management system is a control system based on video networking, and has the main functions of controlling the starting and ending of a video networking terminal conference, dynamically adding and removing video networking soft and hard terminals or virtual terminals to the conference, recording the detailed information of the conference, and backing up and displaying.

The conference management system has two modes of controlling the conference: conference meeting and conference meeting. Wherein, there can be 2, 3, 4 participants in the conference mode, and dynamic increase and decrease of participants is supported. When two parties are present, the terminal video picture is displayed in a large screen (picture-in-picture) mode; when three parties are involved, the terminal video picture is displayed in a delta-shaped mode; when there are four parties, the terminal video picture is displayed in a four-screen mode. When the number of the participants is gradually increased from 2 to 3 and then to 4, the terminal picture is gradually switched from the large screen to the small screen to the delta screen and then to the four-split screen; when the number of the participants is gradually reduced from 4 to 3 and then to 2, the terminal picture is gradually switched from the quarter screen to the delta screen and then to the large screen and the small screen.

In a specific implementation, the information of the participants can be set on a graphical user interface provided by the conference management system, the information of the participants can include information such as numbers of video networks and types of roles, and after the information of the participants is set, a conference can be initiated. The conference management system can determine the number of the participant terminals according to the participant information, generate a conference entering instruction and a screen splitting instruction according to the number of the participant terminals, and send the conference entering instruction and the screen splitting instruction to the core server of the video network.

The method specifically comprises the following steps:

step S101, the video network soft terminal receives a conference entering instruction forwarded by the video network core server;

the video networking hard terminal supports a video networking protocol, is accessed to a video networking core server, can initiate a high-definition video conference, watch video monitoring, digital broadcast television and delayed television, and can be hardware equipment for performing network teaching, live broadcast, VOD (video on demand) and other services, and can be understood as client hardware equipment of the video networking. The video, voice, picture, character, data and other resources of other video network terminals initiating the service can be played and displayed, and the video, voice, picture, character, data and other resources are collected and transmitted to other video network terminals for playing and displaying. And the unique MAC address and the video network number are arranged in the video network.

The video networking soft terminal supports a video networking protocol, is accessed to a video networking core server, can initiate a high-definition video conference, watch video monitoring, digital broadcast television and delayed television, and can be installed on a PC (personal computer), a notebook or a tablet computer and understood as client software equipment of the video networking. The video, voice, picture, character, data and other resources of other video network terminals initiating the service can be played and displayed, and the video, voice, picture, character, data and other resources are collected and transmitted to other video network terminals for playing and displaying. And the unique MAC address and the video network number are arranged in the video network.

The video network core server is used for allocating a unique video network number to each video network soft terminal and/or video network hard terminal. Specifically, MAC addresses of the video network soft terminal and/or the video network hard terminal are respectively registered in a video network core server, and the video network core server is respectively allocated with a unique video network number. The video network core server is also used for forwarding video connection data transmitted between the video network soft terminal and/or the video network hard terminal, and the video connection core server is equivalent to the function of a router.

In the embodiment of the invention, the conference management system can firstly send the conference entering instruction to the video network core server, the video network core server forwards the conference entering instruction to the video network soft terminal, and the video network soft terminal can receive the conference entering instruction forwarded by the video network core server. And the conference entering instruction is used for informing the video networking soft terminal to access the conference.

Step S102, the video network soft terminal accesses a conference according to the conference entering instruction and calls the screen switching component to receive the screen splitting instruction;

in the embodiment of the invention, after the video networking soft terminal receives the conference instruction, the screen switching component can be called to receive the screen splitting instruction. The screen-cutting component can be a script program pre-deployed in the video network soft terminal.

Step S103, the video networking soft terminal adopts the screen switching component to determine a screen splitting mode based on the screen splitting instruction;

the split screen mode may be used to indicate a video picture display mode, including a large-size screen (picture-in-picture) split screen mode (as shown in fig. 2A), a delta-shape split screen mode (as shown in fig. 2B), a quarter-screen split screen mode (as shown in fig. 2C), and the like, wherein the large-size screen (picture-in-picture) split screen mode corresponds to 2 participant terminals, the delta-shape split screen mode corresponds to 3 participant terminals, and the quarter-screen split screen mode corresponds to 4 participant terminals.

In the embodiment of the invention, the video networking soft terminal can adopt the screen switching component to determine the screen splitting mode based on the screen splitting instruction. Specifically, the number of terminals that need to join the conference can be determined according to the split-screen instruction, and the split-screen mode can be determined according to the number of terminals.

And step S104, the video networking soft terminal adopts the screen switching component to adjust a video display interface according to the screen splitting mode.

In the embodiment of the invention, the video network soft terminal can adopt the screen switching component to adjust the video display interface according to the screen splitting mode. Specifically, the video networking soft terminal can determine the video networking number and the display sequence of each participant terminal through a screen splitting mode by adopting a screen splitting component, constructs (or clears the previous set and reconstructs) a corresponding number of video data source sets through a 'dynamic screen splitting component' of the conference meeting, and adjusts the display layout of video pictures.

In a preferred embodiment of the present invention, the screen splitting instruction carries a video networking number, and the step S103 may include the following sub-steps:

the video networking soft terminal extracts the video networking number in the screen splitting instruction by adopting the screen cutting component; and the video networking soft terminal determines a screen splitting mode according to the video networking number in the screen splitting instruction by adopting the screen switching component.

The video network number may be a unique identification code of the video network soft terminal, for example, the video network soft terminal of the video network soft terminal may be 003.

In the embodiment of the invention, the video networking soft terminal can adopt the screen switching component to extract the video networking number in the screen splitting instruction, and determines the screen splitting mode according to the video networking number.

As an example, if there are 3 internet of

view numbers

001, 002, 003 in the split screen command, the split screen mode can be determined according to the 3 internet of view numbers as: a delta screen mode.

In a preferred embodiment of the present invention, the step S104 may include the following sub-steps:

the video network soft terminal determines the number of display controls according to the split screen mode by adopting the screen switching component; the video networking soft terminal adopts the screen switching component to determine a target participant terminal and a video display sequence corresponding to the target participant terminal according to the video networking number; and the video network soft terminal adopts the screen switching component to adjust a video display interface according to the display control number, the target participating terminal and the video display sequence corresponding to the target participating terminal.

In the embodiment of the invention, the video networking soft terminal can adopt the screen switching component to determine the number of the display controls according to the screen splitting mode, determine the target participant terminal and the video display sequence corresponding to the target participant terminal according to the video networking number, and adopt the screen switching component to adjust the video display interface according to the number of the display controls, the target participant terminal and the video display sequence corresponding to the target participant terminal.

As an example, when the split screen mode is: when the triangle screen splitting mode is adopted, the number of the display controls can be determined to be 3 according to the triangle screen splitting mode, the target participating terminal and the video display sequence corresponding to the target participating terminal are determined according to the video networking number, then 3 display controls can be constructed according to the number of the display controls, the corresponding relation between the display controls and the target participating terminal is established according to the video display sequence, and therefore the video data of the target participating terminal can be rendered on the corresponding display controls subsequently.

In a preferred embodiment of the invention, the conference management system further comprises an internet-of-view hard terminal and a streaming media server,

the video networking hard terminal is used for sending video data based on a video networking protocol to the video networking core server; the streaming media server is used for receiving the video data based on the video networking protocol forwarded by the video networking core server, converting the video data based on the video networking protocol into video data based on the internet protocol, and sending the video data based on the internet protocol to the video networking soft terminal; and the video data based on the Internet protocol carries a video networking number corresponding to the video networking hard terminal.

In the embodiment of the invention, the video networking hard terminal communicates based on the video networking protocol, the video networking soft terminal communicates based on the inter-frequency networking protocol, and a streaming media server can be adopted for protocol conversion, so that the communication between the video networking hard terminal and the video networking soft terminal is realized.

The streaming media server is used for receiving video data based on a video networking protocol forwarded by the video networking core server, converting the video data based on the video networking protocol into video data based on the internet protocol, and sending the video data based on the internet protocol to the video networking soft terminal.

In a preferred embodiment of the present invention, the method further comprises:

the video network soft terminal adopts the screen switching component to determine a target video display position corresponding to the video network hard terminal according to the video network number in the video data based on the Internet protocol; and the video networking soft terminal renders the video data based on the Internet protocol on the video display interface by adopting the screen switching component according to the target video display position.

The video data based on the internet protocol can carry a video networking number corresponding to the video networking hard terminal.

In the embodiment of the invention, the video networking soft terminal can extract the video networking number in the video data based on the Internet protocol, determine the matched participant terminal according to the video networking number, determine the corresponding target display control according to the matched participant terminal, acquire the target video display position corresponding to the target display control, and render the video data based on the Internet protocol on the video display interface according to the target video display position.

Fig. 3 is a flowchart illustrating a screen splitting control method of a conference management system according to the present invention. In fig. 3, the method for controlling split screen may include the following steps:

1. starting a conference by a conference management system, wherein conference participants comprise a video networking hard terminal A (the video networking number is 001), a video networking hard terminal B (the video networking number is 002) and a video networking soft terminal C (the video networking number is 003);

2. the conference management system firstly issues a conference-entering instruction and then issues a screen-splitting instruction (the instruction comprises a screen-splitting mode and related information of each participant, such as a video networking number) to a video networking core server;

3. the video network core server forwards the conference entering instruction and the screen splitting instruction to video network hard terminals A and B and a streaming media server according to the video network number, the video network hard terminals A and B start preparation before conference after receiving the conference entering instruction, and then initialize a conference display interface after receiving the screen splitting instruction;

4. after receiving the conference entering instruction and the screen splitting instruction transmitted by the video network core server, the streaming media server transmits the conference entering instruction and the screen splitting instruction to the video network soft terminal C according to the video network number;

5. after receiving the conference entering instruction, the video networking soft terminal C receives a screen switching instruction by calling a screen switching component, and obtains a screen splitting mode, video networking numbers of all participants and a display sequence by analyzing the screen switching instruction; obtaining a split screen mode, the numbers of video networks of participants and a display sequence according to analysis, constructing (or emptying the previous set and reconstructing) a video data source set with a corresponding quantity through a screen cutting component, and adjusting the display layout of video pictures; after receiving the video stream sent by the core server of the video network, the soft terminal of the video network calls the screen switching component, and the screen switching component correspondingly displays the video network number to a specific position according to the video network number in the video stream.

6. When the conference management system dynamically increases the participants, the screen splitting instruction is issued again, and then the steps 2, 3, 4 and 5 are repeated.

The precondition (software configuration) for realizing the above process is as follows:

1. respectively registering MAC addresses of a hard terminal A, B and a soft terminal C in a core server of the video network, and respectively allocating a unique video network number as unique identifiers of the hard terminal and the soft terminal of the video network in a meeting;

2. the 'streaming media server' provides service support for the video networking soft terminal C, and stores the video networking number distributed by the video networking soft terminal C on the streaming media server;

3. the hard video network terminal A, B and the soft video network terminal C need to access the same video network server.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 4, a block diagram of a structure of an embodiment of a screen splitting control device of a conference management system according to an embodiment of the present invention is shown, where the conference management system includes a conference management server, a video network core server, and a video network soft terminal, where the video network soft terminal has a screen splitting component, the conference management server is configured to generate a conference entering instruction and a screen splitting instruction, and send the conference entering instruction and the screen splitting instruction to the video network core server, and the video network soft terminal may include the following modules:

an conference instruction receiving module 101, configured to receive a conference instruction forwarded by the video network core server;

a screen splitting instruction receiving module 102, configured to access a conference according to the conference entering instruction, and call the screen switching component to receive the screen splitting instruction;

a screen splitting mode determining module 103, configured to determine, by using the screen cutting component, a screen splitting mode based on the screen splitting instruction;

and the interface adjusting module 104 is configured to adjust a video display interface according to the split screen mode by using the screen cutting component.

In a preferred embodiment of the present invention, the split screen instruction carries a video networking number, and the split screen mode determining module includes:

In a preferred embodiment of the present invention, the interface adjusting module includes:

In a preferred embodiment of the present invention, the apparatus further comprises:

the target video display position determining module is used for determining a target video display position corresponding to the video network hard terminal by adopting the screen switching component according to the video network number in the video data based on the Internet protocol;

and the rendering module is used for rendering the video data based on the Internet protocol on the video display interface by adopting the screen cutting assembly according to the target video display position.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

An embodiment of the present invention further provides an electronic device, including:

one or more processors; and

Embodiments of the present invention also provide a computer-readable storage medium storing a computer program for causing a processor to execute the steps of the method according to the embodiments of the present invention.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved the traditional Ethernet (Ethernet) to face the potentially huge first video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network security Technology (network security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 5, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: server, exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, code board, memory, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node server, access exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, coding board, memory, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 6, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 7, the network interface module (downlink network interface module 301, uplink network interface module 302), switching engine module 303 and CPU module 304 are mainly included;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the incoming data packet of the CPU module 304 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues and may include two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 308 is configured by the CPU module 304, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 8, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MACSA of the ethernet coordination gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The method for controlling the split screen of the conference management system and the device for controlling the split screen of the conference management system provided by the invention are described in detail, specific examples are applied in the text to explain the principle and the implementation mode of the invention, and the description of the above examples is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. The control screen splitting method of the conference management system is characterized in that the conference management system comprises a conference management server, a video network core server and a video network soft terminal, the video network soft terminal is provided with a screen switching component, the conference management server is used for generating a conference entering instruction and a screen splitting instruction and sending the conference entering instruction and the screen splitting instruction to the video network core server, and the method comprises the following steps:

2. The method of claim 1, wherein the screen splitting instruction carries a video networking number, and the video networking soft terminal determines a screen splitting mode based on the screen splitting instruction by using the screen switching component, comprising:

3. The method of claim 2, wherein the video networking soft terminal adapting the video display interface according to the split screen mode using the split screen component comprises:

4. The method of claim 1, wherein the conference management system further comprises a video networking hard terminal and a streaming media server,

5. The method of claim 4, further comprising:

6. The utility model provides a meeting management system's control split screen device, its characterized in that, meeting management system includes meeting management server, video networking core server and video networking soft terminal, video networking soft terminal has the screen cutting subassembly, meeting management server is used for generating meeting instruction and split screen instruction, and will meeting instruction and split screen instruction send to video networking core server, video networking soft terminal includes:

7. The apparatus of claim 6, wherein the split screen instruction carries a video networking number, and wherein the split screen mode determination module comprises:

8. The apparatus of claim 7, wherein the interface adjustment module comprises:

9. An electronic device, comprising:

one or more processors; and

one or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the electronic device to perform the steps of the method of one or more of claims 1-5.

10. A computer-readable storage medium, characterized in that it stores a computer program for causing a processor to perform the steps of the method according to any one of claims 1 to 5.