CN111131749B

CN111131749B - Video conference control method and device

Info

Publication number: CN111131749B
Application number: CN201911304184.XA
Authority: CN
Inventors: 马龙飞; 牛永会; 王艳辉; 陈晨
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-12-17
Filing date: 2019-12-17
Publication date: 2023-10-10
Anticipated expiration: 2039-12-17
Also published as: CN111131749A

Abstract

The embodiment of the invention provides a control method and device for a video conference. The control method of the video conference comprises the following steps: acquiring a terminal number of a conference terminal in a video conference; receiving selection information input by a user, and generating a conference control instruction according to the selection information and the terminal number; the conference control instruction comprises a screenshot instruction or a recording instruction; and sending the conference control instruction to a target conference terminal indicated by the terminal number, so that the target conference terminal captures or records the video conference. According to the embodiment of the invention, at least two kinds of control on the video conference can be realized, and a user decides which control is carried out on the video conference, so that the flexibility is improved. Meanwhile, the screenshot and the recording of the video conference can not influence the progress of the video conference, and other participants can not even perceive the operations.

Description

Video conference control method and device

Technical Field

The present invention relates to the field of video conferences, and in particular, to a method and apparatus for controlling a video conference.

Background

Modern enterprises and institutions have larger and larger scale, and people are distributed more and more widely and are dispersed more and more, so that the demands of people on different-place collaborative offices are more and more urgent. The video conference meets most of demands of people for different-place collaborative offices. Because the video conference can transmit sound and image data in real time, people in different geographic positions can participate in a conference at the same time.

However, currently, a fixed video conference control terminal is provided in most video conferences, and the video conference process is controlled only by the video conference control terminal. This is to avoid the influence of the participants on the video conference by controlling the video conference process at will. But also limits the flexibility of video conferencing. Even if the control of the video conference by each participant does not affect the progress of the video conference, the control cannot be implemented.

Disclosure of Invention

In view of the foregoing, embodiments of the present invention are provided to provide a method and apparatus for controlling a video conference that overcomes or at least partially solves the foregoing problems.

In a first aspect, an embodiment of the present invention discloses a control method for a video conference, which is applied to a mobile terminal, and the method includes:

acquiring a terminal number of a conference terminal in a video conference;

receiving selection information input by a user, and generating a conference control instruction according to the selection information and the terminal number; the conference control instruction comprises a screenshot instruction or a recording instruction;

and sending the conference control instruction to a target conference terminal indicated by the terminal number, so that the target conference terminal captures or records the video conference.

Optionally, the step of obtaining the terminal number of the conference terminal in the video conference includes:

and scanning the two-dimensional codes on the conference terminals to obtain the terminal numbers, wherein each conference terminal is provided with the two-dimensional code containing the terminal number.

Optionally, the step of sending the conference control instruction to a target conference terminal indicated by the terminal number, so that the target conference terminal captures or records the video conference includes:

the screenshot instruction is sent to a storage service system, the storage service system forwards the screenshot instruction to the target conference terminal, and an image intercepted by the target conference terminal according to the screenshot instruction is received and stored;

or sending the recording instruction to a session management server, and forwarding the recording instruction to the target conference terminal by the session management server so that the target conference terminal sends the video stream of the video conference to a storage service system.

In a second aspect, the embodiment of the invention also discloses a control method of the video conference, which is applied to a conference terminal in the video conference, and the method comprises the following steps:

receiving a conference control instruction sent by a mobile terminal, wherein the conference control instruction comprises a screenshot instruction or a recording instruction;

And capturing or recording the video conference according to the conference control instruction.

Optionally, the step of receiving the conference control instruction sent by the mobile terminal includes:

receiving a screenshot instruction forwarded by a storage service system from the mobile terminal;

or the receiving management server forwards the recording instruction from the mobile terminal.

Optionally, the step of capturing a video conference according to the conference control instruction includes:

judging whether the conference control instruction is a screenshot instruction or not;

when the conference control instruction is a screenshot instruction, controlling the conference terminal to perform screenshot to obtain a target image, and sending a screenshot success message to the storage service system after the target image is obtained;

receiving an image request message returned by the storage service system according to the screenshot success message;

and sending the target image to the storage service system so that the storage service system stores the target image.

In a third aspect, the embodiment of the present invention also discloses a control device for a video conference, which is applied to a mobile terminal, and the device includes:

the acquisition module is used for acquiring the terminal number of the conference terminal in the video conference;

The instruction module is used for receiving the selection information input by the user and generating a conference control instruction according to the selection information and the terminal number; the conference control instruction comprises a screenshot instruction or a recording instruction;

and the sending module is used for sending the conference control instruction to a target conference terminal indicated by the terminal number so that the target conference terminal can capture or record the video conference.

Optionally, the acquiring module is specifically configured to scan the two-dimensional codes on the conference terminals to obtain the terminal numbers, where each conference terminal is provided with a two-dimensional code containing the terminal number.

Optionally, the sending module is specifically configured to send the screenshot instruction to a storage service system, where the storage service system forwards the screenshot instruction to the target conference terminal, and receives and stores an image intercepted by the target conference terminal according to the screenshot instruction;

or sending the recording instruction to the session management server, and forwarding the recording instruction to the target conference terminal by the session management server so that the target conference terminal sends the video stream of the video conference to a storage service system.

In a fourth aspect, the embodiment of the present invention further discloses a control device for a video conference, which is applied to a conference terminal in the video conference, and the device includes:

the receiving module is used for receiving conference control instructions sent by the mobile terminal, wherein the conference control instructions comprise screenshot instructions or recording instructions;

and the processing module is used for capturing or recording the video conference according to the conference control instruction.

Optionally, the receiving module is specifically configured to receive a screenshot instruction forwarded by a storage service system from the mobile terminal; or the receiving management server forwards the recording instruction from the mobile terminal.

Optionally, the processing module includes:

the judging unit is used for judging whether the conference control instruction is a screenshot instruction or not;

the screenshot unit is used for controlling the conference terminal to perform screenshot when the conference control instruction is a screenshot instruction, obtaining a target image, and sending a screenshot success message to the storage service system after obtaining the target image;

the message receiving unit is used for receiving an image request message returned by the storage service system according to the screenshot success message;

and the image sending unit is used for sending the target image to the storage service system so that the storage service system stores the target image.

In a fifth aspect, an embodiment of the present invention further discloses an electronic device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor executes the computer program to implement the method described in the first aspect.

In a sixth aspect, an embodiment of the present invention further discloses a computer readable storage medium, where a computer program for executing the method of the first aspect is stored.

The method and the device for controlling the video conference, provided by the embodiment of the invention, acquire the terminal number of the conference terminal in the video conference process; and positioning the corresponding conference terminal according to the acquired terminal number. Receiving selection information input by a user, and generating a conference control instruction according to the selection information and the terminal number; the conference control instruction comprises a screenshot instruction or a recording instruction; and sending the conference control instruction to a target conference terminal indicated by the terminal number, so that the target conference terminal captures or records the video conference. At least two kinds of control on the video conference can be realized, and a user decides which kind of control is carried out on the video conference, so that the flexibility is improved. Meanwhile, the screenshot and the recording of the video conference can not influence the progress of the video conference, the video conference can not be influenced, and other participants can not even perceive the operations. Therefore, the user can select to screen or record the video conference according to the self requirement, and the process of the video conference is not influenced at all.

Drawings

Fig. 1 is a schematic diagram of steps of a control method of a video conference applied to a mobile terminal according to an embodiment of the present invention;

fig. 2 is a schematic diagram of steps of a control method of a video conference applied to a conference terminal according to an embodiment of the present invention;

FIG. 3 is an application scenario architecture diagram of a screenshot during a video conference in accordance with an embodiment of the present invention;

fig. 4 is an application scene architecture diagram recorded during a video conference according to an embodiment of the present invention;

fig. 5 is a flowchart of a practical application of a control method for a video conference according to an embodiment of the present invention;

fig. 6 is a schematic diagram of a control device for a video conference applied to a mobile terminal according to an embodiment of the present invention;

fig. 7 is a schematic diagram of a control device for video conference applied to a conference terminal according to an embodiment of the present invention;

fig. 8 is a networking schematic diagram of a video networking provided by an embodiment of the present invention;

fig. 9 is a schematic hardware structure of a node server according to an embodiment of the present invention;

fig. 10 is a schematic hardware structure of an access switch according to an embodiment of the present invention;

fig. 11 is a schematic hardware structure of an ethernet corotation gateway according to an embodiment of the present invention.

Detailed Description

In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.

Fig. 1 shows a control method for a video conference according to an embodiment of the present invention, which is applied to a mobile terminal, and the method includes the following steps:

step 101, obtaining a terminal number of a conference terminal in a video conference.

It should be noted that the video conference is a video conference in which a plurality of conference terminals participate, and each participant performs a video conference through one conference terminal. Preferably, each conference terminal has a unique identification, i.e. a terminal number. The terminal number obtained is the terminal number of any conference terminal participating in the video conference. The terminal number can be obtained in a code scanning mode, namely, a two-dimensional code or a bar code carrying the terminal number is posted on each conference terminal. Or displaying the two-dimensional code or the bar code carrying the terminal number in a display screen of the conference terminal, and scanning the two-dimensional code or the bar code through a camera of the mobile terminal to obtain the terminal number. Of course, the terminal number can also be input by a manual input mode, and the mobile terminal can be a smart phone or a tablet personal computer. Preferably, the step of obtaining the terminal number of the conference terminal in the video conference includes: scanning two-dimension codes on the conference terminals to obtain terminal numbers, wherein each conference terminal is provided with a two-dimension code containing the terminal number. The two-dimensional code can also contain information such as the service type and calling mode of the video conference, the name of the video conference, the coding parameters of the participants, the multicast address and the like, so that other operations are convenient to carry out.

Step 102, receiving the selection information input by the user, and generating a conference control instruction according to the selection information and the terminal number.

It should be noted that the preset page may be displayed by the mobile terminal, and at least two selection boxes, such as a "screenshot" selection box and a "recording" selection box, are disposed in the page. The user clicks different selection boxes, different conference control instructions are generated, and the terminal numbers are carried in the generated conference control instructions, wherein the conference control instructions comprise screenshot instructions or recording instructions. Therefore, when the user clicks the screenshot selecting box, a screenshot instruction is generated, and the terminal number is carried in the generated screenshot instruction. When a user clicks a recording selection box, a recording instruction is generated, and the terminal number is carried in the generated recording instruction. Of course, the preset parameters such as resolution can be configured, and when the screenshot instruction is generated, the configured resolution can be carried in the generated screenshot instruction, so that the image can be intercepted according to the configured resolution.

And step 103, sending the conference control instruction to the target conference terminal indicated by the terminal number so that the target conference terminal can capture or record the video conference.

It should be noted that the conference control instruction may be directly or indirectly transmitted to the target conference terminal. In a video conference, for example, conducted in a video networking environment, it is necessary to send conference control instructions to devices in the video networking and then forward the conference control instructions to target conference terminals via the video networking.

After the target conference terminal captures the video conference, the captured image is stored in a storage service system. The user can input inquiry command to inquire the intercepted image via the mobile terminal, i.e. the image stored in the storage service system is accessed via the mobile terminal.

In the embodiment of the invention, in the process of carrying out the video conference, the terminal number of the conference terminal in the video conference is obtained; and positioning the corresponding conference terminal according to the acquired terminal number. Receiving selection information input by a user, and generating a conference control instruction according to the selection information and a terminal number; the conference control instruction comprises a screenshot instruction or a recording instruction; and sending the conference control instruction to the target conference terminal indicated by the terminal number, so that the target conference terminal captures or records the video conference. At least two kinds of control on the video conference can be realized, and a user decides which kind of control is carried out on the video conference, so that the flexibility is improved. Meanwhile, the screenshot and the recording of the video conference can not influence the progress of the video conference, the video conference can not be influenced, and other participants can not even perceive the operations. Therefore, the user can select to screen or record the video conference according to the self requirement, and the process of the video conference is not influenced at all.

In the case of performing a video conference in a video networking environment, on the basis of the embodiment of the present invention, in the embodiment of the present invention, the step of sending a conference control instruction to a target conference terminal indicated by a terminal number, so that the target conference terminal performs screenshot or recording on the video conference includes:

the method comprises the steps of sending a screenshot instruction to a storage service system, forwarding the screenshot instruction to a target conference terminal by the storage service system, and receiving and storing an image intercepted by the target conference terminal according to the screenshot instruction;

It should be noted that the receiving object of the instruction to be transmitted by the mobile terminal may be preconfigured according to the conference control instruction. Therefore, if the generated conference control instruction is detected to be the screenshot instruction, the screenshot instruction is sent to the storage service system, and the screenshot instruction is forwarded to the target conference terminal by the storage service system. If the generated conference control instruction is detected to be a recording instruction, the screenshot instruction is sent to a conference management server, and the conference management server forwards the recording instruction to the target conference terminal through the autonomous server. In this way, the target conference terminal can send the video stream of the video conference to the storage service system for storage through the video network. Wherein the autonomous server: and is responsible for protocol parsing and business processing in the autonomous cloud. And managing the server: and receiving a conference control instruction, analyzing the instruction, and forwarding the instruction to the autonomous server to control the conference. Storage service system: and the storage of audio and video data of the video network is responsible, and the audio and video data of the Internet is transmitted to the video network.

As shown in fig. 2, according to still another aspect of the present invention, there is provided a control method of a video conference, applied to a conference terminal in the video conference, the method comprising:

step 201, receiving a conference control instruction sent by a mobile terminal;

it should be noted that the conference control instruction includes a screenshot instruction or a recording instruction. The conference control instruction is directly or indirectly sent to the conference terminal by the mobile terminal. The mobile terminal is a smart phone or a tablet computer.

In the case of performing a video conference in an internet of view environment, preferably, the step of receiving a conference control instruction sent by the mobile terminal includes:

receiving a screenshot instruction forwarded by a storage service system from a mobile terminal;

or the receiving session server forwards the recording instruction from the mobile terminal.

Wherein the session server: and receiving a conference control instruction, analyzing the instruction, and forwarding the instruction to the autonomous server to control the conference. Storage service system: and the storage of audio and video data of the video network is responsible, and the audio and video data of the Internet is transmitted to the video network.

Step 202, capturing or recording the video conference according to the conference control instruction.

It should be noted that when the video conference is captured or recorded, the video stream or the captured image of the video conference may be sent to the storage service system, and the storage service system stores the video stream or the captured image of the video conference.

In the embodiment of the invention, in the process of video conference, the conference terminal receives a conference control instruction sent by the mobile terminal; the conference control instruction comprises a screenshot instruction or a recording instruction; and then, capturing or recording the video conference according to the conference control instruction. Therefore, at least two kinds of control on the video conference are realized, and the flexibility is improved. Meanwhile, the screenshot and the recording of the video conference can not influence the progress of the video conference, the video conference can not be influenced, and other participants can not even perceive the operations.

Based on the above embodiments of the present invention, in the embodiment of the present invention, according to a conference control instruction, the steps of capturing a video conference include:

and sending the target image to a storage service system so that the storage service system stores the target image.

It should be noted that after the storage service system stores the target image, a success message is returned to the mobile terminal. And after the screenshot of the conference terminal fails, returning a failure message to the mobile terminal. When the conference control instruction is a recording instruction, the video stream of the video conference is sent to a storage service system, and the video stream of the video conference is stored through the storage service system.

As shown in fig. 3, an application scene structure diagram for capturing images in the video conference process is shown; the conference terminals 1 to 4 are participants of the video conference, and each conference terminal has a display screen on which a picture of the video conference and a two-dimensional code carrying the terminal number are displayed. The mobile terminal obtains a terminal number corresponding to the conference terminal 1 by scanning the two-dimensional code on the conference terminal 1, then a user selects a screenshot option on the mobile terminal, so that the mobile terminal generates a screenshot instruction carrying the terminal number, the screenshot instruction is sent to a storage service system through the Internet, the storage service system forwards the screenshot instruction to the conference terminal 1 through the Internet of view, and the conference terminal 1 performs screenshot operation after receiving the screenshot instruction to obtain a target image. And then returning a success message to the storage service system after the screenshot is successful, and sending an image request message to the conference terminal 1 after the storage service system receives the success message, thereby acquiring and storing the target image. The user can view the target image stored in the storage service system through the mobile terminal.

As shown in fig. 4, an application scene structure diagram recorded in the video conference process is shown; the conference terminals 1 to 4 are participants of the video conference, and each conference terminal has a display screen on which a picture of the video conference and a two-dimensional code carrying the terminal number are displayed. The mobile terminal obtains a terminal number corresponding to the conference terminal 1 by scanning the two-dimensional code on the conference terminal 1, then a user selects a recording option on the mobile terminal, so that the mobile terminal generates a recording instruction carrying the terminal number, the screenshot instruction is sent to the conference management server through the Internet, the conference management server forwards the recording instruction to the autonomous server through the Internet, the autonomous server forwards the recording instruction to the conference terminal 1, and the conference terminal 1 sends a video stream of the video conference to the storage service system through the Internet of view after receiving the recording instruction. The video stream of the video conference is stored by a storage service system.

As shown in fig. 5, a flowchart of an actual application of a control method for a video conference according to an embodiment of the present invention includes:

step 501, start.

Step 502, the mobile terminal scans the two-dimensional code on the conference terminal to obtain the terminal number of the conference terminal.

Step 503, determining whether to perform screenshot, if yes, executing step 504, and if not, executing step 511.

And step 504, sending a screenshot instruction to the storage service system, wherein the screenshot instruction carries a terminal number.

Step 505, the storage service system forwards the screenshot instruction to the conference terminal indicated by the terminal number.

Step 506, performing screenshot and judging whether the screenshot is successful, if yes, executing step 507, and if not, executing step 510.

In step 507, the storage service system receives the screenshot.

Step 508, the storage service system stores the screenshot.

Step 509, the storage service system returns a success message to the mobile terminal.

Step 510, an error message is returned to the mobile terminal.

Step 511, determining whether recording is performed, if yes, executing step 512, and if not, executing step 515.

Step 512, a recording command is sent to the session server, wherein the recording command carries a terminal number.

Step 513, scheduling video streams of the video conference to a storage service system via the autonomous server.

The storage service system stores 514 the received video stream.

Step 515 ends.

It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.

Fig. 6 shows a control device for a video conference according to another embodiment of the present invention, which is applied to a mobile terminal, and includes:

an obtaining module 61, configured to obtain a terminal number of a conference terminal in a video conference;

the instruction module 62 is configured to receive selection information input by a user, and generate a conference control instruction according to the selection information and a terminal number; the conference control instruction comprises a screenshot instruction or a recording instruction;

and the sending module 63 is configured to send the conference control instruction to the target conference terminal indicated by the terminal number, so that the target conference terminal captures or records the video conference.

Optionally, the acquiring module 61 is specifically configured to scan the two-dimensional codes on the conference terminals to obtain terminal numbers, where each conference terminal is provided with a two-dimensional code containing the terminal number.

Optionally, the sending module 63 is specifically configured to send the screenshot instruction to the storage service system, and the storage service system forwards the screenshot instruction to the target conference terminal, and receives and stores an image intercepted by the target conference terminal according to the screenshot instruction;

Fig. 7 shows a control device for a video conference according to another embodiment of the present invention, which is applied to a conference terminal in the video conference, and includes:

A receiving module 71, configured to receive a conference control instruction sent by a mobile terminal, where the conference control instruction includes a screenshot instruction or a recording instruction;

and the processing module 72 is used for capturing or recording the video conference according to the conference control instruction.

Optionally, the receiving module 71 is specifically configured to receive a screenshot instruction forwarded by the storage service system from the mobile terminal; or the receiving session server forwards the recording instruction from the mobile terminal.

Optionally, the processing module 72 includes:

the screenshot unit is used for controlling the conference terminal to perform screenshot when the conference control instruction is the screenshot instruction, obtaining a target image, and sending a screenshot success message to the storage service system after obtaining the target image;

For the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.

The embodiment of the invention also discloses an electronic device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the method of any embodiment when executing the computer program.

The embodiment of the invention also discloses a computer readable storage medium, which stores a computer program for executing the method for realizing any of the embodiments.

In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.

It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The video networking is an important milestone for network development, is a real-time network, can realize real-time transmission of high-definition videos, and pushes numerous internet applications to high-definition videos, and the high definition faces.

The video networking adopts a real-time high-definition video exchange technology, and can integrate all required services such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delay television, network teaching, live broadcast, VOD on demand, television mail, personal record (PVR), intranet (self-processing) channel, intelligent video playing control, information release and other tens of services into one system platform, and realize high-definition quality video playing through television or computer.

For a better understanding of embodiments of the present invention, the following description of the video networking is presented to one skilled in the art:

the partial techniques applied by the video networking are as follows:

network technology (Network Technology)

The network technology innovation of the internet of vision improves on the traditional Ethernet (Ethernet) to face the potentially huge video traffic on the network. Unlike simple network Packet Switching (Packet Switching) or network circuit Switching (Circuit Switching), the video networking technology adopts network Packet Switching to meet the Streaming (translating into Streaming, streaming and continuous broadcasting, which is a data transmission technology, changes received data into a stable continuous stream, and continuously sends out the received data, so that the sound heard or the image seen by the user is very stable, and the user can start browsing on the screen before the whole data is transmitted). The video networking technology has the flexibility, simplicity and low price of packet switching, and simultaneously has the quality and the safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Exchange technology (Switching Technology)

The video network adopts the two advantages of the asynchronization and the packet switching of the Ethernet, eliminates the Ethernet defect on the premise of full compatibility, has full-network end-to-end seamless connection, and is directly connected with the user terminal to directly bear the IP data packet. The user data does not need any format conversion in the whole network. The video networking is a higher-level form of Ethernet, is a real-time exchange platform, can realize real-time transmission of full-network large-scale high-definition video which cannot be realized by the current Internet, and pushes numerous network video applications to high definition and unification.

Server technology (Server Technology)

The server technology on the video networking and unified video platform is different from the server in the traditional sense, the streaming media transmission is based on connection-oriented basis, the data processing capability is irrelevant to the flow and the communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than hundred times than that of a traditional server.

Accumulator technology (Storage Technology)

The ultra-high-speed storage technology of the unified video platform adopts the most advanced real-time operating system for adapting to the ultra-large capacity and ultra-large flow media content, the program information in the server instruction is mapped to a specific hard disk space, the media content does not pass through the server any more, the media content is instantly and directly delivered to a user terminal, and the waiting time of the user is generally less than 0.2 seconds. The optimized sector distribution greatly reduces the mechanical motion of magnetic head seek of the hard disk, the resource consumption only accounts for 20% of the IP Internet of the same grade, but the concurrent flow which is 3 times greater than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network security technology (Network Security Technology)

The structural design of the video networking thoroughly structurally solves the network security problem puzzling the Internet by means of independent permission of each service, complete isolation of equipment and user data and the like, generally does not need antivirus programs or firewalls, eliminates attacks of hackers and viruses, and provides a structural carefree security network for users.

Service innovation technology (Service Innovation Technology)

The unified video platform fuses services with transmissions, whether a single user, private network users or a network aggregate, but automatically connects at a time. The user terminal, the set top box or the PC is directly connected to the unified video platform, so that various multimedia video services are obtained. The unified video platform adopts a menu type table allocation mode to replace the traditional complex application programming, and can realize complex application by using very few codes, thereby realizing 'infinite' new business innovation.

Networking of the video networking is as follows:

the video networking is a centrally controlled network structure, which may be of the tree network, star network, ring network, etc., but on the basis of this there is a need for a centralized control node in the network to control the whole network.

As shown in fig. 8, the view network is divided into an access network and a metropolitan area network.

The devices of the access network part can be mainly divided into 3 classes: node server, access switch, terminal (including various set-top boxes, code boards, memories, etc.). The node server is connected with an access switch, which can be connected with a plurality of terminals and can be connected with an Ethernet.

The node server is a node with a centralized control function in the access network, and can control the access switch and the terminal. The node server may be directly connected to the access switch or may be directly connected to the terminal.

Similarly, devices of the metropolitan area network portion can also be classified into 3 categories: metropolitan area server, node switch, node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is the node server of the access network part, namely the node server belongs to the access network part and also belongs to the metropolitan area network part.

The metropolitan area server is a node with centralized control function in the metropolitan area network, and can control a node switch and a node server. The metropolitan area server may be directly connected to the node switch or directly connected to the node server.

Thus, the whole video network is a hierarchical centralized control network structure, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star, ring and the like.

The access network part can form a unified video platform (ring part), and a plurality of unified video platforms can form a video network; each unified video platform can be interconnected and intercommunicated through metropolitan area and wide area video networking.

View networking device classification

1.1 devices in the visual network according to the embodiment of the present invention may be mainly classified into 3 types: a server, a switch (including an ethernet gateway), a terminal (including various set-top boxes, a code board, a memory, etc.). The view networking can be divided into metropolitan area networks (or national networks, global networks, etc.) and access networks as a whole.

1.2 devices in the access network part can be mainly classified into 3 classes: node server, access switch (including Ethernet gateway), terminal (including various set-top boxes, code board, memory, etc.).

The specific hardware structure of each access network device is as follows:

the node server:

as shown in fig. 9, the device mainly includes a network interface module 901, a switching engine module 902, a CPU module 903, and a disk array module 904.

Wherein, the packets coming in from the network interface module 901, the cpu module 903 and the disk array module 904 all enter the switching engine module 902; the switching engine module 902 performs an operation of looking up an address table 905 on an incoming packet, thereby obtaining packet steering information; and stores the packet into a corresponding queue of the packet buffer 906 according to the packet's guiding information; discarding if the queue of packet buffer 906 is nearly full; the switch engine module 902 polls all packet buffer queues for forwarding if the following conditions are met: 1) The port sending buffer is not full; 2) The queue packet counter is greater than zero. The disk array module 904 mainly controls the hard disk, including initializing, reading and writing operations on the hard disk; the CPU 903 is mainly responsible for protocol processing with access switches and terminals (not shown), configuration of address tables 905 (including downstream protocol packet address tables, upstream protocol packet address tables, and data packet address tables), and configuration of the disk array module 904.

Access switch:

as shown in fig. 10, mainly includes a network interface module (a downstream network interface module 1001, an upstream network interface module 1002), a switching engine module 1003, and a CPU module 1004.

Wherein, the packet (uplink data) coming in from the downlink network interface module 1001 enters the packet detection module 1005; the packet detection module 1005 detects whether the Destination Address (DA), source Address (SA), packet type, and packet length of the packet meet the requirements, if so, allocates a corresponding stream identifier (stream-id), and enters the switch engine module 1003, otherwise, discards the packet; the packets (downstream data) coming in from the upstream network interface module 1002 enter the switching engine module 1003; the data packet coming in by the CPU module 1004 enters the switching engine module 1003; the switch engine module 1003 performs an operation of looking up an address table 1006 on an incoming packet, thereby obtaining packet guiding information; if a packet entering the switch engine module 1003 is destined for the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 1007 in association with a stream identifier (stream-id); discarding if the queue of the packet buffer 1007 is nearly full; if the packet entering the switch engine module 1003 is not sent from the downstream network interface to the upstream network interface, storing the data packet into the queue of the corresponding packet buffer 1007 according to the packet guiding information; if the queue of the packet buffer 1007 is nearly full, it is discarded.

The switch engine module 1003 polls all packet buffer queues, in two cases in the embodiment of the present invention:

if the queue is sent from the downlink network interface to the uplink network interface, the following conditions are satisfied for forwarding: 1) The port sending buffer is not full; 2) The queue packet counter is greater than zero; 3) And obtaining the token generated by the code rate control module.

If the queue is not addressed by the downstream network interface to the upstream network interface, the following condition is satisfied for forwarding: 1) The port sending buffer is not full; 2) The queue packet counter is greater than zero.

The rate control module 1008 is configured by the CPU module 1004 to generate tokens for all packet buffer queues from the downstream network interface to the upstream network interface at programmable intervals to control the rate of upstream forwarding.

The CPU module 1004 is mainly responsible for protocol processing with the node server, configuration of the address table 1006, and configuration of the rate control module 1008.

Ethernet corotation gateway：

As shown in fig. 11, the network interface module (downlink network interface module 1101, uplink network interface module 1102), switching engine module 1103, CPU module 1104, packet detection module 1105, rate control module 1108, address table 1106, packet buffer 1107, MAC adding module 1109, and MAC deleting module 1110 are mainly included.

Wherein, the data packet coming in from the downlink network interface module 1101 enters the packet detection module 1105; the packet detection module 1105 detects whether the ethernet MAC DA, ethernet MAC SA, ethernet length or frame type, video network destination address DA, video network source address SA, video network packet type and packet length of the data packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC DA, MAC SA, length or frame type (2 byte) are subtracted by the MAC delete module 1110 and enter the corresponding receive buffer, otherwise discarded;

the downlink network interface module 1101 detects the transmission buffer of the port, if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MAC SA of the ethernet cooperative gateway, and the ethernet length or frame type, and transmits the packet.

The function of the other modules in the ethernet corotation gateway is similar to that of the access switch.

And (3) a terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set top box mainly comprises a network interface module, a video/audio encoding/decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly divided into 3 classes: node server, node switch, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. View networking data packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), source Address (SA), reserved bytes, payload (PDU), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

the Destination Address (DA) consists of 8 bytes (bytes), the first byte representing the type of data packet (e.g. various protocol packets, multicast packets, unicast packets, etc.), up to 256 possibilities, the second to sixth byte being a metropolitan area network address and the seventh and eighth byte being an access network address.

The Source Address (SA) is also composed of 8 bytes (bytes), defined identically to the Destination Address (DA).

The reserved bytes consist of 2 bytes.

The payload portion has different lengths according to the types of the different datagrams, and if the types of the datagrams are various protocol packets, the length of the payload portion is 64 bytes, and if the types of the datagrams are unicast packets, the length of the payload portion is 32+1024=1056 bytes, which is of course not limited to only the above 2.

The CRC consists of 4 bytes and its calculation method follows the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of the metropolitan area network is a pattern, there may be 2 or even more than 2 connections between two devices, i.e. there may be more than 2 connections between node switches and node servers, node switches and node switches, node switches and node servers. However, the metropolitan area network address of the metropolitan area network device is unique, and in order to accurately describe the connection relationship between metropolitan area network devices, parameters are introduced in the embodiment of the present invention: a tag to uniquely describe a metropolitan area network device.

The definition of labels in this specification is similar to that of multiprotocol label switching (MPLS), and assuming that there are two connections between device a and device B, there are 2 labels for packets from device a to device B and 2 labels for packets from device B to device a. The label is split into label and label out, and assuming that the label (in label) of the packet entering the device a is 0x0000, the label (out label) of the packet when leaving the device a may become 0x0001. The network access process of the metropolitan area network is a network access process under centralized control, that is, the address allocation and label allocation of the metropolitan area network are all led by the metropolitan area server, the node switch and the node server are all passively executed, which is different from the label allocation of the MPLS, which is the result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metropolitan area network mainly includes the following parts:

DA

SA

Reserved

label (Label)

Payload

CRC

I.e. Destination Address (DA), source Address (SA), reserved bytes (Reserved), labels, payload (PDU), CRC. Wherein the format of the tag may be defined with reference to the following: the tag is 32 bits, with the high 16bit reservation, with only the low 16bit, and its position is between the reserved bytes and payload of the packet.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.

Claims

1. A control method for a video conference, applied to a mobile terminal, comprising:

acquiring a terminal number of a conference terminal in a video conference, including: the mobile terminal obtains the terminal numbers by scanning two-dimensional codes on the conference terminals, wherein each conference terminal is respectively provided with a two-dimensional code containing the terminal number, and the two-dimensional codes carry the terminal numbers;

receiving selection information input by a user and configured preset parameters, generating a conference control instruction according to the selection information and the terminal number, and pre-configuring a receiving object of an instruction to be sent by a mobile terminal according to the conference control instruction; the conference control instruction comprises a screenshot instruction or a recording instruction and preset parameters, wherein the preset parameters comprise resolution, a receiving object of the screenshot instruction is a storage server, and a receiving object of the recording instruction is a conference management server;

the conference control instruction is sent to a target conference terminal indicated by the terminal number, so that the target conference terminal captures or records the video conference according to the preset parameters, and the method comprises the following steps: if the generated conference control instruction is detected to be a screenshot instruction, the screenshot instruction and a preset parameter are sent to a storage service system, the storage service system forwards the screenshot instruction and the preset parameter to the target conference terminal, and an image intercepted by the target conference terminal according to the screenshot instruction and the preset parameter is received and stored; or the generated conference control instruction is detected to be a recording instruction, the recording instruction and the preset parameters are sent to a conference management server, and the conference management server forwards the recording instruction and the preset parameters to the target conference terminal so that the target conference terminal can send the video stream of the video conference to a storage service system.

2. A control method of a video conference, applied to a conference terminal in the video conference, comprising:

receiving a conference control instruction sent by a mobile terminal, including: receiving a screenshot instruction forwarded by a storage service system from the mobile terminal and preset parameters; or receiving a recording instruction and preset parameters forwarded by a session management server from the mobile terminal, wherein the conference control instruction comprises a screenshot instruction or a recording instruction and the preset parameters, and the preset parameters comprise resolution;

and capturing or recording the video conference according to the conference control instruction, including: judging whether the conference control instruction is a screenshot instruction or not; when the conference control instruction is a screenshot instruction, controlling the conference terminal to perform screenshot according to the preset parameters to obtain a target image, and sending a screenshot success message to the storage service system after the target image is obtained; receiving an image request message returned by the storage service system according to the screenshot success message; and sending the target image to the storage service system so that the storage service system stores the target image.

3. A control device for video conference, applied to a mobile terminal, comprising:

the acquisition module is used for acquiring the terminal number of the conference terminal in the video conference and comprises the following steps: the mobile terminal obtains the terminal numbers by scanning two-dimensional codes on the conference terminals, wherein each conference terminal is respectively provided with a two-dimensional code containing the terminal number, and the two-dimensional codes carry the terminal numbers;

the instruction module is used for receiving the selection information input by the user and the configured preset parameters, generating a conference control instruction according to the selection information and the terminal number, and pre-configuring a receiving object of an instruction to be sent by the mobile terminal according to the conference control instruction; the conference control instruction comprises a screenshot instruction or a recording instruction and preset parameters, wherein the preset parameters comprise resolution, a receiving object of the screenshot instruction is a storage server, and a receiving object of the recording instruction is a conference management server;

the sending module is configured to send the conference control instruction to a target conference terminal indicated by the terminal number, so that the target conference terminal captures or records the video conference according to the preset parameter, and includes: the method comprises the steps that a generated conference control instruction is detected to be a screenshot instruction, the screenshot instruction and preset parameters are sent to a storage service system, the screenshot instruction and the preset parameters are forwarded to a target conference terminal by the storage service system, and an image intercepted by the target conference terminal according to the screenshot instruction and the preset parameters is received and stored; or the generated conference control instruction is detected to be a recording instruction, the recording instruction and the preset parameters are sent to a conference management server, and the conference management server forwards the recording instruction and the preset parameters to the target conference terminal so that the target conference terminal can send the video stream of the video conference to a storage service system.

4. A control device for a video conference, which is applied to a conference terminal in the video conference, comprising:

the receiving module is used for receiving the conference control instruction sent by the mobile terminal, and comprises the following steps: receiving a screenshot instruction forwarded by a storage service system from the mobile terminal and preset parameters; or receiving a recording instruction and preset parameters forwarded by a session management server from the mobile terminal, wherein the conference control instruction comprises a screenshot instruction or a recording instruction and the preset parameters, and the preset parameters comprise resolution;

the processing module is used for capturing or recording the video conference according to the conference control instruction, and comprises the following steps: judging whether the conference control instruction is a screenshot instruction or not; when the conference control instruction is a screenshot instruction, controlling the conference terminal to perform screenshot according to the preset parameters to obtain a target image, and sending a screenshot success message to the storage service system after the target image is obtained; receiving an image request message returned by the storage service system according to the screenshot success message; and sending the target image to the storage service system so that the storage service system stores the target image.

5. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the control method of a video conference as claimed in claim 1 or the control method of a video conference as claimed in claim 2 when executing the computer program.

6. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program that executes the control method of a video conference as set forth in claim 1 or the control method of a video conference as set forth in claim 2.