CN117424975A

CN117424975A - Video conference management method, device, equipment and storage medium

Info

Publication number: CN117424975A
Application number: CN202311217188.0A
Authority: CN
Inventors: 漆金峰
Original assignee: Guangzhou Kaidelian Software Technology Co ltd
Current assignee: Guangzhou Kaidelian Software Technology Co ltd
Priority date: 2023-09-19
Filing date: 2023-09-19
Publication date: 2024-01-19

Abstract

The embodiment of the invention discloses a video conference management method, a device, equipment and a storage medium, wherein after a user enters a video conference room through an equipment end, the equipment end displays a video conference interface, video pictures of upper members and an upper member list are displayed in the video conference interface, the user can directly interact with the video pictures in the video conference room and the upper member labels in the upper member list through the management end, and the management end sends a layout adjustment instruction or a sequence adjustment instruction to a server according to an interaction mode so as to realize adjustment of the video pictures and management of the display sequence of the video pictures and the arrangement sequence of the upper member labels. The embodiment of the invention can improve the efficiency of managing the video pictures of the video conference and the participants, and solves the technical problem of low management efficiency when managing the video pictures of the video conference and the participants in the prior art.

Description

Video conference management method, device, equipment and storage medium

Technical Field

The embodiment of the application relates to the field of computers, in particular to a video conference management method, a video conference management device, video conference management equipment and a video conference storage medium.

Background

Video conferencing refers to a conference in which people at two or more locations, through a communication device and a network, enter a network room where they talk face-to-face. In video conferencing, a presenter is typically required to be located in a network room, and the presenter manages video pictures and participants in the video conference. However, in the prior art, when the host manages the video frames and the participants, the steps required to be executed are complex and cumbersome, and the management efficiency is low.

In summary, in the prior art, when managing video frames and participant members of a video conference, there is a technical problem of low management efficiency.

Disclosure of Invention

The embodiment of the invention provides a video conference management method, a device, equipment and a storage medium, which can improve the efficiency of managing video pictures and participant members of a video conference and solve the technical problem of low management efficiency when managing the video pictures and participant members of the video conference in the prior art.

In a first aspect, an embodiment of the present invention provides a video conference management method, where the method is applicable to a device side, and the method includes:

Acquiring room data of a video conference room which is currently added in real time, wherein the room data comprises upper member data, video stream data of video pictures corresponding to each upper member and display layout of the video pictures, and the video conference room is built in a server;

displaying a video conference interface, wherein video pictures corresponding to each video stream data are displayed in the video conference interface according to the display layout; displaying an upper member list in the video conference interface according to the upper member data, wherein the upper member list comprises upper member labels corresponding to each video picture, the display sequence of the video pictures is consistent with the arrangement sequence of the upper member labels, the upper member data comprises an arrangement sequence, and the display layout comprises a display sequence;

responding to picture adjustment operation acting on video pictures, and sending a layout adjustment instruction to a server so as to enable the server to update the display layout;

updating the video conference interface according to the updated display layout;

responding to the sequence adjustment operation, sending a sequence adjustment instruction to the server so as to enable the server to update the arrangement sequence in the upper member data and the display sequence in the display layout, wherein the sequence adjustment operation acts on the upper member labels or the video pictures;

And updating the video conference interface according to the updated upper member data and the updated display layout.

In a second aspect, an embodiment of the present invention provides a video conference management apparatus, where the apparatus is applicable to a device side, and the apparatus includes:

the system comprises a data acquisition module, a server and a video conference system, wherein the data acquisition module is used for acquiring room data of a video conference room which is currently added in real time, the room data comprises upper member data, video stream data of video pictures corresponding to each upper member and display layout of the video pictures, and the video conference room is built in the server;

the interface display module is used for displaying a video conference interface, and displaying video pictures corresponding to each video stream data in the video conference interface according to the display layout; displaying an upper member list in the video conference interface according to the upper member data, wherein the upper member list comprises upper member labels corresponding to each video picture, the display sequence of the video pictures is consistent with the arrangement sequence of the upper member labels, the upper member data comprises an arrangement sequence, and the display layout comprises a display sequence;

the picture adjusting module is used for responding to picture adjusting operation acted on the video picture and sending a layout adjusting instruction to the server so as to enable the server to update the display layout;

The first updating module is used for updating the video conference interface according to the updated display layout;

the sequence adjusting module is used for responding to the sequence adjusting operation and sending a sequence adjusting instruction to the server so that the server updates the arrangement sequence in the upper member data and the display sequence in the display layout, and the sequence adjusting operation acts on the upper member labels or the video pictures;

and the second updating module is used for updating the video conference interface according to the updated upper member data and the updated display layout.

In a third aspect, an embodiment of the present invention provides a video conference management apparatus, including a processor and a memory;

the memory is used for storing the computer program and transmitting the computer program to the processor;

the processor is configured to execute a video conference management method as in the first aspect according to instructions in the computer program.

In a fourth aspect, embodiments of the present invention provide a storage medium storing computer-executable instructions that, when executed by a computer processor, are for performing a video conference management method as in the first aspect.

The embodiment of the invention provides a video conference management method, a video conference management device, video conference management equipment and a video conference storage medium. When a user enters a video conference room through a device end, the device end displays a video conference interface, video pictures of upper member and an upper member list are displayed in the video conference interface, the user can directly interact with the video pictures in the video conference interface and the upper member labels in the upper member list through a management end, and the management end sends a layout adjustment instruction or a sequence adjustment instruction to a server according to an interaction mode so as to realize adjustment of the video pictures and management of the display sequence of the video pictures and the arrangement sequence of the upper member labels. The embodiment of the invention can improve the efficiency of managing the video pictures of the video conference and the participants, and solves the technical problem of low management efficiency when managing the video pictures of the video conference and the participants in the prior art.

Drawings

Fig. 1 is a schematic diagram of a server communicating with a lecturer side and a student side according to an embodiment of the present invention.

Fig. 2 is a schematic diagram of a lecturer side and a student side joining a network room according to an embodiment of the present invention.

Fig. 3 is a schematic diagram of managing video frames and upper members in the prior art according to an embodiment of the present invention.

Fig. 4 is a flow chart of a video conference management method according to an embodiment of the present invention.

Fig. 5 is a schematic diagram of a video conference interface in a classical mode according to an embodiment of the present invention.

Fig. 6 is a schematic diagram of a video conference interface in an equalization mode according to an embodiment of the present invention.

Fig. 7 is a schematic diagram of displaying a list of members on an upper platform on a videoconference interface in a classical mode according to an embodiment of the present invention.

Fig. 8 is a schematic diagram of a display sequence of video frames in a classical mode according to an embodiment of the present invention corresponding to an arrangement sequence of upper member tags.

Fig. 9 is a schematic diagram of performing a picture broadcasting operation on a video picture according to an embodiment of the present invention.

Fig. 10 is a flowchart illustrating a process of performing a picture broadcasting operation on a video picture according to an embodiment of the present invention.

Fig. 11 is a schematic diagram of performing a picture enlarging operation on a video picture according to an embodiment of the present invention.

Fig. 12 is a flowchart illustrating a process of performing a frame enlarging operation on a video frame according to an embodiment of the present invention.

Fig. 13 is a schematic diagram of performing a sequence adjustment operation on a member tag in an upper stage according to an embodiment of the present invention.

Fig. 14 is a flowchart illustrating a procedure for performing a sequence adjustment operation on a member tag in an upper stage according to an embodiment of the present invention.

Fig. 15 is a schematic diagram of performing a sequence adjustment operation on a video frame according to an embodiment of the present invention.

Fig. 16 is a flowchart illustrating a procedure for performing a sequence adjustment operation on a video frame according to an embodiment of the present invention.

Fig. 17 is a schematic diagram of displaying a list of members in a lower platform according to an embodiment of the present invention.

Fig. 18 is a schematic diagram of displaying an operation menu according to an embodiment of the present invention.

Fig. 19 is a schematic structural diagram of a video conference management device according to an embodiment of the present invention.

Fig. 20 is a schematic structural diagram of a video conference management device according to an embodiment of the present invention.

Reference numerals:

student side 10, server 20, lecturer side 30, video conference interface 1, first region S1, second region S2.

Detailed Description

The following description and the drawings illustrate specific embodiments of the application sufficiently to enable those skilled in the art to practice them. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in, or substituted for, those of others. The scope of the embodiments of the present application encompasses the full ambit of the claims, as well as all available equivalents of the claims. Embodiments may be referred to herein, individually or collectively, by the term "invention" merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept if more than one is in fact disclosed. Relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed. Various embodiments are described herein in a progressive manner, each embodiment focusing on differences from other embodiments, and identical and similar parts between the various embodiments are sufficient to be seen with each other. The structures, products and the like disclosed in the embodiments correspond to the parts disclosed in the embodiments, so that the description is relatively simple, and the relevant parts refer to the description of the method parts.

The video conference management method provided by the embodiment of the application is suitable for video conference scenes. In a video conference scene, at least two equipment ends are added into the same video conference room, the video conference room is used for realizing video conference, the video conference room is a network room, and the network room is created in a server. The server stores the room data of the video conference room, and after the equipment end joins the video conference room, the room data of the video conference room is obtained from the server in real time so as to realize the video conference function.

The device side refers to a program (also referred to as an application program, a software program, an APP, or the like) for implementing a local service of a video conference in an electronic device. The electronic device used by the user includes, but is not limited to: a mobile phone, a tablet computer, a notebook computer, a learning machine, a desktop computer and other devices.

In one embodiment, an electronic device for use by a user includes a processor, a display screen, a memory, and a communication module. The processor, display, memory, communication module may be connected by a communication bus or other means.

Among other things, the processors may include processing units such as application processors (application processor, APs), graphics processors (graphics processing unit, GPUs), and central processing units (central processing unit, CPUs). The processor executes various functional applications of the electronic device and data processing by running computer-executable programs (e.g., software programs, instructions, modules, etc.) stored in the memory. For example, the processor runs a program of a video conference to realize the function of the video conference.

The memory may be used to store a computer-executable program of the electronic device, or the like, the computer-executable program including instructions. The memory may include a stored program area and a stored data area. The storage program area may store an operating system, at least one application program required for a function, among others. The storage data area may store data created according to the use of the electronic device, etc. The memory may include high-speed random access memory, and may also include non-volatile memory. Such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, the memory may further include memory remotely located with respect to the processor, the remote memory being connectable to the electronic device through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The number of display screens may be one or more. The display screen may be a liquid crystal display screen (Liquid Crystal Display), an LED display screen (LED display), an organic light-emitting diode (OLED) display screen, a flexible light-emitting diode (flex) display screen, or the like. The display screen may be displayed based on the indication of the processor.

In some cases, the display screen may further have a touch function, that is, a touch display screen, where the touch display screen includes a display panel and a touch panel. The display panel is used for completing visual output. The touch panel may be a component supporting infrared touch, electromagnetic touch, capacitive touch, resistive touch, or the like. The touch panel may transfer touch data corresponding to the detected touch operation to the processor, and a visual output related to the touch operation may be provided by the display panel.

The communication module may include a wired communication module and/or a wireless communication module. The wired communication module includes at least one communication interface, such as a universal serial bus (Universal Serial Bus, USB) interface, a network interface, and the like. The wireless communication module includes one or more of a bluetooth module, an infrared module, a wireless fidelity (Wi-Fi) module, and a near field communication (Near Field Communication, NFC) module. Currently, the processor may communicate with external devices through a communication module, such as a server in the background, with other devices, and with external devices adapted to the electronic device. The external device may be one or more of a writing pen (also referred to as a smart pen, a handwriting pen, etc.), a keyboard, a mouse, etc.

Based on the above structure, the electronic device supports at least one type of operating system, wherein the operating system can be an Android system, a Windows system, a Linux system, an IOS system, a macOS system or the like. The electronic device installs at least one application under the operating system. The application program may be an application program of the operating system, or may be an application program downloaded from a third party device or a server, for example, an application program for implementing a video conference is installed on the electronic device.

In some cases, the device ends may be further distinguished according to the identity of the user using the electronic device, for example, in an online education scenario, the device ends may be further distinguished into a lecturer end, a student end and a management end, where the lecturer end is the device end used by the lecturer, the student end is the device end used by the student, and the management end is the device end used by the manager of the video conference. It can be understood that the student end, the lecturer end and the management end can be used only after logging in the account numbers, at this time, the student indicates the identity of the student when registering the account numbers, the lecturer indicates the identity of the lecturer when registering the account numbers, and the manager indicates the identity of the manager when registering the account numbers, so as to determine whether the student uses the lecturer end, the student end and the management end or not according to the identity of the currently used account numbers. In one embodiment, the identity of the administrator may also be assigned to the lecturer, i.e., the lecturer side is also the management side. On the basis, the lecturer side and the student side have different functional rights to ensure the control right of the lecturer on the video conference, and meanwhile, the influence of the error control of the students on the video conference is avoided.

A server refers to a computer system in a network that can provide some service (in this embodiment, network video service) to other machines. The server may be one physical entity or a plurality of physical entities.

As shown in fig. 1, the server 20 may communicate with the lecturer side 30 and the student side 10, respectively. The implementation manner of the communication is not limited at present, for example, the communication is implemented through a hypertext transfer protocol (HyperText Transfer Protocol, HTTP), and for example, the communication is implemented through WebSocket. In one embodiment, the server side, the lecturer side, and the student side may use multiple communication methods, and may select different implementations in combination with different communication requirements.

After the student end, the lecturer end and the server are matched, the video conference can be realized. In one embodiment, a video conference room is created by the server 20 as shown in fig. 2, and both the student side 10 and the lecturer side 30 can join the video conference room to achieve the effect of lecturing the lecturer "face-to-face" with the student through the video conference room. The manner in which the student end and the lecturer end join the video conference room is not limited currently, for example, after the lecturer end initiates a request for creating the video conference room to the server, the server creates the video conference room and generates an invitation code for joining the video conference room, where the invitation code may be formed by numbers and/or letters, or may be a two-dimensional code, and after the student end and the lecturer end detect the input or are scanned, the invitation code is sent to the server, and the server joins the student end and the lecturer end into the corresponding video conference room according to the invitation code. Optionally, the lecturer side instructs the server to create a video conference room, after the server creates the video conference room, the server can send the corresponding invitation code to the lecturer side, and then, the lecturer using the lecturer side can notify each student and other lectures of the invitation code, after the students use the student side to input or scan the invitation code, the students join the video conference room, and after the other lectures use the lecturer side to input or scan the invitation code, the students join the video conference room. Alternatively, after the lecturer side instructs the server to create the video conference room, the server may automatically invite the lecturer side into the room. It can be appreciated that in practical application, the video conference room can be created by the student end, and the creation process is the same as the process created by the lecturer end.

Optionally, each video conference room has a unique room identification, which may be composed of letters, numbers, symbols, etc. The room identity is automatically generated by the server side when the video conference room is created.

Illustratively, each video conference room has corresponding room data describing the current state of the video conference room. In this embodiment, the room data includes the member data of the upper member, the video stream of the video picture corresponding to each upper member, and the display layout of the video picture, where the upper member refers to a member that displays the video picture in the video conference room and can speak, and the member data of the upper member includes the related information of the upper member, such as the name of the upper member, the order of the upper member, and so on. The room data also comprises video stream data corresponding to the video picture of each upper member, and the video stream data is obtained by collecting the real-time video picture of the upper member. The device side includes a camera and a microphone, the camera is used for collecting video picture data of the upper members, the microphone is used for collecting sound data of the upper members, the device side synthesizes the video picture data and the sound data into video stream data and then uploads the video stream data to the server, so that subsequent other devices can obtain the video stream data of each upper member from the server, and video pictures of each upper member are displayed according to the video stream data. The streaming mode is to divide a multimedia file such as the video data into compressed packets after compression, so that the video data can be played in a real-time mode without downloading waiting. In addition, the room data also includes a display layout of the video frames, where the display layout is a display parameter of the video frames, such as a display order, a display position, a size, and whether to display the video frames corresponding to the video stream when the video frames are displayed on the device side.

In the prior art, after joining a video conference room, a device side displays a video conference interface, where the video conference interface is used to display related content of the video conference. For example, the device side displays a video picture corresponding to video stream data on a video conference interface according to the video stream data and the display layout in the room data acquired from the server in real time, and generates a hidden upper member list on the video conference interface according to upper member data in the room data, wherein the upper member list comprises corresponding upper member labels of upper members, and the upper member labels are used for identifying each upper member. When the management end needs to control the upper member or the video picture of the upper member, the hidden upper member list needs to be called out on the video conference interface, and then the upper member label in the upper member list is operated to call out the management menu, so that the video picture corresponding to the upper member label and the upper member can be managed, as shown in fig. 3, and fig. 3 is a video conference interface. In addition, in the prior art, a certain limitation exists on the display sequence of the video pictures of the upper member.

In order to solve the above problems, the embodiment of the present invention provides a video conference management method, where the video conference management method is applied to a device side, and in this embodiment, the management side is taken as the device side for explanation. When the management end executes the video conference management method, the implementation flow is shown in fig. 4, and referring to fig. 4, the courseware playing control method includes steps 110-160:

step 110, acquiring room data of a video conference room which is currently added in real time, wherein the room data comprises upper member data, video stream data of video pictures corresponding to each upper member and display layout of the video pictures, and the video conference room is built in a server.

In this embodiment, after the management end joins the video conference room, the management end may acquire room data of the video conference room in real time from the server, where the room data includes upper member data, video stream data of video frames corresponding to each upper member, and display layout of the video frames.

Step 120, displaying a video conference interface, wherein video pictures corresponding to each video stream data are displayed in the video conference interface according to the display layout; and displaying an upper member list in the video conference interface according to the upper member data, wherein the upper member list comprises upper member labels corresponding to each video picture, the display sequence of the video pictures is consistent with the arrangement sequence of the upper member labels, the upper member data comprises an arrangement sequence, and the display layout comprises a display sequence.

After joining the network room, the management end displays the video conference interface in the local display screen. And then, the management end displays corresponding video pictures on the video conference interface according to video stream data in the room data, wherein the video pictures are required to be displayed on the video conference interface according to the display layout. In this embodiment, the display layout includes a display mode and a display sequence of each video picture, where the display mode is a layout mode of the video pictures when displayed, for example, the display mode may be a "classical mode", as shown in fig. 5, in the "classical mode", the left side of the video conference interface includes a first area S1 for displaying a video picture with a larger area, for example, a video picture corresponding to video stream data of a lecturer side, and the right side of the video conference interface includes a second area S2 for displaying a plurality of video pictures with a smaller area, for example, a video picture corresponding to video stream data of a student side. In addition, the display mode may be an "equalization mode" in which a plurality of video pictures having the same area are displayed on the video conference interface, as shown in fig. 6.

The display order is the order in which the video pictures are displayed, for example, in the display order in this embodiment, the display priority of the video picture corresponding to the video stream data of the lecturer side may be set to be highest by default, and the display priority of the video picture corresponding to the video stream data of the student side may be set to be lower. For example, when the video conference interface displays video pictures in the "equalizing mode", video pictures corresponding to video stream data of the lecturer side are displayed in the first position in the order from left to right and from top to bottom, and video pictures corresponding to video stream data of the student side are displayed in the subsequent position in the order.

In an embodiment, the management end further needs to display an upper member list in the video conference interface according to upper member data in the room data, where the upper member list includes an upper member tag corresponding to each video picture. Illustratively, the list of the upper members displayed on the video conference interface is shown in fig. 7, in which a plurality of upper member tags are displayed, and a name corresponding to each upper member is displayed in each upper member tag. In addition, in this embodiment, the list of the members includes a list of the members, and in this embodiment, the display order of the video frames is consistent with the list of the members. For example, as shown in fig. 8, in the list of upper members of the video conference interface, the displayed upper member labels are respectively lecturer a, student B, student C, student D, and student E, and then the display order of the video interface on the video conference interface is the video picture corresponding to lecturer a, the video picture corresponding to student B, the video picture corresponding to student C, the video picture corresponding to student D, and the video picture corresponding to student E.

And 130, responding to the picture adjustment operation on the video picture, and sending a layout adjustment instruction to the server so as to enable the server to update the display layout.

After the management end displays the video picture and the list of the upper members in the video conference interface, at this time, the administrator may perform a picture adjustment operation on the video picture displayed in the video conference interface through the management end, where the picture adjustment operation is used to adjust the video picture, for example, adjust the size of the video picture, etc. In one embodiment, an administrator may interact with video frames in a video conferencing interface via a mouse to perform frame adjustment operations on the video frames; if the display screen of the management end is a touch display screen, the user can execute the picture adjustment operation on the video picture through gestures. It is understood that the manner in which the user performs the screen adjustment operation in this embodiment may be set according to actual needs, and is not particularly limited in this embodiment.

After the management end monitors that the user executes the picture adjustment operation on the video picture, the management end responds to the picture adjustment operation, generates a layout adjustment instruction and sends the layout adjustment instruction to the server, wherein the layout adjustment instruction is used for instructing the server to adjust the display layout in the video conference room. The layout adjustment instruction includes a target video frame acted by the frame adjustment operation and specific information of the frame adjustment operation, and the server may adjust parameters of the target video frame in the display layout, for example, adjust a size and a display position of the target video frame, adaptively adjust parameters of other video frames, and the like, according to the specific information of the frame adjustment operation and the target video frame after receiving the layout adjustment instruction. For example, when the screen adjustment operation is to enlarge the target video screen, the server enlarges the size of the target video screen in the display layout according to the layout adjustment instruction, adjusts the display position of the enlarged target video screen, and reduces the sizes of other video screens and adjusts the display position.

And 140, updating the video conference interface according to the updated display layout.

After updating the display layout in the room data according to the picture adjustment operation, the management terminal and other equipment terminals also update the video conference interface according to the updated display layout in the room data received in real time, so as to display the adjusted video picture.

And step 150, responding to the sequence adjustment operation, and sending a sequence adjustment instruction to the server so that the server updates the arrangement sequence in the upper member data and the display sequence in the display layout, wherein the sequence adjustment operation acts on the upper member labels or the video pictures.

In addition, in this embodiment, the administrator may also adjust the display sequence of the video frames in the video conference interface through the management end. Specifically, when the administrator needs to adjust the video frames, the administrator can execute a sequence adjustment operation on the top member labels or the video frames displayed in the video conference interface through the management end, wherein the sequence adjustment operation is used for adjusting the display sequence of the video frames. The manner in which the administrator performs the sequence adjustment operation on the video frame is similar to the manner in which the frame adjustment operation is performed, and the sequence adjustment operation may be performed on the video frame or the member tag on the upper stage by means of a mouse or a gesture, which is not described in detail in this embodiment.

When the management end monitors that the user executes the sequence adjustment operation on the member label of the upper platform or the video picture, the management end responds to the sequence adjustment operation, generates a sequence adjustment instruction and sends the sequence adjustment instruction to the server, wherein the sequence adjustment instruction is used for instructing the server to adjust the display sequence of the video picture. For example, when the sequence adjustment operation acts on the video frames, the management end may generate a sequence adjustment instruction according to the display sequence of the video frames after adjustment; when the sequence adjustment operation acts on the upper member labels, the management end can generate a sequence adjustment instruction according to the arrangement sequence of the upper member labels in the upper member list. After receiving the sequence adjustment instruction, the subsequent server updates the display sequence in the display layout of the room data according to the sequence adjustment instruction when the sequence adjustment instruction comprises the display sequence after the video picture adjustment, and then updates the arrangement sequence of the upper member labels corresponding to the video picture in the upper member data according to the updated display sequence. When the order adjustment instruction includes the arrangement order of the upper member labels after adjustment, the server updates the arrangement order in the upper member data according to the order adjustment instruction, and then updates the display order of the video pictures corresponding to the upper member labels in the display layout according to the updated arrangement order.

And step 160, updating the video conference interface according to the updated upper member data and the updated display layout.

After updating the display layout and the arrangement sequence in the room data according to the sequence adjustment operation, the management end and other equipment ends update the video conference interface according to the updated display layout and the updated upper member data in the room data received in real time, so that the adjusted video picture and the upper member list are displayed.

In addition, it should be further noted that the execution order of the steps 130 and 150 in the present embodiment is not strictly limited, and the user may execute the step 130 after executing the step 150.

In the above-mentioned embodiment of the present invention, after a user enters a video conference room through a device end, the device end displays a video conference interface, in which a video frame of an upper member and an upper member list are displayed, and the user can interact with the video frame in the video conference room and an upper member tag in the upper member list directly through the management end, and the management end sends a layout adjustment instruction or a sequence adjustment instruction to a server according to an interaction manner, so as to implement adjustment of the video frame, and management of a display sequence of the video frame and an arrangement sequence of the upper member tag. The embodiment of the invention can improve the efficiency of managing the video pictures of the video conference and the participants, and solves the technical problem of low management efficiency when managing the video pictures of the video conference and the participants in the prior art.

On the basis of the above-described embodiments, the picture adjustment operation includes a picture broadcasting operation.

In one embodiment, the picture adjustment operation includes a picture broadcast operation, which refers to an operation of displaying a video picture on a video conference interface in full screen. Illustratively, the screen broadcast operation is performed by a user interacting with a video screen through gestures, and the specific interaction modes are as follows:

(1) The user presses the first video screen with two fingers, and the position of the two finger presses is required to be within the display area of the first video screen.

(2) Two fingers of a user press the video picture for 1 second, the positions of the two fingers need to be kept in the display area of the first video picture within 1 second, and after 1 second arrives, the management end intercepts the image of the first video picture pressed by the user.

(3) After the management end intercepts the image, two fingers of the user move to two opposite angles of the image respectively, and an amplifying gesture is performed on the image, as shown in fig. 9, at this time, the image is amplified along with the movement of the fingers, and the management end continuously acquires video stream data corresponding to the first video picture in the process.

(4) When the distance between the two fingers of the user on the display screen is greater than or equal to the preset multiple of the distance between the two fingers when the two fingers press the first video picture for the first time, the whole process of performing the picture broadcasting operation on the video picture is completed, and the specific process is shown in fig. 10, wherein the preset multiple can be set according to actual needs, for example, can be set to be 1.5 times.

It can be understood that the process of performing the picture broadcasting operation on the video picture by the user in this embodiment may be set according to actual needs, and the manner of performing the picture broadcasting operation by the user in this embodiment is not specifically limited.

In step 103, in response to a frame adjustment operation applied to the video frame, a layout adjustment instruction is sent to the server, so that the server updates the display layout, including:

step 1031, in response to the frame broadcasting operation acting on the first video frame, sends a layout adjustment instruction to the server, so that the server sets the first video frame to be displayed in full screen according to the layout adjustment instruction in the display layout, and the layout adjustment instruction includes frame identification information of the first video frame and the frame broadcasting instruction.

When the management end monitors that the user executes the picture broadcasting operation on the first video picture, the management end responds to the picture broadcasting operation, at the moment, the management end determines picture identification information of the first video picture, wherein the picture identification information is unique identification of the video picture, for example, the picture identification information comprises picture ID of the video picture or names of members on the upper platform corresponding to the video picture, and the unique video picture can be determined through the picture identification information. Meanwhile, the management end generates a picture broadcasting instruction which is used for instructing the server to broadcast the first video picture. And finally, the management end generates a layout adjustment instruction according to the picture identification information of the first video picture and the picture broadcasting instruction, and sends the layout adjustment modulation to the server.

After receiving the layout adjustment instruction sent by the management end, the server analyzes the layout adjustment instruction, determines the picture broadcasting instruction and the picture identification information carried by the layout adjustment instruction, determines a first video picture corresponding to the picture identification information, and broadcasts the first video picture according to the picture broadcasting instruction. Specifically, in the display layout of the room data, the server may set the first video frame to be displayed in full screen, and set the other video frames to be displayed in hidden, so as to complete updating of the display layout.

After the follow-up management terminal equipment and other equipment terminals acquire updated room data from the server, the video conference interface can be updated according to the updated display layout in the room data, so that full-screen display of the first video picture is realized.

In the embodiment of the invention, the user can execute the picture broadcasting operation on the video picture through the management terminal, and after the server responds to the picture broadcasting operation, the layout adjustment instruction is sent to the server, so that the server sets the video picture acted by the picture broadcasting operation to be full-screen display, sets other video pictures to be hidden display in the display layout, and after the updated room data is acquired from the server by the subsequent other equipment terminals, the video conference interface can be updated according to the updated display layout in the room data, thereby realizing full-screen display of the video picture.

On the basis of the above embodiment, the method further comprises:

step 1032, transmitting a broadcast cancellation instruction to the server in response to the broadcast cancellation operation acting on the first video picture, and the server restoring the first video picture in the display layout.

In this embodiment, after the first video frame is displayed in full screen on the video conference interface, the user may cancel the full screen display of the first video frame in the management end. Specifically, the user may cancel the full-screen display of the first video picture by performing a broadcast cancel operation on the management side, which is an operation for canceling the full-screen display. In one embodiment, the process of performing the broadcast cancellation operation on the first video frame by the user is similar to the process of performing the frame broadcast operation, and the difference is that after the management end intercepts the image of the first video frame pressed by the user, two fingers of the user need to move to the center of the image respectively, a zoom-out gesture is performed on the image, at this time, the image is zoomed out along with the movement of the fingers, and when the distance between the two fingers of the user on the display screen is smaller than the preset multiple of the distance between the two fingers when the two fingers press the first video frame for the first time, the whole process of performing the broadcast cancellation operation on the first video frame is completed.

After monitoring that the user executes the broadcast cancellation operation on the first video picture, the management end generates a broadcast cancellation instruction and sends the broadcast cancellation instruction to the server, wherein the broadcast cancellation instruction is used for indicating the server to cancel the full-screen display of the first video picture. After receiving the broadcast cancellation instruction, the server cancels the full-screen display of the first video picture in the display layout of the room data. After the subsequent management terminal equipment and other equipment terminals acquire updated room data from the server, the video conference interface can be updated according to the updated display layout in the room data, the full-screen display of the first video picture is canceled, and the first video picture is restored to the original corresponding display sequence for display.

In the embodiment of the invention, after the first video frame is displayed in full screen, the user may also execute the broadcast cancel operation on the first video frame in the management end, the management end responds to the broadcast cancel operation and sends the broadcast cancel instruction to the server, so that the server cancels the full screen display of the first video frame in the display layout, and after the other equipment ends acquire the updated display layout from the server, the video conference interface can be updated to cancel the full screen display of the first video frame.

On the basis of the above-described embodiments, the screen adjustment operation includes a screen enlargement operation.

In one embodiment, the screen adjustment operation includes a screen zoom operation, where the screen zoom operation refers to an operation of zooming in and displaying a video screen on the video conference interface. For example, in the classical mode, the user performs the operation of zooming in by means of the gesture to interact with the video frames, where in the classical mode, the ordering order of the video frames in the second area is the display order of the video frames, and when the video frames in the second area are zoomed in to the first area for displaying, the video frames disappear in the second area, but the display order of the video frames is not changed. For example, assume that the display order of the video pictures in the second area is the video picture corresponding to the lecturer a, the video picture corresponding to the student B, the video picture corresponding to the student C, the video picture corresponding to the student D, and the video picture corresponding to the student E, and in the initial state, the video picture corresponding to the lecturer side is displayed in the first area in an enlarged manner by default, that is, the video picture corresponding to the lecturer a is displayed in the first area at this time, and the video picture corresponding to the student a, the video picture corresponding to the student B, the video picture corresponding to the student C, the video picture corresponding to the student D, and the video picture corresponding to the student E are displayed in the second area, and the display order of the video pictures is not changed at this time. If the picture enlarging operation performed by the subsequent user causes the video picture corresponding to the student a to be displayed in the first area, the video picture corresponding to the lecturer a, the video picture corresponding to the student B, the video picture corresponding to the student C, the video picture corresponding to the student D, and the video picture corresponding to the student E are displayed in the second area at this time, but the display order of the video pictures remains unchanged, that is, the video pictures are enlarged and displayed in the classical mode, and the display order of the video pictures is not changed.

The specific interaction mode is as follows:

(1) The user presses on the second video screen, which is a video screen displayed in the second area, using one finger.

(2) The user presses one finger on the video picture for 500 milliseconds, the position of the finger is changed but kept in the display area of the second video picture within 500 milliseconds, and after 500 milliseconds are reached, the management end intercepts the image of the second video picture pressed by the user and moves the center of the image to the position pressed by the finger.

(3) After the image is intercepted by the management end, the user can move the finger, the management end controls the center of the image to move along with the finger, as shown in fig. 11, after the finger moves to the first area, the user releases the finger to release the image, the whole process of performing the picture amplifying operation on the second video picture is completed, the specific process is as shown in fig. 12, and the management end continuously acquires video stream data corresponding to the second video picture in the process.

step 1033, in response to the screen enlarging operation acting on the second video screen, sending a layout adjustment instruction to the server, so that the server sets the second video screen to be enlarged for display in the display layout according to the layout adjustment instruction; the layout adjustment instruction includes picture identification information of the second video picture and a picture enlargement instruction.

When the management end monitors that the user performs the picture amplifying operation on the second video picture, the management end responds to the picture amplifying operation, at the moment, the management end determines picture identification information of the second video picture, and meanwhile, the management end generates a picture amplifying instruction which is used for indicating the server to amplify the second video picture. And finally, the management end generates a layout adjustment instruction according to the picture identification information of the second video picture and the picture amplification instruction, and sends the layout adjustment instruction to the server.

After receiving the layout adjustment instruction sent by the management end, the server analyzes the layout adjustment instruction, determines the picture amplification instruction and the picture identification information carried by the layout adjustment instruction, determines a second video picture corresponding to the picture identification information, and amplifies and displays the second video picture according to the picture broadcasting instruction. Specifically, in the display layout of the room data, the server may restore the video frame currently displayed in the first area to the corresponding display sequence in the second area in the classical mode to display, set the display area of the second video frame as the first area, and cancel displaying the second video frame in the second area at the same time, thereby performing enlarged display on the second video frame and completing updating the display layout.

After the subsequent management terminal equipment and other equipment terminals acquire updated room data from the server, the video conference interface can be updated according to the updated display layout in the room data, so that the second video picture can be displayed in an enlarged mode.

In the embodiment of the invention, the user can execute the picture amplifying operation on the video picture through the management terminal, and after the server responds to the picture amplifying operation, the server sends the layout adjusting instruction to the server, so that the server amplifies and displays the video picture acted by the picture amplifying operation in the display layout, and after the updated room data is acquired from the server by other equipment terminals, the video conference interface can be updated according to the updated display layout in the room data, thereby realizing the amplified display of the video picture.

On the basis of the above embodiment, the method further comprises:

step 1034, in response to the magnification cancel operation applied to the second video frame, sends a magnification cancel instruction to the server to cause the server to restore the second video frame in the display layout.

In this embodiment, after the second video frame is displayed in an enlarged manner on the video conference interface, the user may cancel the enlarged display of the second video frame in the management end. Specifically, the user can cancel the enlarged display of the second video picture by performing an enlarged cancel operation on the management side, which is an operation for canceling the enlarged display. In one embodiment, the process of performing the zoom-in cancel operation on the second video picture by the user is similar to the process of performing the picture-in cancel operation, except that when the management end intercepts the image of the second video picture pressed by the user, the finger of the user needs to be released after moving from the first area to the second area to perform the zoom-in cancel operation on the second video picture.

After monitoring that the user performs the amplification cancel operation on the second video picture, the management end generates an amplification cancel instruction and sends the amplification cancel instruction to the server, wherein the amplification cancel instruction is used for instructing the server to cancel the amplification display of the second video picture. After receiving the instruction of canceling the amplification, the server cancels the amplification display of the second video picture in the display layout of the room data, and restores the second video picture to the original display sequence of the second area for display. After the subsequent management terminal equipment and other equipment terminals acquire updated room data from the server, the video conference interface can be updated according to the updated display layout in the room data, the enlarged display of the second video picture is canceled, and the second video picture is restored to the corresponding display sequence for display.

In the embodiment of the invention, after the second video frame is displayed in an enlarged manner, the user may perform an operation of canceling the second video frame in the management terminal, and the management terminal responds to the operation of canceling the second video frame and sends an instruction of canceling the second video frame to the server, so that the server cancels the enlarged display of the second video frame in the display layout, and after the other equipment terminal acquires the updated display layout from the server, the video conference interface can be updated to cancel the enlarged display of the second video frame.

On the basis of the above embodiment, when the order adjustment operation acts on the upper member label, in response to the order adjustment operation, an order adjustment instruction is sent to the server in step 105 to cause the server to update the arrangement order in the upper member data and the display order in the display layout, including:

step 1051, in response to the order adjustment operation applied to the first upper member tag, determines a first location in the upper member list at which the first upper member tag is inserted.

In this embodiment, the user may adjust the display sequence of the video frames by operating the top member tab displayed in the video conference interface in the management terminal. Specifically, the sequence adjustment operation is described by taking an example of a manner that a user interacts with the member tag through gestures, and the specific interaction manner is as follows:

(1) The user presses with a finger on the first superordinate member tag of the superordinate member list.

(2) And a finger of the user presses the first upper member label for 500 milliseconds, the position of the finger is kept in the display area of the first upper member label within 500 milliseconds, and after 500 milliseconds arrive, the management end intercepts the image of the first upper member label pressed by the user and moves the center of the image to the position pressed by the finger.

(3) After the image is intercepted by the management end, the user can move the finger, the management end controls the center of the image to move along with the finger, when the finger moves into the display area of the other upper member labels, an 'insertable' prompt is displayed on the display area of the other upper member labels, as shown in fig. 13, the user releases the finger release image, and at the moment, the position of releasing the finger by the user is the first position of inserting the first upper member label into the upper member list, and the specific process is shown in fig. 14.

After monitoring that the user executes the sequence adjustment operation on the first upper member label, the management end responds to the sequence adjustment operation and determines the first position of the first upper member label inserted in the upper member list.

Step 1052, sending a sequence adjustment instruction to the server, so that the server updates the arrangement sequence in the upper member data according to the first position inserted by the first upper member tag, and updates the display sequence in the display layout according to the arrangement sequence, where the sequence adjustment instruction includes member identification information corresponding to the first upper member tag and the first position.

After determining the first position of the first upper member tag inserted in the upper member list, the management end obtains member identification information corresponding to the first upper member tag, wherein the member identification information is a unique identifier of the upper member, for example, the member identification information comprises a member ID of the upper member or a name of the upper member, and the unique upper member can be determined through the member identification information. And then, the management end generates a sequence adjustment instruction according to the member identification information and the first position and sends the sequence adjustment instruction to the server.

After receiving the order adjustment instruction, the server analyzes the order adjustment instruction, determines member identification information and a first position in the order adjustment instruction, and determines a first upper member corresponding to the member identification information. And then the server modifies the upper member data in the room data, inserts the first upper member into the first position in the arrangement sequence, and adaptively modifies the arrangement sequence of other upper members to finish updating the arrangement sequence. Meanwhile, the server also needs to synchronously update the display sequence of the video pictures in the display layout according to the updated arrangement sequence, so that the display sequence of the video pictures is consistent with the arrangement sequence of the upper member labels, and the adjustment of the display sequence of the video pictures corresponding to the first upper member label is completed.

After the subsequent management end device and other device ends acquire updated room data from the server, the video conference interface can be updated according to the updated display layout and the upper member data in the room data, so as to display the upper member list with the adjusted arrangement sequence and the video picture with the adjusted display sequence.

In the embodiment of the invention, the user can execute the sequence adjustment operation on the upper member label through the management end, so that the display sequence of the video picture in the video conference interface is adjusted.

On the basis of the above embodiment, when the order adjustment operation is applied to the video frame, in response to the order adjustment operation, an order adjustment instruction is sent to the server in step 105 to cause the server to update the arrangement order in the upper member data and the display order in the display layout, including:

step 1053, in response to the order adjustment operation applied to the third video frame, determines a second position at which the third video frame is inserted in the display order.

In another embodiment, the user may also adjust the display order of the video pictures by operating the video pictures displayed in the video conference interface in the management terminal. Specifically, the following description will be given by taking the example of performing the sequence adjustment operation in a manner that the user interacts with the video frame through gestures, and the specific interaction manner is as follows:

(1) The user presses on the third video screen using a finger.

(2) And a finger of the user presses the third video picture for 500 milliseconds, the position of the finger is kept in the display area of the third video picture within 500 milliseconds, and after 500 milliseconds arrive, the management end intercepts the image of the third video picture pressed by the user and moves the center of the image to the position pressed by the finger.

(3) After the image is intercepted by the management end, the user can move the finger, the management end controls the center of the image to move along with the finger, and the management end continuously acquires video stream data corresponding to the third video picture in the process. When the finger moves to the display area of the other video pictures, an 'insertable' prompt is displayed on the display area of the other third video pictures, as shown in fig. 15, the user releases the finger release image, and the position where the user releases the finger is the second position where the third video pictures are inserted in the display sequence of the video pictures, and the specific process is shown in fig. 16.

After monitoring that the user executes the sequence adjustment operation on the third video picture, the management end responds to the sequence adjustment operation and determines a second position of the third video picture inserted in the display sequence.

Step 1054, sending a sequence adjustment instruction to the server, so that the server updates the display sequence in the display layout according to the second position inserted by the third video frame, and updates the arrangement sequence in the upper member data according to the display sequence; the order adjustment instruction includes picture identification information of the third video picture and the second position.

And the management end acquires picture identification information corresponding to the third video picture after determining the second position of the third video picture inserted in the upper member list. And then, the management end generates a sequence adjustment instruction according to the picture identification information and the second position and sends the sequence adjustment instruction to the server.

After receiving the order adjustment instruction, the server analyzes the order adjustment instruction, determines picture identification information and a second position in the order adjustment instruction, and determines a third video picture corresponding to the picture identification information. And then the server modifies the display layout in the room data, inserts the third video picture into the third position in the display sequence, and adaptively modifies the display sequence of other video pictures to finish updating the display sequence. Meanwhile, the server also needs to synchronously update the arrangement sequence of the upper member labels in the upper member data according to the updated display sequence, so that the display sequence of the video picture is consistent with the arrangement sequence of the upper member labels, and the arrangement sequence of the upper member labels corresponding to the third video picture is adjusted.

After the subsequent management end equipment and other equipment ends acquire updated room data from the server, the video conference interface can be updated according to the updated display layout and the upper member data in the room data, so that the video pictures with the adjusted display sequence and the upper member list with the adjusted display arrangement sequence are displayed.

In addition, it should be further noted that when the display mode of the video frames is the classical mode, there are 5 video frames on the video conference interface, namely, video frame 1, video frame 2, video frame 3, video frame 4 and video frame 5, and the corresponding top member labels in the top member list are top member 1, top member 2, top member 3, top member 4 and top member 5. If the first region in the classical mode is displayed with video frame 3, the second region is displayed with video frame 1, video frame 2, video frame 4 and video frame 5, and the display sequence of the video frames is { video frame 1, video frame 2, video frame 3, video frame 4, video frame 5}. If the user inserts video frame 5 before video frame 4, the display order of the video frames at this time is { video frame 1, video frame 2, video frame 3, video frame 5, video frame 4}. If the user inserts video frame 5 before video frame 2, the display order of the video frames is { video frame 1, video frame 5, video frame 2, video frame 3, video frame 4}.

In the embodiment of the invention, the user can execute the sequence adjustment operation on the video pictures through the management terminal, so that the display sequence of the video pictures in the video conference interface is adjusted.

Based on the above embodiment, the upper member labels in the upper member list are divided into at least two arrangement priorities, the upper member labels are ordered according to the arrangement priorities in the arrangement order, and only adjustment of the arrangement order between the upper member labels with the same arrangement priority is allowed, and adjustment of the display order between video pictures corresponding to the upper member labels with the same arrangement priority is allowed.

In one embodiment, the upper member tags in the upper member list are divided into at least two prioritization levels, where prioritization levels refer to the priorities of the upper member tags as they are being prioritized in the upper member list.

In one embodiment, the arrangement priorities of the labels of the upper members may be divided according to the identities of the upper members, for example, the arrangement priorities of the labels of the upper members may be divided into a lecturer teacher, and students, where the arrangement priorities are from high to low, i.e., the lecturer teacher > student. In addition, the positions in the ranking order of the upper member labels may be ranked according to the ranking priority, for example, the upper member labels corresponding to the lecture teacher may be ranked from high to low according to the ranking priority, that is, the upper member label corresponding to the lecture teacher is located at the forefront of the ranking order, and the upper member label corresponding to the lecture teacher is located after the upper member label corresponding to the lecture teacher, and the upper member label corresponding to the student is located after the upper member label corresponding to the lecture teacher.

In addition, in this embodiment, only adjustment of the arrangement order between the top member tags with the same arrangement priority is allowed, and adjustment of the display order between video pictures corresponding to the top member tags with the same arrangement priority is allowed. For example, the upper member labels corresponding to students can be sequentially switched only between the upper member labels corresponding to students, and the upper member labels corresponding to students cannot be sequentially switched between the upper member labels corresponding to lecture teachers or the upper member labels corresponding to lecture teachers. Similarly, the video frames of the upper member labels corresponding to the students are only allowed to switch the display sequence among the video frames of the upper member labels corresponding to the other students. According to the embodiment of the invention, the upper member labels are divided into at least two arrangement priorities, so that the upper member labels with higher arrangement priorities and the corresponding video pictures can be preferentially displayed in the video conference interface, and the actual use requirements are met.

On the basis of the embodiment, the room data further includes the data of the members of the lower stage, wherein the members of the lower stage refer to members who enter the video conference room but do not transmit video data to the server, i.e. the video pictures corresponding to the members of the lower stage are not displayed in the conference video interface; the lower member data is related information of the lower member, such as names of the lower member and arrangement sequence of the lower personnel labels in the lower member list.

The video conference management method further comprises the following steps:

step 107, displaying a lower member list on the video conference interface according to lower member data, wherein the lower member list comprises lower member labels, the arrangement sequence of the lower member labels is consistent with the sequence of the lower members entering the video conference room, each lower member corresponds to one lower member label, and the lower member data comprises the arrangement sequence of the lower member labels.

In this embodiment, after the management end obtains the room data of the video conference room, the management end further needs to display a list of lower members on the video conference interface according to the lower member data in the room data, where the list of lower members includes a label of the lower member, and the label of the lower member is used to identify the lower member, for example, a name of the label of the lower member may be displayed on the label of the lower member, as shown in fig. 17. In addition, in this embodiment, the arrangement order of the labels of the lower members in the lower member list is consistent with the order of the lower members entering the video conference room, that is, the lower members who enter the video conference room preferentially, and the arrangement order of the labels of the corresponding lower members is higher than the labels of the lower members who enter the video conference room subsequently.

On the basis of the above embodiment, the method further comprises:

step 108, in response to the lower operation acting on the second upper member tag, determining a third position where the second upper member tag is inserted in the arrangement order of the lower member tags.

In this embodiment, for an upper member displaying a video picture on a video conference interface, an administrator may also enable the upper member to be in a lower stage by performing a lower stage operation on a label of the upper member corresponding to the upper member, that is, the video picture of the upper member is not displayed on the video conference interface. In one embodiment, the procedure of the lower stage operation is similar to the procedure of performing the sequence adjustment operation on the upper stage member tags, except that after the management end is required to intercept the image of the second upper stage member tag pressed by the user, the user needs to move a finger to insert the image of the second upper stage member tag into the lower stage member list, so as to complete the lower stage operation. After monitoring that the user performs the operation of the second upper member label in the lower stage, the management end needs to determine a third position where the second upper member label is inserted in the arrangement sequence of the lower member label, that is, a position where the image of the second upper member label is inserted into the lower member list.

Step 109, sending a lower instruction to the server, so that the server updates the arrangement sequence in the upper member data and the arrangement sequence in the lower member data according to the third position inserted by the second upper member label, and in the display layout, setting to cancel displaying the video picture corresponding to the second upper member label, wherein the lower instruction comprises the member identification information corresponding to the second upper member label and the third position.

And the management end acquires member identification information corresponding to the second upper member tag after determining a third position of the second upper member tag inserted in the lower member list. And then, the management end generates a descending instruction according to the member identification information and the third position and sends the descending instruction to the server.

After receiving the descending instruction, the server analyzes the descending instruction, determines member identification information and a third position in the descending instruction, and determines a second upper member corresponding to the member identification information. And then the server updates the arrangement sequence of the upper member data and the arrangement sequence of the lower member data in the room data. Specifically, the server needs to delete the second upper member tag in the arrangement sequence in the upper member data, and insert the second upper member tag in the third position in the arrangement sequence in the lower member data. And then, the server stops acquiring the video stream data corresponding to the second upper member label, and further sets a cancel display of the video picture corresponding to the second upper member label in the display layout, so that the update of the display layout is completed.

After the subsequent management end device and other device ends acquire updated room data from the server, the video conference interface can be updated according to the updated display layout, the upper member data and the lower member data in the room data, so as to display the upper member list with the second upper member label deleted, the lower member list with the second upper member label added, and cancel the display of the video picture corresponding to the second upper member label.

In the embodiment of the invention, the user executes the lower operation on the upper member label displayed on the video conference interface through the management end, so that the video picture corresponding to the upper member label can be canceled from being displayed on the video conference interface, and the management on the upper member is realized. The embodiment of the invention can improve the efficiency of managing the video pictures and the upper members, so as to solve the technical problem of low efficiency of managing the video pictures and the upper members in the prior art.

On the basis of the above embodiment, the method further comprises:

step 110, in response to the upload operation acting on the first member tag, determining a fourth position where the first member tag is inserted in the arrangement order of the member tags.

Similarly, in this embodiment, the administrator may also enable the lower member to upload, that is, display the video picture of the lower member in the video conference interface, by executing the upload operation on the lower member label corresponding to the lower member. In one embodiment, the procedure of the upper stage operation is similar to the procedure of performing the sequence adjustment operation on the upper stage member tags, except that after the management end is required to intercept the image of the first lower stage member tag pressed by the user, the user needs to move a finger, and insert the image of the first lower stage member tag into the upper stage member list, thereby completing the upper stage operation. After monitoring that the user performs the stage operation on the first stage member tag, the management end needs to determine a fourth position where the first stage member tag is inserted in the arrangement sequence of the stage member tags, that is, a position where the image of the first stage member tag is inserted into the stage member list.

Step 111, sending an upper instruction to the server, so that the server updates the arrangement sequence in the upper member data and the arrangement sequence in the lower member data according to the fourth position in which the first lower member tag is inserted, receives video stream data corresponding to the first lower member tag, and sets and displays a video picture corresponding to the first lower member tag in a display layout, where the upper instruction includes member identification information corresponding to the first lower member tag and the fourth position.

And the management end acquires member identification information corresponding to the first lower member tag after determining the fourth position in which the first lower member tag is inserted in the upper member list. And then, the management end generates an upper instruction according to the member identification information and the fourth position and sends the upper instruction to the server.

After receiving the upper instruction, the server analyzes the lower instruction, determines member identification information and a fourth position in the lower instruction, and determines a first lower member corresponding to the member identification information. And then the server updates the arrangement sequence of the upper member data and the arrangement sequence of the lower member data in the room data. Specifically, the server needs to delete the first lower member tag in the arrangement sequence of the lower member data, and insert the first lower member tag in the fourth position of the arrangement sequence of the upper member data. Then, the server needs to receive the video stream data corresponding to the first member label, and further sets and displays the video picture corresponding to the first member label in the display layout, so as to complete the updating of the display layout.

After the subsequent management end device and other device ends acquire updated room data from the server, the video conference interface can be updated according to the updated display layout, the updated upper member data and the updated lower member data in the room data, so as to display the upper member list added with the first lower member label, delete the lower member list of the first lower member label and display the video picture corresponding to the first lower member label.

In the embodiment of the invention, the user executes the upper-stage operation on the lower-stage member label displayed on the video conference interface through the management terminal, so that the video picture corresponding to the lower-stage member label can be displayed on the video conference interface, and the management of the upper-stage member is realized. The embodiment of the invention can improve the efficiency of managing the video pictures and the upper members, so as to solve the technical problem of low efficiency of managing the video pictures and the upper members in the prior art.

In another embodiment, the administrator may also call out an operation menu of the video screen by pressing a single finger on the management end for a long time, where a plurality of operation options are displayed on the operation menu. For example, as shown in fig. 18, the operation options in the operation menu include operations such as "broadcast screen, cancel broadcast, zoom in screen, cancel zoom in, get down, invite to speak, close to speak, set as a lecture teacher, set as a main lecture teacher, set as a student, get out of room", etc., the user can trigger the corresponding operation option by clicking the operation option, and after the user triggers the operation option, the operation menu disappears. In the embodiment, the mode of setting the operation menu can further facilitate the user to manage the video picture and the member on the platform, and further improve the efficiency of managing the video picture and the member on the platform.

As shown in fig. 19, fig. 19 is a schematic structural diagram of a video conference management apparatus according to an embodiment of the present invention, where in fig. 19, the video conference management apparatus is suitable for a device side, and the video conference management apparatus includes:

the data acquisition module 201 is configured to acquire, in real time, room data of a currently added video conference room, where the room data includes upper member data, video stream data of video frames corresponding to each upper member, and display layout of the video frames, and the video conference room is built in a server;

an interface display module 202, configured to display a video conference interface, and display video frames corresponding to each video stream data in the video conference interface according to a display layout; displaying an upper member list in the video conference interface according to the upper member data, wherein the upper member list comprises upper member labels corresponding to each video picture, the display sequence of the video pictures is consistent with the arrangement sequence of the upper member labels, the upper member data comprises an arrangement sequence, and the display layout comprises a display sequence;

a picture adjustment module 203, configured to send a layout adjustment instruction to the server in response to a picture adjustment operation applied to the video picture, so that the server updates the display layout;

A first updating module 204, configured to update the video conference interface according to the updated display layout;

the sequence adjustment module 205 is configured to send a sequence adjustment instruction to the server in response to a sequence adjustment operation, so that the server updates the arrangement sequence in the upper member data and the display sequence in the display layout, and the sequence adjustment operation acts on the upper member tag or the video frame;

a second updating module 206, configured to update the video conference interface according to the updated upper member data and the updated display layout.

On the basis of the above-described embodiments, the picture adjustment operation includes a picture broadcasting operation;

the screen adjustment module 203 includes:

and the picture broadcasting sub-module is used for responding to picture broadcasting operation acted on the first video picture and sending a layout adjustment instruction to the server so that the server can set the first video picture to be displayed in a full screen mode in a display layout according to the layout adjustment instruction, and the layout adjustment instruction comprises picture identification information and picture broadcasting instructions of the first video picture.

On the basis of the above embodiment, the method further comprises:

and the broadcast cancellation sub-module is used for responding to the broadcast cancellation operation acted on the first video picture and sending a broadcast cancellation instruction to the server so as to enable the server to restore the first video picture in the display layout.

On the basis of the above-described embodiments, the screen adjustment operation includes a screen enlargement operation;

the screen adjustment module 203 includes:

a picture amplifying sub-module for responding to the picture amplifying operation acted on the second video picture and sending a layout adjusting instruction to the server so that the server can set the second video picture as amplified display in the display layout according to the layout adjusting instruction; the layout adjustment instruction includes picture identification information of the second video picture and a picture enlargement instruction.

On the basis of the above embodiment, the method further comprises:

and the amplification cancellation sub-module is used for responding to the amplification cancellation operation acted on the second video picture and sending an amplification cancellation instruction to the server so as to enable the server to restore the second video picture in the display layout.

On the basis of the above embodiment, when a sequence adjustment operation acts on the upper member tag, the sequence adjustment module 205 includes:

a first position determining sub-module for determining a first position in which the first upper member tag is inserted in the upper member list in response to a sequence adjustment operation acting on the first upper member tag;

the first order adjustment sub-module is used for sending an order adjustment instruction to the server so that the server can update the arrangement order in the upper member data according to the first position inserted by the first upper member label, and update the display order in the display layout according to the arrangement order, wherein the order adjustment instruction comprises member identification information corresponding to the first upper member label and the first position.

On the basis of the above-described embodiment, when a sequence adjustment operation is applied to a video picture, the sequence adjustment module 205 includes:

a second position determining sub-module for determining a second position in which the third video picture is inserted in the display order in response to a sequence adjustment operation acting on the third video picture;

the second sequence adjustment sub-module is used for sending a sequence adjustment instruction to the server so that the server updates the display sequence in the display layout according to the second position inserted by the third video picture and updates the arrangement sequence in the upper member data according to the display sequence; the order adjustment instruction includes picture identification information of the third video picture and the second position.

On the basis of the above embodiment, the room data further includes lower member data, and the apparatus further includes:

the system comprises a lower member display module, a video conference interface and a video conference interface, wherein the lower member display module is used for displaying a lower member list on the video conference interface according to lower member data, the lower member list comprises lower member labels, the arrangement sequence of the lower member labels is consistent with the sequence of the lower members entering a video conference room, each lower member corresponds to one lower member label, and the lower member data comprises the arrangement sequence of the lower member labels.

On the basis of the above embodiment, the method further comprises:

a third position determining module for determining a third position where the second upper member tag is inserted in the arrangement order of the lower member tags in response to a lower operation acting on the second upper member tag;

the lower platform module is used for sending a lower platform instruction to the server so that the server updates the arrangement sequence in the upper platform member data and the arrangement sequence in the lower platform member data according to the third position inserted by the second upper platform member label, and in the display layout, the cancel display of the video picture corresponding to the second upper platform member label is set, and the lower platform instruction comprises the member identification information corresponding to the second upper platform member label and the third position.

On the basis of the above embodiment, the method further comprises:

a fourth position determining module for determining a fourth position where the first lower member tag is inserted in the arrangement order of the upper member tags in response to an upper operation acting on the first lower member tag;

the upper stage module is used for sending an upper stage instruction to the server so that the server updates the arrangement sequence in the upper stage member data and the arrangement sequence in the lower stage member data according to the fourth position inserted by the first lower stage member label, receives video stream data corresponding to the first lower stage member label, and sets and displays a video picture corresponding to the first lower stage member label in a display layout, wherein the upper stage instruction comprises member identification information corresponding to the first lower stage member label and the fourth position.

The video conference management device provided by the embodiment of the invention is contained in the video conference management equipment, can be used for executing the video conference management method provided by the embodiment, and has corresponding functions and beneficial effects.

It should be noted that, in the embodiment of the video conference management apparatus described above, each unit and module included are only divided according to the functional logic, but not limited to the above-described division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present invention.

The present embodiment also provides a video conference management apparatus, as shown in fig. 20, in which the video conference management apparatus 30 in fig. 20 includes a processor 300 and a memory 301;

the memory 301 is used for storing the computer program 302 and transmitting the computer program 302 to the processor 300;

the processor 300 is configured to perform the steps of one of the video conference management method embodiments described above in accordance with instructions in the computer program 302.

By way of example, the computer program 302 may be partitioned into one or more modules/units, which are stored in the memory 301 and executed by the processor 300 to complete the present application. One or more of the modules/units may be a series of computer program instruction segments capable of performing particular functions for describing the execution of the computer program 302 in the video conference management device 30.

Video conference management device 30 may be a computing device such as a desktop computer, a notebook, a palm top computer, and a cloud server. Video conference management device 30 may include, but is not limited to, a processor 300, a memory 301. It will be appreciated by those skilled in the art that fig. 20 is merely an example of video conference management device 30 and does not constitute a limitation on video conference management device 30, and may include more or fewer components than illustrated, or may combine certain components, or different components, e.g., video conference management device 30 may also include input and output devices, network access devices, buses, etc.

The processor 300 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 301 may be an internal storage unit of the video conference management device 30, such as a hard disk or a memory of the video conference management device 30. The memory 301 may also be an external storage device of the video conference management device 30, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card) or the like, which are provided on the video conference management device 30. Further, the memory 301 may also include both an internal storage unit and an external storage device of the video conference management device 30. The memory 301 is used to store computer programs and other programs and data required by the video conference management device 30. The memory 301 may also be used to temporarily store data that has been output or is to be output.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, which are not repeated herein.

In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of elements is merely a logical functional division, and there may be additional divisions of actual implementation, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of the embodiments of the present invention. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media in which computer programs can be stored.

The embodiments of the present invention also provide a storage medium containing computer executable instructions which, when executed by a computer processor, are used to perform a method of video conference management, the method comprising the steps of:

Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the embodiments of the present invention are not limited to the particular embodiments described herein, but are capable of numerous obvious changes, rearrangements and substitutions without departing from the scope of the embodiments of the present invention. Therefore, while the embodiments of the present invention have been described in connection with the above embodiments, the embodiments of the present invention are not limited to the above embodiments, but may include many other equivalent embodiments without departing from the spirit of the embodiments of the present invention, and the scope of the embodiments of the present invention is determined by the scope of the appended claims.

Claims

1. A method for managing a video conference, the method being suitable for a device side, the method comprising:

displaying a video conference interface, and displaying video pictures corresponding to each video stream data in the video conference interface according to the display layout; displaying a top member list in the video conference interface according to the top member data, wherein the top member list comprises top member labels corresponding to each video picture, the display sequence of the video pictures is consistent with the arrangement sequence of the top member labels, the top member data comprises the arrangement sequence, and the display layout comprises the display sequence;

responding to a picture adjustment operation acting on the video picture, and sending a layout adjustment instruction to the server so as to enable the server to update the display layout;

transmitting a sequence adjustment instruction to the server in response to a sequence adjustment operation, so that the server updates the arrangement sequence in the upper member data and the display sequence in the display layout, wherein the sequence adjustment operation acts on the upper member label or the video picture;

2. The video conference management method according to claim 1, wherein said picture adjustment operation includes a picture broadcasting operation;

the response to the picture adjustment operation applied to the video picture, sending a layout adjustment instruction to the server to cause the server to update the display layout, including:

and responding to a picture broadcasting operation acting on a first video picture, sending the layout adjustment instruction to the server so that the server can set the first video picture to be displayed in a full screen mode in the display layout according to the layout adjustment instruction, wherein the layout adjustment instruction comprises picture identification information of the first video picture and a picture broadcasting instruction.

3. A video conference management method as claimed in claim 2, wherein said method further comprises:

and transmitting a broadcast cancellation instruction to the server in response to a broadcast cancellation operation acting on the first video picture, so that the server restores the first video picture in the display layout.

4. The video conference management method according to claim 1, wherein the picture adjustment operation includes a picture enlargement operation;

transmitting the layout adjustment instruction to the server in response to a picture enlargement operation acting on a second video picture, so that the server sets the second video picture to be enlarged display in the display layout according to the layout adjustment instruction; the layout adjustment instruction includes picture identification information of the second video picture and the picture amplification instruction.

5. The video conference management method as claimed in claim 4, further comprising:

And transmitting an enlargement cancel instruction to the server in response to an enlargement cancel operation acting on the second video picture, so that the server restores the second video picture in the display layout.

6. The method according to claim 1, wherein when the order adjustment operation acts on the upper member label, the sending, in response to the order adjustment operation, an order adjustment instruction to the server to cause the server to update the arrangement order in the upper member data and the display order in the display layout, includes:

determining a first position of the first upper member tag inserted in the upper member list in response to a sequence adjustment operation acting on the first upper member tag;

and sending the sequence adjustment instruction to the server so that the server updates the arrangement sequence in the upper member data according to the first position inserted by the first upper member label and updates the display sequence in the display layout according to the arrangement sequence, wherein the sequence adjustment instruction comprises member identification information corresponding to the first upper member label and the first position.

7. The method according to claim 1, wherein when the order adjustment operation is applied to the video picture, the sending, in response to the order adjustment operation, an order adjustment instruction to the server to cause the server to update the arrangement order in the upper member data and the display order in the display layout, includes:

determining a second position in the display order at which a third video picture is inserted in response to an order adjustment operation acting on the third video picture;

sending the order adjustment instruction to the server so that the server updates the display order in the display layout according to the second position inserted by the third video picture, and updates the arrangement order in the upper member data according to the display order; the order adjustment instruction includes picture identification information of the third video picture and the second position.

8. The method according to claim 6 or 7, wherein the top member labels in the top member list are divided into at least two ranks, the top member labels are ranked according to the ranks in the ranks, and only adjustment of the ranks among top member labels with the same ranks is allowed, and adjustment of the display ranks among video pictures corresponding to the top member labels with the same ranks is allowed.

9. A video conference management method as defined in claim 1, wherein the room data further comprises a lower member data, the method further comprising:

and displaying a lower member list on the video conference interface according to the lower member data, wherein the lower member list comprises lower member labels, the arrangement sequence of the lower member labels is consistent with the sequence of the lower members entering the video conference room, each lower member corresponds to one lower member label, and the lower member data comprises the arrangement sequence of the lower member labels.

10. The video conference management method according to claim 9, further comprising:

determining a third position of the second upper member tag inserted in the arrangement sequence of the lower member tags in response to a lower operation acting on the second upper member tag;

the method comprises the steps of sending a lower instruction to a server, enabling the server to update the arrangement sequence in upper member data and the arrangement sequence in lower member data according to a third position inserted by a second upper member label, setting to cancel display of a video picture corresponding to the second upper member label in the display layout, and enabling the lower instruction to comprise member identification information corresponding to the second upper member label and the third position.

11. The video conference management method according to claim 9, further comprising:

determining a fourth position of the first lower member tag inserted in the arrangement sequence of the upper member tags in response to an upper operation acting on the first lower member tag;

the method comprises the steps of sending an upper instruction to a server, enabling the server to update the arrangement sequence in upper member data and the arrangement sequence in lower member data according to a fourth position inserted by a first lower member label, receiving video stream data corresponding to the first lower member label, and setting and displaying a video picture corresponding to the first lower member label in a display layout, wherein the upper instruction comprises member identification information corresponding to the first lower member label and the fourth position.

12. A video conference management apparatus, the apparatus being adapted for use at a device end, the apparatus comprising:

the system comprises a data acquisition module, a server and a video conference server, wherein the data acquisition module is used for acquiring room data of a video conference room which is currently added in real time, the room data comprises upper member data, video stream data of video pictures corresponding to each upper member and display layout of the video pictures, and the video conference room is established in the server;

The interface display module is used for displaying a video conference interface, and displaying video pictures corresponding to each video stream data in the video conference interface according to the display layout; displaying a top member list in the video conference interface according to the top member data, wherein the top member list comprises top member labels corresponding to each video picture, the display sequence of the video pictures is consistent with the arrangement sequence of the top member labels, the top member data comprises the arrangement sequence, and the display layout comprises the display sequence;

the order adjustment module is used for responding to order adjustment operation and sending an order adjustment instruction to the server so that the server updates the arrangement order in the upper member data and the display order in the display layout, and the order adjustment operation acts on the upper member label or the video picture;

13. A video conference management device, characterized in that the video conference management device comprises a processor and a memory;

the memory is used for storing a computer program and transmitting the computer program to the processor;

the processor is configured to execute a video conference management method according to any one of claims 1-11 according to instructions in the computer program.

14. A storage medium storing computer executable instructions which, when executed by a computer processor, are for performing a video conference management method as claimed in any one of claims 1 to 11.