WO2022222541A1

WO2022222541A1 - Conference control method and related apparatus

Info

Publication number: WO2022222541A1
Application number: PCT/CN2021/143364
Authority: WO
Inventors: 朱建平; 闫宏伟; 吴浪
Original assignee: 华为云计算技术有限公司
Priority date: 2021-04-20
Filing date: 2021-12-30
Publication date: 2022-10-27
Also published as: CN115225616A

Abstract

A conference control method, which is used to achieve fast conference control during remote conferences. The method specifically comprises: when a first user of a first conference terminal of a current conference applies to perform a first operation, a conference control device (1000) correspondingly receives a first user application and an identifier of the first user, the identifier of the first user being associated with the permission of the first user; then, upon determining, according to the permission of the first user and a preset conference control policy, that the first user has the permission to perform the first operation, the conference control device (1000) modifies attributes of the first conference terminal so that the first conference terminal obtains the permission to perform the first operation, the preset conference control policy being used to indicate the correspondence between conference operations and user permissions.

Description

A conference control method and related device

technical field

The present application relates to the field of communications, and in particular, to a conference control method and related devices.

Background technique

With the development of communication technology and business requirements, many businesses need to be completed by multiple people or departments. In this process, remote meetings are usually needed for discussion and communication.

In a remote conference, the conference controller or conference chairman at the main conference site needs to view the conference control applications of each conference terminal in the current conference in real time (for example, raise his hand to speak, etc.); then the conference controller or conference chairman manually modifies the corresponding The attribute of the conference terminal enables the conference terminal that initiates the conference control application to obtain the corresponding operation authority (for example, cancel the mute of the person who raised his hand to allow him to speak, or put him in the queue to speak with his hand raised and wait to speak, etc.), and the participating user Bad experience.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a conference control method and a related device, which are used to realize flexible and fast conference control during a remote conference.

In a first aspect, an embodiment of the present application provides a conference control method, which is applied to a conference control device in a remote conference, where the conference control device is used to control a first conference terminal and a second conference terminal to participate in a current conference; When a conference terminal applies for performing the first operation, the conference control device receives the application for performing the first operation on the current conference sent by the first conference terminal and the identifier of the first user who initiated the application through the first conference terminal, wherein the The identification of the first user is associated with the authority of the first user; then, the conference control device determines that the first user has the authority to perform the first operation according to the authority of the first user and a preset conference control policy, wherein the The preset conference control policy is used to indicate the correspondence between the conference operation and the user authority; finally, the conference control device modifies the attribute of the first conference terminal, so that the first conference terminal obtains the authority to perform the first operation.

It can be understood that, the identifier of the first user and the authority of the first user may be in a preset corresponding relationship. In a possible design, the identifier of the first user can be used to identify who the first user is, for example, the first user is determined as "Zhang San through the name of the first user and the job number of the first user. ", the corresponding authority of "Zhang San" is A. The corresponding relationship between the conference operation and the user authority in the preset conference control policy may be set according to the conference participants before the current conference starts; it may also be the corresponding relationship between the conference operation and the user authority indicated in the saved historical conference. , and then obtained by matching according to the conference participants of the current conference; it may also be a general saved corresponding relationship used to indicate the conference operation and the user authority. For example, employee A has the authority to perform any operation on the conference, and employee B has the authority to speak in the conference, mute other conference venues, and modify the conference topic.

In this embodiment, the conference control device automatically modifies the conference corresponding to the user when it is determined that the user has the authority for the first operation corresponding to the conference control application according to the identification of the user who initiated the conference control application and the predetermined conference control strategy. properties of the terminal, so that the user can obtain the authority to perform the first operation in time, thereby realizing quick conference control. In this way, even if the conference controller or the conference chair is not aware of the conference control application, the user can obtain the right to perform the first operation in time, so the solution can improve the user experience.

Optionally, before the conference control device modifies the attribute of the first conference terminal, the conference control device may further perform the following operation: the conference control device sends a first prompt to the second conference terminal, so that the second conference terminal can display the first prompt; or, the conference control device instructs the media server in the conference system to send the first prompt to the second conference terminal, so that the second conference terminal can display the first prompt; wherein the first prompt uses In order to indicate whether to approve the first conference terminal to obtain the permission to perform the first operation; finally, the conference control device receives the first response sent by the second conference terminal, and the first response is used to indicate that the first conference terminal is approved to obtain and perform the operation. the authority for the first operation.

It can be understood that, according to different application scenarios, the second conference terminal may be the main controller of the current conference, or may be other participants of the current conference. The response operation acquired by the second conference terminal may be a click operation of a user in the corresponding conference site, a voice operation, or a default consent without a specific operation within a preset time period.

Optionally, in this embodiment, since the specific forms of the first prompt are different, the following possible implementation manners may be adopted for the manner in which the conference control device sends the first prompt to the second conference terminal:

In a possible implementation manner, the first prompt is displayed on the main video interface of the second conference terminal in the form of video frames, that is, the first prompt is included in at least one first video frame; therefore, in the conference Before the control device accepts the first response sent by the second conference terminal, the method further includes:

The conference control device generates video metadata, the video metadata includes the first prompt; then the conference control device sends the video metadata to the media server; the media server generates the at least one first prompt according to the video metadata. a video frame; and sending the at least one first video frame to the second conference terminal.

It is understandable that the video metadata may further include the presentation format of the first prompt; the presentation format of the first prompt includes the position and color of the first prompt when it is presented on the picture of the first video frame. and at least one of the fonts. For example, the first prompt is located in the middle of the first video frame, the font is black, the font color is black, the font size is 34, and so on.

Based on the scheme in which the first prompt is included in the at least one first video frame, the manner in which the media server generates the at least one first video frame may include the following: In an exemplary scheme, the media server according to the first prompt And the presentation format of the first prompt directly generates the at least one first video frame, that is, the media server sends the at least one first video frame and the main video frame of the current conference to the second conference terminal according to two video streams. . In another exemplary solution, the media server obtains at least one second video frame from the main video of the current conference within a preset time range, decodes the at least one second video frame to obtain decoded data, and finally converts the The first prompt is re-encoded according to the presentation format of the first prompt and the decoded data of the at least one second video frame to generate the at least one first video frame. In this way, even if the above conference control application requires the consent of the user of the second conference terminal (for example, it may be the conference chairperson), the user of the second conference terminal can also intuitively see the first prompt on the main video interface of the current conference, Thus, the user of the second conference terminal is effectively prompted to process the above conference control application in time, thereby improving the experience of the user participating in the conference.

Optionally, the video metadata further includes description information of the first control, and the description information of the first control includes at least one of the content presented on the first control and the position where the first control is presented. ; the description information of the first control is used by the media server to generate the first control on the first video frame, and the first control is used to receive an instruction from the user, the instruction indicates the consent The first conference terminal obtains the authority to perform the first operation, that is, the user of the venue where the second conference terminal is located can realize the interaction with the conference control device through the first control, so that the user of the second conference terminal can deal with the above in time. Conference control application, thereby improving the experience of participating users.

In another possible implementation manner, the first prompt is displayed on the second conference terminal in the form of audio, that is, the first prompt is included in the first audio; therefore, the conference control device accepts the second Before the first response sent by the conference terminal, the method further includes: the conference control device sends the first prompt to the media server; the media server generates the first audio according to the first prompt; The first audio is used for sending to the second conference terminal; the second conference terminal plays the first audio.

Based on the solution that the first prompt is included in the first audio, the manner in which the media server generates the first audio may include the following: In an exemplary solution, the media server converts the first prompt to obtain the first audio. In another exemplary solution, the media server converts the audio obtained from the first prompt and mixes the audio of the current conference to obtain the first audio. In this way, even if the above conference control application requires the consent of the user of the second conference terminal (for example, it may be the conference chairman), the user of the second conference terminal can hear the first prompt in the current conference, thereby effectively prompting the second conference The user of the terminal processes the above conference control application in time, thereby improving the experience of the user participating in the conference.

In another possible implementation manner, the first prompt is displayed on the main video interface of the second conference terminal in the form of a bullet screen, the conference control device generates text data including the first prompt; then the conference control device The text data is sent to the second conference terminal, and the second conference terminal displays the text data on the currently playing video screen in the form of a bullet screen. In this way, even if the above conference control application requires the consent of the user of the second conference terminal (for example, it may be the conference chairperson), the user of the second conference terminal can also intuitively see the first prompt on the main video interface of the current conference, Thus, the user of the second conference terminal is effectively prompted to process the above conference control application in time, thereby improving the experience of the user participating in the conference.

Optionally, the conference control device may also send a second prompt to the first conference terminal and the second conference terminal, or the conference control device instructs the media server to send the second prompt to the first conference terminal and the second conference terminal, so that A second prompt is displayed on the first conference terminal or the second conference terminal; wherein, the second prompt is used to indicate that the first conference terminal has obtained the permission to perform the first operation; in this implementation, it can effectively prompt Participants of the current conference The progress or status of the current conference.

In this implementation manner, for the generation manner of the second prompt and the respective corresponding beneficial effects, reference may be made to the above description of the first prompt, which will not be repeated here.

In a possible implementation manner, the above-mentioned first prompt and second prompt may be generated by the conference control device according to the application and the identity of the first user.

Optionally, after the conference control device modifies the attribute of the first conference terminal, the conference control device can modify the attribute of the second conference terminal according to the corresponding association operation, and at this time, the second prompt may further include a message for Information indicating that the second conference terminal has lost the authority to perform a second operation, where the second operation is associated with the first operation; or, after the conference control device modifies the attribute of the first conference terminal, the conference The control device may modify the attribute of the second conference terminal according to the corresponding associated operation, and at this time, the second prompt may further include information for instructing the second conference terminal to obtain the permission to perform the third operation, wherein the third An operation is associated with the first operation. In this embodiment, the second operation and the first operation may be the same or different. For example, when the first operation is "speaking", the second conference terminal loses the authority to perform the operation of "speaking". Or when the first operation is "mute", the second conference terminal will also lose the right to perform the operation of "speaking". This can effectively ensure that when the first conference terminal performs conference control, other conference terminals participating in the conference will not interfere with the first conference terminal, thereby improving the experience of the participating users.

Optionally, the identifier of the first user includes at least one of the following: the name of the first user, the facial features of the first user, the fingerprint information of the first user, the voice of the first user. information, the job number of the first user, the identity of the first user, and the position information of the first user. It can be understood that, according to the different identifications of the first user, the methods of acquiring the identification of the first user are also different. For example, obtaining the name of the first user may be that the user manually enters the name of the first user on the input interface of the first conference terminal; the facial features of the first user may be obtained by obtaining the first user through the camera of the first conference terminal. The facial video or facial photo of the first user; the fingerprint information of the first user may be collected by a fingerprint collector, and the voiceprint information of the first user may be collected by a microphone.

Optionally, the first operation includes at least one of: speaking, switching conference roles, applying for viewing, muting, extending the conference, renaming the current conference site, and releasing the current shared conference site. It can be understood that the second operation is associated with the first operation. For example, if the first operation is speaking, the second operation may be mute.

In a second aspect, the present application provides a conference control device, which has a function of implementing the behavior of the conference control device in the first aspect above. This function can be implemented by hardware or by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the above functions.

In a possible implementation manner, the conference control device includes units or modules for performing the steps of the first aspect above. For example, the conference control device includes: a receiving module configured to receive an application sent by a first conference terminal to perform a first operation on the current conference and an identifier of a first user of the first conference terminal, the first user The identity of the first user is associated with the authority of the first user;

a processing module, configured to determine that the first user has the authority to perform the first operation according to the authority of the first user and a preset conference control strategy, where the preset conference control strategy is used to indicate the conference operation and user authority The corresponding relationship of the first conference terminal is modified, so that the first conference terminal obtains the permission to perform the first operation.

Optionally, it also includes a storage module for storing necessary program instructions and data of the conference control device.

In a possible implementation manner, the conference control device includes: a processor and a transceiver, where the processor is configured to support the conference control device to perform corresponding functions in the method provided in the first aspect. The transceiver is used for instructing the communication between the conference control device and the conference terminal, and sending the prompt involved in the above method to the conference terminal. Optionally, the apparatus may further include a memory, which is used for coupling with the processor, and which stores necessary program instructions and data of the conference control device.

In a possible implementation manner, when the conference control device is a chip in the conference control device, the chip includes: a processing module and a transceiver module. The transceiver module may be, for example, an input/output interface, a pin, or a circuit on the chip, and receives and receives an application sent by the first conference terminal to perform the first operation on the current conference and the first conference terminal's first The identification of the user, the identification of the first user is associated with the authority of the first user; the application and the identification of the first user are transmitted to other chips or modules coupled with this chip. The processing module may be, for example, a processor, and the processor is configured to determine that the first user has the authority to perform the first operation according to the authority of the first user and a preset conference control strategy, and the preset conference control strategy It is used to indicate the correspondence between the conference operation and the user authority; modify the attribute of the first conference terminal, so that the first conference terminal obtains the authority to perform the first operation. The processing module can execute the computer-executed instructions stored in the storage unit, so as to support the conference control device to execute the method provided in the first aspect. Optionally, the storage unit can be a storage unit in the chip, such as a register, a cache, etc., and the storage unit can also be a storage unit located outside the chip, such as a read-only memory (read-only memory, ROM) or a memory unit. Other types of static storage devices that store static information and instructions, random access memory (RAM), etc.

In a possible implementation manner, the conference control device includes a communication interface and a logic circuit, where the communication interface is configured to receive an application sent by a first conference terminal to perform a first operation on the current conference and an application of the first conference terminal to perform a first operation. The identifier of the first user, the identifier of the first user is associated with the authority of the first user; the logic circuit is used to determine the first user according to the authority of the first user and a preset conference control policy Having the authority to perform the first operation, the preset conference control policy is used to indicate the correspondence between the conference operation and the user authority; modify the attributes of the first conference terminal, so that the first conference terminal obtains the Describe the authority for the first operation.

Wherein, the processor mentioned in any of the above may be a general-purpose central processing unit (Central Processing Unit, CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more An integrated circuit for controlling the program execution of the conference control method of the above aspects.

In a third aspect, an embodiment of the present application provides a conference system, where the conference system includes a conference control device and a first conference terminal; wherein the first conference terminal is used to obtain an application for performing a first operation on a current conference and all the identification of the first user; sending the application and the identification of the first user to the conference control device, and the identification of the first user is associated with the authority of the first user;

The conference control device is configured to determine that the first user has the authority to perform the first operation according to the authority of the first user and a preset conference control strategy, where the preset conference control strategy is used to indicate a conference operation Corresponding relationship with user authority; modifying the attribute of the first conference terminal, so that the first conference terminal obtains the authority to perform the first operation.

Optionally, the conference system further includes a second conference terminal; before the conference control device modifies the attributes of the first conference terminal, the conference control device is further configured to send the second conference terminal to the second conference terminal. a prompt; or, instructing the media server to send the first prompt to the second conference terminal, where the first prompt is used to indicate whether to approve the first conference terminal to obtain the permission to perform the first operation; the The second conference terminal is configured to receive and display the first prompt, generate a first response according to the user's input operation, and send the first response to the conference control device, where the first response is used to indicate that the The first conference terminal acquires the authority to perform the first operation; the conference control device is configured to accept the first response sent by the second conference terminal.

Optionally, the first prompt is included in at least one first video frame; the conference system further includes a media server; the conference control device is further configured to generate video metadata including the first prompt; and sending the video metadata to the media server; the media server is configured to receive the video metadata and generate the at least one first video frame according to the video metadata; send the at least one first video frame The first video frame is sent to the second conference terminal; the second conference terminal is further configured to play the at least one first video frame.

Optionally, the media server is specifically configured to obtain at least one second video frame from the current frame to a preset time range of the main video of the current conference; compare the first prompt with the at least one second video frame. The decoded data is re-encoded to generate the at least one first video frame.

Optionally, the video metadata further includes description information of the first control, and the description information of the first control includes at least one of the content presented on the first control and the position where the first control is presented. ; the media server is further configured to generate the first control on the at least one first video frame according to the description information of the first control, the first control is used to receive an instruction from the user, the instruction Instructing the approval of the first conference terminal to obtain the permission to perform the first operation.

Optionally, the first prompt is included in the first audio; the conference system further includes a media server; the conference control device is configured to send the first prompt to the media server; the media server, is configured to obtain the first audio according to the first prompt, and send the first audio to the second conference terminal; the second conference terminal is configured to play the first audio.

Optionally, the media server is configured to convert the first prompt to obtain a second audio; mix the second audio with a third audio to obtain the first audio, and the third audio is the audio of the current conference.

Optionally, the first prompt is included in text data; the conference control device is configured to send the text data including the first prompt to the second conference terminal; the second conference terminal also uses receiving the text data, and displaying the text data in the form of a bullet screen on the playing video screen.

Optionally, the conference system further includes a second conference terminal and a media server; the conference control device is further configured to generate, according to the application and the identifier of the first user, a message indicating that the first conference terminal has Obtain a second prompt for the permission to perform the first operation; send the second prompt to the first conference terminal and the second conference terminal; the first conference terminal and the second conference terminal receive the the second prompt, and display the second prompt;

or,

The conference control device is further configured to generate, according to the application and the identity of the first user, a second prompt for indicating that the first conference terminal has obtained the permission to perform the first operation; The server sends the second prompt;

the media server, configured to send the second prompt to the first conference terminal and the second conference terminal;

The first conference terminal and the second conference terminal receive the second prompt and display the second prompt.

Optionally, the second prompt further includes information used to indicate that the second conference terminal has lost the authority to perform a second operation, and the second operation is associated with the first operation; or, the first operation The second prompt further includes information used to instruct the second conference terminal to obtain the permission to perform a third operation, where the third operation is associated with the first operation.

Optionally, the conference system further includes a second conference terminal; the conference control device is further configured to modify the attributes of the second conference terminal, so that the second conference terminal loses the authority to perform the second operation, the second operation is associated with the first operation; or, the conference control device is further configured to modify an attribute of the second conference terminal, so that the second conference terminal obtains the permission to perform a third operation, the third operation being the same as the first operation Actions are associated.

Optionally, the identification of the first user includes at least one of the following: the name of the first user, the facial features of the first user, the fingerprint information of the first user, the voiceprint information of the first user, the A user's job number, the first user's identity, and the first user's position information.

Optionally, the first operation includes at least one of: speaking, switching conference roles, applying for viewing, muting, extending the conference, renaming the current conference site, and releasing the current shared conference site.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where computer instructions are stored in the computer storage medium, and the computer instructions are used to execute the method in any possible implementation manner of any one of the foregoing aspects.

In a fifth aspect, embodiments of the present application provide a computer program product containing instructions, which, when run on a computer, cause the computer to execute the method in any one of the foregoing aspects.

In a sixth aspect, the present application provides a chip system, the chip system includes a processor for supporting the conference control device to implement the functions involved in the above aspects, such as generating or processing the data and/or information involved in the above methods . In a possible design, the chip system further includes a memory for storing necessary program instructions and data of the conference control device, so as to realize the function of any one of the above aspects. The chip system can be composed of chips, and can also include chips and other discrete devices.

Description of drawings

FIG. 1a is a schematic structural diagram of a conference system according to an embodiment of the present application;

FIG. 1b is a schematic diagram of an application scenario of the conference control method in the embodiment of the application;

FIG. 1c is another schematic diagram of the architecture of the conference system in the embodiment of the application;

FIG. 2 is a schematic diagram of an embodiment of a conference control method in an embodiment of the present application;

Fig. 3a is a schematic diagram of obtaining a user identification and an application in an embodiment of the application;

Fig. 3b is another schematic diagram of obtaining a user identification and an application in an embodiment of the application;

Fig. 3c is another schematic diagram of obtaining a user identification and an application in an embodiment of the application;

FIG. 4 is a schematic diagram of another embodiment of the conference control method in the embodiment of the present application;

5 is a schematic diagram of displaying the first prompt in the form of a bullet screen according to an embodiment of the present application;

6 is a schematic diagram of another embodiment of a conference control method in an embodiment of the present application;

FIG. 7a is a schematic diagram of displaying a first prompt of a video frame in an embodiment of the present application;

FIG. 7b is another schematic diagram of displaying the first prompt of the video frame according to the embodiment of the present application;

FIG. 7c is another schematic diagram of displaying the first prompt of the video frame according to the embodiment of the present application;

FIG. 7d is another schematic diagram of displaying the first prompt of the video frame according to the embodiment of the present application;

FIG. 7e is a schematic diagram of displaying the first prompt of audio display in an embodiment of the present application;

FIG. 7f is another schematic diagram of the audio display of the first prompt in the embodiment of the present application;

8a is a schematic diagram of displaying the second prompt in the form of a bullet screen according to an embodiment of the present application;

FIG. 8b is a schematic diagram of displaying a second prompt in a video frame according to an embodiment of the present application;

FIG. 8c is another schematic diagram of displaying the second prompt of the video frame according to the embodiment of the present application;

8d is another schematic diagram of displaying the second prompt of the video frame according to the embodiment of the present application;

FIG. 8e is a schematic diagram of displaying the second prompt of audio display in an embodiment of the present application;

FIG. 8f is another schematic diagram of displaying the second prompt of the audio display in the embodiment of the present application;

FIG. 9 is a schematic diagram of an embodiment of a conference control device in an embodiment of the present application;

FIG. 10 is a schematic diagram of another embodiment of the conference control device in the embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application clearer, the embodiments of the present application are described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. . Those of ordinary skill in the art know that with the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

The terms "first", "second" and the like in the description and claims of the present application and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It is to be understood that data so used may be interchanged under appropriate circumstances so that the embodiments described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or modules is not necessarily limited to those expressly listed Rather, those steps or modules may include other steps or modules not expressly listed or inherent to the process, method, product or apparatus. The naming or numbering of steps in this application does not mean that the steps in the method flow must be executed in the time/logical sequence indicated by the naming or numbering, and the named or numbered process steps can be implemented according to the The technical purpose is to change the execution order, as long as the same or similar technical effects can be achieved. The division of units in this application is a logical division. In practical applications, there may be other division methods. For example, multiple units may be combined or integrated into another system, or some features may be ignored. , or not implemented, in addition, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, and the indirect coupling or communication connection between units may be electrical or other similar forms. There are no restrictions in the application. In addition, the units or sub-units described as separate components may or may not be physically separated, may or may not be physical units, or may be distributed into multiple circuit units, and some or all of them may be selected according to actual needs. unit to achieve the purpose of the scheme of this application.

With the development of communication technology and business requirements, many businesses need to be completed by multiple people or departments. In this process, remote meetings are usually needed for discussion and communication. In a remote conference, the conference controller or conference chairman at the main conference site needs to view the conference control applications of each conference terminal in the current conference in real time (for example, raise his hand to speak, etc.); then the conference controller or conference chairman manually modifies the corresponding The attribute of the conference terminal enables the conference terminal that initiates the conference control application to obtain the corresponding operation authority (for example, cancel the mute of the person who raised his hand to allow him to speak, or put him in the queue to speak with his hand raised and wait to speak, etc.), and the participating user Bad experience.

In order to solve this problem, an embodiment of the present application provides a conference control method, which is applied to a conference control device in a remote conference, where the conference control device is used to control the first conference terminal and the second conference terminal to participate in the current conference; wherein, in the When the first user of the first conference terminal applies for performing the first operation, the conference control device receives the application for performing the first operation on the current conference and the identifier of the first user sent by the first conference terminal, wherein the first user The identification of the user is associated with the authority of the first user; then the conference control device determines that the first user has the authority to perform the first operation according to the authority of the first user and a preset conference control strategy, wherein the preset The conference control policy is used to indicate the correspondence between the conference operation and the user authority; finally, the conference control device modifies the attribute of the first conference terminal, so that the first conference terminal obtains the authority to perform the first operation.

The conference control method in the embodiment of the present application can be applied to a conference system as shown in FIG. 1a, which includes: a conference control device and a plurality of conference terminals. In this embodiment of the present application, the conference terminal may be a mobile phone, a tablet, a fixed phone, or a large-screen terminal, or a device that can input and output audio, video, or text encoding and decoding. It should be understood that the user can also access the conference through the conference application software on the conference terminal. Wherein, the conference control device is configured to receive information sent by the conference terminal, for example, to receive an application for performing a first operation on the current conference sent by the first conference terminal (for example, applying for speaking, applying for a master controller, etc.) and the first User identification, where the first user is a user at the venue where the first conference terminal is located, and the first user identification may be the first user's name, the first user's job number, or the first user's At least one of a user's voice or facial features; then, the conference control device can determine the authority of the first user according to the identity of the first user, and control the conference according to the authority of the first user and a preset conference control device. When the policy determines that the first user has the authority to perform the first operation, the attribute of the first conference terminal is modified, so that the first conference terminal obtains the authority to perform the first operation. In addition, the conference control device is further configured to send a prompt related to the current conference to the conference terminal of the current conference, or instruct the media server to send the prompt related to the current conference to the conference terminal of the current conference, so that the conference terminal can intuitively display the prompt. For example, the prompt may be a first prompt for indicating whether to approve the first conference terminal to obtain the permission to perform the first operation, and the first prompt may be sent to the master of the current conference (for example, the second conference terminal); wherein, the first prompt can be displayed in the form of audio or video at the second conference terminal, then the conference control device can send the first prompt to the media server to instruct the media server to generate a audio or video, and send the audio or video to the second conference terminal, so that the second conference terminal can play the audio or video containing the first prompt; in addition, the conference control device can also send the second conference terminal containing the first prompt. The text data of a prompt, so that the second conference terminal can display the first prompt in the form of a barrage. In the above manner, the user of the second conference terminal can intuitively see or hear the prompt related to the conference, so that the experience of participating in the conference is better. For another example, the prompt may also be a second prompt for indicating that the first conference terminal has obtained the permission to perform the first operation, and at this time, the second prompt may be sent to all participants of the current conference (for example, the first A conference terminal and a second conference terminal), so that both the first conference terminal and the second conference terminal can intuitively know the status of the current conference.

An application scenario of the conference control method in the embodiment of the present application may be as shown in FIG. 1b. It is assumed that the current conference includes four conference terminals, namely: conference terminal 1, conference terminal 2, conference terminal 3, and conference terminal 4. The conference terminal 2 is a terminal in the current main conference site of the conference (that is, the conference terminal 2 is the current main control conference terminal of the conference). During the conference process, if the first user at the first conference site (the conference site where conference terminal 1 is located) wants to apply for a speech operation, the specific process can be as follows: 1. The first user initiates the speech through conference terminal 1 to execute the speech. operation application and the identification of the first user; 2. The conference control device matches the identification of the first user with the preset conference control strategy, thereby determining the rights of the first user in the current conference, and from Determine whether the first user has the right to perform the speaking operation from the various rights of the first user; 3. When the first user has the right to perform the speaking operation, the conference control device modifies the attributes of the conference terminal 1 4. The conference terminal 1 executes the speaking operation. It can be understood that, the conference control device may also send a prompt to the conference terminal 1 to the conference terminal 4 to instruct the conference terminal 1 to obtain the permission to perform the speaking operation. There is no fixed sequence of execution between the conference terminal 1 performing the speaking operation and the conference terminals 1 to 4 receiving the prompt.

In the application scenario shown in FIG. 1b, if the above prompt is included in the audio or video frame, the conference system to which the conference control method in the embodiment of the present application is applied may also be as shown in FIG. 1c, which includes: a plurality of conference terminals, Conference control equipment and media server. For the functions of the conference terminal and the conference control device, please refer to the description in FIG. 1a above, which will not be repeated here. In practice, the conference system may include multiple media servers or media server clusters deployed in a distributed manner (only one media server is used as an example in Figure 1b). The media server may be configured to receive the above prompt sent by the conference control device, generate video or audio including the prompt, and then send the video or audio containing the prompt to the conference terminal.

Communication between devices in the embodiments of the present application may be implemented through various communication systems. For example, the conference terminal and the conference control device, or between the conference terminal and the media server, can communicate through wired or wireless communication (the wireless communication can be Global System of Mobile Communication (GSM). ) system, Long Term Evolution (Long Term Evolution, LTE) system or 5G communication system, and future wireless communication systems, etc.). In addition, communication between the conference control device and the media server may also be performed in a wired or wireless manner, which is not limited in this application.

The following describes the conference control method in the embodiment of the present application by taking the conference terminal 1 shown in FIG. 1b as the first conference terminal as an example with reference to specific figures. As shown in FIG. 2, an embodiment of the conference control method in the embodiment of the present application includes:

201. The conference terminal 1 sends an application for performing a first operation on the current conference and an identifier of the first user to the conference control device.

During the conference process, users at each site may apply to perform corresponding operations on the current conference through the conference terminal of their own site, and the operations include but are not limited to speaking, switching conference roles, applying for viewing, muting, extending the conference, Rename the site and release the current shared site. As described above, assuming that the first user in the conference terminal 1 wants to apply for performing the speaking operation, at this time, the conference terminal 1 can send the application for performing the speaking operation for the current conference and the first user's speech operation to the conference control device. logo. Wherein, the identification of the first user includes but is not limited to the name of the first user, the facial features of the first user, the fingerprint information of the first user, the voiceprint information of the first user, the work of the first user serial number, the identity of the first user, and the position information of the first user. For example, the first user is "Zhang San", and his identification can be his work number in the company "0022508", his name "Zhang San", his identity identifier "429xxxxxxxxxxx3578", and his position information in the company is "XX department" General manager". Zhang San can also store photos, fingerprints and voiceprints in the company's database, so that Zhang San can also collect facial features, fingerprints and voiceprints as his identification during the meeting.

In this embodiment, before the conference terminal 1 sends the above-mentioned application and the identification of the first user to the conference control device, the conference terminal 1 will generate the above-mentioned application in response to the instruction of the first user to apply for performing the first operation, and obtain the first User's ID. According to different forms of the conference terminal 1, there may be various implementation manners for this process. Several exemplary solutions are described below in conjunction with Figures 3a-3c.

Example solution 1: The conference terminal 1 may obtain an instruction from the first user to apply for performing the first operation through the display interface. Specifically, as shown in FIG. 3a, the conference terminal 1 may display a plurality of option controls for indicating different conference operations on the display interface. When receiving an instruction from the first user to select the first option control (the first option control may It is used to indicate the first operation, as shown in FIG. 3a, assuming that the first option control indicates the "speak" operation), the conference terminal 1 generates an application for requesting the "speak" operation accordingly. Similarly, the conference terminal 1 can obtain the identification of the first user through the display interface. As shown in FIG. 3a, the conference terminal 1 responds to a certain instruction of the first user (for example, it may be an instruction to apply for login or an instruction on the display interface) Click the command at any position), you can pop up an input box on the display interface, and then receive the first user's identification (such as the first user's name Zhang San or the first user's job number 0022508) entered by the first user in the input box ); thereby obtaining the identity of the first user.

Example solution 2: The conference terminal 1 may acquire the instruction of the first user to apply for performing the first operation by capturing the gesture action of the first user through the camera. Specifically, as shown in FIG. 3b, the conference terminal 1 can obtain the gesture action of the first user through the camera, and after recognizing the gesture action, matches the gesture action with the corresponding relationship between the pre-stored gesture action and the conference operation The operation options of the first user are obtained, for example, the gesture as shown in FIG. 3b indicates that the operation that the first user wants to perform is speaking. Similarly, the conference terminal 1 can also acquire the facial features of the first user through the camera as the identification of the first user.

Example solution 3: The conference terminal 1 may obtain an instruction from the first user to apply for performing the first operation through the voice of the first user. Specifically, as shown in FIG. 3c , the conference terminal 1 can collect voice data of the first user through a microphone, and recognize the voice data to obtain the first operation that the first user wants to perform. As shown in Figure 3c, the voice data output by the first user is "I will give a summary of the discussion of this conference", and the conference terminal 1 recognizes the voice data and analyzes it to obtain the first operation of the first user as " speak". In this case, the conference terminal 1 may also extract the voiceprint of the first user through the voice data of the first user, and use the voiceprint of the first user as the identification of the first user.

It can be understood that the above process of obtaining the identity of the first user may occur before the current conference starts (that is, only the first user exists in the venue where the current conference terminal is located), or may occur during the current conference. Or it occurs after receiving an instruction from the first user to apply for performing the first operation. This application does not limit this.

It can be understood that the specific solutions in which the conference terminal 1 obtains the instruction of the first user to apply for performing the first operation and the identification of the first user are not limited to the above three exemplary solutions. For example, the conference terminal 1 may also obtain an instruction for the first user to apply for performing the first operation through the display interface, and then obtain the identity of the first user through face recognition; or the conference terminal 1 obtains the first user's application through voice data. The instruction of the first operation is executed, and then the identification of the first user is obtained through the fingerprint information, and so on.

202. The conference control device determines, according to the identifier of the first user and a preset conference control policy, that the first user has the authority to perform the first operation.

In this embodiment, the identifier of the first user may indicate the authority of the first user, and the preset conference control policy is used to indicate the correspondence between the conference operation and the authority of the user. After acquiring the identification of the first user, the conference control device matches the identification of the first user with a preset conference control strategy pre-stored in the conference control device to determine whether the first user has the ability to perform the first operation. permissions. For example, after acquiring the facial feature information of the first user, the conference control device obtains the first user as "Zhang San" through AI face recognition, and then determines from the preset conference control strategy that "Zhang San" is in Each authority in the current meeting (it is understandable that this authority refers to the authority of the user to perform a certain operation), if it is determined that the authority of "Zhang San" includes the authority to perform the first operation, then it is determined that "Zhang San" has the authority to perform the first operation. "San" has the authority to execute the first operation; otherwise, it is determined that "Zhang San" does not have the authority to execute the first operation.

In this embodiment, the preset conference control strategy may have the following possible implementation manners:

Example solution 1: The corresponding relationship between the conference operation and the user authority in the preset conference control policy may be set according to conference participants before the current conference starts. For example, if the topic of the current meeting is professional and technical discussion, you can set the authority of professional and technical personnel to the highest level (can perform arbitrary operations on the current meeting), and the authority of administrative personnel to the lowest level (can modify their own meeting name, adjust The display interface of the conference terminal); if the topic of the current meeting is an executive meeting, you can set the authority according to the position in the current meeting (for example, the highest position of the current meeting is "chairman", then the "chairman" has the highest authority and can perform any action on the current meeting).

Example solution 2: The corresponding relationship between the conference operation and the user authority in the preset conference control policy may be obtained according to the corresponding relationship between the conference participants of the current conference matching the saved historical conference for indicating the conference operation and the user authority. For example, the conference control device obtains the conference control policy set through the saved conference control policy of the historical conference (for example, in the stored conference control policy, in the professional technical discussion, the authority of professional technician A is the highest level, and the authority of department manager B is the second Level 1; in the executive meeting, the authority of the chairman is the highest level, and the authority of the department manager B is the second level); then the meeting control device obtains the information of the meeting participants in the current meeting (including the professional technician A and the department manager) B, and the conference theme is professional technical discussion), and then match the information of the conference participants with the conference control strategy set to obtain the permissions of each conference participant (that is, confirm that the authority of professional technician A is the highest level, and the authority of department manager B to the next level).

Example solution 3: The corresponding relationship between the conference operation and the user authority in the preset conference control policy may be a general saved corresponding relationship used to indicate the conference operation and the user authority. For example, for all employees of the enterprise, set the corresponding authority according to the position level. For example, the authority of the chairman is the highest authority, the authority of each department supervisor is the next level; the authority of each department head is the next level; the authority of each department member Permission is one level again. It can be understood that, when setting the general correspondence between the conference operation and the user authority, the conference control device may also perform setting according to other information, which is not specifically limited here.

203 . The conference control device modifies the attribute of the conference terminal 1 .

After the conference control device determines that the first user has the authority to perform the first operation, the attribute of the conference terminal 1 is modified so that the attribute of the conference terminal 1 is to perform the first operation. In a possible implementation manner, the attribute of a certain conference terminal is information recorded in the conference control device and used to indicate the authority possessed by the conference terminal in the current conference. As shown in Figure 1b, in the "1" step, the conference control device records the attribute of conference terminal 1 to conference terminal 4 in the current conference as "mute", after the "3" step, the conference control device will The attribute of the conference terminal 1 is changed from "mute" to "speak", and the conference terminal 1 is instructed to keep the microphone in a working state, so that the conference terminal 1 can speak.

204. The conference terminal 1 performs the first operation.

After the conference terminal 1 receives the instruction of the conference control device, the conference terminal 1 correspondingly changes the working state of each module, and then the conference terminal 1 can perform the first operation. In the application scenario described in Figure 1b, after determining that the first user has the "speaking" authority, the conference control device can send an instruction to the conference terminal 1 for instructing the conference terminal 1 to adjust its microphone to a working state, The conference terminal 1 executes the instruction, so that the microphone of the conference terminal 1 is in a working state, so that the microphone can collect the voice information spoken by the first user and transmit it to the conference terminal 2 to the conference terminal 4 through the conference system.

It can be understood that, in the example shown in FIG. 1b, the first conference terminal may be conference terminal 1, and the second conference terminals may be conference terminal 2 to conference terminal 4 as an example for introduction. Before executing the above step 203, the conference control device may further send a first prompt to other terminals of the current conference (for example, the current master (conference terminal 2)) to ask the user of the conference terminal whether to agree to the first prompt. The application of the terminal for the first operation is different according to the specific form of the first prompt, and the execution subject involved is also different, which will be described below with reference to the specific diagrams.

1. The first prompt is contained in the text data.

Please refer to FIG. 4 for details. Another embodiment of the conference control method in the embodiment of the present application includes:

Steps 401 to 402 are the same as the aforementioned steps 201 to 202, and are not repeated here.

403. The conference control device generates, according to the application and the identity of the first user, a first prompt for indicating whether to approve the conference terminal 1 to obtain the permission to perform the first operation.

In this embodiment, the first prompt may include the identifier of the first user and the application. As shown in Figure 1b, the application initiated by the conference terminal 1 is "speaking", and the identification of the first user is "Zhang San". The conference control device obtains the name "Zhang San" in the enterprise address book. The job information of "Zhang San" is "General Manager of XX Department" and the photo of "Zhang San". At this time, the first prompt can include: "Zhang San is about to speak, please press 1 to agree, or 2 to disagree." A text message; or, the first prompt may include: "Zhang San is about to speak, please press 1 to agree, please press 2 to disagree" and a photo of "Zhang San". Or, in some cases, when generating the first prompt, the conference control device may perform adaptive processing on the identification of the first user in the first prompt according to the position information of the first user, for example, in this embodiment, "Zhang Zhang" The position information of "three" is the general manager, then the conference control device can process the identification of "Zhang San" in the first prompt as "Mr. Zhang". At this time, the first prompt can include: "Mr. Zhang will speak". information; or, the first prompt may include: "Mr. Zhang is about to speak, please press 1 to agree, please press 2 to disagree" and a photo of "Zhang San". The above is only an exemplary solution, and the first prompt may also include information such as the job number "0022508" of "Zhang San", which is not specifically limited here.

It should be understood that the manner of instructing the user to interact in the first prompt may also be other manners, which are not specifically limited here. For example, the agreement between the conference control device and the second conference terminal is as follows: within a preset time period, if the second conference terminal does not receive any operation instructions, the conference terminal 1 will be granted the permission to perform the first operation by default, and Within a preset time period, the second conference terminal does not approve the conference terminal 1 to obtain the permission to perform the first operation by default upon receiving any operation instruction.

It can be understood that the conference control device can obtain the type of each conference terminal when the conference terminal accesses the current conference, so as to determine the display modes (such as video, audio, etc.) that each conference terminal can provide; at the same time, the conference control device can also In the conference process of the current conference, the display status selected by each conference terminal is obtained (for example, the conference terminal 2 chooses to display in the form of a bullet screen), so as to determine the display mode that each conference terminal can provide. Therefore, the first prompt may further include indication information for indicating the form of generating the first prompt or identification information of the corresponding conference terminal. In the scenario shown in Figure 1b, assuming that the conference terminal 2 is a Huawei smart screen, but the user at the venue where the conference terminal 2 is located chooses to display the first prompt only in the form of a pop-up screen, the conference control device can determine that the conference The terminal 2 provides a display mode such as a bullet screen, then when the conference control device generates a first prompt for generating a message sent to the conference terminal 2, the first prompt may include the instruction information indicating the generation of the bullet screen or the information of the conference terminal 2. Terminal ID.

404. The conference control device generates text data according to the first prompt.

In this embodiment, the conference control device may generate a first prompt in the form of text data through a websocket notification. For example: active=bulletCCtrl(//Conference control mode: barrage)&ctrlType=mute(//Conference control type: speech)&ctrlData=json string (//The json string carries the content of the barrage to be displayed). Illustratively, ctrlData may be in the following format:

ctrlData:{

"displayInfo":"Mr. Zhang will speak",

"": "",

"":""}.

405 . The conference control device sends the text data to the conference terminal 2 .

The conference control device sends the websocket notification to the conference terminal 2 .

406. The conference terminal 2 displays the text data in the form of a bullet screen.

The conference terminal 2 parses the websocket notification and obtains that the text data is displayed in the form of a bullet screen, and then the conference terminal 2 displays the text data in the form of a bullet screen. In an exemplary solution, as shown in Fig. 5, a text bullet screen pops up on the main video interface of the conference terminal 2, and scrolls and plays on the main video interface. The bullet screen information displays "Mr. Zhang will speak, agree. Please press 1, if you disagree, please press 2" for the text message.

407. The conference terminal 2 generates a first response in response to the operation, where the first response is used to indicate that the conference terminal 1 is approved to obtain the permission to perform the first operation.

After the conference terminal 2 receives the first prompt, the conference terminal 2 displays the first prompt; at the same time, the user at the site to which the conference terminal 2 belongs performs corresponding operations according to the first prompt in the first prompt to generate the first prompt. response.

It can be understood that, in this embodiment, if the conference terminal 2 receives the option control that the user selects "disagree", a second response is generated, and the second response is used to indicate that the conference terminal 1 does not agree to obtain and execute the first response. Permission to operate. As shown in the bullet screen information shown in FIG. 5 , the user at the site where the conference terminal 2 is located presses “1” to generate the first response. It should be understood that if the user at the site where the conference terminal 2 is located presses "2", a message indicating that the conference terminal 1 is not allowed to obtain the permission to perform the first operation is generated.

408. The conference terminal 2 sends the first response to the conference control device.

Steps 409 to 410 are the same as steps 203 to 204, and are not repeated here.

2. The first prompt is contained in the audio or in the video frame.

Steps 601 to 602 are the same as the aforementioned steps 201 to 202, and details are not repeated here.

603. The conference control device generates, according to the application and the identifier of the first user, a first prompt for indicating whether to approve the conference terminal 1 to obtain the permission to perform the first operation.

In this embodiment, the first prompt includes different information according to different forms in which the second conference terminal displays the first prompt.

When the first prompt is included in the audio (ie, the conference terminal is allowed to present the first prompt in the form of audio), the first prompt may include the identification of the first user and the application. As shown in Figure 1b, the application initiated by the conference terminal 1 is "speaking", and the identification of the first user is "Zhang San". The conference control device obtains the name "Zhang San" in the enterprise address book. The job information of "Zhang San" is "General Manager of XX Department" and the photo of "Zhang San". At this time, the first prompt can include: "Zhang San is about to speak, please press 1 to agree, or 2 to disagree." A text message; or, the first prompt may include: "Mr. Zhang will speak" text information; or, the first prompt may include: "Mr. Zhang will speak, please press 1 if you agree, please press 2 if you disagree." information. The above is only an exemplary solution, and the first prompt may also include information such as the job number "0022508" of "Zhang San", which is not specifically limited here.

If the first prompt is contained in a video frame (ie, the conference terminal is to display the first prompt in the form of a video frame), the first prompt may include the identity of the first user and the application. As shown in Figure 1b, the application initiated by the conference terminal 1 is "speaking", and the identification of the first user is "Zhang San". The conference control device obtains the name "Zhang San" in the enterprise address book. The job information of "Zhang San" is "General Manager of XX Department" and the photo of "Zhang San". At this time, the first prompt can include: "Zhang San is about to speak, please press 1 to agree, or 2 to disagree." A text message or, the first prompt may include: "Zhang San is about to speak, please press 1 to agree, please press 2 to disagree", the presentation format of the text information when rendering on the video frame, and the "Zhang San" photo. Further, the conference control device may also generate video metadata according to the first prompt, where the video metadata includes the first prompt. It should be understood that the video metadata may also include the format information presented on the video frame by the first prompt (the presentation format includes that the font in the text information is Arial, the font color is black, and the text information presentation position information is 345*456, The size of the video frame is 15 centimeters (cm)*25cm, etc.), which is used to instruct the media server to generate a first prompt in the form of a video frame according to the first prompt and the format information. The above is only an exemplary solution, the first prompt may also include the job number "0022508" of "Zhang San", or the text information may also be "Mr. Zhang will speak, please press 1 to agree, please 2 to disagree" and other information, There is no specific limitation here.

It should be understood that the manner of instructing the user to interact in the first prompt may also be other manners, which are not specifically limited here. For example, the conference control device and the conference terminal 2 agree on a rule: within a preset time period, if the conference terminal 2 does not receive any operation instructions, the conference terminal 2 agrees by default to obtain the permission to perform the first operation, and in the preset time Within the set time period, the conference terminal 2 does not agree to the conference terminal 1 obtaining the permission to perform the first operation by default upon receiving any operation instruction. Alternatively, the above-mentioned video metadata may also include indication information of the first control, and the indication of the first control includes the presentation format of the first control when rendering on the video frame (the presentation format includes the text information as "agree", the text information The font in it is Song type, the font color is set to black, and the text information presentation position information is xx*yy and other information).

It should be understood that the video metadata may also include indication information of the second control, and the indication information of the second control includes the presentation format of the second control when rendering on the video frame (the presentation format includes the text information as "" Disagree”, the font in the text information is Song, the font color is set to black, and the text information presentation location information is XX*YY, etc.).

It can be understood that, as mentioned above, the conference control device can also determine the display mode (such as video, audio, etc.) that can be provided by each conference terminal or the current display state (for example, the conference terminal 2 chooses to display it in the form of a bullet screen). Display mode that the conference terminal can provide. Therefore, the conference control device may also send the information for instructing the form of the first prompt to be generated to the media server. In the scenario shown in FIG. 1b , assuming that the conference terminal 2 is of a fixed phone type, the conference control device can determine that the conference terminal 2 provides an audio presentation mode, and the conference control device generates an audio display mode for the conference terminal 2 to generate and send to the conference terminal 2 When the first prompt is displayed, the first prompt may include instruction information indicating to generate audio or the terminal identifier of the conference terminal 2 .

604. The conference control device sends the first prompt to the media server.

Specifically, the conference control device may send the first prompt to the media server. It should be understood that, if a video frame including the first prompt is to be generated, the conference control device may send the above-mentioned video metadata including the first prompt to the media server.

605. The media server generates a first audio or a first video frame according to the first prompt.

After receiving the first prompt, the media server may generate an audio or video frame including the first prompt in a predetermined manner. Alternatively, the media server may also generate corresponding audio or video frames including the first prompt according to the indication information (eg, audio format, or video format) of the form of the first prompt sent by the conference control device.

If the first prompt is included in the video frame, the manner in which the media server generates the first video frame according to the first prompt includes: in a possible implementation manner, the media server according to the first prompt according to the video metadata The included presentation format of the first prompt, or at least one first video frame is generated according to a predefined presentation format, and a picture of the at least one first video frame includes the first prompt. That is, the at least one first video frame generated by the media server only includes the first prompt. In another possible implementation manner, the media server obtains at least one second video frame from the main video of the current conference within a preset time range, and decodes the second video frame to obtain decoded data, the preset time The scope takes the current frame of the main video of the current conference as the starting point; then the first prompt is in accordance with the presentation format of the first prompt contained in the video metadata, or, a predefined presentation format, and at least one second prompt. The decoded data of the video frame is re-encoded to generate at least one third video frame, and a picture of the at least one third video frame is included as the first prompt. That is, the at least one third video frame generated by the media server includes the first prompt and also includes the main video of the current conference. It should be understood that when generating a video frame containing the first prompt in the screen, the media server can also render the first prompt in the form specified in the presentation format according to the presentation format indicated in the above-mentioned video metadata to generate a video frame (for example, , superimpose the first prompt on the screen of the second video frame in Arial and white, and render to generate the first video frame).

If the first prompt is included in the audio, the manner in which the media server generates the first audio including the first prompt includes: in a possible implementation manner, the media server converts the first audio into the first audio according to the first prompt, The first audio is the first prompt. That is, only the first prompt is included in the first audio generated by the media server. In another possible implementation manner, the media server mixes the third audio generated by converting the first prompt with the second audio to generate the first audio. That is, the first audio generated by the media server includes the first prompt, and also includes the audio of the current conference.

606 . The media server sends the first audio or first video frame to the conference terminal 2 .

In the case that the first prompt is contained in a video frame, if the picture of the video frame only contains the first prompt (that is, when the video frame is the above-mentioned first video frame), the media server can use the first video frame It is sent to the conference terminal 2 together with the main video stream as an independent video stream; if the picture of the first video frame includes the first prompt and the main video (that is, when the video frame is the above-mentioned third video frame), the media server The data of the third video frame can be sent to the conference terminal 2 .

If the first prompt is included in the audio, the media server sends the above-mentioned first audio or third audio to the conference terminal 2 with one audio stream.

607. The conference terminal 2 plays the first audio or first video frame.

The conference terminal 2 displays correspondingly according to different forms of the first prompt. In an exemplary solution, the first prompt displayed by the conference terminal 2 may be as shown in FIG. 7a to FIG. 7f.

As shown in Fig. 7a, the main video interface of the conference terminal 2 displays the text message "Mr. Zhang will speak, please press 1 if you agree, please press 2 if you disagree". In Figure 7a, the "Mr. Zhang will speak, please press 1 to agree, please press 2 to disagree" is displayed on a transparent frame, so the part of the main video interface that is not blocked by text can also be displayed. The size of the transparent frame may be the same as the size of the current main video interface, or may be other sizes, which are not specifically limited here.

As shown in Fig. 7b, the main video interface of the conference terminal 2 displays the text message "Mr. Zhang will speak, please press 1 if you agree, and please press 2 if you disagree". In Figure 7b, the "Mr. Zhang will speak, please press 1 to agree, please press 2 to disagree" is displayed on a video frame with a background that can completely block the main video interface. The size of the video frame may be the same as the size of the current main video interface, or may be other sizes, which are not specifically limited here.

As shown in Fig. 7c, the main video interface of the conference terminal 2 displays the text information of "Mr. Zhang will speak" and two controls of "Agree" and "Disagree". In Figure 7c, the "Mr. Zhang will speak" is displayed on a video frame with a background that can completely obscure the main video interface. The size of the video frame may be the same as the size of the current main video interface, or may be other sizes, which are not specifically limited here.

As shown in FIG. 7d , the main video interface of the conference terminal 2 displays the text message “Mr. Zhang will speak, please press 1 if you agree, please press 2 if you disagree”. In Figure 7d, the “Mr. Zhang will speak, please press 1 if you agree, please press 2 if you disagree” and the main video information are displayed as one frame of data in the main video interface, and the part of the main video information that is not blocked by text can also be displayed.

It can be understood that the display modes of the video frames shown in FIG. 7a to FIG. 7d are only exemplary solutions, and the specific combinations thereof are not limited here, as long as the obvious display and interaction of the first prompt can be realized.

As shown in Fig. 7e, the conference terminal 2 plays a voice "Mr. Zhang will speak, please press 1 if you agree, and please press 2 if you disagree".

As shown in FIG. 7f , the conference terminal 2 plays the mixed audio “Mr. Zhang will speak, please press 1 if you agree, please press 2 if you disagree”, and “the discussion of the current conference topic is completed”.

It can be understood that, in this embodiment, if the conference terminal 2 receives the option control that the user selects "disagree", a second response is generated, and the second response is used to indicate that the conference terminal 1 does not agree to obtain and execute the first response. Permission to operate.

608. The conference terminal 2 generates a first response in response to the operation, where the first response is used to indicate that the conference terminal 1 is approved to obtain the permission to perform the first operation.

After the conference terminal 2 receives the first prompt, the conference terminal 2 displays the first prompt; at the same time, the user at the site to which the conference terminal 2 belongs performs corresponding operations according to the first prompt in the first prompt to generate the first prompt. response. As shown in Figure 7a, the user at the venue where the conference terminal 2 is located presses "1" to generate the first response; or, as shown in Figure 7c, the user at the venue where the conference terminal 2 is located clicks "1" Agree", the first response is generated.

Steps 609 to 611 are the same as steps 408 to 410, and details are not repeated here.

It should be understood that, in actual implementation, if the current conference does not have a master controller, the conference control device may also send the first prompt to all conference terminals in the current conference except the first conference terminal, for example, send the first prompt to the conference terminal. 2 to the conference terminal 4 to inquire whether all other conference terminals agree with the conference terminal 1 to obtain the "speaking" authority. In this implementation manner, the conference control device modifies the attributes of the conference terminal 1 accordingly after receiving the first response from the conference terminal 2 to the conference terminal 4, so that the conference terminal 1 can perform the "speaking" operation; or the conference control When the number of first responses sent by the conference terminal exceeds a predetermined number threshold (for example, more than 2) or exceeds a predetermined ratio (for example, more than 50%), the device modifies the properties of conference terminal 1 accordingly, so that the conference Terminal 1 can perform a "speaking" operation; wherein, the first response is used to indicate that the conference terminal 1 is allowed to obtain the "speaking" permission.

In this embodiment, after the conference control device modifies the attributes of the conference terminal 1, the conference control device can also send a message to the participants participating in the current conference (the conference terminal 1, conference terminal 2, and conference terminal 3 shown in FIG. 1b). and the conference terminal 4) send a second prompt, where the second prompt is used to indicate that the conference terminal 1 has obtained the permission to perform the first operation. It can be understood that, for the manner in which the conference control device generates the second prompt, reference may be made to the foregoing manner for generating the first prompt, and details are not described herein again. In this implementation manner, the manner in which each conference terminal displays the second prompt may be the same or different. As mentioned above, the conference control device may determine the display form of the second prompt on each conference terminal according to the type of each conference terminal, the state of each conference terminal, or the pre-configuration of each conference terminal.

In an exemplary solution, the second prompt displayed on the conference terminal of the current conference may be the examples shown in FIG. 8a to FIG. 8e.

As shown in FIG. 8a , on the main video interface of the conference terminal 1, the text information of "Zhang Zongzheng is speaking" is scrolled and played.

As shown in Fig. 8b, the conference terminal 2 can superimpose and display a transparent frame (a frame with a transparent background except for text) on the main video interface, and the transparent frame displays "Mr. Zhang is speaking".

As shown in FIG. 8c , the conference terminal 3 can superimpose and display a video frame with a background on the main video interface, the background of which covers all the main video interface, and the text information "Mr. Zhang is speaking" is displayed on the video frame.

As shown in FIG. 8d , the main video interface of the conference terminal 4 displays text information of "Mr. Zhang is speaking" and main video information, and the text information covers part of the information on the main video interface.

It should be understood that each conference terminal may also display the second prompt in other manners. As shown in FIG. 8e , the conference terminal 1 can also play the second prompt in the form of voice, for example, play the voice "Mr. Zhang is speaking".

As shown in FIG. 8f , the second prompt in the form of voice played by the conference terminal 1 may also be mixed audio data. For example, the conference terminal 1 plays “Mr. Zhang is speaking” and then simultaneously plays “Please keep quiet”.

It can be understood that, in this practical application, the conference control device may directly send the second prompt to the second conference terminal after step 203 . That is, the conference control device may directly modify the attributes of the conference terminal 1 without consulting the consent of other terminals, and send the second prompt to the conference terminal 1 to the conference terminal 4 at the same time.

In addition, in practical applications, the first operation applied by the first conference terminal may also include a conference control instruction for controlling the second conference terminal, and the above-mentioned first prompt may also include a command for instructing the second conference terminal to perform corresponding control Content. For example, the first operation is that the conference terminal 1 applies for speaking, and the first operation may also include a conference control instruction that requires the conference terminal 2 to the conference terminal 4 to be muted. until the conference terminal 4 will be muted". In this way, after the conference terminal 1 performs the corresponding operation, the conference terminal 2 to the conference terminal 4 execute the corresponding content according to the content indicated in the first prompt.

In another possible implementation manner, the first operation applied by the first conference terminal does not include a conference control instruction for controlling the second conference terminal, but during the conference process, the conference control device may, according to preset associated operation information, After modifying the attributes of the first conference terminal, modify the attributes of the second conference terminal. For example, if the conference terminal 1 applies to speak, the conference control device can determine that the conference terminal 2 to the conference terminal 4 need to perform the mute operation according to the preset associated operation information (for example, when one participant speaks, other participants are muted), and then at the same time Modify the properties of the conference terminal 2 to the conference terminal 4 so that the conference terminal 2 to the conference terminal 4 are in the mute state.

The conference control device in the embodiment of the present application will be described below. Please refer to FIG. 9 for details. In the embodiment of the present application, the conference control device 900 includes: a receiving module 901 and a processing module 902, wherein the receiving module 901 and the processing module 902 pass through bus connection. The conference control device 900 may be the conference control device in the foregoing method embodiments, or may be configured as one or more chips in the conference control device. The conference control device 900 may be configured to execute part or all of the functions of the conference control device in the above method embodiments.

The receiving module 901 receives the application for performing the first operation on the current conference sent by the first conference terminal and the identifier of the first user of the first conference terminal, where the identifier of the first user is related to the authority of the first user The processing module 902 determines that the first user has the authority to perform the first operation according to the authority of the first user and a preset conference control strategy, and the preset conference control strategy is used to indicate the corresponding relationship between the conference operation and the user authority ; modify the attribute of the first conference terminal, so that the first conference terminal obtains the permission to perform the first operation.

Optionally, the conference control device 900 further includes a storage module, which is coupled to the processing module 902, so that the processing module 902 can execute computer execution instructions stored in the storage module to implement the functions of the terminal in the above method embodiments. In an example, the optional storage module included in the conference control device 900 may be an in-chip storage unit, such as a register, a cache, etc., and the storage module may also be a storage unit located outside the chip, such as a ROM or a storage unit that can store static Other types of static storage devices for information and instructions, RAM, etc.

Optionally, the processing module 902 is further configured to generate, according to the application and the identifier of the first user, a first prompt for indicating whether to approve the first conference terminal to obtain the permission to perform the first operation;

The conference control device 900 further includes a sending module 903, the sending module 903 is configured to send a first prompt to the second conference terminal, or the sending module 903 is configured to instruct the media server to send the second conference terminal sending the first prompt so that the second conference terminal can display the first prompt; the first prompt is used to indicate whether the first conference terminal is approved to obtain the permission to perform the first operation; the receiving Module 901 is further configured to accept a first response sent by the second conference terminal, where the first response is generated by the second conference terminal after receiving the first prompt, and the first response is used to indicate It is agreed that the first conference terminal obtains the permission to perform the first operation.

Optionally, the first prompt is included in at least one first video frame; the processing module 902 is further configured to generate video metadata including the first prompt;

The conference control device further includes a sending module 903, which is further configured to send the video metadata to a media server, so as to instruct the media server to generate the at least one first video frame according to the video metadata, and send the video metadata to the media server. At least one first video frame is sent to the second conference terminal; the picture of the first video frame includes the first prompt.

Optionally, the at least one first video frame is generated by the media server by re-encoding the first prompt and the decoded data of at least one second video frame, and the at least one second video frame is the media server. Obtained from the current frame of the main video of the current conference to at least one video frame in the preset time range.

Optionally, the video metadata further includes description information of the first control, and the description information of the first control includes at least one of the content presented on the first control and the position where the first control is presented. ; the description information of the first control is used by the media server to generate the first control on the first video frame, and the first control is used to receive an instruction from the user, the instruction indicates the consent The first conference terminal acquires the authority to perform the first operation.

Optionally, the first prompt is included in the first audio; the conference control device further includes a sending module 903, configured to send the first prompt to the media server to instruct the media server according to the first prompt. The first audio is obtained with a prompt, and the first audio is sent to the second conference terminal.

Optionally, the first audio is obtained by mixing a second audio and a third audio, wherein the second audio is obtained by converting the first prompt, and the third audio is the audio of the current conference.

Optionally, the first prompt is included in text data; the sending module 903 is configured to send the text data including the first prompt to the second conference terminal, so that the second conference terminal is in the The text data is displayed in the form of a bullet screen on the played video screen.

Optionally, the first prompt is generated by the conference control device according to the application and the identifier of the first user.

Optionally, the processing module 902 is further configured to generate, according to the application and the identifier of the first user, a second prompt for indicating that the first conference terminal has obtained the permission to perform the first operation;

The conference control device further includes a sending module 903, the sending module 903 is configured to send the second prompt to the first conference terminal and the second conference terminal, or the conference control device instructs the media server to send the message to the The first conference terminal and the second conference terminal send the second prompt, so that the first conference terminal and the second conference terminal display the second prompt.

Optionally, the second prompt further includes information used to indicate that the second conference terminal has lost the authority to perform a second operation, where the second operation is associated with the first operation;

or,

The second prompt further includes information for instructing the second conference terminal to obtain the permission to perform a third operation, where the third operation is associated with the first operation.

Optionally, the processing module 902 is further configured to modify the attributes of the second conference terminal, so that the second conference terminal loses the authority to perform a second operation, the second operation is the same as the first operation Associated;

or,

The processing module 902 is further configured to modify the attribute of the second conference terminal, so that the second conference terminal obtains the permission to perform a third operation, where the third operation is associated with the first operation.

It should be understood that the process executed between the modules of the conference control device in the above-mentioned embodiment corresponding to FIG. 9 is similar to the process executed by the conference control device in the corresponding method embodiments in the aforementioned FIG. 2 to FIG. 8f , and details are not repeated here. .

FIG. 10 shows a schematic structural diagram of a conference control device 1000 in the above-mentioned embodiment, and the conference control device 1000 may be configured as the aforementioned conference control device. The conference control device 1000 may include: a processor 1002 , a computer readable storage medium/memory 1003 , a transceiver 1004 , an input device 1005 and an output device 1006 , and a bus 1001 . Wherein, processors, transceivers, computer-readable storage media, etc. are connected through a bus. The embodiments of the present application do not limit the specific connection medium between the above components.

In one example, the transceiver 1004 receives an application sent by the first conference terminal to perform the first operation on the current conference and the identifier of the first user of the first conference terminal, and the identifier of the first user is the same as the identifier of the first user. The authority of the first user is associated; the processor 1002 determines that the first user has the authority to perform the first operation according to the authority of the first user and a preset conference control strategy, and the preset conference control strategy uses in order to indicate the corresponding relationship between the conference operation and the user authority; modify the attribute of the first conference terminal, so that the first conference terminal obtains the authority to perform the first operation.

In one example, the processor 1002 may include baseband circuitry, eg, may generate the first prompt and the second prompt. The transceiver 1004 may include a radio frequency circuit, so as to modulate and amplify the first prompt and the second prompt and send them to the conference terminal.

In yet another example, the processor 1002 may run an operating system to control functions between various devices and devices. The transceiver 1004 may include a baseband circuit and a radio frequency circuit. For example, the first prompt and the second prompt may be sent to the conference terminal after being processed by the baseband circuit and the radio frequency circuit.

The transceiver 1004 and the processor 1002 can implement the corresponding steps in any of the foregoing embodiments in FIG. 2 to FIG. 8f , and details are not repeated here.

It can be understood that FIG. 10 only shows a simplified design of the conference control device. In practical applications, the conference control device may include any number of transceivers, processors, memories, etc., all of which can realize the conference control of the present application. The equipment is all within the scope of protection of this application.

The processor 1002 involved in the above-mentioned apparatus 1000 may be a general-purpose processor, such as a CPU, a network processor (NP), a microprocessor, etc., or an ASIC, or one or more programs used to control the solution of the present application implemented integrated circuits. It can also be a digital signal processor (DSP), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components. A controller/processor may also be a combination that implements computing functions, such as a combination comprising one or more microprocessors, a combination of a DSP and a microprocessor, and the like. Processors typically perform logical and arithmetic operations based on program instructions stored in memory.

The above-mentioned bus 1001 may be a peripheral component interconnect (PCI for short) bus or an extended industry standard architecture (EISA for short) bus or the like. The bus can be divided into address bus, data bus, control bus and so on. For ease of presentation, only one thick line is used in FIG. 10, but it does not mean that there is only one bus or one type of bus.

The above-mentioned computer-readable storage medium/memory 1003 may also store an operating system and other application programs. Specifically, the program may include program code, and the program code includes computer operation instructions. More specifically, the above-mentioned memory may be ROM, other types of static storage devices that can store static information and instructions, RAM, other types of dynamic storage devices that can store information and instructions, disk storage, and the like. The memory 1003 may be a combination of the above storage types. And the above-mentioned computer-readable storage medium/memory may be in the processor, outside the processor, or distributed over multiple entities including the processor or processing circuit. The computer-readable storage medium/memory described above may be embodied in a computer program product. By way of example, a computer program product may include a computer-readable medium in packaging materials.

Alternatively, the embodiments of the present application also provide a general-purpose processing system, for example, commonly referred to as a chip, and the general-purpose processing system includes: one or more microprocessors that provide processor functions; and an external memory that provides at least a part of a storage medium. , all of which are connected together with other support circuits through an external bus architecture. When the instructions stored in the memory are executed by the processor, the processor is caused to execute some or all of the steps in the conference control method of the first communication device in the embodiment of FIG. 2 to FIG. other processes of technology.

The steps of the methods or algorithms described in conjunction with the disclosure of the present application may be implemented in a hardware manner, or may be implemented in a manner in which a processor executes software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable hard disk, CD-ROM, or any other form of storage known in the art in the medium. An exemplary storage medium is coupled to the processor, such that the processor can read information from, and write information to, the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and storage medium may reside in an ASIC. Alternatively, the ASIC may be located in the terminal. Of course, the processor and the storage medium may also exist in the first communication device as discrete components.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above may refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .

Claims

A conference control method, applied to a conference control device, the conference control device being used to control a first conference terminal and a second conference terminal to participate in a current conference, characterized by comprising:

The conference control device receives an application for performing a first operation on the current conference and an identifier of a first user of the first terminal sent by the first conference terminal, and the identifier of the first user is the same as the first user's identifier. associated with the user's permissions;

The conference control device determines that the first user has the authority to perform the first operation according to the authority of the first user and a preset conference control policy, and the preset conference control policy is used to indicate the conference operation and user authority the corresponding relationship;

The conference control device modifies the attribute of the first conference terminal, so that the first conference terminal obtains the authority to perform the first operation.
The method according to claim 1, wherein before the conference control device modifies the attribute of the first conference terminal, the method further comprises:

The conference control device sends the first prompt to the second conference terminal, or the conference control device instructs the media server to send the first prompt to the second conference terminal, so that the second conference terminal can display the first prompt the first prompt; the first prompt is used to indicate whether to approve the first conference terminal to obtain the permission to perform the first operation;

The conference control device receives a first response sent by the second conference terminal, where the first response is used to indicate approval of the first conference terminal to obtain the permission to perform the first operation.
The method of claim 2, wherein the first cue is contained in at least one first video frame;

The conference control device instructing the media server to send the first prompt to the second conference terminal, including:

generating, by the conference control device, video metadata including the first prompt;

The conference control device sends the video metadata to the media server to instruct the media server to generate the at least one first video frame according to the video metadata, and send the at least one first video frame to the second conference terminal; the picture of the at least one first video frame includes the first prompt.
The method according to claim 3, wherein the at least one first video frame is generated by the media server by re-encoding the first prompt and the decoded data of at least one second video frame, and the at least one The second video frame is obtained by the media server from the current frame of the main video of the current conference to at least one video frame in a preset time range.
The method according to claim 3 or 4, wherein the video metadata further includes description information of a first control, and the description information of the first control includes content presented on the first control, the at least one of the positions where the first control is presented; the description information of the first control is used by the media server to generate the first control on the first video frame, and the first control is used for receiving The user's instruction, the instruction indicating that the first conference terminal is approved to obtain the permission to perform the first operation.
The method of claim 2, wherein the first prompt is included in a first audio;

The conference control device instructing the media server to send the first prompt to the second conference terminal, including:

The conference control device sends the first prompt to the media server to instruct the media server to obtain the first audio according to the first prompt, and send the first audio to the second conference terminal .
The method of claim 6, wherein:

The first audio is obtained by mixing the second audio and the third audio, wherein the second audio is obtained by converting the first prompt, and the third audio is the audio of the current conference.
The method of claim 2, wherein the first prompt is contained in text data;

The conference control device sends the first prompt to the second conference terminal, so that the second conference terminal can display the first prompt, including:

The conference control device sends the text data including the first prompt to the second conference terminal, so that the second conference terminal displays the text data in the form of a bullet screen on the playing video screen.
The method according to any one of claims 2 to 8, wherein the first prompt is generated by the conference control device according to the application and the identification of the first user.
The method according to any one of claims 1 to 9, wherein the method further comprises:

The conference control device sends the second prompt to the first conference terminal and the second conference terminal, or the conference control device instructs the media server to send the second prompt to the first conference terminal and the second conference terminal the second prompt, so that the first conference terminal and the second conference terminal display the second prompt, and the second prompt is used to indicate that the first conference terminal has obtained and executed the first operation permission.
The method according to claim 10, wherein the second prompt further comprises information indicating that the second conference terminal has lost the authority to perform a second operation, the second operation being the same as the first operation operation associated;

or,

The second prompt further includes information for instructing the second conference terminal to obtain the permission to perform a third operation, where the third operation is associated with the first operation.
The method according to any one of claims 1 to 11, wherein the method further comprises:

The conference control device modifies the attribute of the second conference terminal, so that the second conference terminal loses the authority to perform a second operation, where the second operation is associated with the first operation;

or,

The conference control device modifies the attribute of the second conference terminal, so that the second conference terminal obtains the authority to perform a third operation, where the third operation is associated with the first operation.
The method according to any one of claims 1 to 12, wherein the identification of the first user comprises at least one of the following: the name of the first user, the facial features of the first user, the The fingerprint information of the first user, the voiceprint information of the first user, the job number of the first user, the identity of the first user, and the position information of the first user.
The method according to any one of claims 1 to 13, wherein the first operation includes at least one of: speaking, switching a participant role, applying for a viewing, muting, extending a conference, renaming the site, Release the current shared site.
A conference control device, comprising:

A receiving module, configured to receive an application for performing a first operation on the current conference sent by the first conference terminal and an identifier of a first user of the first terminal, where the identifier of the first user is the same as that of the first user. associated with the user's permissions;

a processing module, configured to determine that the first user has the authority to perform the first operation according to the authority of the first user and a preset conference control strategy, where the preset conference control strategy is used to indicate the conference operation and user authority The corresponding relationship of the first conference terminal is modified, so that the first conference terminal obtains the permission to perform the first operation.
The conference control device according to claim 15, wherein the conference control device further comprises a sending module, the sending module is configured to send a first prompt to the second conference terminal, or the sending module , used to instruct the media server to send the first prompt to the second conference terminal, so that the second conference terminal can display the first prompt; the first prompt is used to indicate whether to agree to the first conference the terminal obtains the permission to perform the first operation;

The receiving module is further configured to accept a first response sent by the second conference terminal, where the first response is used to indicate approval for the first conference terminal to obtain the permission to perform the first operation.
The conference control device of claim 16, wherein the first prompt is contained in at least one first video frame;

The processing module is further configured to generate video metadata including the first prompt;

The sending module is specifically configured to send the video metadata to the media server, so as to instruct the media server to generate the at least one first video frame according to the video metadata, and send the at least one first video frame to the media server. The frame is sent to the second conference terminal; the picture of the at least one first video frame includes the first prompt.
The conference control device according to claim 17, wherein the video metadata further includes description information of a first control, and the description information of the first control includes content presented on the first control, the at least one of the positions where the first control is presented; the description information of the first control is used by the media server to generate the first control on the first video frame, and the first control is used for receiving The user's instruction, the instruction instructing the approval of the first conference terminal to obtain the permission to perform the first operation.
The conference control device of claim 16, wherein the first prompt is included in the first audio;

The sending module is specifically configured to send the first prompt to the media server to instruct the media server to obtain the first audio according to the first prompt, and send the first audio to the first audio. Two conference terminals.
The conference control device according to claim 16, wherein the first prompt is contained in text data;

The sending module is specifically configured to send the text data including the first prompt to the second conference terminal, so that the second conference terminal displays the text data in the form of a bullet screen on the playing video screen .
The conference control device according to any one of claims 15 to 20, wherein the sending module is further configured to send the second prompt to the first conference terminal and the second conference terminal, Or the sending module is further configured to instruct the media server to send the second prompt to the first conference terminal and the second conference terminal, so that the first conference terminal and the second conference terminal display all the information. The second prompt is used to indicate that the first conference terminal has obtained the permission to perform the first operation.
A conference system, comprising: a conference control device and a first conference terminal;

The first conference terminal is configured to acquire an application for performing a first operation on the current conference and the identifier of the first user; send the application and the identifier of the first user to the conference control device, and the The identity of the first user is associated with the authority of the first user;

The conference control device is configured to determine that the first user has the authority to perform the first operation according to the authority of the first user and a preset conference control strategy, where the preset conference control strategy is used to indicate a conference operation Corresponding relationship with user authority; modifying the attribute of the first conference terminal, so that the first conference terminal obtains the authority to perform the first operation.
The conference system according to claim 22, wherein the conference system further comprises a second conference terminal;

Before the conference control device modifies the attribute of the first conference terminal, the conference control device is further configured to send a first prompt to the second conference terminal; or, instruct the media server to send a message to the second conference terminal sending the first prompt, where the first prompt is used to indicate whether to approve the first conference terminal to obtain the permission to perform the first operation;

The second conference terminal is configured to receive and display the first prompt, generate a first response according to the user's input operation, and send the first response to the conference control device, where the first response is used to indicate agreeing that the first conference terminal obtains the permission to perform the first operation;

The conference control device is configured to accept the first response sent by the second conference terminal.
The conference system of claim 23, wherein the first prompt is contained in at least one first video frame;

The conference system further includes the media server;

The conference control device is further configured to generate video metadata including the first prompt; and send the video metadata to the media server;

The media server is configured to receive the video metadata, and generate the at least one first video frame according to the video metadata; send the at least one first video frame to the second conference terminal, the The first prompt is included in the picture of the first video frame;

The second conference terminal is further configured to receive and play the at least one first video frame.
The conference system according to claim 24, wherein the media server is specifically configured to obtain at least one second video frame from the current frame to a preset time range of the main video of the current conference; The at least one first video frame is generated by re-encoding the decoded data of the at least one second video frame.
The conference system according to claim 24 or 25, wherein the video metadata further includes description information of a first control, and the description information of the first control includes content presented on the first control, at least one of the positions where the first control is presented;

The media server is further configured to generate the first control on the at least one first video frame according to the description information of the first control, where the first control is used to receive an instruction from a user, and the instruction indicates It is agreed that the first conference terminal obtains the permission to perform the first operation.
The conference system according to claim 23, wherein the first prompt is included in the first audio; the conference system further comprises a media server;

the conference control device, configured to send the first prompt to a media server;

the media server, configured to obtain the first audio according to the first prompt, and send the first audio to the second conference terminal;

The second conference terminal is configured to receive and play the first audio.
The conference system of claim 23, wherein the first prompt is contained in text data;

the conference control device, configured to send text data including the first prompt to the second conference terminal;

The second conference terminal is configured to receive the text data and display the text data in the form of a bullet screen on the playing video screen.
The conference system according to any one of claims 22 to 28, characterized in that,

The conference control device is further configured to send the second prompt to the first conference terminal and the second conference terminal; the first conference terminal and the second conference terminal receive the second prompt, and display the second prompt in the form of a bullet screen;

or,

the conference control device, further configured to send the second prompt to the media server;

the media server, configured to send a video frame containing the second prompt or an audio containing the second prompt to the first conference terminal and the second conference terminal;

The first conference terminal and the second conference terminal are configured to receive and play the video frame containing the second prompt, or, to receive and play the audio containing the second prompt;

The second prompt is used to indicate that the first conference terminal has obtained the permission to perform the first operation.
The conference system according to claim 29, wherein the second prompt is further used to indicate that the second conference terminal has lost the authority to perform a second operation, and the second operation is related to the first operation link;

or,

The second prompt is further used to instruct the second conference terminal to obtain the permission to perform a third operation, where the third operation is associated with the first operation.
A computer program, characterized in that, when the computer program is run on a computer, it causes the computer to execute the method according to any one of claims 1 to 14.
A computer-readable storage medium, characterized by comprising a program, which, when the program is run on a computer, causes the computer to execute the method according to any one of claims 1 to 14.
A conference control device, characterized in that it comprises a processor and a memory, wherein the processor is coupled to the memory,

the memory for storing programs;

The processor is configured to execute a program in the memory, so that the conference control device executes the method according to any one of claims 1 to 14.
A chip system, characterized in that the chip system includes one or more processors and a memory, the memory stores program instructions, and when the program instructions are executed in the one or more processors, The method as claimed in any one of claims 1 to 14 is caused to be performed.