WO2021254168A1

WO2021254168A1 - Conference control method and apparatus, readable medium and electronic device

Info

Publication number: WO2021254168A1
Application number: PCT/CN2021/098232
Authority: WO
Inventors: 杨智烨; 徐斌
Original assignee: 北京字节跳动网络技术有限公司
Priority date: 2020-06-15
Filing date: 2021-06-04
Publication date: 2021-12-23
Also published as: CN111711784A; CN111711784B

Abstract

A conference control method and apparatus, a readable medium and an electronic device. The method is applied to a conference control application program, and comprises: acquiring identification information of at least one terminal; and sending, to a signaling server, a conference request that comprises the identification information, wherein the conference request is used for instructing the signaling server to add the at least one terminal to the same conference. In this way, a user can automatically add one or more terminals to the same conference by means of a conference control application program without the intervention of each terminal user, such that the establishment of a video conference is more convenient and fast, thereby improving communication efficiency and user experience.

Description

Conference control method, device, readable medium and electronic equipment

This application claims the priority of the Chinese patent application filed on June 15, 2020 with the application number 202010544787.3 and the application title "Conference control method, device, readable medium and electronic equipment", the entire content of which is incorporated herein by reference Applying.

Technical field

The present disclosure relates to the field of communication technologies, and in particular, to a conference control method, device, readable medium, and electronic equipment.

Background technique

Video conference refers to a meeting in which users located in two or more locations conduct face-to-face conversations through communication equipment and the Internet. The existing video conference control system usually includes multiple terminals and a server that manages and controls these terminals. After a video conference is established, multiple terminals are connected to the server and send their respective media data (for example, audio, video, etc.). , Share pictures, etc.) to the server, the server performs audio/video data mixing and processing according to the actual situation, and then sends these data to each terminal in the form of streaming media, and displays it on each terminal device. Among them, when establishing a video conference, the conference initiator (through a terminal) first initiates a conference request to the server. After the server receives the conference request, it establishes a conference room. After that, other terminals use the address information of the conference room or receive the conference initiator. Invitation to enter the meeting room. It can be seen that the establishment of a video conference requires the intervention of various end users, which is not only time-consuming, but also has a poor user experience.

Summary of the invention

The content of the invention is provided to introduce concepts in a brief form, and these concepts will be described in detail in the following specific embodiments. The content of the invention is not intended to identify the key features or essential features of the technical solution that is required to be protected, nor is it intended to be used to limit the scope of the technical solution that is required to be protected.

In the first aspect, the present disclosure provides a conference control method, which is applied to a conference control application, including:

Acquiring identification information of at least one terminal;

Send a meeting request including the identification information to a signaling server, where the meeting request is used to instruct the signaling server to add the at least one terminal to the same meeting.

In the second aspect, the present disclosure provides a conference control method applied to a signaling server, including:

Receiving a meeting request sent by a meeting control application, where the meeting request includes identification information of at least one terminal;

According to the identification information, control each of the terminals to join the same conference.

In a third aspect, the present disclosure provides a conference control device, including:

An obtaining module, which is used to obtain identification information of at least one terminal;

The first sending module is configured to send a meeting request including the identification information acquired by the acquiring module to the signaling server, where the meeting request is used to instruct the signaling server to add the at least one terminal to the In the same meeting.

In a fourth aspect, the present disclosure provides a conference control device applied to a signaling server, including:

The first receiving module is configured to receive a meeting request sent by a meeting control application, where the meeting request includes identification information of at least one terminal;

The control module is configured to control each of the terminals to join the same conference according to the identification information received by the first receiving module.

In a fifth aspect, the present disclosure provides a computer-readable medium with a computer program stored thereon, which, when executed by a processing device, implements the steps of the method provided in the first aspect or the second aspect of the present disclosure.

In a sixth aspect, the present disclosure provides an electronic device, including:

A storage device on which a computer program is stored;

The processing device is configured to execute the computer program in the storage device to implement the steps of the method provided in the first aspect of the present disclosure.

In a seventh aspect, the present disclosure provides an electronic device, including:

A storage device on which a computer program is stored;

The processing device is configured to execute the computer program in the storage device to implement the steps of the method provided in the second aspect of the present disclosure.

In the above technical solution, when a user initiates a meeting through a meeting control application, the meeting control application sends a meeting request including identification information of at least one terminal to the signaling server; after receiving the meeting request, the signaling server uses the above identification Information to control at least one of the aforementioned terminals to join the same conference. It can be seen that the user can realize one or more terminals to automatically join the same meeting through the meeting control application without the intervention of each terminal user. The establishment of a video conference is more convenient and faster, thereby improving communication efficiency and user experience.

Other features and advantages of the present disclosure will be described in detail in the following specific embodiments.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments described in this application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

Fig. 1A is a schematic structural diagram of a conference control system according to an exemplary embodiment.

Fig. 1B is a schematic structural diagram of a conference control system according to another exemplary embodiment.

Fig. 2 is a flow chart showing a method for controlling a conference according to an exemplary embodiment.

Fig. 3 is a flowchart showing a conference control method according to another exemplary embodiment.

Fig. 4 is a schematic diagram showing a different terminal displaying different media data according to another exemplary embodiment.

Fig. 5 is a flowchart showing a method for meeting control according to another exemplary embodiment.

Fig. 6 is a flowchart showing a conference control method according to another exemplary embodiment.

Fig. 7 is a flowchart showing a method for controlling a conference according to an exemplary embodiment.

Fig. 8 is a block diagram showing a conference control device according to an exemplary embodiment.

Fig. 9 is a block diagram showing a conference control device according to an exemplary embodiment.

Fig. 10 is a block diagram showing an electronic device according to an exemplary embodiment.

detailed description

Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided for Have a more thorough and complete understanding of this disclosure. It should be understood that the drawings and embodiments of the present disclosure are only used for exemplary purposes, and are not used to limit the protection scope of the present disclosure.

It should be understood that the steps recorded in the method embodiments of the present disclosure may be executed in a different order, and/or executed in parallel. In addition, method implementations may include additional steps and/or omit to perform the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and its variants as used herein are open-ended includes, that is, "including but not limited to". The term "based on" is "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments." Related definitions of other terms will be given in the following description.

It should be noted that the concepts of “first” and “second” mentioned in the present disclosure are only used to distinguish different devices, modules, or units, and are not used to limit the order of functions performed by these devices, modules or units. Or interdependence.

It should be noted that the modifications of “a” and “a plurality of” mentioned in the present disclosure are illustrative and not restrictive, and those skilled in the art should understand that unless clearly indicated otherwise in the context, they should be understood as “one or Multiple".

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes, and are not used to limit the scope of these messages or information.

The present disclosure provides a conference control system, wherein the conference control system may include a conference control application, at least one terminal, a signaling server, and a streaming media server.

As shown in FIG. 1A and FIG. 1B, the conference control system includes a terminal 100, a terminal 110, ..., a terminal 120, a signaling server 20, a streaming media server 30, and a conference control application.

Wherein, the above-mentioned terminal may be a local terminal or a remote terminal, and it may be, for example, a smart phone, a tablet computer, a notebook computer, a desktop computer, etc., which are not specifically limited in the present disclosure, and the at least one of the above-mentioned terminals Meeting applications (ie, meeting software) are installed on each terminal. Among them, in the present disclosure, the methods executed on the terminal side can all be executed by the conference application on the terminal.

The signaling server 20 is a server that controls access to the conference and manages the entire conference, and it may be located in the cloud.

The streaming media server 30 can be used to forward media data (for example, images, video streams, audio streams, etc.), wherein the media data shared or collected by each terminal is sent to the streaming media server through the signaling server 20, and the streaming media server The media data is received and buffered, and the corresponding buffered media data is forwarded to the corresponding terminal according to the control of the signaling server for display on the corresponding terminal.

Among them, the encoding and decoding operations of the media data can both be completed by the terminal. Specifically, each terminal may encode the shared or collected media data to obtain a media stream suitable for transmission, and then send the encoded media data to the streaming media server 30 through the signaling server 20 The streaming media server 30 receives and buffers the encoded media data, and according to the control of the signaling server 20, forwards the buffered corresponding encoded media data to the corresponding terminal, and the corresponding terminal receives the encoded media data To decode it and display the decoded media data. In this way, compared to the way of encoding and decoding by the signaling server, the available terminal resources can be effectively allocated, the processing pressure of the signaling server can be reduced, and the reasonable configuration of conference control system resources can be realized.

In addition, the conference control application can be installed on any one of the aforementioned at least one terminal and the signaling server. In one embodiment, as shown in Fig. 1A, the conference control application is installed on any one of the aforementioned at least one terminal (in Fig. 1A, the conference control application is installed on the terminal 120 as an example). In this way, the user can initiate a meeting and control the display content of each terminal by operating the meeting control application on the corresponding terminal, which is convenient and fast, and has high real-time control.

Wherein, it should be noted that when the conference control application is installed on any one of the above-mentioned at least one terminal, the conference control application can be independent of the conference application on the terminal, or it can be integrated with the conference application on the terminal. In the meeting application, there is no specific limitation in this disclosure.

In another embodiment, as shown in FIG. 1B, the conference control application can be installed on the above-mentioned signaling server. Among them, the user can send control instructions to the conference control application through any one of the above at least one terminal, so as to initiate a conference through the conference control application, control the display content of each terminal, etc., so that the user can realize the conference through the cloud. control.

In addition, each terminal and the signaling server 20 can communicate through Bluetooth, serial port, Wireless Fidelity (Wireless Fidelity, WiFi for short), USB, Ethernet, etc., and the signaling server 20 and the streaming media server 30 can also communicate through Bluetooth, Communication via serial port, WiFi, USB, Ethernet, etc. In addition, there may be one or more streaming media servers 30, which are not specifically limited in this disclosure.

Fig. 2 is a flow chart showing a method for meeting control according to an exemplary embodiment, wherein the method can be applied to a meeting control application. As shown in FIG. 2, the method may include the following

steps

201 and 202.

In step 201, the identification information of at least one terminal is obtained.

In the present disclosure, the above-mentioned identification information may be, for example, Internet Protocol Address (IP address), Media Access Control Address (Mac address), and the like. The user can initiate a meeting by operating the initiating meeting button in the meeting control application. After that, the meeting control application obtains identification information of at least one terminal.

In step 202, a meeting request including identification information is sent to the signaling server.

Wherein, the meeting request is used to instruct the signaling server to add the above-mentioned at least one terminal to the same meeting.

In addition, users can freely control the display content of each terminal through the conference control application to meet the needs of different users. Specifically, as shown in FIG. 3, the above method may include the following

steps

203 and 204.

In step 203, the first media data to be received by each terminal is determined.

In the present disclosure, the first media data may be an image (for example, a shared screen of each terminal), audio, video (including a local screen, a remote screen), and the like. Wherein, the first media data to be received by the terminal may be determined according to the detected data distribution control operation (for example, a drag operation) for each terminal.

For example, the conference control application is installed on any terminal, where the interface of the conference control application can display various terminal icons and candidate media data, and the user can drag any one of the candidate media data to the corresponding terminal icon Location, to achieve the purpose of controlling the display content of the corresponding terminal. After detecting the drag operation, the conference control application can determine the dragged media data as the first media data to be received by the terminal corresponding to the terminal icon at the end position of the drag operation.

In step 204, a data distribution instruction is generated, and the data distribution instruction is sent to the signaling server.

In the present disclosure, the data distribution instruction is used to instruct the signaling server to send the corresponding first media data to each terminal. After the signaling server receives the data distribution instruction sent by the conference control application, it can forward the first media data corresponding to each terminal to the corresponding terminal through the streaming media server according to the data distribution instruction, and each terminal receives the corresponding first media data. The media data is displayed through the display device of the first terminal (which may be the display screen of the terminal or an external display).

Among them, the first media data to be received by at least one terminal may be all the same or not all the same, so that different terminals can display different media data to meet the needs of different users.

For example, as shown in FIG. 4, the first media data displayed by the terminal 100 is a local video, the first media data displayed by the terminal 110 is a remote video, and the first media data displayed by the terminal 120 is a shared screen (which may be a remote shared screen). , It can also be a local shared screen).

In addition, the user can also switch (ie adjust) the display content of each terminal through the conference control application. Specifically, as shown in FIG. 5, the above method may include the following

steps

205 and 206.

In step 205, in response to the data distribution adjustment operation input by the user, the target terminal to be adjusted and the second media data to be received by the target terminal to be adjusted are determined.

In the present disclosure, the second media data to be received by the target terminal to be adjusted is used to replace the first media data currently received by it.

Among them, the target terminal to be adjusted and the second media data to be received by the target terminal to be adjusted can be determined in various ways. In one embodiment, the interface of the conference control application can display various terminal icons and candidate media data, and the user can adjust the corresponding terminal by dragging any one of the candidate media data to the location of the corresponding terminal icon. The purpose of displaying the content. After the conference control application detects the drag operation for the terminal icon, it can determine the terminal corresponding to the terminal icon at the end of the drag operation as the target terminal to be adjusted, and determine the dragged media data as the to-be-adjusted terminal The second media data to be received by the target terminal.

In another embodiment, the interface of the conference control application program can display various terminal icons, and the user can drag and drop one terminal icon to the location of the other terminal icon to achieve the purpose of exchanging the displayed content of any two terminals. After the conference control application detects a drag operation for a terminal icon, it can set the terminal corresponding to the dragged terminal icon (here called the first terminal), and the terminal corresponding to the terminal icon at the end of the drag operation (here (Referred to as the second terminal) is determined as the target terminal to be adjusted, the first media data currently received by the first terminal is determined as the second media data to be received by the second terminal, and the first media data currently received by the second terminal is determined It is determined as the second media data to be received by the first terminal, that is, the display content of the first terminal and the second terminal are exchanged.

In step 206, a data distribution adjustment instruction is generated, and the data distribution adjustment instruction is sent to the signaling server.

Wherein, the data distribution adjustment instruction is used to instruct the signaling server to send the second media data to be received to the target terminal to be adjusted. After receiving the data distribution adjustment instruction, the signaling server may send the corresponding second media data to the target terminal to be adjusted.

In addition, the conference control application can also perform mixing processing on the third media data collected by multiple terminals to obtain mixed media data, which can be displayed to the user and improve the user's conference experience. Specifically, as shown in FIG. 6, the foregoing method may include the following

steps

207 and 208.

In step 207, third media data collected by multiple terminals are received.

In the present disclosure, the terminal may include a video capture device (for example, a camera) and/or an audio capture device, where the video capture device and/or audio capture device may be built in or connected to the terminal body External equipment. Correspondingly, the third media data may be audio data, video data, and so on. Wherein, after each terminal collects the third media data, it can send it to the conference control application, and the conference control application receives the third media data.

In step 208, the third media data collected by multiple terminals is sent to the signaling server.

In the present disclosure, the third media data is used for mixing processing to generate mixed target media data. The signaling server receives the third media data collected by multiple terminals and performs mixing processing on them to generate mixed target media data.

In an embodiment, the third media data includes video data, and the signaling server may perform video splicing processing on the video data collected by multiple terminals to generate panoramic video data (ie, target media data).

In another implementation manner, the third media data includes audio data, and the signaling server may perform mixing processing on the audio data collected by multiple terminals to generate mixed audio data (that is, target media data).

In another embodiment, the third media data includes video data and audio data, and the signaling server can perform video splicing processing on the video data collected by multiple terminals to generate panoramic video data; at the same time, multiple The audio data collected by the terminal is subjected to audio mixing processing to generate audio mixing data, thereby obtaining target media data (including panoramic video data and audio mixing data).

In addition, in the present disclosure, different numbers of terminals can be configured according to different display requirements and video capture requirements, without chip support or hardware expansion for the terminal, and no long cable connection, thereby reducing the complexity and complexity of the terminal. Expansion cost and deployment difficulty of the conference control system. In addition, the display content of different terminals can be freely deployed, while ensuring high resolution, thereby enhancing the flexibility of deployment and conference control system expansion.

Fig. 7 is a flowchart showing a conference control method according to an exemplary embodiment, wherein the method can be applied to a signaling server, for example, the signaling server 20 shown in Figs. 1A and 1B. As shown in FIG. 7, the method may include the following steps 701 and 702.

In step 701, a meeting request sent by a meeting control application is received, where the meeting request includes identification information of at least one terminal.

In step 702, each terminal is controlled to join the same conference according to the identification information of at least one terminal.

Specifically, it is possible to first determine whether the meeting request includes meeting identification information; in response to determining that the meeting request does not include meeting identification information (for example, meeting room address), create a new meeting and control each terminal to join the new meeting; Or, in response to determining that the meeting request includes meeting identification information, each terminal is directly controlled to join the meeting corresponding to the meeting identification information.

Optionally, the method further includes the following steps:

Receive the data distribution instruction; in response to the data distribution instruction, send the corresponding first media data to the terminal to be distributed.

In the present disclosure, the data distribution instruction is used to instruct the signaling server to send the corresponding first media data to each of the aforementioned at least one terminal. Among them, the data distribution instruction can be sent by the above-mentioned conference control application, or sent by any terminal, that is, the user can not only control the display content of each terminal through the conference control application, but also through each terminal (specifically corresponding The conference application on the terminal) for control.

Optionally, the method further includes the following steps:

Receive the data distribution adjustment instruction; in response to the data distribution adjustment instruction, send the second media data to the target terminal to be adjusted.

In the present disclosure, the data distribution adjustment instruction may be used to instruct the signaling server to send second media data to the target terminal to be adjusted, and the second media data is used to replace the first media data currently received by the target terminal to be adjusted. Among them, the data distribution adjustment instruction can be sent by the above-mentioned conference control application, or sent by any terminal, that is, the user can not only control the display content of each terminal through the conference control application, but also through each terminal (specifically: The conference application on the corresponding terminal) for control.

Optionally, the media data sent by the signaling server to the terminal is coded data. In this way, after receiving the encoded data, the terminal can decode and display it.

Optionally, the above method may further include the following steps:

Receive third media data collected by multiple terminals; perform mixing processing on the third media data collected by multiple terminals to generate mixed target media data.

In the present disclosure, the above-mentioned third media data may be sent by the above-mentioned conference control application, or may be sent by each terminal, which is not specifically limited in the present disclosure.

Optionally, the foregoing terminal is a local terminal; the foregoing method may further include: sending mixed target media data to a remote terminal (that is, the foregoing conference control system may further include at least one remote terminal). After that, the remote terminal receives the mixed target media data and displays it. In this way, the user of the remote terminal can be provided with an immersive meeting experience of panoramic meeting pictures and panoramic stereo.

In addition, the mixed processing operation of the third media data collected by multiple terminals may not only be executed by the signaling server, but also may be executed by a remote terminal. Specifically, the signaling server receives the third media data collected by multiple terminals, and can forward it to the remote terminal through the streaming media server; after the remote terminal receives the third media data collected by multiple terminals, it can It performs mixing processing to obtain mixed target media data and display it.

Regarding the above-mentioned method applied to the embodiment on the signaling server side, the specific manner of performing operations in each step has been described in detail in the embodiment of the conference control method on the conference control application side, and will not be described in detail here. Elaborate instructions.

Fig. 8 is a block diagram showing a conference control device according to an exemplary embodiment. Referring to FIG. 8, the apparatus 800 may include: an acquiring module 801, configured to acquire identification information of at least one terminal; a first sending module 802, configured to send to a signaling server including the identification information acquired by the acquiring module 801 Wherein, the meeting request is used to instruct the signaling server to add the at least one terminal to the same meeting.

Optionally, the device 800 further includes: a first determining module, configured to determine the first media data to be received by each of the terminals; The server sends the data distribution instruction, where the data distribution instruction is used to instruct the signaling server to send the corresponding first media data to each of the terminals.

Optionally, the device 800 further includes: a second determining module, configured to determine the target terminal to be adjusted and the second media data to be received by the target terminal to be adjusted in response to the data distribution adjustment operation. The second media data is used to replace the first media data; the second generation module is used to generate a data distribution adjustment instruction, and send the data distribution adjustment instruction to the signaling server, wherein the data distribution adjustment The instruction is used to instruct the signaling server to send the second media data to the target terminal to be adjusted.

Optionally, the device 800 further includes: a second receiving module, configured to receive a plurality of third media data collected by the terminal; the first sending module 802, further configured to send to the signaling server The third media data, wherein the third media data is used for mixing processing to generate mixed target media data.

Fig. 9 is a block diagram showing a conference control device according to an exemplary embodiment, where the device can be applied to a signaling server. 9, the device 900 may include: a first receiving module 901 for receiving a meeting request sent by a meeting control application, where the meeting request includes identification information of at least one terminal; a control module 902 for receiving a meeting request according to the The identification information received by the first receiving module 901 controls each of the terminals to join the same conference.

Optionally, the control module 902 includes: a determination sub-module for determining whether the meeting request includes meeting identification information; and a control sub-module for responding to determining that the meeting request does not include the meeting identification information, Create a new conference, and control each of the terminals to join the new conference.

Optionally, the first receiving module 901 is further configured to receive a data distribution instruction, where the data distribution instruction is used to instruct the signaling server to send corresponding first media data to each of the terminals; the device 900 also includes: a second sending module, configured to send the corresponding first media data to the terminal to which data is to be distributed in response to the data distribution instruction.

Optionally, the first receiving module 901 is further configured to receive a data distribution adjustment instruction. The data distribution adjustment instruction is used to instruct the signaling server to send second media data to the target terminal to be adjusted. The second media data is used to replace the first media data; the device 900 further includes: a third sending module, configured to send the second media to the target terminal to be adjusted in response to the data distribution adjustment instruction data.

Optionally, the media data sent by the signaling server to the terminal is encoded data.

Optionally, the first receiving module 901 is further configured to receive third media data collected by a plurality of the terminals; the device 900 further includes: a processing module configured to perform processing on the third media data collected by a plurality of the terminals The third media data is mixed to generate mixed target media data.

Optionally, the terminal is a local terminal; further comprising: a fourth sending module, configured to send the target media data to a remote terminal.

Regarding the device in the foregoing embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment of the method, and a detailed description will not be given here.

The present disclosure also provides a computer-readable medium on which a computer program is stored, which, when executed by a processing device, implements the steps of the conference control method on the conference control application side or the step of the conference control method on the signaling server side.

Referring now to FIG. 10, it shows a schematic structural diagram of an electronic device (for example, the terminal or the signaling server in FIG. 1) 1000 suitable for implementing the embodiments of the present disclosure. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals (e.g. Mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG. 10 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.

As shown in FIG. 10, the electronic device 1000 may include a processing device (such as a central processing unit, a graphics processor, etc.) 1001, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 1002 or from a storage device 1008. The program in the memory (RAM) 1003 executes various appropriate actions and processing. In the RAM 1003, various programs and data required for the operation of the electronic device 1000 are also stored. The processing device 1001, ROM 1002, and RAM 1003 are connected to each other through a bus 1004. An input/output (I/O) interface 1005 is also connected to the bus 1004.

Generally, the following devices can be connected to the I/O interface 1005: including input devices 1006 such as touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, liquid crystal display (LCD), speakers, vibration An output device 1007 such as a device; a storage device 1008 such as a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the electronic device 1000 to perform wireless or wired communication with other devices to exchange data. Although FIG. 10 shows the electronic device 1000 with various devices, it should be understood that it is not required to implement or have all of the illustrated devices. It may be implemented alternatively or provided with more or fewer devices.

In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network through the communication device 1009, or installed from the storage device 1008, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, it executes the above-mentioned functions defined in the method of the embodiment of the present disclosure.

It should be noted that the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium. The computer-readable signal medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device . The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.

In some embodiments, the terminal and the signaling server can communicate with any currently known or future-developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium. Data communications (e.g., communication networks) are interconnected. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (for example, the Internet), and end-to-end networks (for example, ad hoc end-to-end networks), as well as any currently known or future research and development network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device.

The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: obtains identification information of at least one terminal; and sends the identification information including the identification information to the signaling server Wherein, the meeting request is used to instruct the signaling server to add the at least one terminal to the same meeting.

Alternatively, the aforementioned computer-readable medium carries one or more programs, and when the aforementioned one or more programs are executed by the electronic device, the electronic device is caused to receive the meeting request sent by the meeting control application, wherein the meeting request It includes identification information of at least one terminal; according to the identification information, each terminal is controlled to join the same conference.

The computer program code used to perform the operations of the present disclosure can be written in one or more programming languages or a combination thereof. The above-mentioned programming languages include, but are not limited to, object-oriented programming languages—such as Java, Smalltalk, C++, and Including conventional procedural programming languages-such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to Connect via the Internet).

The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions, and operations of the system, method, and computer program product according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram can represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logic function. Executable instructions. It should also be noted that, in some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks shown one after the other can actually be executed substantially in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by a combination of dedicated hardware and computer instructions.

The modules involved in the embodiments described in the present disclosure can be implemented in software or hardware. Wherein, the name of the module does not constitute a limitation on the module itself under certain circumstances. For example, the first receiving module can also be described as "a module that receives a meeting request sent by a meeting control application."

The functions described herein above may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logical device (CPLD) and so on.

In the context of the present disclosure, a machine-readable medium may be a tangible medium, which may contain or store a program for use by the instruction execution system, apparatus, or device or in combination with the instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, there is provided a conference control method applied to a conference control application, including: acquiring identification information of at least one terminal; sending a conference request including the identification information to a signaling server, Wherein, the meeting request is used to instruct the signaling server to add the at least one terminal to the same meeting.

According to one or more embodiments of the present disclosure, the method further includes: determining the first media data to be received by each of the terminals; generating a data distribution instruction, and sending the data distribution instruction to the signaling server, wherein The data distribution instruction is used to instruct the signaling server to send the corresponding first media data to each of the terminals.

According to one or more embodiments of the present disclosure, the method further includes: in response to a data distribution adjustment operation, determining a target terminal to be adjusted and second media data to be received by the target terminal to be adjusted, wherein the second media Data is used to replace the first media data; generate a data distribution adjustment instruction, and send the data distribution adjustment instruction to the signaling server, wherein the data distribution adjustment instruction is used to instruct the signaling server to send the The target terminal to be adjusted sends the second media data.

According to one or more embodiments of the present disclosure, the method further includes: receiving third media data collected by a plurality of the terminals; sending the third media data to the signaling server, wherein the third media data It is used for mixing processing to generate mixed target media data.

According to one or more embodiments of the present disclosure, there is provided a conference control method applied to a signaling server, including: receiving a conference request sent by a conference control application, wherein the conference request includes identification information of at least one terminal ; According to the identification information, control each of the terminals to join the same conference.

According to one or more embodiments of the present disclosure, the controlling each of the terminals to join the same meeting includes: determining whether the meeting request includes meeting identification information; in response to determining that the meeting request does not include the Conference identification information, create a new conference, and control each of the terminals to join the new conference.

According to one or more embodiments of the present disclosure, the method further includes: receiving a data distribution instruction, where the data distribution instruction is used to instruct the signaling server to send corresponding first media data to each of the terminals; in response to the The data distribution instruction sends the corresponding first media data to the terminal to be distributed.

According to one or more embodiments of the present disclosure, the method further includes: receiving a data distribution adjustment instruction, where the data distribution adjustment instruction is used to instruct the signaling server to send second media data to the target terminal to be adjusted, and the second The media data is used to replace the first media data; in response to the data distribution adjustment instruction, the second media data is sent to the target terminal to be adjusted.

According to one or more embodiments of the present disclosure, the media data sent by the signaling server to the terminal is encoded data.

According to one or more embodiments of the present disclosure, the method further includes: receiving third media data collected by a plurality of the terminals; performing mixing processing on the third media data collected by the plurality of terminals to generate a mixed After the target media data.

According to one or more embodiments of the present disclosure, the terminal is a local terminal; and the method further includes: sending the target media data to a remote terminal.

According to one or more embodiments of the present disclosure, there is provided a conference control device, including: an acquiring module, configured to acquire identification information of at least one terminal; and a first sending module, configured to send to a signaling server including the acquired The meeting request of the identification information acquired by the module, wherein the meeting request is used to instruct the signaling server to add the at least one terminal to the same meeting.

According to one or more embodiments of the present disclosure, there is provided a conference control device, which is applied to a signaling server, and includes: a first receiving module configured to receive a conference request sent by a conference control application, wherein the conference request It includes identification information of at least one terminal; a control module, configured to control each of the terminals to join the same conference according to the identification information received by the first receiving module.

According to one or more embodiments of the present disclosure, there is provided a computer-readable medium having a computer program stored thereon, which, when executed by a processing device, realizes the steps or all of the meeting control method on the meeting control application side. The steps of the conference control method on the signaling server side are described.

According to one or more embodiments of the present disclosure, there is provided an electronic device including: a storage device on which a computer program is stored; and a processing device for executing the computer program in the storage device to realize the The steps of the conference control method on the conference control application side are described.

According to one or more embodiments of the present disclosure, there is provided an electronic device including: a storage device on which a computer program is stored; and a processing device for executing the computer program in the storage device to realize the The steps of the conference control method on the signaling server side are described.

It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. For the system or device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part can refer to the description of the method part.

It should be understood that in this application, "at least one (item)" refers to one or more, and "multiple" refers to two or more. "And/or" is used to describe the association relationship of associated objects, indicating that there can be three types of relationships. For example, "A and/or B" can mean: only A, only B, and both A and B. , Where A and B can be singular or plural. The character "/" generally indicates that the associated objects before and after are in an "or" relationship. "The following at least one item (a)" or similar expressions refers to any combination of these items, including any combination of a single item (a) or a plurality of items (a). For example, at least one (a) of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c" ", where a, b, and c can be single or multiple.

It should also be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or operations. There is any such actual relationship or order between. Moreover, the terms "including", "including" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device that includes a series of elements includes not only those elements, but also those that are not explicitly listed Other elements of, or also include elements inherent to this process, method, article or equipment. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or equipment that includes the element.

The steps of the method or algorithm described in combination with the embodiments disclosed herein can be directly implemented by hardware, a software module executed by a processor, or a combination of the two. The software module can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or all areas in the technical field. Any other known storage media.

The foregoing description of the disclosed embodiments enables those skilled in the art to implement or use this application. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the application. Therefore, this application will not be limited to the embodiments shown in this document, but should conform to the widest scope consistent with the principles and novel features disclosed in this document.

Claims

A conference control method, applied to a conference control application, includes:

Acquiring identification information of at least one terminal;

Send a meeting request including the identification information to a signaling server, where the meeting request is used to instruct the signaling server to add the at least one terminal to the same meeting.
The method according to claim 1, further comprising:

Determine the first media data to be received by each of the terminals;

Generate a data distribution instruction and send the data distribution instruction to the signaling server, where the data distribution instruction is used to instruct the signaling server to send the corresponding first media data to each of the terminals.
The method according to claim 2, wherein said determining the first media data to be received by each said terminal comprises:

After the drag operation is detected, the dragged media data is determined as the first media data to be received by the terminal corresponding to the terminal icon at the end position of the drag operation.
The method according to claim 3, further comprising:

A terminal icon and candidate media data corresponding to each terminal are displayed on the interface of the conference control application, and the dragged media data is any media data in the candidate media data.
The method according to any one of claims 2-4, the first media data includes at least one of a local video, a remote video, or a shared picture.
The method according to claim 2, further comprising:

In response to the data distribution adjustment operation, determining a target terminal to be adjusted and second media data to be received by the target terminal to be adjusted, where the second media data is used to replace the first media data;

Generate a data distribution adjustment instruction, and send the data distribution adjustment instruction to the signaling server, where the data distribution adjustment instruction is used to instruct the signaling server to send the second data distribution adjustment instruction to the target terminal to be adjusted. Media data.
The method according to claim 6, wherein, in response to a data distribution adjustment operation, determining the target terminal to be adjusted and the second media data to be received by the target terminal to be adjusted comprises:

After the drag operation is detected, the terminal corresponding to the terminal icon at the end of the drag operation is determined as the target terminal to be adjusted, and the dragged media data is determined as the second to be received by the target terminal to be adjusted. Media data.
The method according to claim 6, wherein, in response to a data distribution adjustment operation, determining the target terminal to be adjusted and the second media data to be received by the target terminal to be adjusted comprises:

After the drag operation is detected, the first terminal corresponding to the dragged terminal icon and the second terminal corresponding to the terminal icon at the end position of the drag operation are both determined as the target terminal to be adjusted;

Determine the first media data currently received by the first terminal as the second media data to be received by the second terminal and determine the first media data currently received by the second terminal as the first media data The second media data to be received by a terminal.
The method according to claim 1, further comprising:

Receiving a plurality of third media data collected by the terminal;

Sending the third media data to the signaling server, where the third media data is used for mixing processing to generate mixed target media data.
The method according to claim 9, wherein the third media data includes video data and/or audio data.
A conference control method, applied to a signaling server, includes:

Receiving a meeting request sent by a meeting control application, where the meeting request includes identification information of at least one terminal;

According to the identification information, control each of the terminals to join the same conference.
The method according to claim 11, wherein said controlling each said terminal to join the same conference comprises:

Determining whether the meeting request includes meeting identification information;

In response to determining that the meeting request does not include the meeting identification information, a new meeting is created, and each terminal is controlled to join the new meeting.
The method according to claim 11, further comprising:

Receiving a data distribution instruction, where the data distribution instruction is used to instruct the signaling server to send corresponding first media data to each of the terminals;

In response to the data distribution instruction, the corresponding first media data is sent to the terminal to be distributed.
The method according to claim 13, further comprising:

Receiving a data distribution adjustment instruction, where the data distribution adjustment instruction is used to instruct the signaling server to send second media data to a target terminal to be adjusted, and the second media data is used to replace the first media data;

In response to the data distribution adjustment instruction, the second media data is sent to the target terminal to be adjusted.
The method according to claim 13 or 14, wherein the media data sent by the signaling server to the terminal is coded data.
The method according to claim 11, further comprising:

Receiving a plurality of third media data collected by the terminal;

Perform mixing processing on the third media data collected by the multiple terminals to generate mixed target media data.
The method according to claim 16, wherein said receiving a plurality of third media data collected by said terminal comprises:

Receiving a plurality of third media data collected by the terminal and sent by the conference control application program.
The method according to claim 16 or 17, wherein the terminal is a local terminal;

Also includes:

Send the target media data to the remote terminal.
A conference control device applied to a conference control application program, including:

An obtaining module for obtaining identification information of at least one terminal;

The first sending module is configured to send a meeting request including the identification information acquired by the acquiring module to the signaling server, where the meeting request is used to instruct the signaling server to add the at least one terminal to the In the same meeting.
A conference control device applied to a signaling server, including:

The first receiving module is configured to receive a meeting request sent by a meeting control application, where the meeting request includes identification information of at least one terminal;

The control module is configured to control each of the terminals to join the same conference according to the identification information received by the first receiving module.
A computer-readable medium with a computer program stored thereon, wherein the program is executed by a processing device to implement the steps of the method in any one of claims 1-18.
An electronic device including:

A storage device on which a computer program is stored;

The processing device is configured to execute the computer program in the storage device to implement the steps of the method in any one of claims 1-10.
An electronic device including:

A storage device on which a computer program is stored;

The processing device is configured to execute the computer program in the storage device to implement the steps of the method in any one of claims 11-18.