CN112866619A - Teleconference control method and device, electronic equipment and storage medium - Google Patents
Teleconference control method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112866619A CN112866619A CN202110011016.2A CN202110011016A CN112866619A CN 112866619 A CN112866619 A CN 112866619A CN 202110011016 A CN202110011016 A CN 202110011016A CN 112866619 A CN112866619 A CN 112866619A
- Authority
- CN
- China
- Prior art keywords
- conference
- user interface
- teleconference
- audio signal
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/155—Conference systems involving storage of or access to video conference sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/157—Conference systems defining a virtual conference space and using avatars or agents
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The application provides a teleconference control method, a teleconference control device, electronic equipment and a storage medium, wherein the teleconference control method comprises the following steps: responding to the remote control instruction, and operating the remote conference service; capturing a user interface image of a teleconference service and a conference audio signal; and streaming the captured user interface image and the conference audio signal to a participant end running the immersive conference service, so that the participant end plays the conference audio signal and displays the user interface image in a three-dimensional virtual conference scene picture displayed by the participant end in an embedded manner. The scheme enables users of the immersive conference to watch the user interface images of the teleconference service at the participant ends running the immersive conference service, and realizes sharing of teleconference content.
Description
Technical Field
The present disclosure relates to the field of internet technologies, and in particular, to a teleconference control method, a teleconference control system, a teleconference control apparatus, an electronic device, and a computer-readable storage medium.
Background
Online meetings, in short, are relatively speaking offline. One type of online meeting, known as desktop sharing, allows participants to see a particular user screen. This may include presentations such as videos, multimedia files, and presentations. From offline to online, the organization, participation, and interaction of the conference change, but the core elements of the conference remain unchanged: high quality content + social interaction to establish connections + rituals of the meeting. The on-line meeting platform needs to continuously attract the attention of audiences and create ceremonial feelings on the line.
At present, a plurality of teleconference systems are available in the market, including internet cloud conferences, enterprise WeChat, Tencent conferences, nailing, book flying, Hua cloud WeLink, zoom and the like, and the systems are dedicated to the fact that users can conveniently access the conferences and provide real-time voice and video communication functions, such as one-to-one audio and video calls, multi-person audio and video conferences, multi-person microphone connection, high-quality audio and video recording and storage and the like.
However, these teleconference systems are independently developed by respective companies, and only users who enter the same conference using the same conference system can receive conference contents. Different conference systems are independent and not communicated with each other.
Disclosure of Invention
The embodiment of the application provides a teleconference control method, which is used for realizing the sharing of teleconference content.
The embodiment of the application provides a teleconference control method, which comprises the following steps:
responding to the remote control instruction, and operating the remote conference service;
capturing a user interface image of the teleconferencing service and a conference audio signal;
and streaming the captured user interface image and the conference audio signal to a participant terminal running an immersive conference service, so that the participant terminal plays the conference audio signal and displays the user interface image in a three-dimensional virtual conference scene picture displayed by the participant terminal in an embedded manner.
In one embodiment, the operating the remote conference service in response to the remote manipulation instruction includes:
establishing remote connection with a remote control terminal through a transfer server;
and receiving a remote control instruction of the remote control terminal through the transfer server, and sending a remote conference establishing request or sending a remote conference joining request.
In an embodiment, the method further comprises:
the user interface of the teleconference service displays a conference presentation file.
In one embodiment, the capturing of the user interface image of the teleconference service and the conference audio signal comprises:
and operating an audio and video frame capturing program through the transit server to capture a conference audio signal and a user interface image of the teleconference service.
In an embodiment, prior to streaming the captured user interface image and conference audio signal to a participant running an immersive conferencing service, the method further comprises:
receiving a meeting participation request of a designated meeting sent by the meeting participation end, and acquiring a three-dimensional virtual meeting scene picture corresponding to the designated meeting;
and sending the scene picture of the three-dimensional virtual conference to the participating terminal for displaying.
In an embodiment, the method further comprises:
receiving user registration information which is sent by the participant terminal and contains personal photos of the participants and the selected virtual roles;
and generating a virtual character corresponding to the participant in the three-dimensional virtual conference scene picture by an intelligent face pinching technology according to the personal photo of the participant and the selected virtual character.
In one embodiment, said streaming the captured user interface image and conference audio signal to a participant running an immersive conferencing service comprises:
the captured conference audio signal and the user interface image are pushed to a live broadcast server through a transit server;
and forwarding the conference audio signal and the user interface image to a participant end running the immersive conference service through a live broadcast publishing program at the storage address of the live broadcast server.
An embodiment of the present application further provides a teleconference control system, including:
the remote control terminal is used for sending a remote control instruction to the server;
the server is used for responding to the remote control instruction and operating the remote conference service; capturing a user interface image of the teleconferencing service and a conference audio signal; streaming the captured user interface image and conference audio signals to a participant end running an immersive conference service;
and the participating end is used for playing the conference audio signal and displaying the user interface image in a displayed three-dimensional virtual conference scene picture in an embedded mode.
In one embodiment, the server includes:
the transfer server is used for establishing remote connection with a remote control terminal, receiving a remote control instruction of the remote control terminal and sending a remote conference establishing request or sending a remote conference joining request; displaying a conference presentation file on a user interface of the remote conference service, operating an audio and video frame capturing program, capturing a conference audio signal and a user interface image of the remote conference service, and pushing the captured conference audio signal and the user interface image to a live broadcast server;
and the live broadcast server is used for storing the conference audio signal and the user interface image and forwarding the storage addresses of the conference audio signal and the user interface image to the participant terminal through a live broadcast release program.
In an embodiment, the server further includes:
the immersive conference server is used for receiving the user registration information which is sent by the participant terminal and contains the personal photos of the participants and the selected virtual roles; generating a virtual character corresponding to the participant in the three-dimensional virtual conference scene picture through an intelligent face pinching technology according to the personal photo of the participant and the selected virtual character;
receiving a meeting participation request of a designated meeting sent by the meeting participation end, and acquiring a three-dimensional virtual meeting scene picture corresponding to the designated meeting; and sending the scene picture of the three-dimensional virtual conference to the participating terminal.
In an embodiment, the participating terminal is configured to display a three-dimensional virtual conference scene picture, play the conference audio signal through an embedded browser, and display the user interface image in a virtual curtain of the three-dimensional virtual conference scene picture.
An embodiment of the present application provides a teleconference control apparatus, including:
the conference entering module is used for responding to the remote control instruction and operating the remote conference service;
a conference frame capture module for capturing a user interface image of the teleconference service and a conference audio signal;
and the video pushing module is used for streaming the captured user interface image and the conference audio signal to a participant end running the immersive conference service so that the participant end plays the conference audio signal and displays the user interface image in a three-dimensional virtual conference scene picture displayed by the participant end in an embedded manner.
An embodiment of the present application provides an electronic device, which includes:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform the above-described teleconference control method.
Embodiments of the present application provide a computer-readable storage medium storing a computer program, which is executable by a processor to perform a teleconference control method.
According to the technical scheme provided by the embodiment of the application, the teleconference service can be operated by receiving the remote control instruction, the user interface image and the conference audio signal of the teleconference service are captured, and the captured user interface image and the conference audio signal are streamed to the participant end of the immersive conference, so that the participant end of the immersive conference can play the conference audio signal, the user interface image is embedded and displayed in the three-dimensional virtual conference scene picture, a user of the immersive conference can watch the user interface image of the teleconference service at the participant end of the immersive conference service, and the sharing of the teleconference content is realized.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the embodiments of the present application will be briefly described below.
Fig. 1 is a schematic architecture diagram of a teleconference control system provided in an embodiment of the present application;
fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a teleconference control method according to an embodiment of the present application;
fig. 4 is a schematic diagram of a user interface for embedded display of a teleconference in a three-dimensional virtual conference scene screen according to an embodiment of the present application;
FIG. 5 is a flowchart illustrating steps of a teleconference control method according to the embodiment shown in FIG. 3;
fig. 6 is a block diagram of a teleconference control apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
Like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Fig. 1 is a schematic structural diagram of a teleconference control system according to an embodiment of the present application. As shown in fig. 1, the teleconference system 100 includes: a plurality of teleconference participants 101, a teleconference server 102, a remote control terminal 103, a server 110, and a plurality of immersive conference participants 104. The remote control terminal 103 may be a desktop computer or a notebook computer, the teleconference server 102 may be one or more servers, and the participant terminal 101 of the teleconference may be a smart phone, a notebook computer or a desktop computer that runs a teleconference service (e.g., runs a teleconference software application APP, and opens a teleconference web page through a browser). The participant end 104 of the immersive conference may be a smartphone, laptop, or desktop computer running an immersive conference service (e.g., running an immersive conference software application APP, opening an immersive conference web page through a browser). The server 110 may be a server cluster.
The remote control terminal 103 is connected with the server 110 through a wireless network, and the server 110 is connected with the participant terminal 104 of the immersive conference through a wireless network. The participating terminals 101 of the teleconference are connected with the teleconference server 102 through a wireless network.
The server 110 may include a relay server 111, the relay server 111 may be a virtual machine, and the remote control terminal 103 may establish remote communication with the relay server 111. The remote control terminal 103 may transmit a remote manipulation instruction to the relay server 111 so that the relay server 111 is remotely controlled by the remote control terminal 103. The remote control terminal 103 may control the relay server 111 to run a teleconference service, which may be an existing teleconference service such as a spiked video conference, an internet cloud conference, and the like. The relay server 111, by running the teleconference service, may log in using the teleconference user account and send a teleconference creation request or a teleconference joining request to the teleconference server 102. So that the transit server 111 and the participating terminals 101 of a plurality of teleconference can perform the teleconference through the teleconference server 102. The teleconference user registered in the relay server 111 may be an instructor or an audience. In this case, the relay server 111 corresponds to one of the participating terminals participating in the teleconference. The transit server 111 may display the conference presentation file in a user interface.
Thereafter, the transit server 111 may run an audio-video frame grabber to capture conference audio signals and user interface images of the teleconference service. The conference audio signal may be transmitted to the relay server 111 by the remote control terminal 103 or the participant terminal 101 of the teleconference. The user interface images may be captured at preset time intervals to form successive video frames.
The transit server 111 may stream the captured user interface image and the conference audio signal to the participant 104 running the immersive conference service, and the participant 104 of the immersive conference may play the conference audio signal and display the user interface image in a displayed three-dimensional virtual conference scene screen in an embedded manner.
The server 110 may include a live broadcast server 112, and the transit server 111 may push the user interface image and the conference audio signal to the live broadcast server 112, where the live broadcast server 112 stores the conference audio signal and the user interface image, and forwards the storage addresses of the conference audio signal and the user interface image to the participant 104 of the immersive conference through a live broadcast program. And the participant end 104 of the immersive conference acquires the user interface image and the conference audio signal according to the storage address to play. Specifically, the participating end can play the conference audio signal and display the user interface image in the virtual curtain of the three-dimensional virtual conference scene picture through the embedded browser in the display process of the three-dimensional virtual conference scene picture.
In one embodiment, the server 110 may include an immersive conference server 113, and the immersive conference server 113 may receive user registration information containing personal photos of participants and selected virtual characters sent by the participants 104 of the immersive conference; and generating a virtual character corresponding to the participant in the three-dimensional virtual conference scene picture by an intelligent face pinching technology according to the personal photo of the participant and the selected virtual character. Therefore, the virtual character in the scene picture of the three-dimensional virtual conference can be similar to the appearance of the participant, and the conference substitution feeling of the participant is improved.
When receiving a conference participation request of a designated conference, which is sent by a conference participant 104 of the immersive conference, acquiring a three-dimensional virtual conference scene picture corresponding to the designated conference; and sending the three-dimensional virtual conference scene picture to the participant end 104 of the immersive conference for display.
In the above solution, the transit server 111 is remotely controlled to run a teleconference service, and becomes one of the participating terminals 101 of the teleconference, and sends the user interface image and the conference audio signal of the teleconference to the participating terminal 104 of the immersive conference through the live server 112. Therefore, when the participant end 104 of the immersive conference displays the three-dimensional virtual conference scene picture, the user interface image of the teleconference can be embedded in the picture, and the conference audio signal can be played, so that the user of the immersive conference can personally view the user interface of the teleconference.
Fig. 2 is a schematic structural diagram of an electronic device provided in an embodiment of the present application, where the electronic device 200 may include a processor 210 and a memory 220 for storing instructions executable by the processor 210; wherein the processor 210 is configured to execute a teleconference control method provided by the following embodiments of the present application. In an embodiment, the electronic device 200 may be the server 110, and the transit server, the live server, and the immersive conference server may be virtual machines in the electronic device 200.
Embodiments of the present application also provide a computer-readable storage medium, which stores a computer program, where the computer program is executable by the processor 210 to implement the teleconference control method described below.
Fig. 3 is a schematic flowchart of a teleconference control method according to an embodiment of the present application. As shown in fig. 3, the method may be performed by the server 110, and the server 110 may include the transit server 111, the live server 112, and the immersive conference server 113, and the method includes the following steps S310 to S330.
Step S310: the transfer server responds to the remote control instruction and operates the remote conference service.
The teleconference service may be a software application for performing a teleconference or a web page for performing a teleconference, among others. Taking the internet cloud conference as an example, the server can receive a remote control instruction sent by an external computer (i.e., a remote control terminal) by operating the transfer server, open the software application of the internet cloud conference, log in through a conference account of the internet cloud conference, and then initiate a teleconference, so that participants of other teleconferences can join in, or join in an existing teleconference. The transfer server of the server can also open a remote conference login page through the browser, log in through the conference account, and then initiate a remote conference to enable participants of other remote conferences to join in or join in an existing remote conference.
In an embodiment, to initiate a teleconference or join an existing teleconference, the transit server of the server may first establish a remote connection between the transit server and the remote control terminal, and the transit server receives a remote control command from the remote control terminal, for example, clicking a conference creation button or a conference joining button, so as to send a teleconference creation request to the teleconference server or send a teleconference joining request to the teleconference server, create a new teleconference or join an existing teleconference.
After entering the teleconference, if the user where the relay server is located is an instructor, the relay server may receive a remote control instruction from the remote control terminal, for example, click a window sharing button, and display a conference presentation file on a user interface of the teleconference. If the user where the relay server is located is an audience, the relay server can also receive the conference demonstration file shared by the participating terminals of the teleconference through the teleconference server, and the shared conference demonstration file is displayed on the user interface of the teleconference service. The conference presentation file may be a presentation, text document, video, image, or the like.
Step S320: a transit server captures a user interface image of the teleconference service and a conference audio signal.
The user interface image may be an image obtained by intercepting a window of the teleconference software application, or may be a page image intercepted after opening a teleconference web page through a browser. In one embodiment, the transit server is remotely controlled, and can initiate a conference or join a conference after logging in a teleconference through a conference account, and capture a user interface image and a conference audio signal after successfully entering the conference.
For example, the transfer server is remotely controlled, opens an internet easy cloud conference software application, inputs a conference account number for logging in, intercepts a window of the software application after entering a specified remote conference, and takes an obtained image as a user interface image.
For example, the transfer server is remotely controlled, a browser is opened, a website of the internet access cloud conference is input, a webpage of the internet access cloud conference is opened, then a conference account is input for logging in, and after a specified remote conference is entered, a page image is captured.
In one embodiment, the user interface image may include pages of a conference presentation file shared in the teleconference, and optionally may also include the avatar of a person participating in the teleconference. Alternatively, in a particular conference display mode, for example, in full screen mode, the user interface image may contain only pages of the conference presentation file.
In an embodiment, the server may capture the received conference audio signal and the user interface image of the teleconference service by running an audio/video frame capturing program of the transit server. Alternatively, the transit server may capture the user interface image at preset time intervals. For example, the user interface image of the "internet easy cloud conference" conference software application is intercepted 60 times per second, and 60 user interface images are obtained.
The conference audio signal can be sent to the transfer server by the conference end of the teleconference through the teleconference server, and can also be sent to the transfer server by the remote control terminal. The conference audio signal may be considered as the content of a speech utterance during the teleconference.
Step S330: and the transfer server streams the captured user interface image and the conference audio signal to a participant terminal running an immersive conference service through a live broadcast server, so that the participant terminal plays the conference audio signal and displays the user interface image in a three-dimensional virtual conference scene picture displayed by the participant terminal in an embedded manner.
Wherein the immersive conferencing service is another conferencing service different from the teleconferencing services listed above. The participating end of the operation immersive conference service can display three-dimensional virtual conference scene pictures, so that a virtual conference environment is created, an immersive feeling is provided for a user, and the conference substitution feeling of the user is increased. The three-dimensional virtual conference scene picture can be sent to a participant terminal of the immersive conference by an immersive conference server of the server terminal. The participating end of the immersive conference can be a computer or a smart phone which logs in the immersive conference software application through an account and enters the appointed conference, or can also be a computer or a smart phone which opens an immersive conference webpage through a browser, logs in through the account and enters the appointed conference.
In one embodiment, the immersive conference server of the server can receive a conference participation request of a specified conference sent by the conference participants of the immersive conference. For example, a meeting request for participating in the xx international meeting is obtained, and a three-dimensional virtual meeting scene picture corresponding to the specified meeting is obtained. Different three-dimensional virtual conference scene pictures can be configured in advance for different conferences, so that the three-dimensional virtual conference scene pictures are closer to a real conference scene, and a more real virtual conference scene is created. And the immersive conference server of the server receives a conference participation request of a specified conference, and can acquire a three-dimensional virtual conference scene picture corresponding to the specified conference, which is configured in advance, from the database. For example, a three-dimensional virtual scene picture of xx international conferences configured in advance. And the immersive conference server of the server side can send the three-dimensional virtual conference scene picture to the participant side of the immersive conference for display.
And after receiving the conference audio signal, the participant end of the immersive conference can play the conference audio signal. The embedded display refers to displaying a user interface image in a designated area of a three-dimensional virtual conference scene picture. In one embodiment, as shown in fig. 4, a virtual curtain is included in the three-dimensional virtual conference scene picture, and in order to improve the conference immersive experience, a user interface image may be displayed in the virtual curtain.
Streaming refers to sending one frame to a participant of the immersive conference each time one frame of the user interface image is captured. The conference audio signals are collected and sent to the participant terminals of the immersive conference.
In an embodiment, the server may push the captured conference audio signal and the user interface image to a live server of the server through a relay server, and the server forwards the conference audio signal and the user interface image to a participant end running the immersive conference service through a live publishing program at a storage address of the live server.
Therefore, the conference participating end of the immersive conference can acquire the conference audio signal and the user interface image from the live broadcast server through the storage address to play. The user interface image can be embedded and displayed in the three-dimensional virtual scene picture.
Through the technical scheme provided by the embodiment of the disclosure, the teleconference service and the immersive conference service do not need secondary development, the server can be used as an intermediary between the teleconference service and the immersive conference service to connect the teleconference service and the immersive conference service, and the interaction of audio and video images, PPT demonstration and participants in the teleconference service and the interaction of the PPT demonstration and the participants synchronously enter the immersive conference to be played.
According to the technical scheme provided by the embodiment of the application, the teleconference service can be operated by receiving the remote control instruction, the user interface image and the conference audio signal of the teleconference service are captured, and the captured user interface image and the conference audio signal are streamed to the participant end of the immersive conference, so that the participant end of the immersive conference can play the conference audio signal, the user interface image is embedded and displayed in the three-dimensional virtual conference scene picture, a user of the immersive conference can watch the user interface image of the teleconference service at the participant end of the immersive conference service, and the sharing of the teleconference content is realized.
In an embodiment, as shown in fig. 5, a teleconference control method provided in an embodiment of the present application further includes:
step S510: and receiving user registration information which is sent by the participant terminal and contains the personal photos of the participants and the selected virtual roles.
The user registration information includes personal photos of the participants, the selected virtual roles, user contact information and the like. The immersive conference server of the server can receive user registration information sent by the participants running the immersive conference service.
Step S520: and generating a virtual character corresponding to the participant in the three-dimensional virtual conference scene picture by an intelligent face pinching technology according to the personal photo of the participant and the selected virtual character.
The intelligent face pinching technology is used for generating new face feature parameters of the virtual character through a model according to the face features of the personal photos of the participants and the original face features of the selected virtual character. The model can be obtained by training a large amount of sample data.
The virtual character generated based on the personal photograph of the participant resembles the face of the participant and thus may improve the sense of substitution of the participant in the immersive conference.
In one embodiment, the participating end of the immersive conference can receive an action instruction triggered by the user, and control the virtual character to perform a corresponding action, such as forward, backward, sit down, and the like. The participant end of the immersive conference can receive a visual angle switching instruction triggered by a user, and a specified picture of the three-dimensional virtual conference scene is displayed at a corresponding visual angle.
Therefore, the conference end of the immersive conference not only can display the conference content of the teleconference, but also can build a vivid virtual conference scene, so that participants of the immersive conference have an immersive conference experience.
The following are embodiments of the apparatus of the present application, which may be used to implement the above-mentioned embodiments of the teleconference control method of the present application. For details not disclosed in the embodiments of the apparatus of the present application, please refer to the embodiments of the teleconference control method of the present application.
Fig. 6 is a block diagram of a teleconference control apparatus according to an embodiment of the present application. As shown in fig. 6, the apparatus includes: a conference entry module 610, a conference frame grabber module 620, and a video push module 630.
A conference entering module 610, configured to respond to the remote control instruction and run a remote conference service;
a conference frame capture module 620 for capturing a user interface image of the teleconferencing service and a conference audio signal;
the video pushing module 630 is configured to stream the captured user interface image and the conference audio signal to a participant terminal running an immersive conference service, so that the participant terminal plays the conference audio signal and displays the user interface image in a three-dimensional virtual conference scene picture displayed by the participant terminal in an embedded manner.
The implementation processes of the functions and actions of each module in the device are specifically described in the implementation processes of the corresponding steps in the teleconference control method, and are not described herein again.
In the embodiments provided in the present application, the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Claims (14)
1. A teleconference control method characterized by comprising:
responding to the remote control instruction, and operating the remote conference service;
capturing a user interface image of the teleconferencing service and a conference audio signal;
and streaming the captured user interface image and the conference audio signal to a participant terminal running an immersive conference service, so that the participant terminal plays the conference audio signal and displays the user interface image in a three-dimensional virtual conference scene picture displayed by the participant terminal in an embedded manner.
2. The method of claim 1, wherein the operating the teleconferencing service in response to the telemanipulation instruction comprises:
establishing remote connection with a remote control terminal through a transfer server;
and receiving a remote control instruction of the remote control terminal through the transfer server, and sending a remote conference establishing request or sending a remote conference joining request.
3. The method of claim 2, further comprising:
the user interface of the teleconference service displays a conference presentation file.
4. The method of claim 1, wherein capturing the user interface image of the teleconferencing service and the conference audio signal comprises:
and operating an audio and video frame capturing program through the transit server to capture a conference audio signal and a user interface image of the teleconference service.
5. The method of claim 1, wherein prior to streaming the captured user interface image and conference audio signal to a participant running an immersive conferencing service, the method further comprises:
receiving a meeting participation request of a designated meeting sent by the meeting participation end, and acquiring a three-dimensional virtual meeting scene picture corresponding to the designated meeting;
and sending the scene picture of the three-dimensional virtual conference to the participating terminal for displaying.
6. The method of claim 1, further comprising:
receiving user registration information which is sent by the participant terminal and contains personal photos of the participants and the selected virtual roles;
and generating a virtual character corresponding to the participant in the three-dimensional virtual conference scene picture by an intelligent face pinching technology according to the personal photo of the participant and the selected virtual character.
7. The method of claim 1, wherein said streaming the captured user interface image and conference audio signal to a participant running an immersive conferencing service comprises:
the captured conference audio signal and the user interface image are pushed to a live broadcast server through a transit server;
and forwarding the conference audio signal and the user interface image to a participant end running the immersive conference service through a live broadcast publishing program at the storage address of the live broadcast server.
8. A teleconference control system characterized by comprising:
the remote control terminal is used for sending a remote control instruction to the server;
the server is used for responding to the remote control instruction and operating the remote conference service; capturing a user interface image of the teleconferencing service and a conference audio signal; streaming the captured user interface image and conference audio signals to a participant end running an immersive conference service;
and the participating end is used for playing the conference audio signal and displaying the user interface image in a displayed three-dimensional virtual conference scene picture in an embedded mode.
9. The teleconference control system according to claim 8, wherein the server side comprises:
the transfer server is used for establishing remote connection with a remote control terminal, receiving a remote control instruction of the remote control terminal and sending a remote conference establishing request or sending a remote conference joining request; displaying a conference presentation file on a user interface of the remote conference service, operating an audio and video frame capturing program, capturing a conference audio signal and a user interface image of the remote conference service, and pushing the captured conference audio signal and the user interface image to a live broadcast server;
and the live broadcast server is used for storing the conference audio signal and the user interface image and forwarding the storage addresses of the conference audio signal and the user interface image to the participant terminal through a live broadcast release program.
10. The teleconference control system according to claim 8, wherein the server side further comprises:
the immersive conference server is used for receiving the user registration information which is sent by the participant terminal and contains the personal photos of the participants and the selected virtual roles; generating a virtual character corresponding to the participant in the three-dimensional virtual conference scene picture through an intelligent face pinching technology according to the personal photo of the participant and the selected virtual character;
receiving a meeting participation request of a designated meeting sent by the meeting participation end, and acquiring a three-dimensional virtual meeting scene picture corresponding to the designated meeting; and sending the scene picture of the three-dimensional virtual conference to the participating terminal.
11. The teleconference control system according to claim 8, wherein the participating terminals are configured to display a three-dimensional virtual conference scene picture, and to display the user interface image in a virtual curtain of the three-dimensional virtual conference scene picture by playing the conference audio signal through an embedded browser.
12. A teleconference control apparatus characterized by comprising:
the conference entering module is used for responding to the remote control instruction and operating the remote conference service;
a conference frame capture module for capturing a user interface image of the teleconference service and a conference audio signal;
and the video pushing module is used for streaming the captured user interface image and the conference audio signal to a participant end running the immersive conference service so that the participant end plays the conference audio signal and displays the user interface image in a three-dimensional virtual conference scene picture displayed by the participant end in an embedded manner.
13. An electronic device, characterized in that the electronic device comprises:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform the teleconference control method of any one of claims 1-7.
14. A computer-readable storage medium, characterized in that the storage medium stores a computer program executable by a processor to perform the teleconference control method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110011016.2A CN112866619B (en) | 2021-01-05 | 2021-01-05 | Teleconference control method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110011016.2A CN112866619B (en) | 2021-01-05 | 2021-01-05 | Teleconference control method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112866619A true CN112866619A (en) | 2021-05-28 |
| CN112866619B CN112866619B (en) | 2021-12-28 |
Family
ID=76004117
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110011016.2A Active CN112866619B (en) | 2021-01-05 | 2021-01-05 | Teleconference control method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112866619B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113938336A (en) * | 2021-11-15 | 2022-01-14 | 网易（杭州）网络有限公司 | Conference control method and device and electronic equipment |
| CN114095671A (en) * | 2021-11-11 | 2022-02-25 | 北京有竹居网络技术有限公司 | Cloud conference live broadcast system, method, device, equipment and medium |
| CN114531564A (en) * | 2022-03-01 | 2022-05-24 | 联想(北京)有限公司 | Processing method and electronic equipment |
| CN114615455A (en) * | 2022-01-24 | 2022-06-10 | 北京师范大学 | Teleconference processing method, teleconference processing device, teleconference system, and storage medium |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006005526A (en) * | 2004-06-16 | 2006-01-05 | Nippon Telegr & Teleph Corp <Ntt> | Video conference terminal, system and method |
| CN102263772A (en) * | 2010-05-28 | 2011-11-30 | 经典时空科技(北京)有限公司 | Virtual conference system based on three-dimensional technology |
| JP2014220649A (en) * | 2013-05-08 | 2014-11-20 | パナソニック株式会社 | Video conference system |
| CN108289187A (en) * | 2017-07-31 | 2018-07-17 | 深圳银澎云计算有限公司 | Network direct broadcasting accesses video-meeting method and system |
| CN108322474A (en) * | 2018-02-23 | 2018-07-24 | 北京搜狐新媒体信息技术有限公司 | Virtual reality system, relevant apparatus based on share desktop and method |
| CN108965774A (en) * | 2017-05-22 | 2018-12-07 | 中兴通讯股份有限公司 | Videoconference data processing method, MCU, AI platform and storage medium |
| CN109451264A (en) * | 2018-10-23 | 2019-03-08 | 视联动力信息技术股份有限公司 | A kind of method and system of monitoring device membership |
| CN109618122A (en) * | 2018-12-07 | 2019-04-12 | 合肥万户网络技术有限公司 | A kind of virtual office conference system |
| CN109640028A (en) * | 2018-11-16 | 2019-04-16 | 视联动力信息技术股份有限公司 | It is a kind of by multiple method and apparatus for carrying out group meeting depending on networked terminals and multiple internet terminals |
| CN109788236A (en) * | 2019-04-01 | 2019-05-21 | 北京百度网讯科技有限公司 | Audio/video conference control method, device, equipment and storage medium |
| CN110418099A (en) * | 2018-08-30 | 2019-11-05 | 腾讯科技（深圳）有限公司 | A kind of audio/video processing method, device and storage medium |
| CN110620896A (en) * | 2019-08-28 | 2019-12-27 | 视联动力信息技术股份有限公司 | Conference establishing method, system and device |
| CN111064919A (en) * | 2019-12-09 | 2020-04-24 | 零空间（北京）科技有限公司 | VR (virtual reality) teleconference method and device |
| CN111083428A (en) * | 2019-12-27 | 2020-04-28 | 北京东土科技股份有限公司 | Audio and video data processing method and device, computer equipment and storage medium |
-
2021
- 2021-01-05 CN CN202110011016.2A patent/CN112866619B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006005526A (en) * | 2004-06-16 | 2006-01-05 | Nippon Telegr & Teleph Corp <Ntt> | Video conference terminal, system and method |
| CN102263772A (en) * | 2010-05-28 | 2011-11-30 | 经典时空科技(北京)有限公司 | Virtual conference system based on three-dimensional technology |
| JP2014220649A (en) * | 2013-05-08 | 2014-11-20 | パナソニック株式会社 | Video conference system |
| CN108965774A (en) * | 2017-05-22 | 2018-12-07 | 中兴通讯股份有限公司 | Videoconference data processing method, MCU, AI platform and storage medium |
| CN108289187A (en) * | 2017-07-31 | 2018-07-17 | 深圳银澎云计算有限公司 | Network direct broadcasting accesses video-meeting method and system |
| CN108322474A (en) * | 2018-02-23 | 2018-07-24 | 北京搜狐新媒体信息技术有限公司 | Virtual reality system, relevant apparatus based on share desktop and method |
| CN110418099A (en) * | 2018-08-30 | 2019-11-05 | 腾讯科技（深圳）有限公司 | A kind of audio/video processing method, device and storage medium |
| CN109451264A (en) * | 2018-10-23 | 2019-03-08 | 视联动力信息技术股份有限公司 | A kind of method and system of monitoring device membership |
| CN109640028A (en) * | 2018-11-16 | 2019-04-16 | 视联动力信息技术股份有限公司 | It is a kind of by multiple method and apparatus for carrying out group meeting depending on networked terminals and multiple internet terminals |
| CN109618122A (en) * | 2018-12-07 | 2019-04-12 | 合肥万户网络技术有限公司 | A kind of virtual office conference system |
| CN109788236A (en) * | 2019-04-01 | 2019-05-21 | 北京百度网讯科技有限公司 | Audio/video conference control method, device, equipment and storage medium |
| CN110620896A (en) * | 2019-08-28 | 2019-12-27 | 视联动力信息技术股份有限公司 | Conference establishing method, system and device |
| CN111064919A (en) * | 2019-12-09 | 2020-04-24 | 零空间（北京）科技有限公司 | VR (virtual reality) teleconference method and device |
| CN111083428A (en) * | 2019-12-27 | 2020-04-28 | 北京东土科技股份有限公司 | Audio and video data processing method and device, computer equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 周春丰等: "多类型视频终端在IMS融合会议中的应用", 《计算机技术与发展》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114095671A (en) * | 2021-11-11 | 2022-02-25 | 北京有竹居网络技术有限公司 | Cloud conference live broadcast system, method, device, equipment and medium |
| CN113938336A (en) * | 2021-11-15 | 2022-01-14 | 网易（杭州）网络有限公司 | Conference control method and device and electronic equipment |
| CN114615455A (en) * | 2022-01-24 | 2022-06-10 | 北京师范大学 | Teleconference processing method, teleconference processing device, teleconference system, and storage medium |
| CN114531564A (en) * | 2022-03-01 | 2022-05-24 | 联想(北京)有限公司 | Processing method and electronic equipment |
| CN114531564B (en) * | 2022-03-01 | 2024-04-23 | 联想(北京)有限公司 | Processing method and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112866619B (en) | 2021-12-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112866619B (en) | Teleconference control method and device, electronic equipment and storage medium | |
| US10567448B2 (en) | Participation queue system and method for online video conferencing | |
| EP2348671B1 (en) | Conference terminal, conference server, conference system and method for data processing | |
| CN103238317B (en) | The system and method for scalable distributed universal infrastructure in real-time multimedia communication | |
| US20120017149A1 (en) | Video whisper sessions during online collaborative computing sessions | |
| CN112235530B (en) | Method and device for realizing teleconference, electronic device and storage medium | |
| US10715344B2 (en) | Method of establishing a video call using multiple mobile communication devices | |
| US10757365B2 (en) | System and method for providing and interacting with coordinated presentations | |
| US20100279266A1 (en) | System and method for hybrid course instruction | |
| US20100138746A1 (en) | System and method for synchronized video sharing | |
| US9888211B1 (en) | Replacing live video of a meeting participant with recorded video of the meeting participant during an online meeting | |
| CN112817671A (en) | Image processing method, device, equipment and computer readable storage medium | |
| CN111107301A (en) | Video conference platform and communication method based on video conference platform | |
| WO2016206471A1 (en) | Multimedia service processing method, system and device | |
| Pandusadewa et al. | Development of conversation application as english learning using WebRTC | |
| WO2018214614A1 (en) | A method of establishing a video call using multiple mobile communications devices | |
| CN116055670B (en) | Method for collaborative checking three-dimensional model based on network conference and network conference system | |
| US11968476B2 (en) | Virtual environment streaming to a video communications platform | |
| US9426415B2 (en) | System, method and architecture for in-built media enabled personal collaboration on endpoints capable of IP voice video communication | |
| US20230376178A1 (en) | Information exchange system and method for enhanced collaboration | |
| CN115048069A (en) | Cloud conference content sharing method and device, electronic equipment and storage medium | |
| CN117041223A (en) | Document sharing method, device, electronic equipment and storage medium | |
| CN114268759A (en) | Data processing method and device, computer equipment and storage medium | |
| Burström et al. | The Online Paris Café | |
| Yu et al. | Web conferencing systems for ubi-media collaboration: Achievements and challenges |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |