CN115278149A

CN115278149A - Method and related device for preloading cloud conference desktop

Info

Publication number: CN115278149A
Application number: CN202210790190.6A
Authority: CN
Inventors: 曹佳新
Original assignee: Shenzhen Happycast Technology Co Ltd
Current assignee: Shenzhen Happycast Technology Co Ltd
Priority date: 2022-07-06
Filing date: 2022-07-06
Publication date: 2022-11-01

Abstract

The application provides a method and a related device for preloading a cloud conference desktop, comprising the following steps: receiving a consultation request message for consulting the first shared content in the cloud conference from first conference equipment operated by a speaker, responding to the consultation request message, and sending a first explanation picture containing first content information of the first shared content to at least one terminal device and at least one conference device; if the obtained conference information of the speaker comprises the first voice information and the first user operation of the speaker, creating a second explanation picture according to the first user operation, creating at least one third explanation picture according to the first voice information, the first user operation and at least one second user operation predicted by the first shared content, and sending a picture indication message carrying the second explanation picture and the at least one third explanation picture to the first conference device. According to the embodiment of the application, the corresponding explanation picture is obtained through the operation of the prediction speaker and is sent to the conference equipment, and the loading efficiency is improved.

Description

Method and related device for preloading cloud conference desktop

Technical Field

The application belongs to the technical field of communication, and particularly relates to a method for preloading a cloud conference desktop and a related device.

Background

In order to improve the efficiency of communication, users mostly adopt video conferences, i.e. conferences in which people located at two or more places have face-to-face conversations through communication equipment and a network. Video conferences can be divided into point-to-point conferences and multipoint conferences according to different numbers of participating places.

In the prior art, when a conference is in progress, files related to the content explained by a main speaker are shared through terminal equipment so as to be referred by all participants. However, because the terminal device of the speaker is connected to the server through the network, the screen-casting picture of the conference is delayed due to the influence of the network quality in the middle of the conference, and the conference needs to wait for loading for a long time, which affects the efficiency of the conference and reduces the user experience.

Disclosure of Invention

The application provides a method and a related device for preloading a cloud conference desktop, which predict second user operation according to the participated information of a speaker and first shared content, establish a third explanation picture according to the second user operation, and send the third explanation picture to conference equipment, so that the conference equipment prestores the explanation pictures required by the speaker, the loading efficiency is improved, and the conference time is saved.

In a first aspect, the present application provides a method for preloading a cloud conference desktop, where the method is applied to a server, and the method includes:

receiving a query request message from a first conference device operated by a speaker to request to query a first shared content in a cloud conference, wherein the cloud conference is a conference group created by a first user at a cloud end through a first terminal device, the first shared content is a shared content in at least one shared content uploaded by conference participants participating in the cloud conference through a second terminal device, the cloud conference comprises at least one terminal device and at least one conference device, the second terminal device is a device in the at least one terminal device, the first terminal device is the at least one terminal device or a device in the at least one conference device, and the first conference device is a device in the at least one conference device;

transmitting a first explanation screen including first content information of the first shared content to the at least one terminal apparatus and the at least one conference apparatus in response to the reference request message;

acquiring conference participation information of the speaker in the cloud conference at the current time period, wherein the conference participation information comprises at least one of the following information: the voice information of the speaker and the user operation of the speaker are acquired by the first conference device;

if the conference information is detected to comprise first voice information of the speaker and first user operation of the speaker, creating a second explanation picture according to the first user operation, and predicting at least one second user operation of the speaker according to the first voice information, the first user operation and the first shared content;

creating at least one third explanation picture according to the at least one second user operation;

and sending an indication message carrying the second explanation picture and at least one third explanation picture to the first conference device, wherein the indication message is used for representing indication information aiming at the playing of the second explanation picture and the caching of the third explanation picture, the third explanation picture is associated with a third user operation, and the third user operation is a user operation which is detected by the first conference device after the second explanation picture is played and is matched with the second user operation.

In a second aspect, the present application provides an apparatus for preloading a cloud conference desktop, including:

a first receiving unit, configured to receive a consultation request message from a first conference device operated by a presenter to ask for consulting of first shared content in a cloud conference, where the cloud conference is a conference group created by a first user at a cloud end through a first terminal device, the first shared content is shared content in at least one shared content uploaded by conference participants participating in the cloud conference through a second terminal device, the cloud conference includes at least one terminal device and at least one conference device, the second terminal device is a device in the at least one terminal device, the first terminal device is the at least one terminal device or a device in the at least one conference device, and the first conference device is a device in the at least one conference device;

a first transmission unit configured to transmit a first explanation screen including first content information of the first shared content to the at least one terminal apparatus and the at least one conference apparatus in response to the reference request message;

a first obtaining unit, configured to obtain conference participation information of the presenter in the cloud conference at a current time period, where the conference participation information includes at least one of the following: the voice information of the speaker and the user operation of the speaker are acquired by the first conference device;

a detecting unit, configured to create a second explanation picture according to a first user operation if it is detected that the conference information includes first voice information of the speaker and the first user operation of the speaker, and predict at least one second user operation of the speaker according to the first voice information, the first user operation, and the first shared content;

a creating unit configured to create at least one third interpretation picture according to the at least one second user operation;

and the second sending unit is used for sending an indication message carrying the second explanation picture and at least one third explanation picture to the first conference device, the indication message is used for representing indication information aiming at the playing of the second explanation picture and the caching of the third explanation picture, the third explanation picture is associated with a third user operation, and the third user operation is a user operation which is detected by the first conference device after the second explanation picture is played and is matched with the second user operation.

In a third aspect, the present application provides another method for preloading a cloud conference desktop, where the method is applied to a conference device, and includes:

sending a query request message to a server, where the query request message is a message for querying a first shared content sent by a first conference device operated by a speaker in a cloud conference, the cloud conference is a conference group created by a first user at a cloud end through a first terminal device, the first shared content is a shared content in at least one shared content uploaded by participants participating in the cloud conference through a second terminal device, the cloud conference includes at least one terminal device and at least one conference device, the second terminal device is a device in the at least one terminal device, the first terminal device is the at least one terminal device or a device in the at least one conference device, and the first conference device is a device in the at least one conference device;

receiving a first explanation picture generated according to the reference request message, wherein the first explanation picture comprises first content information of the first shared content;

receiving an indication message carrying a second explanation picture and at least one third explanation picture while displaying the first explanation picture, wherein the second explanation picture is a picture created according to a first user operation, the at least one third explanation picture is a picture created according to at least one second user operation predicted by conference participation information, and the conference participation information includes at least one of the following: the voice information of the speaker and the user operation of the speaker are acquired by the first conference device;

and caching the at least one third explanation picture while playing the second explanation picture according to the indication message.

In a fourth aspect, the present application provides an electronic device comprising:

one or more processors;

one or more memories for storing programs,

the one or more memories and the program are configured to control the electronic device by the one or more processors to perform the steps of any one of the methods or the second aspect of the embodiments of the present application.

In a fifth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, and wherein the computer program causes a computer to perform some or all of the steps as described in any one of the methods or the second aspects of the embodiments of the present application.

In a sixth aspect, the present application provides a computer program, wherein the computer program is operable to cause a computer to perform some or all of the steps as described in any one of the methods or the second aspects of the embodiments of the present application. The computer program may be a software installation package.

It can be seen that, in the embodiment of the present application, after receiving a query request message for querying a first shared content in a cloud conference from a first conference device operated by a speaker, a server responds to the query request message, the server sends a first explanation picture containing first content information of the first shared content to at least one terminal device and at least one conference device, obtains conference participation information of the speaker in the cloud conference, if it is detected that the conference participation information includes voice information of the speaker and user operation of the speaker, predicts at least one second user operation of the speaker according to the conference participation information and the first shared information, creates a second explanation picture according to the first user operation in the conference participation information, creates at least one third explanation picture according to the at least one second user operation, and predicts the second user operation through the conference participation information, thereby obtaining the explanation picture, and making the predicted explanation picture more accurate. And sending an indication message carrying the second explaining picture and at least one third explaining picture to the first conference equipment. Since the indication message is used for representing the indication information for the playing of the second explanation picture and the caching of the third explanation picture, the conference equipment plays the second explanation picture and stores the third explanation picture at the same time after receiving the indication message. The third explaining picture is associated with the third user operation, and when the conference equipment receives the third user operation, the third explaining picture can be directly obtained locally from the conference equipment, so that the influence of factors such as network signals is avoided, the loading efficiency is improved, and the conference time is further saved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a server according to an embodiment of the present application;

fig. 2a is a schematic diagram of a cloud conference system according to an embodiment of the present application;

fig. 2b is a schematic interface diagram of a conference device according to an embodiment of the present application;

fig. 3a is a flowchart of a method for preloading a cloud conference desktop according to an embodiment of the present application;

FIG. 3b is a schematic interface diagram of another conference device provided in an embodiment of the present application;

fig. 4 is a flowchart of another method for preloading a cloud conference desktop according to an embodiment of the present application;

fig. 5 is a block diagram illustrating functional units of an apparatus for preloading a cloud conference desktop according to an embodiment of the present application;

fig. 6 is a block diagram illustrating functional units of another apparatus for preloading a cloud conference desktop according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

In order to better understand the technical solution of the embodiment of the present application, a server that may be involved in the embodiment of the present application is introduced first. The server in the application can be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, and can also be a cloud server for providing basic cloud computing services such as cloud service, a cloud database, cloud computing, a cloud function, cloud storage, network service, cloud communication, middleware service, domain name service, security service, CDN, a big data and artificial intelligence platform and the like.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a server according to an embodiment of the present disclosure. As shown in fig. 1, the server includes one or more processors 120, a memory 130, a communication module 140, and one or more programs 131, and the processors 120 are communicatively connected to the memory 130 and the communication module 140 through an internal communication bus.

Wherein the one or more programs 131 are stored in the memory 130 and configured to be executed by the processor 120, the one or more programs 131 comprising instructions for performing any of the steps of the method embodiments.

The Processor 120 may be, for example, a Central Processing Unit (CPU), a general purpose Processor, a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, units, and circuits described in connection with the present disclosure. The processor 120 may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs and microprocessors, and the like. The communication unit may be the communication module 140, the transceiver, the transceiving circuit, etc., and the storage unit may be the memory 130.

The memory 130 may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. By way of example, but not limitation, many forms of Random Access Memory (RAM) are available, such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct bus RAM (DR RAM).

In order to better understand the technical solution of the embodiment of the present application, a cloud conference system that may be related to the embodiment of the present application is introduced first.

Referring to fig. 2a, fig. 2a is a schematic view of a cloud conference system according to an embodiment of the present disclosure.

The cloud conference system comprises a server, a plurality of terminal devices and a plurality of conference devices. Each terminal device in the plurality of terminal devices and each conference device in the plurality of conference devices are connected with the server through a network, so that each terminal device and each conference device can perform data interaction with the server through the network. And the terminal equipment in the plurality of terminal equipment is in communication connection with the conference equipment in the plurality of conference equipment, so that each terminal equipment and each conference equipment can perform data interaction. Specifically, as shown in fig. 2a, terminal device 210b, terminal device 210c, \8230;, terminal device 210n, and conference device 220a, conference device 220b, \8230;, conference device 220m may be included.

Each terminal device in the plurality of terminal devices is a device capable of providing a corresponding desktop of voice and/or data information to a participating user, the terminal device may be an intelligent terminal with a physical examination recommendation function, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a wearable device, a head-mounted device, and a vehicle-mounted terminal, and the type of the terminal device is not limited here. Each conference device in the plurality of conference devices may be an intelligent device such as a computer, an intelligent television with an internet function, and an intelligent projector with an internet function, and the type of the conference device is not limited here. It should be understood that each terminal device and each conference device in the cloud conference system shown in fig. 2a may be installed with a cloud conference application (i.e., an application client), and when the application client runs on each terminal device and conference device, data interaction may be performed between the application client and the server shown in fig. 2 a.

Referring to fig. 2b, fig. 2b is a schematic interface diagram of a conference device according to an embodiment of the present application. The playing data stream received by the conference device may be a real-time screen-projecting data stream of any terminal device, such as a screen projection of a smart phone, a screen projection of a smart computer, a screen projection of a smart watch, and the like, which is not limited herein. For example, referring to fig. 2b, the display area of the conference device includes a plurality of shared content partitions, each of which corresponds to one shared content, and as shown in fig. 2b, includes four shared content partitions, which correspond to the first shared content, the second shared content, the third shared content, and the fourth shared content, respectively. The shared content in the shared content partition may be a real-time screen-casting data stream shared by a plurality of terminal devices, such as a pdf file, a PPT file, or another type of shared file, which is not limited herein. In the case that the number p of types of shared content is greater than the preset number threshold N, since the number of partitions of the display partition in the conference desktop must not exceed the preset number threshold N, only the display partition with the top N arrangement order is displayed in the conference desktop.

Referring to fig. 3a, fig. 3a is a flowchart of a method for preloading a cloud conference desktop according to an embodiment of the present application. Next, a method for preloading a cloud conference desktop in a server according to an embodiment of the present application will be described in detail with reference to fig. 3 a. As shown in fig. 3a, a method of preloading a cloud conference desktop, comprising:

step 310: receiving a reference request message from a first conference device operated by a speaker requesting to reference the first shared content in the cloud conference.

The cloud conference is a conference group created by a first user at the cloud end through first terminal equipment, the first shared content is shared content in at least one shared content uploaded by conference participants participating in the cloud conference through second terminal equipment, the cloud conference comprises at least one terminal equipment and at least one conference equipment, the second terminal equipment is equipment in the at least one terminal equipment, the first terminal equipment is the at least one terminal equipment or equipment in the at least one conference equipment, and the first conference equipment is equipment in the at least one conference equipment.

Specifically, the speaker controls the conference device through the terminal device or directly controls the conference device. The conference equipment is intelligent equipment such as an intelligent television with an online function or an intelligent projector with an online function, so that conference information can be received through the conference equipment when a conference user refers to other information through terminal equipment, and the influence on watching or listening to conference real-time information of other conference users through the conference equipment is avoided. The shared content information can be a video file, a voice file or a text file uploaded by the participating users through the terminal equipment. The speaker sends a query request message requesting to query the first shared content in the cloud conference through the operated first conference device, and the server starts to query according to the query request message after receiving the query request message. Wherein the first conference device is a device in at least one conference device.

It can be understood that "the first terminal device" and "the second terminal device" are only general names of devices in the cloud conference, and do not refer to a certain device, that is, a participating user may send a lookup request message, a conference group created by a cloud, and shared content information uploaded through the same terminal device, or may complete an operation through different terminal devices, and the "first terminal device" and the "second terminal device" may be replaced by other names, which is not limited herein specifically, and in this embodiment of the present application, only the "first terminal device" and the "second terminal device" are taken as examples for explanation.

Step 320: and sending a first explanation picture containing first content information of the first shared content to the at least one terminal device and the at least one conference device in response to the reference request message.

Specifically, after receiving the query request message, the server parses a first shared content that the speaker needs to play, opens the first shared content by running software, creates a first explanation picture containing first content information of the first shared content, and sends the first explanation picture to at least one terminal device and at least one conference device. Referring to fig. 3b, fig. 3b is a schematic interface diagram of another conference device according to an embodiment of the present application. And after receiving the first explanation picture, the conference equipment plays the first picture, and displays a prompt bar containing the corresponding relation between the control button of the conference equipment and the user operation in the first explanation picture, wherein the prompt bar is sequenced according to the file type of the shared content to be explained. As shown in fig. 3b, if the first shared content is a video file, the video file user operation prompt is preferentially displayed at the head, and the video file user operation prompt includes: the user can play the video by pressing the confirmation key and quit the full screen by pressing the menu key, so that the speaker can conveniently operate the user according to the prompt, and the time is saved.

Step 330: and acquiring the conference information of the speaker in the cloud conference at the current time. The conferencing information comprises at least one of the following: the voice information of the speaker and the user operation of the speaker are collected by the first conference device.

Specifically, the speaker can generate various information such as speaker voice information and user operation of the speaker during the conference hosting process, and the conference information of the speaker is collected through the terminal device or the conference device and sent to the server, so that the server can predict the user operation of the speaker in the subsequent conference according to the conference information.

Step 340: if the conference information is detected to comprise first voice information of the speaker and first user operation of the speaker, creating a second explanation picture according to the first user operation, and predicting at least one second user operation of the speaker according to the first voice information, the first user operation and the first shared content.

Specifically, if it is detected that the conference information includes the first voice information of the speaker and the first user operation of the speaker, a second explanation picture is created according to the first user operation, wherein the first user operation is an operation in the user operation, corresponding content in the first shared content is obtained by the server according to the first user operation, and the second explanation picture including the content is created. And predicting at least one second user operation of the speaker according to the first voice information, the first user operation and the first shared content.

Step 350: and creating at least one third explanation picture according to the at least one second user operation.

In one possible example, the creating at least one third explanation picture according to the at least one second user operation includes: determining fifth content information of the first shared content corresponding to each second user operation in the at least one second user operation, and obtaining at least one fifth content information; and creating the at least one third explanation picture according to the at least one fifth content information.

Specifically, the server determines fifth content information in the first shared content corresponding to each second user operation in the at least one second user operation, and creates at least one third explanation picture according to the obtained at least one fifth content information.

As can be seen, in this example, the fifth content information of the first shared content is determined through the predicted second user operation, and the third interpretation picture is created according to the fifth content information, so as to obtain the third interpretation picture corresponding to the predicted second user operation, thereby improving the creation efficiency.

Step 360: and sending an indication message carrying the second explaining picture and the at least one third explaining picture to the first conference equipment.

The indication message is used for representing indication information of playing of the second explanation picture and caching of the third explanation picture, the third explanation picture is associated with a third user operation, and the third user operation is a user operation which is detected by the first conference device after the second explanation picture is played and is matched with the second user operation.

Specifically, a picture indication message carrying a second explanation picture and at least one third explanation picture is sent to the first conference device, so that the first conference device plays the second explanation picture according to the first user operation completed by the speaker, at least one third explanation picture created according to the second user operation is stored, and after the first conference device obtains the third user operation of the speaker, the third explanation picture is directly obtained from the first conference device for playing, wherein the third user operation is an operation matched with the second user operation. For example, the first shared content is APP software, the server creates a second explanation picture according to the acquired first user operation, predicts at least one second user operation of the speaker according to the first voice information, the first user operation and the first shared content, if the second user operation is clicking a next icon, creates a third explanation picture according to the operation of clicking the next icon, sends the second explanation picture and the third explanation picture to the first conference device, the first conference device plays the second explanation picture, and after the third user operation of the speaker is acquired, namely clicking the next icon, the third explanation picture is loaded from the first conference device for playing.

Therefore, in the example, the user operation of the speaker is predicted according to the conference information of the speaker, so that the prediction result is accurate, the explanation picture is created according to the user operation and is sent to the conference equipment in advance, the conference efficiency is improved, and the slow loading caused by the influence of factors such as a network on the conference process is prevented.

In one possible example, the predicting at least one second user action of the speaker based on the first voice information, the first user action, and the first shared content comprises: acquiring a first explanation picture jump relation table, wherein the first explanation picture jump relation table is used for representing jump operation among all explanation pictures of the first shared content; acquiring the association degree between the jump operations; determining at least one second skip operation of which the correlation degree of the first skip operation same as the first user operation reaches a preset correlation degree according to the correlation degree; acquiring second content information of the first shared content corresponding to an explanation picture after each second jump operation in the at least one second jump operation; extracting key words in the first voice information; judging whether each piece of second content information contains the keyword or not; and if so, determining that the at least one second jump operation is the at least one second user operation.

In a specific example, when the participating information includes the first voice information, the first user operation, and the first shared content, the specific step of predicting at least one second user operation according to the participating information may be: firstly, a server acquires a first explanation picture jump relation table, wherein the first explanation picture jump relation table is used for representing jump operations among all explanation pictures of first shared content, and then acquires the association degree among all the jump operations in the first explanation picture jump relation table. Secondly, determining a first jump operation which is the same as the first user operation according to the association degree, searching at least one second jump operation of which the association degree with the first jump operation reaches a preset association degree, and acquiring second content information of the first shared content corresponding to the explanation picture after each second jump operation in the at least one second jump operation jumps, wherein the association degree between the jump operations can be determined according to the number of the jump operations spaced between the jump operations, or preset according to the user, and the specific point is not limited here. For example, if the first shared content is a PPT file, the screen jump relation table records jump operations of pages in the PPT, and if a jump operation a from a first PPT page to a second PPT page is: clicking a next icon in the first PPT page; the jump operation b for jumping from the second PPT page to the third PPT page is as follows: clicking a next page of icons in a second PPT page; the jump operation c from the fourth PPT page to the fifth PPT page is as follows: clicking on the next icon in the fourth PPT page. And acquiring the association degree between the jump operation a and the jump operation b, the association degree between the jump operation a and the jump operation c, and the association degree between the jump operation b and the jump operation c. If the skip operation a is the same as the first user operation, the association degree between the skip operation a and the skip operation b is 99%, the association degree between the skip operation a and the skip operation c is 97%, the association degree between the skip operation b and the skip operation c is 98%, and the preset association degree is 99%, determining that the skip operation b associated with the first user operation reaches the preset association degree, and extracting the content in the page as second content information because the corresponding explanation picture after the skip operation b is operated is a second PPT page. And finally, extracting the keywords in the first voice message, judging whether the second content message contains the extracted keywords, and if so, judging that at least one second skip operation is at least one second user operation.

As can be seen, in this example, the second user operation is predicted according to the voice information of the speaker, the first user operation, and the first shared content, so that the predicted result is more accurate, the prediction precision is improved, the possibility of reloading is reduced, and the conference efficiency is improved.

In one possible example, the predicting at least one second user action of the speaker from the first voice information, the first user action, and the first shared content comprises: acquiring a second explanation picture created according to the first user operation; acquiring at least one fourth explanation picture related to the second explanation picture; acquiring third content information of the first shared content corresponding to each fourth explanation picture in the at least one fourth explanation picture; acquiring a keyword in the first voice message; judging the association degree of each piece of third content information and the keyword; determining at least one piece of third content information with the association degree reaching a preset association degree; and acquiring a jump operation of jumping from the second explanation picture to a fourth explanation picture corresponding to the at least one piece of third content information, wherein the jump operation is the second user operation.

In a specific example, when the participating information includes the first voice information, the first user operation, and the first shared content, the specific step of predicting at least one second user operation according to the participating information may be: firstly, the server determines content information of first shared content according to acquired first user operation, creates a second explanation picture according to the determined content information, acquires a fourth explanation picture associated with the second explanation picture, and acquires third content information of the first shared content corresponding to the fourth explanation picture, for example, if the first shared content is a PPT file, if the content information corresponding to the first user operation is a first PPT page, and a PPT page associated with the first PPT page is a second PPT page, so as to create a fourth explanation picture according to the content of the second PPT page, acquire third content information in the fourth explanation picture, then extract keywords in the first voice information, judge the association degree of the extracted keywords in the third content information, and acquire a jump operation of jumping from the second explanation picture to the fourth explanation picture corresponding to at least one piece of third content information with a preset association degree, and take the second user operation.

As can be seen, in this example, the explanation picture is determined according to the completed user operation, the explanation picture associated with the explanation picture is determined, the picture most likely to be explained by the speaker is screened out, and the keyword in the voice information is further screened out, so that the prediction result is more accurate.

In one possible example, the predicting at least one second user action of the speaker based on the first voice information, the first user action, and the first shared content comprises: acquiring a second explanation picture jump relation table, wherein the second explanation picture jump relation table is used for representing jump operation among all explanation pictures of the first file; determining fourth content information of the first shared content corresponding to the explanation picture after each jump operation is jumped; acquiring a keyword in the voice information; judging a first association value of each fourth content information and the keyword; searching at least one fourth content information of which the first relevance value reaches a first preset relevance value, and determining at least one first skip operation corresponding to the at least one fourth content information; determining a second skip operation which is the same as the first user operation in the second explanation picture skip relation table; acquiring at least one third jump operation with the second jump operation correlation degree reaching a second preset correlation degree value according to the second explanation picture jump relation table; acquiring a second association value between each first jump operation in the at least one first jump operation and each third jump operation in the at least one third jump operation; and determining a first jumping operation when the second relevance value reaches a third preset relevance value, wherein the first jumping operation is the second user operation.

In a specific example, when the conference information includes the first voice information, the first user operation, and the first shared content, the specific step of predicting at least one second user operation according to the conference information may be: firstly, the server acquires a preset second explanation picture jump relation table, then acquires each jump operation in the second explanation picture jump relation table, determines an explanation picture corresponding to each jump operation, and acquires fourth content information of the first shared content in each explanation picture. And extracting the keywords in the first voice message, judging a first relevance value of the fourth content message and the extracted keywords, and searching at least one fourth content message of which the first relevance value reaches a first preset relevance value so as to obtain at least one corresponding first jump operation. And searching a second jump operation which is the same as the first user operation in a preset second explanation picture jump relation table, acquiring at least one third jump operation of which the correlation degree with the second jump operation reaches a second preset correlation value, and respectively acquiring a second correlation value of each first jump operation in the at least one first jump operation and each third jump operation in the at least one third jump operation. For example, the at least one first jump operation includes a first jump operation a and a first jump operation b, and the at least one third jump operation includes a third jump operation a and a third jump operation b. The first jump operation a is the same as the third jump operation a, so the corresponding second correlation value is 100; the first jump operation a is different from the third jump operation b, so the corresponding second correlation value is 0, and the first jump operation b is different from the third jump operation a, so the corresponding second correlation value is 0; the first jump operation b is different from the third jump operation b, so the corresponding second relevance value is 0, if the third preset relevance value is 100, the first jump operation a with the second relevance value reaching the third preset relevance value is the second user operation.

It can be seen that in this example, all the interpretation pictures corresponding to the skip operations in the second interpretation picture skip relation table are obtained, the pictures that the speaker is likely to interpret next step are screened out according to the keywords in the voice information, so as to obtain the first skip operation, the second skip operation that is the same as the user operation in the second interpretation picture skip relation table is determined according to the user operation that the speaker has completed, the third skip operation that the correlation value with the second skip operation exceeds the preset correlation value is determined, the second user operation of the speaker is predicted through the first skip operation and the third skip operation, and the accuracy of the prediction result is improved.

It can be understood that the first explanation picture skipping relationship table and the second explanation picture skipping relationship table are only general names of the explanation picture skipping relationship table, and are not specific to a certain explanation picture skipping relationship table, that is, the first explanation picture skipping relationship table and the second explanation picture skipping relationship table may be the same or different, and may be specifically set according to actual requirements, which is not limited herein.

In a possible example, after the sending, to the first conferencing device, the indication message carrying the second explanation picture and the at least one third explanation picture, the method further includes: acquiring first detailed content information of the fifth explanation picture displayed by the conference equipment; acquiring second detailed content information of ending part content in the first shared content, and judging whether the first detailed content information is the same as the second detailed content information; and if the first file is the same as the second file, sending a prompt message to the first conference device to remind the speaker that the first file is displayed completely.

In a specific example, after sending the instruction message, the server obtains second detailed information of the content at the end of the first shared content, obtains a fifth explanation picture played by the conference device in real time, obtains first detailed content information in the fifth explanation picture, compares whether the first detailed content information is the same as the second detailed content information, determines that the first shared content has been played completely if the first detailed content information is the same as the second detailed content information, and sends a prompt message to the first conference device.

Therefore, in this example, by referring to the content of the explanation picture played in real time, it is determined whether the first shared content information is played completely, and the speaker is reminded in time, so that the convenience of the conference is improved.

Referring to fig. 4, fig. 4 is a flowchart of another method for preloading a cloud conference desktop according to an embodiment of the present application, and details of another method for preloading a cloud conference desktop according to the embodiment of the present application will be described below with reference to fig. 4. A method for preloading a cloud conference desktop, which is applied to conference equipment, comprises the following steps:

step 410: sending a query request message to a server, wherein the query request message is a message for querying a first shared content, which is sent by a first conference device operated by a speaker in a cloud conference, the cloud conference is a conference group created by a first user at a cloud end through a first terminal device, the first shared content is a shared content in at least one shared content uploaded by conference participants participating in the cloud conference through a second terminal device, the cloud conference comprises at least one terminal device and at least one conference device, the second terminal device is a device in the at least one terminal device, the first terminal device is the at least one terminal device or a device in the at least one conference device, and the first conference device is a device in the at least one conference device.

Specifically, after receiving the operation of the speaker, the conference device generates a query request message requesting to query the first shared content according to the operation of the speaker, and sends the query request message to the server.

Step 420: and receiving a first explanation picture generated according to the consultation request message. The first explanation picture contains first content information of the first shared content.

Specifically, the conference device receives a first explanation picture generated by the server according to the query request message, wherein the first explanation picture is an explanation picture created by the server according to the first content information of the first shared content.

Step 430: receiving an indication message carrying a second explanation picture and at least one third explanation picture while displaying the first explanation picture, wherein the second explanation picture is a picture created according to a first user operation, the at least one third explanation picture is a picture created according to at least one second user operation predicted by conference participation information, and the conference participation information includes at least one of the following: the voice information of the speaker and the user operation of the speaker are collected by the first conference device.

Specifically, the conference device receives an indication message sent by the server while displaying the first explanation picture, wherein the indication message carries the second explanation picture and at least one third explanation picture.

Step 440: and caching the at least one third explanation picture while playing the second explanation picture according to the indication message.

Specifically, the server plays the second explanation picture according to the indication message, and stores the third explanation picture, so that the third explanation picture can be directly obtained from the conference device when receiving the third user operation associated with the third explanation picture.

Therefore, in this example, the third speech interpretation picture corresponding to the third user operation is obtained in advance, and after the third user operation is performed by the speaker, the third speech interpretation picture is directly obtained, so that the conference efficiency is improved.

According to the method, the device for preloading the cloud conference desktop can be divided into the functional units, for example, the functional units can be divided corresponding to the functions, or two or more functions can be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. The division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.

Under the condition that each function unit is divided by using corresponding functions, fig. 5 is a block diagram of functional units of a device for preloading a cloud conference desktop according to an embodiment of the present application, where the block diagram includes:

an apparatus to preload a cloud conference desktop, comprising:

the first receiving unit 510: the device comprises a consultation request message used for receiving a first conference device operated by a speaker to request to consult first shared content in a cloud conference, wherein the cloud conference is a conference group created by a first user through a first terminal device at the cloud end, the first shared content is shared content in at least one shared content uploaded by conference participants participating in the cloud conference through a second terminal device, the cloud conference comprises at least one terminal device and at least one conference device, the second terminal device is a device in the at least one terminal device, the first terminal device is the at least one terminal device or a device in the at least one conference device, and the first conference device is a device in the at least one conference device;

the first sending unit 520: a first explanation screen for sending first content information containing the first shared content to the at least one terminal device and the at least one conference device in response to the reference request message;

the first acquisition unit 530: the conference information acquisition module is used for acquiring conference information of the speaker in the cloud conference at the current time period, and the conference information comprises at least one of the following: the voice information of the speaker and the user operation of the speaker are acquired by the first conference device;

the detection unit 540: the conference information processing device is used for creating a second explanation picture according to the first user operation if the conference information is detected to comprise first voice information of the speaker and the first user operation of the speaker, and predicting at least one second user operation of the speaker according to the first voice information, the first user operation and the first shared content;

the creating unit 550: the second user operation is used for creating at least one third explanation picture according to the at least one second user operation;

the second transmitting unit 560: and the instruction message is used for sending an instruction message carrying the second explanation picture and at least one third explanation picture to the first conference device, the instruction message is used for representing the playing of the second explanation picture and the cached instruction information of the third explanation picture, the third explanation picture is associated with a third user operation, and the third user operation is a user operation which is detected by the first conference device after the second explanation picture is played and is matched with the second user operation.

In a possible example, the detecting unit is further configured to obtain a first interpretation picture jump relation table, where the first interpretation picture jump relation table is used to characterize a jump operation between the respective interpretation pictures of the first shared content; acquiring the association degree between the jump operations; determining at least one second skip operation with the correlation degree reaching a preset correlation degree of a first skip operation which is the same as the first user operation according to the correlation degree; acquiring second content information of the first shared content corresponding to an explanation picture after each second jump operation in the at least one second jump operation; extracting key words in the first voice information; judging whether each piece of second content information contains the keyword or not; and if so, determining that the at least one second jump operation is the at least one second user operation.

In a possible example, the detection unit is further configured to acquire a second explanation screen created according to the first user operation; acquiring at least one fourth explanation picture related to the second explanation picture; acquiring third content information of the first shared content corresponding to each fourth explanation picture in the at least one fourth explanation picture; acquiring a keyword in the first voice message; judging the association degree of each third content information and the keyword; determining at least one third content information with the association degree reaching a preset association degree; and acquiring a jump operation of jumping from the second explanation picture to a fourth explanation picture corresponding to the at least one piece of third content information, wherein the jump operation is the second user operation.

In a possible example, the detecting unit is further configured to obtain a second interpretation picture jump relation table, where the second interpretation picture jump relation table is used to characterize a jump operation between the interpretation pictures of the first file; determining fourth content information of the first shared content corresponding to the explanation picture after each jump operation is jumped; acquiring a keyword in the voice message; judging a first relevance value of each fourth content information and the keyword; searching at least one fourth content information reaching a first preset relevance value with the first relevance value, and determining at least one first jump operation corresponding to the at least one fourth content information; determining a second skip operation which is the same as the first user operation in the second explanation picture skip relation table; acquiring at least one third jump operation with the second jump operation correlation degree reaching a second preset correlation degree value according to the second explanation picture jump relation table; obtaining a second association value between each first jump operation in the at least one first jump operation and each third jump operation in the at least one third jump operation; and determining a first jumping operation when the second relevance value reaches a third preset relevance value, wherein the first jumping operation is the second user operation.

In a possible example, the creating unit is further configured to determine fifth content information of the first shared content corresponding to each of the at least one second user operation, and obtain at least one fifth content information; and creating the at least one third explanation picture according to the at least one fifth content information.

In one possible example, the method further comprises: a second obtaining unit, configured to obtain first detailed content information of the fifth interpretation picture displayed by the conference device; acquiring second detailed content information of the ending part content in the first shared content, and judging whether the first detailed content information is the same as the second detailed content information; and sending a prompt message to the first conference device to remind the speaker that the first file is displayed.

Referring to fig. 6, fig. 6 is a block diagram illustrating functional units of another apparatus for preloading a cloud conference desktop according to an embodiment of the present application. As shown in fig. 6, includes:

a third sending unit 610, configured to send a lookup request message to a server, where the lookup request message is a message that a first conference device operated by a speaker in a cloud conference refers to first shared content, the cloud conference is a conference group created by a first user at a cloud end through a first terminal device, the first shared content is shared content in at least one shared content uploaded by conference participants participating in the cloud conference through a second terminal device, the cloud conference includes at least one terminal device and at least one conference device, the second terminal device is a device in the at least one terminal device, the first terminal device is the at least one terminal device or a device in the at least one conference device, and the first conference device is a device in the at least one conference device;

a second receiving unit 620, configured to receive the first explanation picture generated according to the reference request message. The first explanation picture comprises first content information of the first shared content;

a third receiving unit 630, configured to receive, while displaying the first explanation picture, an indication message carrying a second explanation picture and at least one third explanation picture, where the second explanation picture is a picture created according to a first user operation, and the at least one third explanation picture is a picture created according to at least one second user operation predicted by conference participation information, and the conference participation information includes at least one of the following: the voice information of the speaker and the user operation of the speaker are acquired by the first conference device;

the buffer unit 640 is configured to buffer the at least one third explanation picture while playing the second explanation picture according to the indication message.

The above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, the above-described embodiments may be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer instructions or computer programs. The procedures or functions according to the embodiments of the present application are wholly or partially generated when the computer instructions or the computer program are loaded or executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire or wirelessly. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, data center, etc., that contains one or more collections of available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. The semiconductor medium may be a solid state disk.

Embodiments of the present application further provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, the computer program enables a computer to execute part or all of the steps of any one of the methods as described in the above method embodiments, and the computer includes an electronic device.

Embodiments of the present application also provide a computer program product, which includes a computer program operable to cause a computer to perform some or all of the steps of any one of the methods as set forth in the above method embodiments.

The computer program product may be a software installation package, the computer comprising an electronic device.

It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

In the several embodiments provided in the present application, it should be understood that the disclosed method, apparatus, and system may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative; for example, the division of the unit is only a logic function division, and there may be another division manner in actual implementation; for example, various elements or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be physically included alone, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware, or in the form of hardware plus a software functional unit.

The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute some steps of the methods according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

Although embodiments of the present application have been shown and described, it is understood that the above embodiments are illustrative and not restrictive, and that those skilled in the art may make changes, modifications, substitutions and alterations to the above embodiments without departing from the scope of the present application, and that such changes and modifications are also to be considered as within the scope of the present application.

Claims

1. A method for preloading a cloud conference desktop is applied to a server and comprises the following steps:

transmitting a first explanation screen including first content information of the first shared content to the at least one terminal device and the at least one conference device in response to the reference request message;

obtaining the conference information of the speaker in the cloud conference at the current time period, wherein the conference information comprises at least one of the following information: the voice information of the speaker and the user operation of the speaker are acquired by the first conference device;

2. The method for preloading a cloud conference desktop as recited in claim 1, wherein the predicting at least one second user action of the speaker from the first voice information, the first user action and the first shared content comprises:

acquiring a first explanation picture jump relation table, wherein the first explanation picture jump relation table is used for representing jump operation among all explanation pictures of the first shared content;

obtaining the association degree between the jump operations;

determining at least one second skip operation of which the correlation degree of the first skip operation same as the first user operation reaches a preset correlation degree according to the correlation degree;

acquiring second content information of the first shared content corresponding to an explanation picture after each second jump operation in the at least one second jump operation;

extracting key words in the first voice information;

judging whether each piece of second content information contains the keyword or not;

and if so, determining that the at least one second jumping operation is the at least one second user operation.

3. The method for preloading a cloud conference desktop as recited in claim 1, wherein the predicting at least one second user action of the speaker from the first voice information, the first user action and the first shared content comprises:

acquiring a second explanation picture created according to the first user operation;

acquiring at least one fourth explanation picture related to the second explanation picture;

acquiring third content information of the first shared content corresponding to each fourth explanation picture in the at least one fourth explanation picture;

acquiring a keyword in the first voice message;

judging the association degree of each piece of third content information and the keyword;

determining at least one piece of third content information with the association degree reaching a preset association degree;

and acquiring a jump operation of jumping from the second explanation picture to a fourth explanation picture corresponding to the at least one piece of third content information, wherein the jump operation is the second user operation.

4. The method for preloading a cloud conference desktop as recited in claim 1, wherein the predicting at least one second user action of the speaker from the first voice information, the first user action and the first shared content comprises:

acquiring a second explanation picture jump relation table, wherein the second explanation picture jump relation table is used for representing jump operation among all explanation pictures of the first file;

determining fourth content information of the first shared content corresponding to the explanation picture after each jump operation is jumped;

acquiring a keyword in the voice information;

judging a first relevance value of each fourth content information and the keyword;

searching at least one fourth content information reaching a first preset relevance value with the first relevance value, and determining at least one first jump operation corresponding to the at least one fourth content information;

determining a second skip operation which is the same as the first user operation in the second explanation picture skip relation table;

acquiring at least one third jump operation with the second jump operation correlation degree reaching a second preset correlation degree value according to the second explanation picture jump relation table;

acquiring a second association value between each first jump operation in the at least one first jump operation and each third jump operation in the at least one third jump operation;

and determining a first jumping operation when the second relevance value reaches a third preset relevance value, wherein the first jumping operation is the second user operation.

5. The method for preloading the cloud conference desktop according to claim 1, wherein the creating at least one third explanation picture according to the at least one second user operation comprises:

determining fifth content information of the first shared content corresponding to each second user operation in the at least one second user operation, and obtaining at least one fifth content information;

and creating the at least one third explanation picture according to the at least one fifth content information.

6. The method for preloading the cloud conference desktop according to any one of claims 1 to 5, wherein after the sending the indication message carrying the second interpretation picture and the at least one third interpretation picture to the first conference device, further comprising:

acquiring first detailed content information of the fifth explanation picture displayed by the conference equipment;

acquiring second detailed content information of the ending part of the first shared content;

judging whether the first detailed content information is the same as the second detailed content information;

and if the first file is the same as the second file, sending a prompt message to the first conference device to remind the speaker that the first file is displayed completely.

7. A method for preloading a cloud conference desktop is applied to conference equipment and comprises the following steps:

8. An apparatus for preloading a cloud conference desktop, comprising:

a first receiving unit, configured to receive a query request message from a first conference device operated by a speaker to request to query a first shared content in a cloud conference, where the cloud conference is a conference group created by a first user at a cloud end through a first terminal device, the first shared content is a shared content in at least one shared content uploaded by conference participants participating in the cloud conference through a second terminal device, the cloud conference includes at least one terminal device and at least one conference device, the second terminal device is a device in the at least one terminal device, the first terminal device is the at least one terminal device or a device in the at least one conference device, and the first conference device is a device in the at least one conference device;

a first transmitting unit that transmits a first explanation screen including first content information of the first shared content to the at least one terminal device and the at least one conference device in response to the reference request message;

a first obtaining unit, configured to obtain conference participation information of the speaker in the cloud conference at a current time period, where the conference participation information includes at least one of the following: the voice information of the speaker and the user operation of the speaker are acquired by the first conference device;

9. An electronic device, comprising: a processor and a memory for storing computer program code comprising computer instructions which, if executed by the processor, the electronic device performs the method of any of claims 1 to 7.

10. A computer-readable storage medium, in which a computer program is stored, which computer program comprises program instructions which, if executed by a processor, cause the processor to carry out the method according to any one of claims 1 to 7.