WO2015078199A1

WO2015078199A1 - Live interaction method and device, client, server and system

Info

Publication number: WO2015078199A1
Application number: PCT/CN2014/083897
Authority: WO
Inventors: 王欢
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2013-11-29
Filing date: 2014-08-07
Publication date: 2015-06-04
Also published as: CN103634681A; CN103634681B

Abstract

Disclosed are a live interaction method and device, a client, a server and a system, which belong to the technical field of network communications. The method is used in a client which comprises a main broadcasting client or a user client belonging to the same room, and the method comprises: receiving a live video which comes from the main broadcasting client and is sent by a server, and interaction data which comes from at least one user client in the room; according to the interaction data, generating interaction display content, the interaction display content being used for displaying the interaction between the main broadcasting client and the user client; and merging all or some of the interaction display content with the live video in the same region for display. The present invention can solve the problems of the easy omission of display contents of other display regions and the low information acquisition rate when the line of sight of a user is switched back and forth between a plurality of regions, due to the fact that the live interaction is displayed in the plurality of regions, and then the line of sight of the user is switched to a certain display region, thereby achieving the effect of increasing the information acquisition rate.

Description

Live interactive method, device, client, server and system

The present invention relates to the field of network communication technologies, and in particular, to a live interaction method, device, client, server, and system. Background technique

The Team Voice Tool is a network tool that supports multi-person online voice communication and video communication. It has the characteristics of small bandwidth and high voice service quality. The team voice tool usually divides the team according to the room (also called the channel). Each room includes at least one anchor client and at least one user client, and the anchor client and the client client can interact online.

The live interaction method in the team voice tool includes: the anchor client and the user client are in the same room, the anchor client communicates with each user client in the same room by the live video, and the user client in the same room uses the text information. Communicate with anchor clients and other user clients. As shown in FIG. 1, both the anchor client and the user client display the same or similar user interface 10, on which the video area 12 is used to display live video, and the chat area 14 is used to display each user client. The text information, the gift area 16 is used to display the gifts sent by the respective user client to the anchor client.

In the process of implementing the invention of the present invention, the inventor finds that the live interaction between the user client and the anchor client is displayed in different areas of the user interface according to the interaction type, for example, the live video is displayed in the video area 12, and the text information is displayed. In the chat area 14, etc., when the user obtains information of a plurality of areas in the user interface, it is necessary to switch the line of sight back and forth between the plurality of areas. When the user's line of sight switches to a certain area, it is easy to miss the display content of other areas in the user interface, resulting in a low information acquisition rate. Summary of the invention

Traditionally, when the live interaction is displayed in multiple areas, the user needs to switch the line of sight between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in The information acquisition rate is not high. Therefore, the embodiment of the present invention provides a Live interactive methods, devices, clients, servers and systems.

In a first aspect, the embodiment of the present invention provides a live broadcast interaction method, which is used in a client, where the client includes an anchor client or a user client that belongs to the same room, and the method includes:

Receiving, by the receiving server, a live video from the anchor client and interaction data originating from at least one of the user clients in the room;

And generating interactive display content according to the interaction data, where the interactive display content is used to display an interaction between the anchor client and the user client;

All or part of the interactive display content is fused with the live video in the same area for display. ,

In a second aspect, an embodiment of the present invention provides a live interaction method, which is used in a server, where the method includes:

Receiving a live video from the anchor client and interaction data from at least one user client in the room, the room including the anchor client and at least one user client;

Forwarding the live video and the interaction data to each client in the room, so that each client in the room generates an interactive display content according to the interaction data, and the interactive display content is used to display the An interaction between the anchor client and the user client, and all or part of the interactive display content is displayed in the same area as the live video, the client including the anchor belonging to the room Client or the user client.

In a third aspect, the embodiment of the present invention provides a live interactive participation device, which is used in a client, where the client includes an anchor client or a user client that belongs to the same room, and the device includes: a data switching module. Used for receiving, by the server, a live video from the anchor client and interaction data originating from at least one of the user clients in the room;

a content generating module, configured to generate an interactive display content according to the interaction data received by the data switching module, where the interactive display content is used to display an interaction between the anchor client and the user client;

The interactive display module is configured to merge all or part of the interactive display content generated by the content generating module with the live video received by the data switching module in a same area for display.

In a fourth aspect, the embodiment of the present invention provides a live broadcast interactive service device, which is used in a server, where the device includes: a data receiving module, configured to receive a live video from the anchor client and interaction data from at least one user client in the room, where the room includes the anchor client and at least one user client;

a data forwarding module, configured to forward the live video and the interaction data received by the data receiving module to each client in the room, so that each client in the room generates according to the interaction data The interactive display content is used to display the interaction between the anchor client and the user client, and all or part of the interactive display content is merged with the live video in the same area for display. The client includes the anchor client or the user client belonging to the room.

In a fifth aspect, the embodiment of the present invention provides a client, where the client includes an anchor client or a user client that belongs to the same room, and the client includes the live interactive participation device according to the third aspect.

According to a sixth aspect, an embodiment of the present invention provides a server, where the server includes the live interactive service device according to the fourth aspect.

The seventh aspect, the embodiment of the present invention provides a live interactive system, the system comprising the client according to the fifth aspect and the server according to the sixth aspect.

Receiving live video from the anchor client and interaction data from at least one user client in the room by the receiving server; generating interactive display content according to the interaction data, the interactive display content is used to display between the anchor client and the client client Interactive; integrate all or part of the interactive display content with the live video in the same area for display, so that the user can focus on one area to obtain live interaction, which can solve, for example, displaying the live interaction in multiple areas, causing the user to need more than The line of sight is switched back and forth between the areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in a problem that the information acquisition rate is not high, and the effect of improving the information acquisition rate is achieved. DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in view of the drawings. FIG. 1 is an application scenario diagram of a live interaction method conventionally provided;

2 is a schematic structural diagram of a team voice tool according to an embodiment of the present invention;

3 is a flowchart of a method for a live interaction method according to an embodiment of the present invention;

4 is a flowchart of a method for a live interaction method according to an embodiment of the present invention;

FIG. 5A is a flowchart of a method for a live interaction method according to an embodiment of the present invention; FIG.

5B is a first application scenario diagram of a live interaction method according to an embodiment of the present invention; FIG. 5C is a second application scenario diagram of a live interaction method according to an embodiment of the present invention; FIG. 5E is a fourth application scenario diagram of a live interaction method according to an embodiment of the present invention; FIG. 5F is a fifth application scenario diagram of a live interaction method according to an embodiment of the present invention; FIG. 5 is a sixth application scenario diagram of a live interaction method according to an embodiment of the present invention; FIG. 5 is a seventh application scenario diagram of a live interaction method according to an embodiment of the present invention; FIG. Figure 7 is a structural block diagram of a live interactive participation device according to another embodiment of the present invention; Figure 8 is a structural block diagram of a live interactive service device according to an embodiment of the present invention; It is a structural framework diagram of a live interactive service device provided by another embodiment of the present invention; FIG. 10 is a diagram of a server provided by an embodiment of the present invention; Frame diagram

FIG. 11 is a structural diagram of a live interactive system according to an embodiment of the present invention. detailed description

The embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. Please refer to FIG. 2, which shows a schematic structural diagram of a team voice tool according to an embodiment of the present invention. The team voice tool typically includes at least one client 220 and server 240.

The client 220 can be an electronic device such as a computer, a smart phone, a tablet, and an e-book reader. The electronic device can be installed with an application client of the team voice tool, or a web browser with a browser installed and then accessing the team voice tool through a browser. The client 220 can be divided according to the user: the anchor client used by the anchor and the user client used by the viewer. Among them, the anchor is a user who has the right to upload live video, and can upload the video collected by the local camera. The data is forwarded to the server 240, and then forwarded by the server 240 to the user client 220. The viewer is a user with interactive rights, and the interactive data can be uploaded to the server 240, and the interactive data is forwarded by the server 240 to the anchor client 220. And the user client 220, the user client 220 can receive the live video and interaction data sent by the server 240, and then display. In addition, the client used by the anchor is basically the same as the client, and one team voice tool has one to multiple clients, such as one million clients or ten million clients.

Server 240 can be coupled to client 220 via a wireless or wired network. Server 240 can be one or more servers or a cloud computing center. In other words, the server ²⁴⁰ may be implemented by a single server; may be realized by a combination of a plurality of servers, each server functions bear the same or different, such as a server used to register and login for the server to save the user's avatar The server for storing channel information and configuration information, the server for saving pictures or videos, and the like; the server 240 can also be implemented by a cloud computing center, which is a virtual computing platform formed by a whole service cluster. Please refer to FIG. 3, which is a flowchart of a method for a live interaction method according to an embodiment of the present invention. The live interaction method may be applied to a client, where the client includes an anchor client or a user client belonging to the same room. . The live interaction method includes:

Step 301: The live video from the anchor client sent by the server and the interaction data from at least one user client in the room are received;

The live video is captured by the anchor through a local camera. Specifically, the anchor records the behavior of the camera through the camera and transmits the recorded content to the server.

The interactive data is generated based on the interactions provided by the user's client and the viewer's choices. The interaction is used to interact with the anchor, such as giving gifts to the anchor, chatting with the anchor or other viewers. Specifically, the user client provides an option for interactive operation in the displayed user interface. If the viewer selects the option, the user client generates interaction data according to the interaction operation, and sends the interaction data to the server.

Step 302: Generate an interactive display content according to the interaction data, where the interactive display content is used to display an interaction between the anchor client and the user client;

After the client receives the interactive data, the interactive display content of the interactive operation is generated according to the interaction data. Step 303: Integrate all or part of the interactive display content with the live video in the same area for display.

The client can display the interactive display content and the live video in different areas. Preferably, in order to avoid displaying the live interaction in multiple areas, the user needs to switch the line of sight between the multiple areas, and switch the user's line of sight to a certain one. When the display area is displayed, it is easy to miss the display content of other display areas in the user interface, resulting in a problem that the information acquisition rate is not high, and all or part of the interactive display content may be merged with the anchor video in the same area for display.

In summary, the live interaction method provided by the embodiment of the present invention receives the live video from the anchor client and the interaction data from at least one user client in the room, and generates interactive display content according to the interaction data. The display content is used to display the interaction between the anchor client and the user client Lu; the whole or part of the interactive display content is integrated with the live video in the same area for display, so that the user can pay attention to an area to obtain live interaction, which can be solved. For example, displaying live interactions in multiple areas causes the user to switch back and forth between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in information acquisition rate. The problem is not high, and the effect of improving the access rate of information is achieved. Please refer to FIG. 4, which illustrates a method flow diagram of a live interaction method according to another embodiment of the present invention, where the live interaction method can be applied to a server. The live interaction method includes:

Step 401: Receive a live video from the anchor client and interaction data from at least one user client in the room, where the room includes an anchor client and at least one user client.

Live video is provided by the anchor client. Specifically, the anchor broadcasts its own behavior through the camera, and sends the recorded content to the server, and the server receives the live video sent by the anchor client.

Interactive data is provided by the user's client. Interactive data can be generated based on the interactions provided by the user's client and the viewer's choices. The interaction is used to interact with the viewer, such as giving gifts to the anchor, chatting with the anchor or other viewers. Specifically, the user client provides an option of interactive operation in the displayed user interface. If the viewer selects the option, the user client generates interaction data according to the interaction operation, and sends the interaction data to the server, and the server receives the user client to send. Interactive data.

Step 402: Forward the live video and the interactive data to each client in the room, so that each client in the room generates an interactive display content according to the interaction data, and the interactive display content is used to display the host broadcaster. The interaction between the client and the client client, and each client displays all or part of the interactive display content in the same area as the live video, and the client includes an anchor client or a user client belonging to the room.

The server forwards the received live video and interactive data to each client in the room, and the client integrates all or part of the live video and the interactive display content generated according to the interaction data in one area to avoid live interaction. Displaying in multiple areas causes the user to switch back and forth between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in a problem that the information acquisition rate is not high. . The client includes an anchor client or a user client belonging to the room.

In summary, the live interaction method provided by the embodiment of the present invention forwards the live video and the interactive data to each client in the room, so that each client in the room generates an interactive display content according to the interaction data, and interactively displays the content. Displaying the interaction between the anchor client and the user client, and integrating all or part of the interactive display content with the live video in the same area for display, so that the user can obtain a live interaction by focusing on one area, and can solve, for example, live interaction. Displaying in multiple areas causes the user to switch back and forth between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in a problem that the information acquisition rate is not high. , to achieve the effect of improving the access rate of information. Please refer to FIG. 5A, which illustrates a method flowchart of a live interaction method provided by another embodiment. The live interaction method can be applied to a live interactive system including a client and a server, and the client includes An anchor client or user client in the same room. The live interaction method includes: Step 501: If the client is a user client, send interaction data to the server; if the client is an anchor client, send a live video to the server;

The client in this embodiment includes an anchor client used by the anchor and a user client used by the viewer. Since the anchor and the viewer have different rights in the team voice tool, the anchor client and the client client according to their respective rights are The data sent by the server is different.

When the client is the anchor client, the anchor client can send a live video to the server. The video is captured by a local camera. Specifically, the anchor's own behavior is recorded by the camera, and the recorded content is sent to the server.

When the client is a user client, the user client can send a message to the server for displaying the user. Interactive data for interaction between the client and the anchor client. The interactive data is generated based on the interactions provided by the user's client and the viewer's choices. The interaction is used to interact with the viewer, such as giving gifts to the anchor, chatting with the anchor or other viewers. Specifically, the user client provides an option of interactive operation in the displayed user interface. If the viewer selects the option, the user client generates interaction data according to the interaction operation, and sends the interaction data to the server.

In this embodiment, an interaction scenario may be defined for each interaction operation. When the viewer selects an interaction operation, the user client generates interaction data according to the interaction scenario corresponding to the interaction. For example, if the interactive operation is "send flowers to the anchor", the predefined "send flower scene" in the user client can be called, and the interactive data generated according to the scene includes the flower type, the flower color, and the display duration of the flowers. And the display position of the flowers in the user interface, etc. Preferably, when the other user client also includes the "send flower scene", in order to save the waste of resources caused by transmitting the data of the interactive scene, the user client can obtain the obtained The scenario identifier of the interaction scenario corresponding to the interaction is sent to the server in the interaction data, and the scenario identifier is used to identify the scenario in the client client.

In order to improve the fun of live interaction, viewers can also customize interactive scenes based on the material of the interactive scene provided by the user's client. Specifically, when the viewer performs an interactive action, the viewer can select the corresponding material to generate an interactive scene. Still taking the interactive operation as an example of "sending flowers to the anchor", the viewer can select the flower type, the flower color, and input the display duration and the display position in the user interface in the material library provided by the user client. The user client can generate interactive data based on the material customized by the viewer.

Further, the viewer's own published content may be added to the interactive data by text, picture, audio or video to be sent to the server. The published content is information transmitted by the viewer to the anchor. For example, the published content may be the text of the viewer's love to the anchor, the content of the prompt in the interaction with the anchor, the content of the audience participating in the discussion, or the talent performance requirement presented by the viewer to the anchor. Wait.

Further, before sending the interactive data to the server, the method further includes:

Sending account information corresponding to the user client to the server, so that the server adds the account information to the interactive right after detecting that the account information identifies that the user client has the right to send interactive data;

Get the permissions that the server uses to send interactive data based on the list of interaction permissions.

Therefore, sending the interaction data to the server may include: sending the interaction data to the server according to the authority. In this embodiment, the user client can also set the permission to send the interactive data, so that the user client having the right to send the interactive data can participate in the live interaction, thereby achieving the fun effect of increasing the live interaction. Specifically, the viewer applies for the interaction authority to the server through the user client, and after the server subtracts the account value or the point in the account information corresponding to the user client from the predetermined value, the account information corresponding to the user client is sent. The permission of the interactive data, the server feeds back the permission to the user client, and the user client can send the interaction data to the server according to the permission. Among them, the predetermined value is used to redeem the authority to send interactive data. Further, the value of the redemption may be set according to the type of the interactive operation. For example, the redemption value of "send the flower to the anchor" is 100, and the redemption value of the "fireworks" is 200 or the like, which is not limited in this embodiment.

In an actual application, when the viewer logs in to the account in the user client, the account information of the account may be sent to the server, and the server detects whether the account information identifies the user client having the right to send interactive data, and if the account is detected The information identifies that the user client has the right to send data, and then adds the account information to the rights forwarding list and feeds the permission to the user client. Specifically, the user client can be fed back to the entry of the interactive operation, and the user client selects an interactive operation through the portal of the server feedback to send the interactive data.

Wherein step 501 is an optional step. That is, for the user client that does not participate in the interaction but only watches the interaction between the other user client and the anchor client, step 501 does not need to be performed.

Step 502: The server receives the live video from the anchor client and the interaction data from at least one user client in the room, where the room includes an anchor client and at least one user client; the server receives the originating anchor through the wired network or the wireless network respectively. The live video of the client and the interactive data from at least one user client.

Further, before receiving the live video from the anchor client and the interaction data from the at least one user client in the room, the method further includes: detecting whether the account information has the right to send the interaction data by the user client;

If the detection result indicates that the user client has the right to send the interaction data, the account information is added to the interaction permission list, and the interaction permission list is used to determine at least one user client having the permission to send the interaction data; the client Send interactive data based on permissions. For details about the process for the server to send feedback to the user client, see the description in step 501, and details are not described here.

Step 503: Forward the live video and the interactive data to each client in the room.

Since the server pre-records the anchor client and the user client that join the room, the server can forward the live video and interactive data to the room after receiving the live video and interactive data.

All or part of the content is displayed in the same area as the live video, and the client includes an anchor client or a user client belonging to the room.

For the anchor client that sends the live video and the user client that sends the interactive data, in order to save the waste of transmission resources caused by receiving the data sent by itself, the server may only send the interaction data to the anchor client and the anchor client obtains the local The live video generated by the server may send the live video and the interaction data sent by other user clients only to the user client, so that the user client obtains the interaction data generated by the local user.

Step 504: The client receives the live video from the anchor client and the interaction data from the at least one user client in the room.

The client can receive live video and interactive data sent by the server over a wired or wireless network. Alternatively, for the anchor client that sends the live video and the user client that sends the interactive data, in order to save the waste of transmission resources caused by receiving the data sent by itself, the anchor client can only receive the interactive data and obtain the live broadcast generated by the local itself. Video, the user client can only receive the live video and step 505, the client generates an interactive display content according to the interaction data, and the interactive display content is used to display the interaction between the anchor client and the user client;

Specifically, generating interactive display content according to the interaction data, including:

If the interaction data includes text data and/or image data, the interaction data is added to the display template to generate an interactive display content, and the display template includes at least one of a frame, a banner, a bubble, and a dialog box; The audio data of the user client acquires the personal information of the user client as an interactive display content, and the personal information includes at least one of an avatar, a nickname, and a username;

If the interactive data includes animation data, the animation data is displayed as an interactive display.

First, if the interactive data includes text data and/or image data, the client can convert the text data. And/or image data as interactive display content. Further, in order to enhance the display effect, a display template may also be set for the interaction data, for example, at least one of a frame, a banner, a bubble, and a dialog box, and the user client may also generate the interaction data by adding the interaction data to the display template. Interactive display of content.

Further, when generating the interactive display content according to the text data and/or the image data, in order to explicitly send the text data and/or the image data to the viewer, the personal information of the user client may also be obtained, for example, in the avatar, nickname and user name. At least one, and personal information as interactive display content, to increase the audience's exposure, and enhance the enthusiasm of the audience to participate in the interaction.

Second, if the interactive data includes audio data, since the audio data does not need to be displayed in the user interface, the interactive display content of the audio data can be set to null. Alternatively, the personal information of the viewer who sent the audio data, for example, at least one of an avatar, a nickname, and a username, may be obtained, and the personal information is used as an interactive display content to increase the audience's exposure and enhance the audience's participation in the interaction. Enthusiasm.

Third, if the interactive data includes video data, the video data can be displayed as an interactive display. In general, such interactive data may be animation data, such as a FLASH animation, etc., which is not limited in this embodiment.

Further, when the interactive display content is generated according to the animation data, in order to explicitly clear the viewer who sends the animation data, the personal information of the user client, for example, at least one of an avatar, a nickname, and a username, may be acquired, and the personal information is used as an interaction. Display content to increase viewers' exposure and increase viewers' enthusiasm for engaging in interactions.

It should be noted that the interactive display content generated by the client may be an interactive scenario; or the interactive display content generated by the client may be the user's published content, and the interactive data also includes the data of the interactive scenario, and the user client also The local pre-defined interactive scene indicated by the interactive data can be read, or the user client can read the material indicated by the interactive data to generate a customized interactive scene, and embed the interactive display content into the interactive scene. Specifically, the interactive scene and/or interactive display content can be displayed through the window, and the size of the window can be adjusted.

Step 506: The client displays all or part of the interactive display content in the same area as the live video.

In order to avoid displaying the live interaction in multiple areas, the user needs to switch the line of sight between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in information acquisition. The problem is not high. In this embodiment, all or part of the interactive display content and the live video are fused in the same area for display. The user client can display all or part of the interactive display content and the live video in the same area by means of fusion, overlay or overlay. In this embodiment, the superimposed manner is taken as an example, and all or part of the interactive display content is displayed in the same area as the live video, including: superimposing all or part of the interactive display content on the live video for display.

First, if the interaction data includes text data and/or image data, all or part of the generated interactive display content may be superimposed on the live video for display. Please refer to the live interaction provided by the embodiment of the present invention shown in FIG. 5B. A schematic diagram of a first application scenario of the method. In FIG. 5B, a dialog box of the user client in the video area 12 displays text information of "supporting anchor one" sent by the user F. Referring to FIG. 5C, a schematic diagram of a second application scenario of the live interaction method provided by the embodiment of the present invention is shown in FIG. 5C. In FIG. 5C, a dialog box of the user client in the video area 12 shows that "the user G has gone through many hardships. On the top of the list, applause encourages "text information."

Secondly, all or part of the interactive display content is superimposed on the live video for display, including: if the interactive data includes audio data originating from the user client, all or part of the interactive display content is superimposed on the live video for display. And play audio data.

If the interactive data includes audio data, the user client may superimpose the personal information of the viewer who sent the audio data as all or part of the interactive display content on the live video for display, and acquire the audio data for playing. Referring to FIG. 5D, a third application scenario of the live interaction method provided by the embodiment of the present invention is shown. In FIG. 5D, the user client displays the avatar of the user G in the video area 12, and displays it in the chat area 14. The prompt message of "User G and the anchor is connected to Mai," can play the audio data sent by User G at this time.

Third, superimposing all or part of the interactive display content on the live video for display, including: if the animation data is a switch curtain animation, superimposing the switch curtain animation on the live video for playing;

If the animation data is a gift animation, all or part of the gift animation corresponding to the gift type is superimposed on the live video for playing, and the gift animation is used to indicate that the user client sends a gift to the anchor client; if the interaction data includes animation data, Then, all or part of the interactive display content may be superimposed on the live video for display according to the type of the animation data.

If the animation data is a switch curtain animation, the user client can superimpose the switch curtain animation on the live video for playback. In a specific example, the anchor and the viewer are playing a game of "you are guessing", the anchor interprets a word by doing an action, and the viewer guesses the word according to the action of the anchor. At the start of the anchor Before a new word, you can close the curtain, slowly open the curtain at the beginning of the game, the anchor starts to do the action, when the timing of the guessing of a certain word reaches a predetermined threshold, you can slowly close the curtain, in the form of a stage play. Make guesses and improve the fun of the game. Referring to the fourth application scenario of the live interaction method provided by the embodiment of the present invention shown in FIG. 5E, the screen of the video area 12 is closed in FIG. 5E; please refer to the live broadcast provided by the embodiment of the present invention shown in FIG. 5F. The fifth application scenario of the interactive method, the curtain of the video zone 12 in Figure 5F is open.

If the animation data is a gift animation, the user client can superimpose the gift animation on the live video for playback. There are many types of gifts, such as flowers, fireworks, and cupids. In order to enhance the gift-giving effect, different gift-giving animations can be set according to the type of gift.

In this embodiment, the gift is a fireworks and a cupid as an example. Referring to FIG. 5G, a sixth application scenario diagram of the live interaction method provided by the embodiment of the present invention is shown. The animation of the live fire video is played on the live video of FIG. 5G, and the animation may partially or completely overlap with the live video. Referring to FIG. 5H, a seventh application scenario diagram of the live interaction method provided by the embodiment of the present invention is shown. In the live video of FIG. 5H, three cupids are played on the screen, and the arrow is shot from the screen of the live video to the screen. Animation of the anchor inside.

Fourth, if the interactive data is derived from at least two user clients, all or part of the interactive display content is superimposed on the live video for display, including:

Obtaining the sending time of the interactive data from each user client, and superimposing all or part of the interactive display content corresponding to each user client in the order of sending time in the order of the sending time on the live video; or

All or part of an interactive display content integrated into interactive display content from various user clients is superimposed on the live video for display.

If the user client receives the interaction data from the at least two user clients, the user client may obtain the sending time of the interaction data, and select the interaction data with the earliest transmission time among all the received interaction data, on the live video. The interactive display content generated according to the interactive data is displayed. After the interactive display content is displayed, the interactive data with the earliest sending time is selected in the remaining interactive data for display, and so on, until all the interactive data is displayed. Among them, the interactive display content can be the same or different.

Alternatively, the user client may also obtain the sending time of the interactive data, generate the interactive display content in the order from the morning to the night according to the sending time, and superimpose the first generated interactive display content on the live video. On the top, the subsequent generated interactive display content is superimposed on the live video after the overlay, and so on, until all the interactive display content is superimposed on the live video and then displayed. In general, directly superimposing audio data is likely to cause interference. Therefore, the present display mode can be applied to audio data after being processed by some means. All interactive display content is integrated into an interactive display content for display. Wherein, each interactive display content may be the same or different.

Further, in the process of displaying the live video and the interactive display content, the server can also receive the color of the screen, the closing time of the screen to increase the time of guessing, and the change of the bow of the cupid, etc., which is not limited in this embodiment.

It should be added that since some viewers do not have the right to send interactive data, in order to facilitate these users to participate in the live interaction, the chat area 14 and the gift area 16 are still retained in the user interface, so as to facilitate communication between the anchor and the audience. .

In summary, the live interaction method provided by the embodiment of the present invention receives the live video from the anchor client and the interaction data from at least one user client in the room, and generates interactive display content according to the interaction data. The display content is used to display the interaction between the anchor client and the user client; the whole or part of the interactive display content is integrated with the live video in the same area for display, so that the user can pay attention to an area to obtain a live interaction, which can solve, for example, Displaying the live interaction in multiple areas causes the user to switch back and forth between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in no information acquisition rate. The high problem has achieved the effect of improving the access rate of information. In addition, by sending interactive data through the server, the client can be granted the right to send interactive data, and the client can participate in the live interaction by sending the interactive data, thereby achieving the interesting effect of increasing the live interaction. Please refer to FIG. 6 , which is a structural diagram of a live interactive participation device provided by an embodiment of the present invention. The live interactive participation device can be applied to a client, where the client includes an anchor client or user belonging to the same room. Client. The live interactive participation device includes:

The data switching module 610 is configured to receive a live video sent by the server and originated from the anchor client. From interactive data from at least one user client in the room;

The content generating module 620 is configured to generate an interactive display content according to the interaction data received by the data switching module 610, where the interactive display content is used to display an interaction between the anchor client and the user client;

The interactive display module 630 is configured to merge all or part of the interactive display content generated by the content generating module 620 with the live video received by the data switching module 610 in the same area for display.

In summary, the live interactive participation device provided by the embodiment of the present invention receives the live video from the anchor client and the interaction data from at least one user client in the room, and generates interactive display content according to the interaction data. The interactive display content is used to display the interaction between the anchor client and the user client; and all or part of the interactive display content is integrated with the live video in the same area for display, so that the user can obtain live interaction by focusing on one area, which can be solved. For example, displaying live interactions in multiple areas causes the user to switch back and forth between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in information acquisition rate. The problem is not high, and the effect of improving the access rate of information is achieved. Please refer to FIG. 7 , which is a structural diagram of a live interactive participation device according to another embodiment of the present invention. The live interactive participation device may be applied to a client, where the client includes an anchor client belonging to the same room or User client. The live interactive participation device includes: a data transfer module 610, a content generation module 620, and an interactive display module 630.

The data switching module 610 is configured to receive, by the server, a live video from the anchor client and interaction data originating from at least one user client in the room;

Further, the content generation module 620 includes:

The first generating unit 621 is configured to: if the interaction data includes text data and/or image data, add the interaction data to the display template to generate the interactive display content, where the display template includes at least one of a frame, a banner, a bubble, and a dialog box. Species

The second generating unit 622 is configured to: if the interaction data includes audio data originating from the user client, obtain the personal information of the user client as the interactive display content, where the personal information includes an avatar, a nickname, and At least one of the account names;

The third generating unit 623 is configured to display the animation data as an interactive display if the interactive data includes animation data.

Further, the interactive display module 630 is configured to superimpose the interactive display content on the live video for display.

Specifically, the interactive display module 630 includes:

The first display unit 631 is configured to: if the interactive data includes audio data originating from the user client, superimpose all or part of the interactive display content on the live video for display, and play the audio data.

Specifically, the interactive display module 630 includes:

a second display unit 632, configured to: if the animation data is a switch curtain animation, superimpose the switch curtain animation on the live video for playing;

The third display unit 633 is configured to: if the animation data is a gift animation, overlay all or part of the gift animation corresponding to the gift type on the live video, and the gift animation is used to indicate that the user client is to the main client. Send a Gift.

Specifically, if the interaction data is derived from at least two user clients, the interactive display module 630 includes: between all the parts of the interactive display content corresponding to the respective user clients in the order of sending time from morning to night. Superimposed on the live video for display; or, all or part of an interactive display is superimposed on the live video for display.

Further, the device further includes:

The first sending module 640 is configured to: if the client is a user client, the data switching module 610 sends the live video from the anchor client sent by the server and the interaction data from the at least one user client in the room, and sends the data to the server. Interactive data;

The second sending module 650 is configured to: if the client is an anchor client, the data switching module 610 sends the live video from the anchor client sent by the server and the interaction data from the at least one user client in the room, and sends the data to the server. Live video.

Further, the device further includes: The third sending module 660 is configured to: before the first sending module 640 sends the interaction data to the server, send the account information corresponding to the user client to the server, so that the server detects that the user information has sent the interactive data by detecting the account information. After the privilege, the account information is added to the interactive privilege list, and the privilege privilege list is used to determine at least one user client having the privilege to send the interactive data. The privilege obtaining module 670 is configured to obtain the server 4 according to the third sending module 660. The permission to send interactive data in the interactive permission list;

The first sending module 640 is specifically configured to send the interaction data to the server according to the authority acquired by the permission acquiring module.

In summary, the live interactive participation device provided by the embodiment of the present invention receives the live video from the anchor client and the interaction data from at least one user client in the room, and generates interactive display content according to the interaction data. The interactive display content is used to display the interaction between the anchor client and the user client; and all or part of the interactive display content is integrated with the live video in the same area for display, so that the user can obtain live interaction by focusing on one area, which can be solved. For example, displaying live interactions in multiple areas causes the user to switch back and forth between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in information acquisition rate. The problem is not high, and the effect of improving the access rate of information is achieved. In addition, by obtaining the permission for the server to send the interactive data according to the interaction permission list, and sending the interaction data to the server according to the permission, the client can be granted the right to send the interaction data, and the client can participate in the live interaction by sending the interaction data. In the middle, the fun effect of increasing live interaction is achieved. Referring to FIG. 8, a structural block diagram of a live interactive service device according to an embodiment of the present invention is shown. The live interactive service device can be applied to a server. The live interactive service device includes: a data receiving module 810, configured to receive a live video from the anchor client and interaction data derived from at least one user client in the room, the room including an anchor client and at least one user client;

The data forwarding module 820 is configured to forward the live video and the interaction data received by the data receiving module to each client in the room, so that each client in the room generates an interactive display content according to the interaction data, and the interactive display content is used to display the anchor. The interaction between the client and the client client, and all or part of the interactive display content is displayed in the same area as the live video, and the client includes an anchor client or a user client belonging to the room. In summary, the live interactive service device provided by the embodiment of the present invention forwards the live video and the interactive data to each client in the room, so that each client in the room generates an interactive display content according to the interaction data, and interactively displays the content. It is used to display the interaction between the anchor client and the user client, and integrate all or part of the interactive display content with the live video in the same area for display, so that the user can obtain the live interaction by focusing on one area, and can solve the live broadcast, for example. The interactive display in multiple areas causes the user to switch the line of sight between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in low information acquisition rate. The problem is that the effect of improving the access rate of information is achieved. Please refer to FIG. 9 , which is a structural diagram of a live interactive service device according to another embodiment of the present invention. The live interactive service device can be applied to a server. The live interactive service device includes: a data receiving module 810 and a data forwarding module 820.

The data receiving module 810 is configured to receive a live video from the anchor client and interaction data from at least one user client in the room, where the room includes an anchor client and at least one user client. '

The data forwarding module 820 is configured to forward the live video and the interaction data received by the data receiving module to each client in the room, so that each client in the room generates an interactive display content according to the interaction data, and the interactive display content is used to display the anchor. The interaction between the client and the client client, and all or part of the interactive display content is displayed in the same area as the live video, and the client includes an anchor client or a user client belonging to the room.

Further, the device further includes:

The information receiving module 830 is configured to receive, by the data receiving module 810, the account information corresponding to the user client sent by the user client before receiving the live video from the anchor client and the interaction data from the at least one user client in the room;

The permission detecting module 840 is configured to detect whether the account information received by the information receiving module 830 identifies that the user client has the right to send interactive data;

The permission adding module 850 is configured to add the account information to the interactive permission list when the user terminal has the right to send the interactive data, and the permission feedback module 860 is used according to the permission. Add the interactive permission list generated by module 850 to the user The client feedback is used to send interactive data permissions so that the user client can send interactive data based on the permissions. In summary, the live interactive service device provided by the embodiment of the present invention forwards the live video and the interactive data to each client in the room, so that each client in the room generates an interactive display content according to the interaction data, and interactively displays the content. It is used to display the interaction between the anchor client and the user client, and integrate all or part of the interactive display content with the live video in the same area for display, so that the user can obtain the live interaction by focusing on one area, and can solve the live broadcast, for example. The interactive display in multiple areas causes the user to switch the line of sight between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in low information acquisition rate. The problem is that the effect of improving the access rate of information is achieved. In addition, by feeding back the user's authority to send interactive data according to the interactive permission list, the client can participate in the live interaction by sending the interactive data, thereby achieving the interesting effect of increasing the live interaction. Please refer to FIG. 10, which is a schematic structural diagram of a server according to an embodiment of the present invention. The server 1000 includes a central processing unit (CPU) 1001, a system memory 1004 including a random access memory (RAM) 1002 and a read only memory (ROM) 1003, and a system bus 1005 that connects the system memory 1004 and the central processing unit 1001. The server 1000 also includes a basic input/output system (I/O system) 1006 that facilitates the transfer of information between various devices within the computer, and mass storage for storing the operating system 1013, the application 1014, and other program modules 1015. Device 1007.

The basic input/output system 1006 includes a display 1008 for displaying information and an input device 1009 such as a mouse, a keyboard for inputting information by a user. The display 1008 and the input device 1009 are both connected to the central processing unit 1001 via an input/output controller 1010 connected to the system bus 1005. The basic input/output system 1006 can also include an input output controller 1010 for receiving and processing input from a plurality of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, input/output controller 1010 also provides output to a display screen, printer, or other type of output device.

The mass storage device 1007 is connected to a mass storage controller of the system bus 1005

(not shown) is connected to the central processing unit 1001. The mass storage device 1007 and its associated computer readable medium provide non-volatile storage for the server 1000. That is, the mass storage device 1007 may include a computer readable medium (not shown) such as a hard disk or a CD-ROM drive.

Without loss of generality, the computer readable medium can include computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, EPROM, EEPROM, flash memory or other solid state storage technologies, CD-ROM, DVD or other optical storage, magnetic tape cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer storage medium is not limited to the above. The system memory 1004 and the mass storage device 1007 described above may be collectively referred to as a memory.

According to various embodiments of the present invention, the server 1000 may also be operated by a remote computer connected to the network through a network such as the Internet. That is, the server 1000 can be connected to the network 1012 through the network interface unit 1011 connected to the system bus 1005, or the network interface unit 1011 can be used to connect to other types of networks or remote computer systems (not shown). .

The memory also includes one or more programs, the one or more programs being stored in a memory and configured to be executed by one or more central processing units 1001. The above one or more programs have the following functions:

Receiving a live video from the anchor client and interaction data derived from at least one user client in the room, the room including an anchor client and at least one user client;

The live video and interactive data are forwarded to each client in the room, so that each client in the room generates an interactive display content according to the interaction data, and the interactive display content is used to display the interaction between the anchor client and the user client, and the interaction will be All or part of the displayed content is merged with the live video in the same area i or into the display.

Further, before receiving the live video from the anchor client and the interaction data originating from at least one user client in the room, the method further includes:

Receiving account information corresponding to the user client sent by the user client;

Check if the account information identifies the user client has the right to send interactive data;

If the detection result indicates that the user client has the right to send the interaction data, the account information is added to the interaction permission list, and the interaction permission list is used to determine at least one user client having the permission to send the interaction data;

The user's client is fed back the right to send interactive data according to the interactive permission list, so that the user client sends the interactive data according to the permission. Please refer to FIG. 11 , which is a structural diagram of a live interactive system provided by an embodiment of the present invention. The live interactive system includes: a client 1110 and a server 1120, and the client 1110 can include an anchor client or a user client belonging to the same room.

The client 1110 may be the client shown in FIG. 6 or FIG. 7, and the server 1120 may be the server shown in FIG. 8 or FIG. 9 or FIG.

In summary, the live interactive system provided by the embodiment of the present invention receives the live video from the anchor client and the interaction data from at least one user client in the room, and generates interactive display content according to the interaction data. The display content is used to display the interaction between the anchor client and the user client; the whole or part of the interactive display content is integrated with the live video in the same area for display, so that the user can pay attention to an area to obtain a live interaction, which can solve, for example, Displaying the live interaction in multiple areas causes the user to switch back and forth between the multiple areas. When the user's line of sight switches to a certain display area, it is easy to miss the display content of other display areas in the user interface, resulting in no information acquisition rate. The high problem has achieved the effect of improving the access rate of information. In addition, by sending interactive data through the server, the client can be granted the right to send interactive data, and the client can participate in the live interaction by sending the interactive data, which can increase the interesting effect of the live interaction. It should be noted that, when the live interaction device provided by the foregoing embodiment performs the live interaction, only the division of the above functional modules is illustrated. In actual applications, the function distribution may be completed by different functional modules as needed. The internal structure of the live interactive device is divided into different functional modules to complete all or part of the functions described above. In addition, the embodiment of the live broadcast interaction device and the live broadcast interaction method provided by the foregoing embodiments are in the same concept, and the specific implementation process is described in the method embodiment, and details are not described herein again.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

A person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium. The storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., which are included in the spirit and scope of the present invention, should be included in the present invention. Within the scope of protection.

Claims

claims

1. A live broadcast interaction method, used in clients. The clients include anchor clients or user clients. The method includes:

Receive live video from the host client and interactive data from at least one of the user clients sent by the server;

Generate interactive display content based on the interactive data, and the interactive display content is used to display the interaction between the anchor client and the user client;

All or part of the interactive display content and the live video are integrated in the same area for display.

2. The method according to claim 1, wherein generating interactive display content based on the interactive data includes:

If the interactive data includes text data and/or picture data, the interactive data is added to a display template to generate the interactive display content. The display template includes at least one of a frame, a banner, a bubble, and a dialog box. kind;

If the interactive data includes audio data originating from the user client, then obtain the personal information of the user client as the interactive display content, and the personal information includes at least one of an avatar, a nickname, and a user name;

If the interactive data includes animation data, the animation data is used as the interactive display content.

3. The method according to claim 2, wherein the integrating all or part of the interactive display content with the live video for display in the same area includes:

All or part of the interactive display content is superimposed on the live video for display.

4. The method according to claim 3, wherein superimposing all or part of the interactive display content on the live video for display includes:

If the interactive data includes audio data from the user client, all or part of the interactive display content is superimposed on the live video for display, and the audio data is played.

5. The method according to claim 3, wherein superimposing all or part of the interactive display content on the live video for display includes:

If the animation data is a curtain opening and closing animation, the curtain opening and closing animation is superimposed on the live video for playback;

If the animation data is a gift-giving animation, all or part of the gift-giving animation corresponding to the gift type is superimposed on the live video for playback. The gift-giving animation is used to represent the user client to the anchor client. Send a Gift.

6. The method according to claim 3, wherein if the interactive data comes from at least two user clients, then all or part of the interactive display content is superimposed on the live video for display, include:

Obtain the sending time of the interactive data from each user client, and partially superimpose it on the live video for display according to the sending time; or partially or partially superimpose it on the live video for display.

7. The method according to any one of claims 1 to 6, wherein before receiving the live video from the anchor client and the interaction data from at least one of the user clients sent by the server, the method further includes:

If the client is a user client, the interactive data is sent to the server; if the client is a host client, the live video is sent to the server.

8. The method according to claim 7, wherein before sending the interactive data to the server, further comprising:

Send the account information corresponding to the user client to the server, so that after the server detects that the account information identifies that the user client has the authority to send the interaction data, the server sends the account information to the server. Added to the interaction permission list, the interaction permission list is used to determine at least one user client with the permission to send the interaction data; Obtain the permissions for sending the interaction data fed back by the server according to the interaction permissions list; and wherein

The sending of the interactive data to the server includes:

Send the interaction data to the server according to the permission.

9. A live broadcast interaction method, used in the server, the method includes:

Receive live video from the anchor client and interactive data from at least one user client;

Forward the live video and the interactive data to each client, so that each client generates interactive display content based on the interactive data, and the interactive display content is used to display the anchor client and the user client Through interaction between clients, all or part of the interactive display content and the live video are integrated in the same area for display, and the client includes the anchor client or the user client.

10. The method according to claim 9, wherein before receiving the live video from the anchor client and the interactive data from at least one user client, it further includes:

Receive account information corresponding to the user client sent by the user client;

Detect whether the account information identifies that the user client has the authority to send the interactive data;

If the detection result is that the account information identifies that the user client has the authority to send the interaction data, then the account information is added to the interaction authority list, and the interaction authority list is used to determine that the user client has the authority to send the interaction data. Data permissions for at least one user client;

Feedback the permission for sending the interactive data to the user client according to the interactive permission list, so that the user client sends the interactive data according to the permission.

11. A live broadcast interactive participation device, used in a client. The client includes a host client or a user client. The device includes:

A data transfer module, configured to receive live video from the host client and interactive data from at least one of the user clients sent by the server;

A content generation module, configured to generate interactive content based on the interactive data received by the data transfer module. Dynamic display content, the interactive display content is used to display the interaction between the anchor client and the user client;

An interactive display module, used to integrate all or part of the interactive display content generated by the content generation module with the live video received by the data transfer module for display in the same area -

12. The device according to claim 11, wherein the content generation module includes: a first generation unit, configured to add the interactive data if the interactive data includes text data and/or picture data. Generate the interactive display content in a display template, where the display template includes at least one of a frame, a banner, a bubble, and a dialog box;

The second generation unit is configured to obtain the personal information of the user client as the interactive display content if the interactive data includes audio data from the user client. The personal information includes an avatar, a nickname and a user name. at least one of;

The third generation unit is configured to use the animation data as the interactive display content if the interactive data includes animation data.

13. The device according to claim 12, wherein the interactive display module is configured to superimpose all or part of the interactive display content on the live video for display.

14. The device according to claim 13, wherein the interactive display module includes: a first display unit, configured to display the interactive content if the interactive data includes audio data originating from the user client. All or part of the video is superimposed on the live video for display, and the audio data is played.

15. The device according to claim 13, wherein the interactive display module includes: a second display unit, configured to superimpose the curtain opening animation on the live video if the animation data is a curtain opening animation. play on;

The third display unit is used to superimpose all or part of the gift animation corresponding to the gift type on the live video for playback if the animation data is a gift animation, and the gift animation is used to represent the user customer The client sends a gift to the anchor client.

16. The device according to claim 13, wherein if the interactive data comes from at least two user clients, then the interactive display module includes: time, according to the order of the sending time from early to late. All or part of the interactive display content corresponding to each user client is sequentially superimposed on the live video for display; or

The fifth display unit is used to superimpose all or part of the interactive display content from the interactive display content from each user client onto the live video for display.

17. The device according to any one of claims 11 to 16, wherein the device further includes: a first sending module, configured to: if the client is a user client, the data transfer module receives the server Before sending the live video from the anchor client and the interaction data from at least one of the user clients, send the interaction data to the server;

The second sending module is used to, if the client is a host client, the data transfer module before receiving the live video from the host client and the interactive data from at least one of the user clients sent by the server. , sending the live video to the server.

18. The device according to claim 17, wherein the device further includes:

The third sending module is configured to send the account information corresponding to the user client to the server before the first sending module sends the interactive data to the server, so that when the server detects the After the account information identifies that the user client has the authority to send the interaction data, the account information is added to an interaction authority list, and the interaction authority list is used to determine at least one client that has the authority to send the interaction data. user client;

A permission acquisition module, configured to obtain the permission for sending the interactive data fed back by the server according to the interactive permission list generated by the third sending module; and wherein

The first sending module is specifically configured to send the interactive data to the server according to the permission obtained by the permission acquisition module.

19. A live interactive service device used in a server. The device includes:

Data receiving module, used to receive live video from the anchor client and from at least one User client interaction data;

A data forwarding module, configured to forward the live video and the interactive data received by the data receiving module to each client, so that each client generates interactive display content based on the interactive data, the interactive display The content is used to display the interaction between the anchor client and the user client, and all or part of the interactive display content is integrated with the live video for display in the same area, and the client includes the Anchor client or said user client.

20. The device according to claim 19, wherein the device further includes:

An information receiving module, configured to receive the account information corresponding to the user client sent by the user client before the data receiving module receives the live video from the anchor client and the interactive data from at least one user client;

An authority detection module, configured to detect whether the account information received by the information receiving module identifies that the user client has the authority to send the interactive data;

A permission adding module, configured to add the account information to one less user client when the detection result of the permission detection module is that the account information identifies that the user client has the permission to send the interactive data. ;

A permission feedback module, configured to feedback permissions for sending the interaction data to the user client according to the interaction permission list generated by the permission adding module, so that the user client sends the interaction according to the permissions. data.

21. A client, the client includes a host client or a user client, and the client includes the live interactive participation device as claimed in any one of claims 11 to 18.

12. A server, the server comprising the live interactive service device as claimed in claim 19 or 20.

23. A live interactive system, the system comprising the client as claimed in claim 21 and the server as claimed in claim 22.