WO2020010819A1

WO2020010819A1 - Live broadcast room-based data interaction method and device, terminal, and storage medium

Info

Publication number: WO2020010819A1
Application number: PCT/CN2018/124778
Authority: WO
Inventors: 廖智
Original assignee: 北京微播视界科技有限公司
Priority date: 2018-07-12
Filing date: 2018-12-28
Publication date: 2020-01-16
Also published as: CN108924661B; CN108924661A

Abstract

Disclosed are a live broadcast room-based data interaction method and device, a terminal, and a storage medium. The method comprises: acquiring an interaction message from any client terminal in a live broadcast room, wherein the interaction message carries data relating to an interaction type and an interaction effect; and adding, according to the interaction type, the interaction effect to a live broadcast video stream.

Description

Data interaction method, device, terminal and storage medium based on live broadcast

This application claims priority from a Chinese patent application filed with the Chinese Patent Office on July 12, 2018, with application number 201810765259.3, the entire contents of which are incorporated herein by reference.

Technical field

Embodiments of the present disclosure relate to the field of Internet technologies, and for example, to a data interaction method, device, terminal, and storage medium based on live broadcast.

Background technique

Webcast is a new social networking method that can be viewed or interacted on different communication platforms through the web system at the same time. The webcast platform has also become a new type of social media. In a common network live broadcast platform, in order to increase the fun of the interaction between the anchor and the user, the user generally purchases a virtual gift and then gives it to the anchor to create an opportunity for interaction. At the same time, the anchor can increase the income of the corresponding value of the gift, and the gift can eventually be exchanged for cash to meet the operation of the network live broadcast platform.

During the anchor live broadcast, when a user (viewer) enters the live broadcast room to watch the live broadcast and interact with the anchor, such as interactive messages, the interactive effects of some interactive messages can only be displayed on the anchor's client interface, and only the anchor can watch . Therefore, the interactive message display method and interaction method are relatively single, and the interaction effect is weak.

Summary of the invention

Embodiments of the present disclosure provide a data interaction method, device, terminal, and storage medium based on live broadcasts, which further enriches the interaction between listeners and anchors in live broadcasts.

An embodiment of the present disclosure provides a data interaction method based on live broadcast, and the method includes:

Obtaining an interactive message from any client in the live broadcast room, wherein the interactive message carries data of an interaction type and an interaction effect;

According to the interaction type, the interaction effect is added to a live video stream.

An embodiment of the present disclosure further provides a data interaction device based on live broadcast, the device includes:

The message obtaining module is configured to obtain an interactive message from any client in the live broadcast room, wherein the interactive message carries data of an interactive type and an interactive effect;

The effect display module is configured to add the interactive effect to a live video stream according to the interaction type.

An embodiment of the present disclosure further provides a terminal, where the terminal includes:

One or more processors;

Memory, set to store one or more programs,

When the one or more programs are executed by the one or more processors, the one or more processors implement the data interaction method based on live broadcast according to any embodiment of the present invention.

An embodiment of the present disclosure further provides a storage medium containing computer-executable instructions that, when executed by a computer processor, are used to execute a data interaction method based on live broadcast according to any embodiment of the present invention. .

Overview of the drawings

FIG. 1 is a flowchart of a data interaction method based on live broadcast in an embodiment of the present disclosure;

FIG. 2 is a schematic view of an interface effect of presenting gifts in a live broadcast room in an embodiment of the present disclosure;

3 is a flowchart of another method for data interaction between live broadcasts according to an embodiment of the present disclosure;

4 is a flowchart of another data interaction method based on live broadcast in an embodiment of the present disclosure;

5 is a schematic structural diagram of a data interaction device based on live broadcast according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of a hardware structure of a terminal according to an embodiment of the present disclosure.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the present invention, rather than limiting the present invention. In addition, it should be noted that, for convenience of description, only some but not all structures related to the present invention are shown in the drawings.

FIG. 1 is a flowchart of a data interaction method based on live broadcast according to an embodiment of the present disclosure. This embodiment is applicable to a situation in which a host and a user watching a live broadcast interact with each other during a live broadcast, for example, a user presents a gift to a broadcaster. situation. The method can be executed by a data interaction device based on live broadcast. The device can be implemented in at least one of software and hardware, and can be configured on any terminal. The terminal can be any network communication function and camera function. Terminals, such as smartphones and tablets.

As shown in FIG. 1, a method for data interaction based on live broadcast provided by an embodiment of the present disclosure includes: step S110 and step S120.

In step S110, an interactive message from any client in the live broadcast room is obtained.

The live broadcast room includes the anchor and other users (viewers). The anchor terminal may obtain interactive messages from any client installed on other user terminals in the live broadcast room, for example, a client used for live video broadcasting. The interaction message carries data of an interaction type and an interaction effect. The interactive message may be a message in which the user and the anchor perform various forms of interaction in the live broadcast room. The type of interaction includes a form of gift giving, animated expression, and other forms of interactive message. Interactive effect is the display effect corresponding to the type of interactive message. The data of interactive effects can be specific effect data used to display interactive messages on the terminal interface, such as data such as dynamic effects or background colors in interactive effects, including control animations for interactive messages, entering effects from outside the screen, and displaying combo effects , And related effects such as disappearance.

In one embodiment, the interactive message includes a gift-giving message, and the interaction type includes a gift-giving type. In an embodiment, if the interactive message is a gift-giving message, the gift-giving message carries data about the type of gift and the effect of the gift. Gift types can be different types that are classified according to gift size, effect, or gift value. In one embodiment, the gifts are divided into three types based on the animation effect of the gift: small gifts, that is, only dynamic display of the gift tray; sticker gifts, display of gift trays and sticker props; large gifts, gift trays, and full screen Animation display (WebP format or MP4 format, etc.). The gift effect data can be specific effect data used to display the gift on the terminal interface, such as data such as motion effects or background colors in the gift effect, including gift control animations, entering effects from outside the screen, displaying combo effects, and Disappearing and other related effects. In an embodiment, the motion effect may include a display motion effect, a combo motion effect, and the like. The display animation refers to the effect of the gift displayed on the terminal interface. The combo animation is a period of time after a gift is successfully given. Click again to give the same gift, and you can achieve the combo displayed on the terminal interface. Percussion effect. The interactive message may also include the basic content of the interactive message, such as the name, icon, interactive time, avatar of the interactor, and the nickname of the interactor.

In an embodiment, FIG. 2 is a schematic view of an interface effect of giving a gift in a live broadcast room. As shown in FIG. 2, in a live broadcast room, all users participating in the live broadcast room can perform it through a client on their own terminal. Gifts are usually given by the user to the anchor to interact with the anchor. Of course, the anchor can also give gifts to the anchor himself. In one embodiment, when the user enters the live broadcast room, he can click on the gift panel. The gift icons and names that can be displayed in the gift panel include: "Lollipop", "Fairy Stick", "Call for you" "," Boom ", etc. Click a gift icon in the gift panel popped up in the live broadcast interface to make a gift. In an embodiment, the gift effect displayed on the interface may include the basic information of the gift, such as the name of the gift, the icon of the gift, the time when the gift was given, the avatar of the presenter, the nickname of the presenter, and the number of hits achieved.

In step S120, the interaction effect is added to the live video stream according to the interaction type.

The video stream refers to the transmission of video data. Generally, because the video stream is a streaming transmission, the browser or plug-in in the terminal can display multimedia data before the entire file is transmitted. The live video stream may be a live video stream in a live broadcast, studio or studio live broadcast, or web broadcast. After adding the interaction effect data corresponding to the interaction type to the live video stream, all users in the same live broadcast room can use the client to watch the gift effect through the video stream on their respective terminals.

In an embodiment, after the user in the live broadcast room successfully sends the client interactive message, the interactive message may be sent to the server. The anchor can obtain the interactive message from the server and add the corresponding interactive effect to the live video stream. In one embodiment, after the gift is successfully delivered, the anchor can obtain the message of the gift from the server. , Add the animation effect corresponding to the gift giving to the live video stream in the live broadcast room, so that other viewers in the live broadcast room at this time watch the gift effect on their user terminal.

The method for data interaction based on live broadcast provided by this embodiment obtains an interactive message from any client in the live broadcast room, wherein the interactive message carries data of an interaction type and an interaction effect; according to the interaction type, Adding the interactive effect to the live video stream, so that all terminals in the live broadcast room can watch the interactive effect through the video stream, further enriching the interaction mode between the listener and the anchor in the live broadcast room, and enhancing the interaction effect.

FIG. 3 is a flowchart of another method for data interaction between live broadcasts according to an embodiment of the present disclosure. As shown in FIG. 3, the method includes: step S310, step S320, and step S330.

In step S310, an interactive message from any client in the live broadcast room is obtained.

In step S320, a face recognition module is started to perform user face recognition.

The face recognition module can recognize a face image. In one embodiment, after the face recognition module is started, the camera module may be triggered to collect an image or video stream containing the face, and then recognize the face.

In step S330, the interaction effect is added to the live video stream according to the interaction type and the result of the user's face recognition.

Wherein, a corresponding interactive effect is added to the interactive message according to the interaction type and the result of the user's face recognition. When the interactive effect is added to the live video stream, all users in the live room can pass on their respective terminals. Clients watch interactive effects. In an embodiment, when receiving a gift-giving message, the anchor end may add a corresponding gift effect to the gift according to the type of gift received and the result of the host's own face recognition. For example, for a sticker gift, the results of anchor face recognition, such as the anchor's static or dynamic face image, can be added to the gift effect of the sticker gift. That is, when presenting a gift effect on the anchor and other user terminals, the present effect including a face image can be displayed, which increases the interest of the gift effect and enhances the interaction between the anchor and the audience.

In an embodiment, the method further includes:

If it is detected that the duration of adding the video stream corresponding to the interactive effect reaches a preset interactive message display time, the adding of the interactive effect is stopped.

The preset interactive message display time is a preset preset interaction effect corresponding to the interactive message is continuously added to the video stream, and the interactive effect can be continuously displayed during the preset interactive message display time.

In an embodiment, if it is a gift-giving message, the effect of the gift may be continuously displayed within a preset interactive message display time. For example, if the preset gift display time is 3s, the sticker gift is continuously displayed in the video stream for 3s, that is, the gift effect disappears after being displayed on the terminals of all users in the live broadcast room for 3s.

In an embodiment, the acquiring the interactive message from any client in the live room includes at least one of the following:

Polling the interactive message interface of the server at a preset time interval, pulling the interactive message of any client from the server; and receiving the interactive message pushed by the server.

The polling may be a long polling, that is, the host sends a request to the server to obtain the latest data information. The anchor end polls the interactive message interface of the server according to a preset time interval, and pulls the interactive message of any user terminal from the server. In an embodiment, the anchor end may send an interactive message request to the server at a fixed time interval or at a preset time interval. After receiving the request, the server immediately returns a response message and closes the connection, that is, pulling any one of the clients from the server. After the message is interactive, the connection between the server and the anchor will be closed. Each time the anchor interacts with the server, it can be regarded as a complete HyperText Transfer Protocol (HTTP) request and response process, which enhances the interactive messages between the anchor and the server, such as the real-time transmission of gift messages. Sex and interactivity.

However, every HTTP request and response comes with complete HTTP header information, which will increase the amount of data transmitted each time. The server and the anchor end establish a two-way connection to transmit data and obtain interactive messages through other methods. For example, an interactive message pushed by the server may be actively received. In an embodiment, the server can actively push interactive messages, for example, by pushing the server to broadcast WebSoket. The host no longer needs to frequently poll the server for new interactive messages, but the new interactive messages are automatically sent by the server. The end is pushed to the anchor end, and finally realizes two-way communication and realizes interactive messages, such as timely push of gift messages.

The method for interactive data based on live broadcast provided by this embodiment is to start the face recognition module to perform user face recognition on the anchor end, and add to the live video stream according to the interaction type and the result of the user's face recognition. The interaction effect further enriches the interaction effect of the interactive message and enhances the interaction between the viewer and the anchor. At the same time, the interactive message interface of the server or the interactive message actively pushed by the server can be polled through preset time intervals to realize the real-time and timely acquisition of interactive messages and increase the interactive messages between live broadcasts, such as the real-time and smooth display of gift presents.

FIG. 4 is a flowchart of another method for data interaction between live broadcasts according to an embodiment of the present disclosure. As shown in FIG. 4, the method for data interaction based on live broadcast includes: step S410, step S420, and step S430.

In step S410, an interactive message from any client in the live broadcast room is obtained, and the interactive message is divided into an interactive message queue corresponding to the interactive type according to the interactive type.

Where multiple people send interactive messages at the same time or in succession, a message queue can be formed, and different types of interactive messages can be divided into corresponding interactive message queues, such as gift queues, expression queues, and so on. Further, the present gift queue may also be divided into different gift queues for different types of present gifts, such as a large gift queue, a tray gift queue, and a sticker gift queue.

In step S420, according to the interaction type, the interaction effect corresponding to the interaction message is sequentially added to the live video stream in the interaction message queue corresponding to the interaction type in the order of the interaction message time.

The interactive messages in the queue are sequentially displayed on the anchor according to the interactive message queue, and the corresponding interactive effects can be sequentially added to the video stream. In an embodiment, since a lot of interactive messages may be received in a short time in the live broadcast room, these interactive messages need to be processed into a queue, and the corresponding interactive effects are added to the live video in turn. Stream, and then play the interactive effect. After the interactive effect of an interactive message is played, remove the interactive message from the interactive message queue or continue to play the interactive effect of the next interactive message, so that the interactive effect of the interactive message can be displayed. The order is not disordered, while ensuring the smooth display of interactive effects. Taking the gift giving message as an example, the gift giving message can be processed into a queue according to the type of gift, and then added to the live video stream in turn, and then the gift effect is played. After a gift effect is played, it can be retrieved from the gift queue or Next message, continue to play the next gift effect to ensure the accuracy and smoothness of the gift effect display.

According to the data interaction method based on live broadcast provided by this embodiment, the anchor obtains an interactive message from any client in the live broadcast room, and divides the interactive message into an interactive message queue corresponding to the interaction type according to the interaction type. ; According to the interaction type, in the corresponding interactive message queue, the corresponding interactive effects are sequentially added to the live video stream according to the sequence of the interactive message time. Adding interactive effects to the video stream according to the interactive message queue can prevent the order of the interactive effect display from being disordered, achieve the accuracy and timeliness of the interactive effect display, and improve the interactive experience between the audience and the anchor in the live broadcast room.

FIG. 5 is a schematic structural diagram of a data interaction device based on a live broadcast room according to an embodiment of the present disclosure. This embodiment is applicable to the interaction in a live broadcast room. As shown in FIG. 5, the structure of the device includes a message acquisition module. 510 and effect display module 520.

The message obtaining module 510 is configured to obtain an interactive message from any client in the live broadcast room, wherein the interactive message carries data of an interaction type and an interaction effect.

The effect display module 520 is configured to add the interactive effect to a live video stream according to the interaction type.

In an embodiment, the effect display module 520 includes: a face recognition unit and an effect adding unit.

The face recognition unit is configured to start a face recognition module to perform user face recognition.

The effect adding unit is configured to add the interaction effect to a live video stream according to the interaction type and a result of a user's face recognition.

In an embodiment, the apparatus further includes: an interactive message display module.

The interactive message display module is configured to stop adding the interactive effect if it is detected that the duration of adding the video stream corresponding to the interactive effect reaches a preset interactive message display time.

In one embodiment, the message obtaining module 520 is configured to poll the server's interactive message interface at a preset time interval, and pull the interactive message of any client from the server; and receive the server Push interactive messages.

In an embodiment, the message obtaining module 510 is configured to obtain an interactive message from any client, and divide the interactive message into an interactive message queue corresponding to the interaction type according to the interaction type, wherein the The interactive message also carries data of the interactive message time; the effect display module 520 is configured to, in accordance with the interaction type, in the interactive message queue corresponding to the interaction type, according to the sequence of the interactive message time, the The interactive effect corresponding to the interactive message is added to the live video stream.

In one embodiment, the interactive message includes a gift-giving message, and the interaction type includes a gift-giving type.

A data interaction device based on live broadcast provided by the embodiments of the present disclosure can execute a data interaction method based on live broadcast provided by any embodiment of the present invention, and has corresponding function modules and beneficial effects of the execution method. For technical details not described in detail in this embodiment, reference may be made to a data interaction method based on live broadcast provided by any embodiment of the present invention.

FIG. 6 is a schematic diagram of a hardware structure of a terminal according to an embodiment of the present disclosure. The terminal may be implemented in various forms, and the terminal in the embodiment of the present disclosure may include, but is not limited to, such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a Personal Digital Assistant (PDA), and a tablet computer ( Portable Android Device (PAD), Portable Multimedia Player (Portable Media Player, PMP), navigation device, vehicle terminal, vehicle display terminal, vehicle electronic rearview mirror and other mobile terminals, as well as digital television (Television, TV), desktop computer And other fixed terminals.

As shown in FIG. 7, the terminal 700 may include a wireless communication unit 710, an A / V (audio / video) input unit 720, a user input unit 730, a sensing unit 740, an output unit 750, a memory 760, an interface unit 770, and a processor 780 and power supply unit 790 and so on. FIG. 7 illustrates a terminal with various components, but it should be understood that implementation of all of the illustrated components is not required. More or fewer components may be implemented instead.

Among them, the wireless communication unit 610 allows radio communication between the terminal 600 and a wireless communication system or network. The A / V input unit 620 is configured to receive an audio or video signal. The user input unit 630 may generate key input data according to a command input by the user to control various operations of the terminal. The sensing unit 640 detects the current state of the terminal 600, the location of the terminal 600, the presence or absence of a user's touch input to the terminal 600, the orientation of the terminal 600, the acceleration or deceleration movement and direction of the terminal 600, and the like, and generates a signal for controlling the terminal 600. The command or signal of the operation. The interface unit 670 functions as an interface through which at least one external device can connect with the terminal 600. The output unit 650 is configured to provide an output signal in at least one of a visual, audio, and haptic manner. The memory 660 may store a software program or the like for processing and control operations performed by the processor 680, or may temporarily store data that has been output or is to be output. The memory 660 may include at least one type of storage medium. Also, the terminal 600 may cooperate with a network storage device that performs a storage function of the memory 660 through a network connection. The processor 680 typically controls the overall operation of the terminal. In addition, the processor 680 may include a multimedia module for reproducing or playing back multimedia data. The processor 680 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as characters or images. The power supply unit 690 receives external power or internal power under the control of the processor 680 and provides appropriate power required to operate a plurality of elements and components. When one or more programs included in the foregoing terminal are executed by the one or more processors 680, the following operations may be performed:

An embodiment of the present disclosure further provides a storage medium containing computer-executable instructions, which are executed by a computer processor to execute a method for data interaction based on live broadcast, the method including:

Certainly, a storage medium including computer-executable instructions provided in the embodiments of the present disclosure is not limited to the method operations described above, and may also perform a live-based based on the live room provided by any embodiment of the present disclosure. Related operations in the data interaction method.

The computer storage medium of the embodiment of the present disclosure may adopt any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (Read-Only Memory (ROM)), Erasable Programmable (Read-Only Memory (EPROM)), or flash memory, optical fiber, portable compact disk read-only memory (Compact Disc-Read-Only Memory (CD-ROM)) , Optical storage device, magnetic storage device, or any suitable combination of the foregoing. In this document, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device.

The computer-readable signal medium may include a data signal in baseband or propagated as part of a carrier wave, which carries a computer-readable program code. Such a propagated data signal may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable medium may send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. .

The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wire, optical fiber cable, radio frequency (RF), or any suitable combination of the foregoing.

Computer program code for performing the operations of the present invention may be written in one or more programming languages, or combinations thereof, including programming languages such as Java, Smalltalk, C ++, and also conventional Procedural programming language-such as "C" or similar programming language. The program code can be executed entirely on the user's computer, partly on the user's computer, as an independent software package, partly on the user's computer, partly on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network-including a local area network (LAN) or a wide area network (WAN)-or it can be connected to an external computer ( (E.g. using an Internet service provider to connect via the Internet).

Claims

A data interaction method based on live broadcast includes:

Obtaining an interactive message from any client in the live broadcast room, wherein the interactive message carries data of an interaction type and an interaction effect;

According to the interaction type, the interaction effect is added to a live video stream.
The method according to claim 1, wherein adding the interaction effect to a live video stream according to the interaction type comprises:

Start the face recognition module to perform user face recognition;

Add the interaction effect to the live video stream according to the interaction type and the result of the user's face recognition.
The method of claim 1, further comprising:

Based on detecting that the duration of the video stream corresponding to adding the interactive effect reaches the preset interactive message display time, the adding of the interactive effect is stopped.
The method according to claim 1, wherein obtaining the interactive message from any client in the live broadcast room comprises at least one of the following:

Poll a server's interactive message interface at a preset time interval, and pull interactive messages from any of the clients from the server; and

Receiving an interactive message pushed by the server.
The method according to claim 1, wherein obtaining interactive messages from any client in the live broadcast room comprises:

Obtain an interactive message from any client in the live broadcast room, and divide the interactive message into an interactive message queue corresponding to the interactive type according to the interactive type, where the interactive message also carries an interactive message time data;

Adding the interactive effect to a live video stream according to the interaction type includes:

According to the interaction type, the interactive effect corresponding to the interactive message is sequentially added to the live video stream in the interactive message queue corresponding to the interaction type in the order of the interactive message time.
The method according to any one of claims 1-5, wherein the interactive message includes a message of gift giving, and the interaction type includes a type of gift giving.
A data interaction device based on live broadcast includes:

The message obtaining module is configured to obtain an interactive message from any client in the live broadcast room, wherein the interactive message carries data of an interactive type and an interactive effect;

The effect display module is configured to add the interaction effect to a live video stream according to the interaction type.
The apparatus according to claim 7, wherein the effect display module comprises:

A face recognition unit configured to start a face recognition module for user face recognition;

The effect adding unit is configured to add the interaction effect to a live video stream according to the interaction type and a result of a user's face recognition.
The apparatus according to claim 7, further comprising:

The interactive message display module is configured to stop adding the interactive effect based on detecting that the duration of the video stream corresponding to the added interactive effect reaches a preset interactive message display time.
The apparatus according to claim 7, wherein the message acquisition module is set to at least one of the following:

Poll a server's interactive message interface at a preset time interval, and pull interactive messages from any of the clients from the server; and

Receiving an interactive message pushed by the server.
The apparatus according to claim 7, wherein the message acquisition module is configured to:

Obtain an interactive message from any client in the live broadcast room, and divide the interactive message into an interactive message queue corresponding to the interactive type according to the interactive type, where the interactive message also carries an interactive message time data;

The effect display module is configured to, in accordance with the interaction type, sequentially add the interaction effect corresponding to the interactive message to the interactive message queue in the interaction message queue corresponding to the interaction type. Live video stream.
The device according to any one of claims 7-11, wherein the interactive message includes a message of gift giving, and the interaction type includes a type of gift giving.
A terminal including:

At least one processor;

Memory, configured to store at least one program,

When the at least one program is executed by the at least one processor, the at least one processor implements the method for data interaction based on live broadcast according to any one of claims 1-6.
A storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to execute the method for data interaction based on live broadcast according to any one of claims 1-6.