CN112492331B

CN112492331B - Live broadcast method, device, system and storage medium

Info

Publication number: CN112492331B
Application number: CN202011221358.9A
Authority: CN
Inventors: 张云龙
Original assignee: Beijing Sankuai Online Technology Co Ltd
Current assignee: Beijing Sankuai Online Technology Co Ltd
Priority date: 2020-11-05
Filing date: 2020-11-05
Publication date: 2022-10-21
Anticipated expiration: 2040-11-05
Also published as: CN112492331A

Abstract

The application provides a live broadcast method, a live broadcast device, a live broadcast system and a storage medium, and belongs to the technical field of internet. The method comprises the following steps: receiving live push content sent by a server; acquiring a first video frame and target index information according to the live push content, wherein the first video frame is a video frame acquired when an anchor terminal executes recommendation operation on target article information, the first video frame comprises live content recommending the target article information, and the target index information is index information corresponding to the target article information; and displaying the target article information corresponding to the target index information when the first video frame is played. The method can ensure that the time for displaying the article information is synchronous with the time for playing the video frame of the live broadcast content containing the recommended article information, thereby improving the live broadcast effect.

Description

Live broadcast method, device, system and storage medium

Technical Field

The present application relates to the field of internet technologies, and in particular, to a live broadcast method, apparatus, system, and storage medium.

Background

With the rapid development of internet technology, internet live broadcasting has become the current trend. In the live broadcasting process, the anchor terminal recommends the item information to the audience terminal, and the audience terminal displays the recommended item information. Therefore, the interest of live broadcast can be improved.

In the related art, when the anchor recommends the item information in the live broadcast process, the anchor terminal respectively sends the current video frame and the currently recommended item information to the audience terminal through two long connections, and the audience terminal plays the video frame and displays the item information after receiving the video frame and the item information.

However, due to the difference of the network environment, the video frame and the object information may not arrive at the viewer terminal at the same time, thereby causing a problem that the time of displaying the object information and the time of playing the video frame at the viewer terminal are not synchronized.

Disclosure of Invention

The embodiment of the application provides a live broadcast method, a live broadcast device, a live broadcast system and a storage medium, which can ensure that the time for displaying the object information and the time for playing the video frame containing the live broadcast content recommending the object information are synchronous at a viewer terminal, and improve the live broadcast effect. The technical scheme is as follows:

in one aspect, a live broadcasting method is provided, and the method includes:

receiving live push content sent by a server;

acquiring a first video frame and target index information according to the live push content, wherein the first video frame is a video frame acquired when an anchor terminal executes recommendation operation on target item information, the first video frame comprises live content recommending the target item information, and the target index information is index information corresponding to the target item information;

and displaying the target article information corresponding to the target index information when the first video frame is played.

In a possible implementation manner, the acquiring the first video frame and the target index information according to the live push content includes:

and analyzing the second video frame to obtain the first video frame and the target index information.

In another possible implementation manner, the acquiring, by the live push content, a first video frame and target index information according to the live push content includes:

analyzing the index file to obtain the target index information and time point information, wherein the time point information represents a live broadcast time point when the anchor terminal executes recommendation operation on the target article information;

determining the first video frame corresponding to the time point information from at least one video frame included in the at least one video slice.

In another possible implementation manner, before displaying the target item information corresponding to the target index information when the first video frame is played, the method further includes:

and inquiring the target article information corresponding to the target index information according to the stored article information and the corresponding index information.

In another possible implementation manner, before the receiving the live push content sent by the server, the method further includes:

receiving at least one item information to be recommended and corresponding index information from the server;

and storing the at least one item information and the corresponding index information.

In another possible implementation manner, the displaying the target item information corresponding to the target index information when the first video frame is played includes:

and displaying a floating window when the first video frame is played, wherein the floating window comprises the target article information.

In another aspect, another live broadcasting method is provided, the method including:

in the live broadcast process, responding to recommendation operation of target item information, and determining target index information corresponding to the target item information;

inserting the target index information into a currently acquired first video frame to obtain a second video frame;

and sending the second video frame to a server, wherein the server is used for carrying out live broadcast push according to the second video frame, so that the target object information corresponding to the target index information is displayed when the first video frame is played by the audience terminal receiving the live broadcast push content.

In one possible implementation, the method further includes:

in the live broadcast process, responding to recommendation operation of the target article information, and determining time point information, wherein the time point information represents a live broadcast time point corresponding to the recommendation operation;

the inserting the target index information into the currently acquired first video frame to obtain a second video frame includes:

and inserting the target index information and the time point information into the first video frame to obtain the second video frame.

In another possible implementation manner, the inserting the target index information into a currently acquired first video frame to obtain a second video frame includes:

and inserting the target index information into supplemental enhancement information SEI of the first video frame to obtain the second video frame.

In another possible implementation manner, the determining, in response to the recommendation operation on the target item information, target index information corresponding to the target item information includes:

and inquiring the target index information corresponding to the target article information according to the stored article information and the corresponding index information.

In another possible implementation manner, before determining, in response to a recommendation operation on target item information, target index information corresponding to the target item information, the method further includes:

and displaying at least one item information to be recommended in a live interface.

receiving a video stream sent by a main broadcasting terminal, wherein the video stream comprises a second video frame, the second video frame is obtained by inserting target index information and time point information into a first video frame, the first video frame is a video frame collected by the main broadcasting terminal when the main broadcasting terminal executes recommendation operation on target article information, the first video frame comprises live broadcast content recommending the target article information, the target index information is index information corresponding to the target article information, and the time point information represents a live broadcast time point when the main broadcasting terminal executes the recommendation operation;

analyzing the second video frame to obtain the first video frame, the target index information and the time point information;

segmenting the analyzed video stream into at least one video slice, and generating an index file comprising the target index information and the time point information;

the index file and the at least one video slice are sent to a viewer terminal, so that the viewer terminal analyzes the index file to obtain the target index information and the time point information, the first video frame corresponding to the time point information is determined from at least one video frame included in the at least one video slice, and the target object information corresponding to the target index information is displayed when the first video frame is played.

In another aspect, a live device is provided, the device including:

the content receiving module is configured to receive live push content sent by the server;

the information acquisition module is configured to acquire a first video frame and target index information according to the live push content, wherein the first video frame is a video frame acquired when an anchor terminal executes recommendation operation on target item information, the first video frame comprises live content recommending the target item information, and the target index information is index information corresponding to the target item information;

an information display module configured to display the target item information corresponding to the target index information when the first video frame is played.

In a possible implementation manner, the live push content includes a second video frame, the second video frame is obtained after the target index information is inserted into the first video frame,

the information acquisition module is configured to analyze the second video frame to obtain the first video frame and the target index information.

In another possible implementation, the live push content includes an index file and at least one video slice, each video slice including at least one video frame,

the information acquisition module is configured to analyze the index file to obtain the target index information and time point information, wherein the time point information represents a live broadcast time point when the anchor terminal executes recommendation operation on the target article information; determining the first video frame corresponding to the time point information from at least one video frame included in the at least one video slice.

In another possible implementation manner, the apparatus further includes:

and the information query module is configured to query the target item information corresponding to the target index information according to the stored item information and the corresponding index information.

In another possible implementation manner, the information query module is further configured to receive, from the server, at least one item information to be recommended and corresponding index information; and storing the at least one item information and the corresponding index information.

In another possible implementation manner, the information display module is configured to display a floating window when the first video frame is played, where the floating window includes the target item information.

In another aspect, a live device is provided, the device including:

the information determining module is configured to respond to recommendation operation of target item information in a live broadcast process and determine target index information corresponding to the target item information;

the information insertion module is configured to insert the target index information into a currently acquired first video frame to obtain a second video frame;

and the video frame sending module is configured to send the second video frame to a server, and the server is used for performing live broadcast push according to the second video frame, so that the target article information corresponding to the target index information is displayed when the first video frame is played by the audience terminal receiving the live broadcast push content.

In a possible implementation manner, the information determining module is further configured to determine, in the process of performing the live broadcast, time point information in response to a recommendation operation on the target item information, where the time point information represents a live broadcast time point corresponding to the recommendation operation;

the information inserting module is further configured to insert the target index information and the time point information into the first video frame, resulting in the second video frame.

In another possible implementation manner, the information insertion module is configured to insert the target index information into supplemental enhancement information SEI of the first video frame, so as to obtain the second video frame.

In another possible implementation manner, the information determining module is configured to query the target index information corresponding to the target item information according to the stored item information and the corresponding index information.

In another possible implementation manner, the information determination module is further configured to receive at least one item information to be recommended and corresponding index information from the server; and storing the at least one item information and the corresponding index information.

In another possible implementation manner, the apparatus further includes:

the information display module is configured to display at least one item information to be recommended in a live interface.

In another aspect, a live device is provided, the device including:

a video stream receiving module configured to receive a video stream sent by a anchor terminal, where the video stream includes a second video frame, the second video frame is obtained by inserting target index information and time point information into a first video frame, the first video frame is a video frame acquired when the anchor terminal performs a recommendation operation on target item information, the first video frame includes live broadcast content recommending the target item information, the target index information is index information corresponding to the target item information, and the time point information indicates a live broadcast time point when the anchor terminal performs the recommendation operation;

a video frame analyzing module configured to analyze the second video frame to obtain the first video frame, the target index information, and the time point information;

a video stream segmentation module configured to segment the parsed video stream into at least one video slice, and generate an index file including the target index information and the time point information;

the slice sending module is configured to send the index file and the at least one video slice to a viewer terminal, so that the viewer terminal analyzes the index file to obtain the target index information and the time point information, determine the first video frame corresponding to the time point information from at least one video frame included in the at least one video slice, and display the target object information corresponding to the target index information when the first video frame is played.

In another aspect, a live system is provided, the system including: the system comprises a main broadcasting terminal, audience terminals and a server;

the anchor terminal is used for responding to recommendation operation of target item information in a live broadcast process, determining target index information corresponding to the target item information, inserting the target index information into a currently acquired first video frame to obtain a second video frame, and sending the second video frame to the server;

the server is used for sending live push content to the audience terminal according to the second video frame;

and the audience terminal is used for acquiring the first video frame and the target index information according to the live broadcast push content, and displaying the target article information corresponding to the target index information when the first video frame is played.

In another aspect, an electronic device is provided, which includes a processor and a memory, where at least one program code is stored, and the program code is loaded and executed by the processor to implement the operations executed in the live broadcast method in any one of the above possible implementation manners.

In another aspect, a computer-readable storage medium is provided, in which at least one program code is stored, and the program code is loaded and executed by a processor to implement the operations performed in the live broadcast method in any one of the above possible implementation manners.

In a further aspect, a computer program product is provided, which includes at least one program code, and the program code is loaded and executed by a processor to implement the operations performed in the live broadcast method in any one of the above possible implementation manners.

The beneficial effects brought by the technical scheme provided by the embodiment of the application at least comprise:

in the embodiment of the application, the index information of the article information and the video frame containing the live content recommending the article information are sent to the audience terminal as live push content at the same time, so that the audience terminal can obtain the video frame and the index information of the article information at the same time after receiving the live push content, the article information corresponding to the index information can be displayed when the video frame is played, the synchronization between the time for displaying the article information and the time for playing the video frame containing the live content recommending the article information is ensured, and the live effect is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

FIG. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application;

fig. 2 is a flowchart of a live broadcasting method provided in an embodiment of the present application;

fig. 3 is a flowchart of a live broadcasting method provided in an embodiment of the present application;

fig. 4 is a flowchart of a live broadcasting method provided in an embodiment of the present application;

fig. 5 is a flowchart of a live broadcasting method provided in an embodiment of the present application;

fig. 6 is a flowchart of a live broadcasting method provided in an embodiment of the present application;

fig. 7 is a block diagram of a live device provided in an embodiment of the present application;

fig. 8 is a block diagram of a live device provided in an embodiment of the present application;

fig. 9 is a block diagram of a live device provided in an embodiment of the present application;

fig. 10 is a block diagram of a live broadcast system provided in an embodiment of the present application;

fig. 11 is a schematic structural diagram of a terminal according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, the following detailed description of the embodiments of the present application will be made with reference to the accompanying drawings.

The terms "first," "second," "third," "fourth," and the like as used herein may be used herein to describe various concepts, but these concepts are not limited by these terms unless otherwise specified. These terms are only used to distinguish one concept from another. For example, a first video frame may be referred to as a video frame, and similarly, a second video frame may be referred to as a first video frame, without departing from the scope of the present application.

As used herein, the terms "at least one," "a plurality," "each," and "any," at least one of which includes one, two, or more than two, and a plurality of which includes two or more than two, each of which refers to each of the corresponding plurality, and any of which refers to any of the plurality. For example, the plurality of item information includes 3 item information, each item information is each item information of the 3 item information, and any item information refers to any one of the 3 item information, which may be the first item information, the second item information, or the third item information.

Fig. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application. Referring to fig. 1, the environment includes at least one anchor terminal 101 (1 in fig. 1 for example), at least one viewer terminal 102 (3 in fig. 1 for example), and a server 103. The anchor terminal 101, the viewer terminal 102, and the server 103 are connected via a wireless or wired network. Optionally, anchor terminal 101 and viewer terminal 102 comprise computers, cell phones, tablets, or other terminals. Optionally, the server 102 is a background server, or a cloud server providing cloud computing and cloud storage services, which is not limited in this application.

Optionally, a target application served by server 103 is installed on anchor terminal 101 and viewer terminal 102, and anchor terminal 101 and viewer terminal 102 implement functions such as data transmission, message interaction, and the like through the target application. Optionally, the target application is an application in an operating system or an application provided by a third party. For example, the target application is a live application having a video live function, and of course, the live application can also have other functions, such as a shopping function, a music function, a social function, a game function, and the like.

In a live scene, the anchor terminal 101 and the viewer terminal 102 are configured to log in a target application based on an account, the anchor terminal 101 performs live broadcast using the target application, uploads a collected video frame to the server 103, the server 103 synchronizes the video frame to the viewer terminal 102, and then the viewer terminal 102 plays the video frame.

In the present application, the anchor terminal 101 is further configured to recommend the target item information during the live broadcast, and the viewer terminal 102 is configured to synchronously display the target item information when playing the video frame of the live broadcast content containing the recommended target item information, so as to improve the live broadcast effect.

The live broadcasting method provided by the embodiment of the application can be applied to any live broadcasting scene, for example, in a shopping live broadcasting scene, the anchor terminal can recommend the commodity information in the live broadcasting process, and the audience terminal can synchronously display the commodity information when playing the video frame containing the live broadcasting content of the commodity information recommended by the anchor.

Fig. 2 is a flowchart of a live broadcasting method provided in an embodiment of the present application. Referring to fig. 2, the main execution body of the embodiment is a master terminal, and the embodiment includes:

201: and in the live broadcasting process, the anchor terminal responds to the recommendation operation of the target item information and determines the target index information corresponding to the target item information.

Optionally, the item information includes, in terms of content, a function of the item, an equivalent amount of a circulated resource, a color, an amount, a production address, a production date, a brand, a taste, a material, offer information, an acquisition interface of the item, and the like, and includes, in terms of format, text information, picture information, video information, and the like.

The index information is information that can identify a specific item, and optionally, the index information includes information such as an ID (Identity document) of a commodity, an UPC (universal Product code), an SPU (Standard Product Unit), a SKU (Stock Keeping Unit), a name, a class, an equivalent amount of a circulated resource, and a label.

In the live broadcast process, the anchor can recommend target item information to the audience, for example, introduce the target item information to the audience and encourage the audience to acquire the target item information, and the anchor can perform a recommendation operation on the target item information, for example, selecting the target item information and confirming that the target item information is sent to the audience terminal, and correspondingly, the anchor terminal can determine target index information corresponding to the target item information in response to the recommendation operation.

In one possible implementation manner, the determining, by the anchor terminal, target index information corresponding to target item information in response to a recommendation operation on the target item information includes: and the anchor terminal inquires the target index information corresponding to the target item information according to the stored item information and the corresponding index information.

The anchor terminal can store at least one item information and index information corresponding to each item information, and under the condition that recommendation operation on the target item information is detected, target index information corresponding to the target item information is inquired according to each item information and the corresponding index information.

In a possible implementation manner, in response to a recommendation operation on target item information, before determining target index information corresponding to the target item information, the anchor terminal receives at least one item information to be recommended and corresponding index information from a server; at least one item information and corresponding index information are stored.

Optionally, the server is an item server, and the item server is configured to store item information and corresponding item index information, and certainly, the item server can also store other information, which is not limited in this embodiment of the present application. Optionally, the time when the anchor terminal receives the at least one item information to be recommended and the corresponding index information from the server is before the start of live broadcasting or after the start of live broadcasting, which is also not limited in this embodiment of the application.

It should be noted that, optionally, at least one item information to be recommended and corresponding index information corresponding to the live broadcast of the local broadcast are uploaded to the server by the anchor terminal before the live broadcast starts, or are uploaded to the server by another terminal before the live broadcast starts, which is not limited in this embodiment of the application.

In a possible implementation manner, the anchor terminal responds to a recommendation operation on the target item information, and displays at least one item information to be recommended in a live broadcast interface before determining target index information corresponding to the target item information.

Optionally, the live interface includes a display option of item information, when the anchor wants to recommend the item information, the anchor can control display of the item information by triggering the display option, correspondingly, if the anchor terminal detects a trigger operation on the display option, at least one item information is displayed in the live interface, and then the anchor can select target item information from the displayed at least one item information.

In a possible implementation manner, the anchor terminal determines the time point information in response to a recommendation operation on the target item information during live broadcasting.

The time point information represents a live time point corresponding to the recommendation operation of the target item information. Optionally, the live time point is based on a live start time point, for example, the live time point is 5 minutes and 30 seconds after the live starts.

202: and the anchor terminal inserts the target index information into the currently acquired first video frame to obtain a second video frame.

The first video frame is a video frame collected when the anchor terminal detects recommendation operation of the target item information, and the first video frame contains live broadcast content of the anchor recommended target item information.

In a possible implementation manner, the inserting, by the anchor terminal, the target index information into the currently acquired first video frame to obtain a second video frame includes: the anchor terminal inserts the target index Information into SEI (Supplemental Enhancement Information) of the first video frame to obtain a second video frame.

SEI belongs to the code stream category, provides a method for adding additional information into a video code stream, and is one of the characteristics of H.264/H.265 video compression standards. When the target index information is inserted into the SEI, a uniform protocol needs to be used, for example, a key (field) of the target index information is "productId", and information after "=" after "productId" is a value (value) of the target index information, so that it is ensured that other terminals or servers can accurately acquire the target index information from the second video frame.

Alternatively, the code for inserting the target index information into the SEI of the first video frame is as follows: ffmpeg-Ishangou.h264

-c:v copy-bsf:v h264_metadata＝sei_user_data＝sei_user_data＝

'086f3693-b7b3-4f2c-9653-21492feee5b8+productId＝123456'shangou.sei.h264。

In a possible implementation manner, the anchor terminal further determines time point information corresponding to the recommendation operation, and accordingly, the anchor terminal inserts the target index information into the currently acquired first video frame to obtain a second video frame, including: and the anchor terminal inserts the target index information and the time point information into the first video frame to obtain a second video frame. The method for inserting the target index information and the time point information into the first video frame is similar to the method for inserting the target index information into the first video frame, and is not repeated here.

203: the anchor terminal sends the second video frame to the server.

In one possible implementation, the anchor terminal sends the second video frame to the server via an RTMP (Real Time Messaging Protocol). Because the Protocol is based on long connection of a Transmission Control Protocol (TCP), the Protocol has the characteristic of small time delay, so that the video frame can be quickly sent to a server, and the time delay of live broadcasting can be reduced.

And the server carries out live broadcast push according to the second video frame so as to enable the audience terminal receiving the live broadcast push content to display the target object information corresponding to the target index information when playing the first video frame.

In a possible implementation manner, the live push content includes a first video frame and target index information, so that the audience terminal can determine the target object information according to the target index information, and then display the target object information corresponding to the target index information when the first video frame is played.

In another possible implementation manner, the live push content includes a plurality of video frames, target index information, and time point information, where the plurality of video frames include a first video frame and other video frames, so that the viewer terminal can determine the first video frame from the plurality of video frames according to the time point information, determine target object information according to the target index information, and then display the target object information corresponding to the target index information when playing the first video frame.

Optionally, the server is a video server, and the video server and the article server are the same server or different servers, which is not limited in this embodiment of the application.

In the embodiment of the application, the index information of the article information and the first video frame containing the live content recommending the article information are simultaneously sent to the server through the second video frame and are simultaneously sent to the audience terminal as the live push content, therefore, the audience terminal can simultaneously obtain the first video frame and the index information of the article information after receiving the live push content, the article information corresponding to the index information can be displayed when the first video frame is played, the time for displaying the article information and the time for playing the video frame containing the live content recommending the article information are synchronous, and the live effect is improved.

All the above optional technical solutions may be combined arbitrarily to form optional embodiments of the present application, and are not described herein again.

Fig. 3 is a flowchart of a live broadcasting method according to an embodiment of the present application. Referring to fig. 3, the execution subject of the embodiment is a server, and the embodiment includes:

301: and the server receives a video stream sent by the anchor terminal, wherein the video stream comprises a second video frame.

Optionally, the server receives the video stream sent by the anchor terminal through an RTMP protocol.

The second video frame is obtained by inserting the target index information and the time point information into the first video frame. The first video frame is a video frame collected when the anchor terminal executes recommendation operation on target item information, the first video frame comprises live broadcast content of the recommended target item information, the target index information is index information corresponding to the target item information, and the time point information represents a live broadcast time point when the anchor terminal executes the recommendation operation.

The video stream includes a plurality of video frames, and accordingly, the implementation manner of the server receiving the video stream sent by the anchor terminal is as follows: the server receives a plurality of video frames sent by the anchor terminal in sequence.

The video stream includes two video frames, one is a video frame into which the target index information and the time point information are inserted, i.e., a second video frame, and the other is a video frame into which the target index information and the time point information are not inserted. After receiving the video stream sent by the anchor terminal, the server determines whether the video stream includes a second video frame, and if the video stream includes the second video frame, the following step 302 is performed.

302: and the server analyzes the second video frame to obtain the first video frame, the target index information and the time point information.

Optionally, the step comprises: and the server extracts the SEI information from the second video frame to obtain the first video frame, and analyzes the SEI information to obtain target index information and time point information.

Optionally, the server parses the SEI information through FFmpeg (audio/video processing software), so as to obtain the target index information and the time point information. Optionally, the code that parses the SEI information is as follows: int ff _ H264_ sei _ decode (H264 SEIContext H, getbtontext gb, const H264ParamSets ps, void logctx).

303: and the server divides the analyzed video stream into at least one video slice and generates an index file comprising target index information and time point information.

Wherein each video slice comprises at least one video frame, and the at least one video frame comprises a first video frame. Optionally, the index file may include, in addition to the target index information and the time point information, index information corresponding to each video slice in at least one video slice, a download address of each video slice, a playing order of at least one video slice, and the like, and certainly, may also include other information, which is not limited in this embodiment of the present application.

Optionally, the implementation manner of the server segmenting the parsed video stream into at least one video slice and generating the index file including the target index information and the time point information includes: the server segments the parsed video stream into at least one video slice in a TS format (a video format) according to an HTTP Live Streaming (HTTP Live Streaming) protocol, and generates an M3U8 file (an index file) including target index information and time point information.

304: the server transmits the index file and the at least one video slice to the viewer terminal.

Optionally, the server transmits the index file and the at least one video slice to the viewer terminal via the HSL protocol.

The server sends the index file and at least one video slice to the audience terminal so that the audience terminal analyzes the index file to obtain target index information and time point information, determines a first video frame corresponding to the time point information from at least one video frame included in the at least one video slice, and displays target object information corresponding to the target index information when the first video frame is played.

In the embodiment of the application, the server generates the index file comprising the target index information and the time point information, and after the index file and the corresponding at least one video slice are sent to the audience terminal, the audience terminal can determine the first video frame from the at least one video frame included in the at least one video slice according to the time point information, so that the target object information can be displayed when the first video frame is played, the synchronization between the time for displaying the object information and the time for playing the first video frame containing the live broadcast content recommending the object information is ensured, and the live broadcast effect is improved.

Fig. 4 is a flowchart of a live broadcasting method provided in an embodiment of the present application. Referring to fig. 4, the execution subject of the embodiment is a viewer terminal, and the embodiment includes:

401: and the audience terminal receives the live push content sent by the server.

In the live broadcast process, the audience terminal receives live broadcast push content from the server and plays the live broadcast according to the live broadcast push content.

In a possible implementation manner, the audience terminal receives live push content sent by the server through an RTMP protocol, and the protocol is based on TCP long connection and has the characteristic of small time delay, so that the audience terminal can receive the live push content from the server in real time, and the live time delay can be reduced.

In another possible implementation manner, the audience terminal receives live push content sent by the server through the HSL protocol, and the protocol is based on HTTP transmission data, is suitable for various operating systems, can pass through firewalls and proxies, and can also stably switch code rates, so that the application range is wide and the stability is good.

402: and the audience terminal acquires the first video frame and the target index information according to the live push content.

The first video frame is a video frame collected when the anchor terminal executes recommendation operation on the target item information, the first video frame comprises live broadcast content of the recommended target item information, and the target index information is index information corresponding to the target item information.

In a possible implementation manner, the live push content includes a second video frame, the second video frame is obtained by inserting the target index information into the first video frame, and accordingly, the implementation manner in which the audience terminal obtains the first video frame and the target index information according to the live push content includes: and the audience terminal analyzes the second video frame to obtain the first video frame and the target index information.

Optionally, the manner of analyzing the second video frame by the viewer terminal to obtain the first video frame and the target index information is as follows: and the audience terminal extracts the SEI information from the second video frame to obtain a first video frame, and analyzes the SEI information to obtain target index information.

In another possible implementation manner, the live push content includes an index file and at least one video slice, each video slice includes at least one video frame, and accordingly, an implementation manner in which the audience terminal acquires the first video frame and the target index information according to the live push content includes: the audience terminal analyzes the index file to obtain target index information and time point information, wherein the time point information represents a live broadcast time point when the anchor terminal executes recommendation operation on the target article information; the audience terminal determines a first video frame corresponding to the time point information from at least one video frame included in at least one video slice.

In a possible implementation manner, the viewer terminal parses the index file according to a parsing protocol of the target index information and the time point information agreed with the server in the index file to obtain the target index information and the time point information, for example, the index file is an M3U8 file in an HLS protocol, and the viewer terminal parses the M3U8 file according to a parsing protocol of the target index information and the time point information agreed with the server in the M3U8 file to obtain the target index information and the time point information. For example, if the field of the target index information in the index file is "productId", the value of the productId "is the target index information, the field of the time point information is" RecommendedTime ", and the value of the RecommendedTime" is the time point information, the viewer terminal analyzes the index file to obtain the values of the fields of "productId" and "RecommendedTime", and then obtains the target index information and the time point information.

In a possible implementation manner, after obtaining at least one video slice, the audience terminal may play the at least one video slice according to a playing sequence of the at least one video slice, and determine a current playing time point when playing each video frame in the video slice, and when a live time point indicated by the time point information is reached, determine that the currently played video frame is a first video frame. For example, if the live time indicated by the time point information is 5 minutes 30 seconds, when the viewer terminal plays the video frames in at least one video slice in sequence, once the currently live playing time reaches 5 minutes 30 seconds, it is determined that the currently played video frame is the first video frame.

403: and when the audience terminal plays the first video frame, displaying the target object information corresponding to the target index information.

In a possible implementation manner, when the viewer terminal plays the first video frame, before the target item information corresponding to the target index information is displayed, the viewer terminal queries the target item information corresponding to the target index information according to the stored item information and the corresponding index information. Therefore, the target article information corresponding to the target index information can be synchronously displayed when the first video frame is played, and the live broadcast effect is improved.

In a possible implementation manner, before receiving live push content sent by a server, a viewer terminal receives at least one item information to be recommended and corresponding index information from the server; at least one item information and corresponding index information are stored. Optionally, the timing when the audience terminal receives the at least one item information to be recommended and the corresponding index information from the server is that after the audience terminal plays the live broadcast, for example, as soon as the audience terminal enters a live broadcast room, an acquisition request is sent to the server, and then the at least one item information and the corresponding index information sent by the server are received. Of course, the time when the audience terminal receives the at least one item information to be recommended and the corresponding index information from the server can be other times, which is not limited in the embodiment of the present application.

In a possible implementation manner, when the viewer terminal plays the first video frame, displaying the target item information corresponding to the target index information, including: and displaying a floating window by the audience terminal when the first video frame is played, wherein the floating window comprises the target object information. Therefore, the target article information is displayed in the form of the floating window, the target article information can be displayed more clearly, the playing of video live broadcast is not influenced, and the live broadcast effect is improved.

In the embodiment of the application, the index information of the object information and the video frame containing the live content recommending the object information are simultaneously sent to the audience terminal as the live push content, therefore, the audience terminal can simultaneously obtain the video frame and the index information of the object information after receiving the live push content, so that the object information corresponding to the index information can be displayed when the video frame is played, the synchronization between the time for displaying the object information and the time for playing the video frame containing the live content recommending the object information is ensured, and the live broadcast effect is improved.

Fig. 5 is a flowchart of a live broadcasting method according to an embodiment of the present application, where the embodiment is an embodiment of interaction among a anchor terminal, a server, and a viewer terminal, and the embodiment includes:

501: and in the process of live broadcasting, the anchor terminal responds to the recommendation operation of the target item information and determines the target index information corresponding to the target item information.

502: and the anchor terminal inserts the target index information into the currently acquired first video frame to obtain a second video frame.

503: the anchor terminal sends the second video frame to the server.

The implementation of 501-503 is similar to the implementation of 201-203 described above and will not be described here.

504: the server transmits the second video frame to the viewer terminal.

Optionally, the server transmits the second video frames to the viewer terminal via an RTMP protocol. The protocol is based on TCP long connection and has the characteristic of small time delay, so that the video frames can be quickly sent to audience terminals by the server, and the time delay of live broadcasting can be reduced.

505: and the audience terminal analyzes the second video frame to obtain the first video frame and the target index information.

The implementation manner of the viewer terminal analyzing the second video frame to obtain the first video frame and the target index information is similar to the implementation manner of the server analyzing the second video frame to obtain the first video frame, the target index information and the time point information in 302, and is not repeated here.

506: and when the audience terminal plays the first video frame, displaying the target object information corresponding to the target index information.

The implementation of this 506 is similar to the implementation of 403 described above, and is not described here again.

In the embodiment of the application, the index information of the article information and the first video frame containing the live content recommending the article information are simultaneously sent to the audience terminal through the second video frame, so that the audience terminal can simultaneously obtain the first video frame and the index information of the article information after receiving the second video frame, the article information corresponding to the index information can be displayed when the first video frame is played, the synchronization between the time for displaying the article information and the time for playing the first video frame containing the live content recommending the article information is ensured, and the live effect is improved.

Fig. 6 is a flowchart of a live broadcasting method provided in an embodiment of the present application, where the embodiment is an interaction embodiment between a anchor terminal, a server, and a viewer terminal, and the embodiment includes:

601: and in the process of live broadcasting, the anchor terminal responds to the recommendation operation of the target item information and determines the time point information and the target index information corresponding to the target item information.

602: and the anchor terminal inserts the target index information and the time point information into the currently acquired first video frame to obtain a second video frame.

601-602 are implemented similarly to 201-202 described above and will not be described in detail here.

603: and the anchor terminal sends a video stream to the server, wherein the video stream comprises a second video frame.

Optionally, the anchor terminal sends the video stream to the server via the RTMP protocol.

The video stream comprises a plurality of video frames, and correspondingly, the realization mode that the anchor terminal sends the video stream to the server is as follows: the anchor terminal sequentially transmits the plurality of video frames to the server.

The video stream includes two video frames, one is a video frame into which the target index information and the time point information are inserted, i.e., a second video frame, and the other is a video frame into which the target index information and the time point information are not inserted.

604: and the server analyzes the second video frame to obtain the first video frame, the target index information and the time point information.

605: and the server divides the analyzed video stream into at least one video slice and generates an index file comprising target index information and time point information.

606: the server transmits the index file and the at least one video slice to the viewer terminal.

604-606 are similar to 302-304 and will not be described further herein.

607: and the audience terminal analyzes the index file to obtain target index information and time point information.

608: the audience terminal determines a first video frame corresponding to the time point information from at least one video frame included in at least one video slice.

609: and when the audience terminal plays the first video frame, displaying the target object information corresponding to the target index information.

The implementation of 607-609 is similar to that of 402-403 and will not be described here.

In the embodiment of the application, the index information of the target object information, the first video frame of the live content containing the recommended target object information, and the time information of the live time point representing the recommendation operation are simultaneously sent to the server through the second video frame, the server generates the index file comprising the target index information and the time point information, and then after the index file and the corresponding at least one video slice are sent to the audience terminal, the audience terminal can determine the first video frame from the at least one video frame included in the at least one video slice according to the time point information, so that the target object information corresponding to the index information can be displayed when the first video frame is played, the time for displaying the object information is ensured to be synchronous with the time for playing the first video frame of the live content containing the recommended object information, and the live effect is improved.

Fig. 7 is a block diagram of a live broadcasting apparatus provided in an embodiment of the present application, where the apparatus includes:

a content receiving module 701 configured to receive live push content sent by a server;

the information obtaining module 702 is configured to obtain a first video frame and target index information according to the live push content, where the first video frame is a video frame acquired when the anchor terminal performs recommendation operation on target item information, the first video frame includes live content of recommended target item information, and the target index information is index information corresponding to the target item information;

the information display module 703 is configured to display the target item information corresponding to the target index information when the first video frame is played.

In one possible implementation, the live push content includes a second video frame, the second video frame is obtained by inserting the target index information into the first video frame,

the information obtaining module 702 is configured to analyze the second video frame to obtain the first video frame and the target index information.

an information obtaining module 702, configured to parse the index file to obtain target index information and time point information, where the time point information indicates a live broadcast time point when the anchor terminal performs a recommendation operation on the target item information; a first video frame corresponding to the time point information is determined from at least one video frame included in the at least one video slice.

In another possible implementation manner, the apparatus further includes:

In another possible implementation manner, the information query module is further configured to receive at least one item information to be recommended and corresponding index information from the server; at least one item information and corresponding index information are stored.

In another possible implementation, the information display module 703 is configured to display a floating window when the first video frame is played, where the floating window includes the target item information.

Fig. 8 is a block diagram of a live broadcasting apparatus provided in an embodiment of the present application, where the apparatus includes:

an information determining module 801 configured to determine, in a live broadcast process, target index information corresponding to target item information in response to a recommendation operation on the target item information;

an information insertion module 802, configured to insert the target index information into a currently acquired first video frame, resulting in a second video frame;

the video frame sending module 803 is configured to send a second video frame to the server, where the server is configured to perform live broadcast push according to the second video frame, so that when the viewer terminal receiving the live broadcast push content plays the first video frame, the target item information corresponding to the target index information is displayed.

In a possible implementation manner, the information determining module 801 is further configured to, during live broadcasting, determine time point information in response to a recommendation operation on target item information, where the time point information indicates a live broadcasting time point corresponding to the recommendation operation;

the information inserting module 802 is further configured to insert the target index information and the time point information into the first video frame, resulting in a second video frame.

In another possible implementation, the information inserting module 802 is configured to insert the target index information into supplemental enhancement information SEI of the first video frame, resulting in the second video frame.

In another possible implementation manner, the information determining module 801 is configured to query target index information corresponding to the target item information according to the stored item information and the corresponding index information.

In another possible implementation manner, the information determining module 801 is further configured to receive at least one item information to be recommended and corresponding index information from the server; at least one item information and corresponding index information are stored.

In another possible implementation manner, the apparatus further includes:

Fig. 9 is a block diagram of a live device provided in an embodiment of the present application, where the device includes:

a video stream receiving module 901, configured to receive a video stream sent by a anchor terminal, where the video stream includes a second video frame, the second video frame is obtained by inserting target index information and time point information into a first video frame, the first video frame is a video frame acquired when the anchor terminal performs a recommendation operation on target item information, the first video frame includes live broadcast content of the recommended target item information, the target index information is index information corresponding to the target item information, and the time point information indicates a live broadcast time point when the anchor terminal performs the recommendation operation;

a video frame parsing module 902 configured to parse the second video frame to obtain the first video frame, the target index information, and the time point information;

a video stream segmentation module 903 configured to segment the parsed video stream into at least one video slice, and generate an index file including target index information and time point information;

the slice transmitting module 904 is configured to transmit the index file and the at least one video slice to the viewer terminal, so that the viewer terminal parses the index file to obtain target index information and time point information, determine a first video frame corresponding to the time point information from at least one video frame included in the at least one video slice, and display target object information corresponding to the target index information when the first video frame is played.

Fig. 10 is a block diagram of a live system provided by an embodiment of the present application, the system including an anchor terminal, a viewer terminal, and a server;

the anchor terminal is used for responding to recommendation operation of target item information in the live broadcasting process, determining target index information corresponding to the target item information, inserting the target index information into a currently acquired first video frame to obtain a second video frame, and sending the second video frame to the server;

and the audience terminal is used for acquiring the first video frame and the target index information according to the live push content, and displaying the target object information corresponding to the target index information when the first video frame is played.

In a possible implementation manner, the live broadcast system includes two servers, one is a video server for executing the steps corresponding to the server in the above steps, and the other is an item server for storing at least one item information to be recommended and corresponding index information.

Correspondingly, the anchor terminal is further configured to obtain at least one item information to be recommended and corresponding index information corresponding to the local live broadcast from the item server before determining the target index information corresponding to the target item information in response to the recommendation operation on the target item information. And the anchor terminal is also used for determining target index information corresponding to the target article information according to the at least one article information to be recommended corresponding to the live broadcast and the corresponding index information.

Correspondingly, the audience terminal is further configured to obtain at least one item information to be recommended and corresponding index information corresponding to the live broadcast from the item server before displaying the target item information corresponding to the target index information when the first video frame is played. And the audience terminal is also used for inquiring the target object information corresponding to the target index information according to the at least one object information to be recommended and the corresponding index information.

In the embodiment of the application, the index information of the article information and the first video frame containing the live content recommending the article information are simultaneously sent to the server through the second video frame and are simultaneously sent to the audience terminal as the live push content, therefore, the audience terminal can simultaneously obtain the index information of the first video frame and the article information after receiving the live push content, the article information corresponding to the index information can be displayed when the first video frame is played, the time for displaying the article information is synchronous with the time for playing the first video frame containing the live content recommending the article information, and the live effect is improved.

It should be noted that: in the live broadcasting device provided in the foregoing embodiment, only the division of the functional modules is exemplified when performing live broadcasting, and in practical applications, the function distribution may be completed by different functional modules as needed, that is, the internal structure of the electronic device is divided into different functional modules to complete all or part of the functions described above. In addition, the live broadcast device and the live broadcast method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments in detail and are not described herein again.

The embodiment of the present application further provides an electronic device, where the electronic device includes a processor and a memory, where the memory stores at least one program code, and the at least one program code is loaded and executed by the processor, so as to implement the operation executed in the live broadcast method of the foregoing embodiment.

Optionally, the electronic device is provided as a terminal. Fig. 11 shows a block diagram of a terminal 1100 according to an exemplary embodiment of the present application. The terminal 1100 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. Terminal 1100 may also be referred to by other names such as user equipment, portable terminal, laptop terminal, desktop terminal, and so forth.

The terminal 1100 includes: a processor 1101, and a memory 1102.

Processor 1101 may include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 1101 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 1101 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1101 may be integrated with a GPU (Graphics Processing Unit) that is responsible for rendering and rendering content that the display screen needs to display. In some embodiments, the processor 1101 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.

Memory 1102 may include one or more computer-readable storage media, which may be non-transitory. Memory 1102 can also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 1102 is used to store at least one program code for execution by processor 1101 to implement the live method provided by method embodiments herein.

In some embodiments, the terminal 1100 may further include: a peripheral interface 1103 and at least one peripheral. The processor 1101, memory 1102 and peripheral interface 1103 may be connected by a bus or signal lines. Various peripheral devices may be connected to peripheral interface 1103 by buses, signal lines, or circuit boards. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1104, display screen 1105, camera assembly 1106, audio circuitry 1107, positioning assembly 1108, and power supply 1109.

The peripheral interface 1103 may be used to connect at least one peripheral associated with I/O (Input/Output) to the processor 1101 and the memory 1102. In some embodiments, the processor 1101, memory 1102, and peripheral interface 1103 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1101, the memory 1102 and the peripheral device interface 1103 may be implemented on separate chips or circuit boards, which is not limited by this embodiment.

The Radio Frequency circuit 1104 is used to receive and transmit RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuit 1104 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 1104 converts an electric signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electric signal. Optionally, the radio frequency circuit 1104 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuit 1104 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the rf circuit 1104 may further include NFC (Near Field Communication) related circuits, which are not limited in this application.

The display screen 1105 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 1105 is a touch display screen, the display screen 1105 also has the ability to capture touch signals on or over the surface of the display screen 1105. The touch signal may be input to the processor 1101 as a control signal for processing. At this point, the display screen 1105 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, display 1105 may be one, providing the front panel of terminal 1100; in other embodiments, the display screens 1105 can be at least two, respectively disposed on different surfaces of the terminal 1100 or in a folded design; in other embodiments, display 1105 can be a flexible display disposed on a curved surface or on a folded surface of terminal 1100. Even further, the display screen 1105 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The Display screen 1105 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and other materials.

Camera assembly 1106 is used to capture images or video. Optionally, camera assembly 1106 includes a front camera and a rear camera. The front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 1106 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

The audio circuitry 1107 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1101 for processing or inputting the electric signals to the radio frequency circuit 1104 to achieve voice communication. For stereo capture or noise reduction purposes, multiple microphones may be provided, each at a different location of terminal 1100. The microphone may also be an array microphone or an omni-directional acquisition microphone. The speaker is used to convert electrical signals from the processor 1101 or the radio frequency circuit 1104 into sound waves. The loudspeaker can be a traditional film loudspeaker and can also be a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuitry 1107 may also include a headphone jack.

Positioning component 1108 is used to locate the current geographic position of terminal 1100 for purposes of navigation or LBS (Location Based Service). The Positioning component 1108 may be a Positioning component based on the united states GPS (Global Positioning System), the chinese beidou System, the russian graves System, or the european union galileo System.

Power supply 1109 is configured to provide power to various components within terminal 1100. The power supply 1109 may be alternating current, direct current, disposable or rechargeable. When the power supply 1109 includes a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery can also be used to support fast charge technology.

In some embodiments, terminal 1100 can also include one or more sensors 1110. The one or more sensors 1110 include, but are not limited to: acceleration sensor 1111, gyro sensor 1112, pressure sensor 1113, fingerprint sensor 1114, optical sensor 1115, and proximity sensor 1116.

Acceleration sensor 1111 may detect acceleration levels in three coordinate axes of a coordinate system established with terminal 1100. For example, the acceleration sensor 1111 may be configured to detect components of the gravitational acceleration in three coordinate axes. The processor 1101 may control the display screen 1105 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 1111. The acceleration sensor 1111 can also be used for acquisition of motion data of a game or a user.

The gyro sensor 1112 may detect a body direction and a rotation angle of the terminal 1100, and the gyro sensor 1112 may cooperate with the acceleration sensor 1111 to acquire a 3D motion of the user with respect to the terminal 1100. From the data collected by gyroscope sensor 1112, processor 1101 may implement the following functions: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.

Pressure sensor 1113 may be disposed on a side bezel of terminal 1100 and/or underlying display screen 1105. When the pressure sensor 1113 is disposed on the side frame of the terminal 1100, the holding signal of the terminal 1100 from the user can be detected, and the processor 1101 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 1113. When the pressure sensor 1113 is disposed at the lower layer of the display screen 1105, the processor 1101 controls the operability control on the UI interface according to the pressure operation of the user on the display screen 1105. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.

The fingerprint sensor 1114 is used to collect a fingerprint of the user, and the processor 1101 identifies the user according to the fingerprint collected by the fingerprint sensor 1114, or the fingerprint sensor 1114 identifies the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the user is authorized by the processor 1101 to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying for and changing settings, etc. Fingerprint sensor 1114 may be disposed on the front, back, or side of terminal 1100. When a physical button or vendor Logo is provided on the terminal 1100, the fingerprint sensor 1114 may be integrated with the physical button or vendor Logo.

Optical sensor 1115 is used to collect ambient light intensity. In one embodiment, the processor 1101 may control the display brightness of the display screen 1105 based on the ambient light intensity collected by the optical sensor 1115. Specifically, when the ambient light intensity is high, the display luminance of the display screen 1105 is increased; when the ambient light intensity is low, the display brightness of the display screen 1105 is reduced. In another embodiment, processor 1101 may also dynamically adjust the shooting parameters of camera assembly 1106 based on the ambient light intensity collected by optical sensor 1115.

A proximity sensor 1116, also referred to as a distance sensor, is provided on the front panel of terminal 1100. Proximity sensor 1116 is used to capture the distance between the user and the front face of terminal 1100. In one embodiment, when the proximity sensor 1116 detects that the distance between the user and the front face of the terminal 1100 is gradually reduced, the display screen 1105 is controlled by the processor 1101 to switch from a bright screen state to a dark screen state; when the proximity sensor 1116 detects that the distance between the user and the front face of the terminal 1100 becomes progressively larger, the display screen 1105 is controlled by the processor 1101 to switch from a breath-screen state to a light-screen state.

Those skilled in the art will appreciate that the configuration shown in fig. 11 does not constitute a limitation of terminal 1100, and may include more or fewer components than those shown, or may combine certain components, or may employ a different arrangement of components.

Optionally, the electronic device is provided as a server. Fig. 12 is a schematic structural diagram of a server 1200 according to an embodiment of the present application, where the server 1200 may generate a relatively large difference due to a difference in configuration or performance, and may include one or more processors (CPUs) 1201 and one or more memories 1202, where at least one program code is stored in the memory 1202, and the at least one program code is loaded and executed by the processors 1201 to implement the live broadcast method provided by the foregoing method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input/output interface, so as to perform input/output, and the server may also include other components for implementing the functions of the device, which are not described herein again.

The embodiment of the present application further provides a computer-readable storage medium, where at least one program code is stored in the computer-readable storage medium, and the at least one program code is loaded and executed by a processor to implement the operations executed in the live broadcasting method of the foregoing embodiment.

The embodiment of the present application further provides a computer program, where at least one program code is stored in the computer program, and the at least one program code is loaded and executed by the processor, so as to implement the operation executed in the live broadcasting method of the foregoing embodiment.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A live broadcast method, the method comprising:

receiving live push content sent by a server;

2. The method of claim 1, wherein the live push content includes a second video frame, the second video frame is obtained by inserting the target index information into the first video frame, and the obtaining the first video frame and the target index information according to the live push content includes:

3. The method of claim 1, wherein the live push content comprises an index file and at least one video slice, each video slice comprising at least one video frame, and wherein the obtaining a first video frame and target index information from the live push content comprises:

4. The method according to claim 1, wherein before displaying the target item information corresponding to the target index information while playing the first video frame, the method further comprises:

5. The method of claim 4, wherein before receiving the live push content sent by the server, the method further comprises:

6. A live broadcast method, the method comprising:

7. The method of claim 6, further comprising:

8. The method of claim 6, wherein the inserting the target index information into a currently captured first video frame to obtain a second video frame comprises:

9. A live broadcast method, the method comprising:

receiving a video stream sent by a main broadcasting terminal, wherein the video stream comprises a second video frame, the second video frame is obtained by inserting target index information and time point information into a first video frame, the first video frame is a video frame collected by the main broadcasting terminal when the main broadcasting terminal executes recommendation operation on target article information, the first video frame comprises live broadcast content recommending the target article information, the target index information is index information corresponding to the target article information, and the time point information represents live broadcast time point when the main broadcasting terminal executes the recommendation operation;

10. A live broadcast apparatus, characterized in that the apparatus comprises:

and the information display module is configured to display the target item information corresponding to the target index information when the first video frame is played.

11. A live device, characterized in that the device comprises:

12. A live broadcast apparatus, characterized in that the apparatus comprises:

a video frame analysis module configured to analyze the second video frame to obtain the first video frame, the target index information, and the time point information;

13. A live broadcast system, comprising a host terminal, a viewer terminal and a server;

14. An electronic device, comprising a processor and a memory, wherein at least one program code is stored in the memory, and wherein the program code is loaded and executed by the processor to perform the operations of the live method as claimed in any one of claims 1 to 9.

15. A computer-readable storage medium having stored therein at least one program code, the program code being loaded and executed by a processor to perform operations performed by a live method as claimed in any one of claims 1 to 9.