CN113784156B

CN113784156B - Live broadcast method and device, electronic equipment and storage medium

Info

Publication number: CN113784156B
Application number: CN202110962454.7A
Authority: CN
Inventors: 韦恒
Original assignee: Guangzhou Fanxing Huyu IT Co Ltd
Current assignee: Guangzhou Fanxing Huyu IT Co Ltd
Priority date: 2021-08-20
Filing date: 2021-08-20
Publication date: 2024-08-02
Anticipated expiration: 2041-08-20
Also published as: CN113784156A

Abstract

The embodiment of the application discloses a live broadcast method, a live broadcast device, electronic equipment and a storage medium, wherein the live broadcast method comprises the following steps: displaying a live broadcast interface of a live broadcast room; if a preset live event occurs in the live program, displaying a first control on a live interface; receiving a first operation acting on a first control; switching a picture of the live program from a first live picture to a second live picture in response to a first operation; if the first direct broadcast picture is a picture for the main broadcasting user to currently explain the object, the second direct broadcast picture is a display picture, and if the first direct broadcast picture is a display picture, the second direct broadcast picture is a picture for the main broadcasting user to currently explain the object.

Description

Live broadcast method and device, electronic equipment and storage medium

Technical Field

The embodiment of the application relates to the technical field of live broadcasting, in particular to a live broadcasting method, a live broadcasting device, electronic equipment and a storage medium.

Background

With the development of live broadcast technology and network technology, online live broadcast shopping occurs, and an anchor user usually displays articles to an audience user in a live broadcast mode, and the audience user purchases the articles taught by the anchor user in a shopping channel of a live broadcast room.

At present, when a host user explains an article in live broadcast, a host terminal collects live broadcast data through a video collecting device and pushes the live broadcast data to a server, the server pushes the live broadcast data to a viewer terminal, and the viewer terminal plays the live broadcast data on a live broadcast interface of a live broadcast room to present live broadcast pictures. A host user may explain multiple items during the opening process, and the host user explains one item at a time while explaining the items.

However, when the audience user enters the live broadcast room after the anchor user plays for a period of time, the audience user cannot know the articles taught by the anchor user, or after the anchor user plays, the audience user can review the live broadcast data of the anchor user to know the articles taught by the anchor user, or can review the article list of the anchor user to other pages.

Disclosure of Invention

The embodiment of the application provides a live broadcast method, a live broadcast device, electronic equipment and a storage medium, which can display articles taught by a host user to a viewer user at a live broadcast interface in the live broadcast process of the host user.

In a first aspect, an embodiment of the present application provides a live broadcast method, applied to a viewer terminal, where the live broadcast method includes:

displaying a live broadcast interface of a live broadcast room, wherein the live broadcast interface is used for playing live broadcast programs released by a host user in the live broadcast room;

If a preset live event occurs in the live program, displaying a first control on the live interface;

receiving a first operation acting on the first control;

Switching the picture of the live program from a first live picture to a second live picture in response to the first operation;

the first live broadcast picture is a picture displayed when the first live broadcast data is played, and the second live broadcast picture is a picture displayed when the second live broadcast data is played.

In a second aspect, an embodiment of the present application provides a live broadcast method, applied to a server, where the live broadcast method includes:

Transmitting interface data of a live interface of a live broadcasting room to a viewer terminal, wherein the live broadcasting interface is used for playing live programs released by a host user in the live broadcasting room;

transmitting one or more paths of live broadcast data to the audience terminal for playing;

Determining that a live event is set by a main broadcasting terminal aiming at the live program;

Transmitting the live event to the audience terminal to support switching of pictures of the live program from a first live picture to a second live picture;

In a third aspect, an embodiment of the present application provides a live broadcast method, applied to a hosting terminal, where the live broadcast method includes:

Releasing a live program in a live broadcast room;

setting a live event for the live program;

collecting one path of live broadcast data for a main broadcasting user to obtain a picture of a live broadcast program;

Collecting another path of live broadcast data for the displayed object to obtain a picture of another live broadcast program;

Releasing two paths of live broadcast data to the live broadcast room so as to support switching the picture of the live broadcast program from a first live broadcast picture to a second live broadcast picture;

Wherein, the first direct broadcast picture is a picture displayed when the first direct broadcast data is played, and the second direct broadcast picture is a picture displayed when the second direct broadcast data is played.

In a fourth aspect, an embodiment of the present application provides a live broadcast apparatus, applied to a viewer terminal, where the live broadcast apparatus includes:

the live broadcast interface display module is used for displaying a live broadcast interface of a live broadcast room, and the live broadcast interface is used for playing live broadcast programs released by a host user in the live broadcast room;

The first control display module is used for displaying a first control on the live broadcast interface if a preset live broadcast event occurs in the live broadcast program;

The first operation receiving module is used for receiving a first operation acting on the first control;

the live broadcast picture switching module is used for responding to the first operation and switching the picture of the live broadcast program from a first live broadcast picture to a second live broadcast picture;

In a fifth aspect, an embodiment of the present application provides a live broadcast apparatus, applied to a server, where the live broadcast apparatus includes:

The live broadcast interface transmitting module is used for transmitting interface data of a live broadcast interface of a live broadcast room to the audience terminal, and the live broadcast interface is used for playing live broadcast programs released by a host user in the live broadcast room;

the live broadcast data transmitting module is used for transmitting one or more paths of live broadcast data to the audience terminal for playing;

the live event determining module is used for determining that the main broadcasting terminal sets a live event for the live program;

the live event sending module is used for sending the live event to the audience terminal so as to support switching the picture of the live program from a first live picture to a second live picture;

In a sixth aspect, an embodiment of the present application provides a live broadcast apparatus, applied to a hosting terminal, where the live broadcast apparatus includes:

the live program release module is used for releasing live programs in the live broadcasting room;

The live event setting module is used for setting a live event for the live program;

The first direct broadcast data acquisition module is used for acquiring one path of direct broadcast data for a main broadcast user so as to obtain a picture of a direct broadcast program;

the second live broadcast data acquisition module is used for acquiring another path of live broadcast data for the displayed objects so as to acquire the picture of another live broadcast program;

The live broadcast data sending module is used for publishing two paths of live broadcast data to the live broadcast room so as to support switching the picture of the live broadcast program from a first live broadcast picture to a second live broadcast picture;

In a seventh aspect, an embodiment of the present application provides an electronic device, including:

One or more processors;

storage means for storing one or more computer programs,

The one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the live method described above.

In an eighth aspect, an embodiment of the present application provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the live broadcast method described above.

In the embodiment of the application, a live broadcast interface of a live broadcast room is displayed on a viewer terminal, a live broadcast program released by a host user in the live broadcast room is played on the live broadcast interface, if a preset live broadcast event occurs in the live broadcast program, a first control is displayed on the live broadcast interface, after a first operation acting on the first control is received, a picture of the live broadcast program is switched from a first live broadcast picture to a second live broadcast picture in response to the first operation, wherein the first live broadcast picture is a picture displayed when first live broadcast data is played, and the second live broadcast picture is a picture displayed when second live broadcast data is played. According to the embodiment of the application, the video data collected for the current explanation of the object of the anchor user can be used as the first direct broadcast data, the video data collected for the displayed object which is already explained by the anchor user is used as the second direct broadcast data, the first control is displayed on the direct broadcast interface when the preset direct broadcast event occurs in the direct broadcast program, the audience user switches the picture for explaining the object of the anchor user to the display picture by triggering the first control, the display picture is displayed in the direct broadcast to display the object explained by the anchor user to the audience user, the audience user does not need to review the direct broadcast data of the anchor user after the anchor user plays the object, or quit the current direct broadcast program to review the object list of the anchor user to learn the object explained by the anchor user, and the viewing experience of the audience user is improved.

Drawings

Fig. 1 is a schematic diagram of a live broadcast system provided by the present application;

fig. 2A is a flowchart illustrating steps of a live broadcast method according to a first embodiment of the present application;

FIG. 2B is a schematic diagram of the present application displaying a presenter inventory item in a live view;

FIG. 2C is a schematic diagram of the display shelf of the present application shown in a live view;

Fig. 3A is a step flowchart of a live broadcast method according to a second embodiment of the present application;

FIG. 3B is a schematic diagram of generating third live data in an embodiment of the present application;

FIG. 3C is a schematic diagram of displaying second control and summary information in an embodiment of the application;

fig. 4 is a step flowchart of a live broadcast method according to a third embodiment of the present application;

fig. 5 is a step flowchart of a live broadcast method according to a fourth embodiment of the present application;

fig. 6 is a step flowchart of a live broadcast method provided in a fifth embodiment of the present application;

fig. 7 is a step flowchart of a live broadcast method according to a sixth embodiment of the present application;

fig. 8 is a block diagram of a live broadcast device according to a seventh embodiment of the present application;

fig. 9 is a block diagram of a live broadcast device according to an eighth embodiment of the present application;

fig. 10 is a block diagram of a live broadcast device according to a ninth embodiment of the present application;

Fig. 11 is a schematic structural diagram of an electronic device according to a tenth embodiment of the present application.

Detailed Description

The application is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present application are shown in the drawings. Embodiments of the application and features of the embodiments may be combined with each other without conflict.

Fig. 1 is a schematic diagram of a live broadcast system according to an embodiment of the present application, where the live broadcast system includes a live broadcast scene 100, a hosting terminal 200, a server 300, and a viewer terminal 400.

The live scene 100 may be a real scene for live broadcast by a host user, and in an embodiment of the present application, the live scene 100 may be a live shopping scene, where the live scene 100 includes a display shelf 10, a host user 11, a first video capture device 12, a second video capture device 13, and at least one item 14 located on the display shelf 10. Wherein the display rack 10 may be an entity display rack for placing the articles 14 by the anchor user 11 in the live broadcast scene 100, the display rack 10 may be provided with a plurality of storage compartments 15, the articles 14 may be placed in the storage compartments 15, and each storage compartment 15 is provided with a position identifier 16, alternatively, the display rack 10 may also be a virtual display rack, and the virtual display rack may be a preset electronic display rack without entity on a wall or on the ground, or an electronic display rack generated according to the placement position of the articles after the anchor user places the taught articles on the wall or on the ground.

The first video capture device 12 and the second video capture device 13 may be devices for capturing video data as live data, and the first video capture device 12 and the second video capture device 13 may be, for example, video cameras, and the like. In the live broadcast scene 100 of the embodiment of the application, a host user 11 can explain an object at a live broadcast position 17, and after the explanation is completed, the object is placed in a placement grid 15 of a display rack 10, at this time, a first video acquisition device 12 explains an object acquisition image to the host user 11 to generate one path of live broadcast data, a live broadcast picture of the path of live broadcast data is the host user explaining the object, a second video acquisition device 13 acquires an image to the display rack 10 to generate another path of live broadcast data, and a live broadcast picture of the path of live broadcast data is the display rack 10, and in the application, the placement positions of the first video acquisition device 12 and the second video acquisition device 13 in the live broadcast scene 100 can be determined according to the live broadcast position 17 and the display rack 10.

The anchor terminal 200 may be a device having a video processing function and a network communication function, and the anchor terminal 200 may be a mobile phone, a tablet computer, a desktop computer, or the like, for example. In the embodiment of the present application, a live client is installed on the anchor terminal 200, and the anchor user 11 may operate the live client on the anchor terminal 200 to create a live broadcast room, and issue live broadcast data collected by the first video collecting device 12 and the second video collecting device 13 in the live broadcast room, that is, send the live broadcast data collected by the first video collecting device 12 and the second video collecting device 13 to the server 300 through the anchor terminal 200, and push the live broadcast data to the viewer terminal 400 by the server 300.

The viewer terminal 400 may be a device having a video playing function and a network communication function, and the viewer terminal 400 may be a mobile phone, a tablet computer, a desktop computer, a personal digital assistant, a wearable device, or the like, for example. The audience terminal 400 is provided with a live client, and after logging in the live client, an audience user enters a live room of a host user, and can play live data released by the host terminal 200 in the live room at a live interface of the live room so as to watch pictures when the host user live.

The server 300 may be a background server of the live client, and the server may be a server or a server cluster. In the embodiment of the present application, the first video capturing device 12 and the second video capturing device 13 respectively capture images of the anchor user 11 and the display rack 10 in the live broadcast scene to generate two paths of live broadcast data, the two paths of live broadcast data are sent to the server 300 by the anchor terminal 200, and sent to the audience terminal 400 via the server 300, and on the audience terminal 400, after the audience user logs in the live broadcast platform, the live broadcast data can be played in the live broadcast room of the anchor user to watch the live broadcast picture.

Based on the live broadcast system, the live broadcast method provided by the application is described with reference to the following embodiments.

Example 1

Fig. 2A is a flowchart illustrating steps of a live broadcast method provided in a first embodiment of the present application, where the embodiment of the present application is applicable to a case where a live program is hosted by a live user watching a live user in a live room, the method may be implemented by a live broadcast device according to an embodiment of the present application, where the live broadcast device may be implemented by hardware or software, and integrated into an electronic device (such as the viewer terminal 400 shown in fig. 1, and exemplarily applied to a live client running on the viewer terminal 400) provided in an embodiment of the present application, and specifically, as shown in fig. 2A, the live broadcast method according to an embodiment of the present application may include the following steps:

S210, displaying a live broadcast interface of a live broadcast room, wherein the live broadcast interface is used for playing live broadcast programs released by a host user in the live broadcast room.

The live broadcasting client can be installed on the audience terminal, after the audience user logs in the live broadcasting platform through the personal account number at the live broadcasting client, the live broadcasting client can display the live broadcasting room covers of a plurality of live broadcasting rooms on the front page of the live broadcasting client, when the live broadcasting client receives the operation of acting on the live broadcasting room covers by the audience user, the live broadcasting interface of the live broadcasting room is displayed on the live broadcasting client, so that the live broadcasting programs released by the host user in the live broadcasting room are played on the live broadcasting interface, one or more paths of video data collected by the video collecting device are pushed to the server as live broadcasting data by the host broadcasting terminal, the live broadcasting data are pushed to the audience terminal by the server, and the live broadcasting data are played by the audience terminal so as to display the live broadcasting programs on the live broadcasting interface of the live broadcasting room. Optionally, the live program in the embodiment of the present application may be a live shopping program that is hosted by a hosting user, where, of course, the live program may also be a live program of other content such as an educational program.

As shown in fig. 2B, a picture area 50 for playing a live program and a comment area 51 located outside the picture area 50 may be included in a live interface, where the comment area 51 is used to display comment information of a viewer user or related controls, and the related controls may include a control for triggering a focused anchor user, a control for triggering a praise anchor user, a control for triggering collection of a live program, and the like, for example.

And S220, if a preset live event occurs in the live program, displaying a first control on the live interface.

As shown in fig. 1, in the embodiment of the present application, a display stand 10 may be placed in a live broadcast scene 100 of a host user, where the display stand 10 is used for placing objects for which the host user finishes explanation, and the display stand 10 may be a physical display stand or a virtual display stand, and the virtual display stand may be a display stand in a preset virtual space, in one example, the virtual display stand may be a display stand for placing objects on a wall or a ground in a live broadcast scene of the host user, and the structure of the virtual display stand may be the same as that of the physical display stand, or may be a display stand that is fictitious according to the placement position of the objects after the objects are placed at will.

In the live broadcast scene 100, live broadcast data is acquired by the first video acquisition device 12 for the item taught by the anchor user, and live broadcast data is acquired by the second video acquisition device 13 for the item taught by the anchor user and displayed on the display rack 10, and the two paths of live broadcast data are transmitted to the audience terminal 400 via the anchor terminal 200 and the server 300. On the hosting terminal 200, a live event may be set by a hosting user, where the live event indicates that the hosting user hosts a live program, a camera is used to collect a picture of an item taught by the hosting user, and another camera is used to collect a picture of a display rack, and the live event is, for example, that the hosting user explains a plurality of items, places the item that completes the explanation on the display rack, or places the item on the display rack, and of course, may be other live events. The live event is sent to the audience terminal 400 after passing through the anchor terminal 200 and the server 300, so that the audience terminal 400 determines that the live event is set in the live room of the anchor user, that is, it can be determined that the anchor terminal 200 is acquiring two paths of live data through two video acquisition devices, and then the first control can be displayed on the live interface of the audience terminal.

As shown in fig. 2B, the first control 52 may be displayed in a live broadcast picture area in a live broadcast interface, or of course, the first control 52 may be displayed in a comment area 51, or the first control 52 may be displayed directly in the live broadcast interface, or the first control 52 that is displayed in advance and not activated may be changed to an activated state.

S230, receiving a first operation acting on the first control.

In the embodiment of the present application, the first operation acting on the first control may be a click operation, a touch operation, or the like of the viewer user. The first operation may be a touch operation of the user, and when the user terminal is a personal computer, the first operation may be a mouse click operation of the user.

S240, responding to the first operation, and switching the picture of the live program from a first live picture to a second live picture.

In the embodiment of the application, the server can receive two paths of live broadcast data sent by the anchor terminal, one path of live broadcast data is data generated by acquiring an object taught by an anchor user by one video acquisition device, and the other path of live broadcast data is data generated by acquiring a display frame by the other video acquisition device.

And when the first operation is responded, the picture of the live broadcast interface is switched from a first live broadcast picture to a second live broadcast picture, wherein the first live broadcast picture is a picture displayed when the first live broadcast data is played, and the second live broadcast picture is a picture displayed when the second live broadcast data is played. For example, if the first direct broadcast picture is a picture of the item that the presenter currently teaches, the second direct broadcast picture is a display picture, and if the first direct broadcast picture is a display picture, the second direct broadcast picture is a picture of the item that the presenter currently teaches, wherein the display picture is a picture of the item that the presenter teaches.

As shown in fig. 2B, the screen of the live interface is the current explanation of the article by the anchor user, and after the first control 52 is triggered by the audience user, the screen of the live interface is switched to the display screen shown in fig. 2C, in which the display rack 10 is displayed, and the articles for which the anchor user has completed explanation are placed on the display rack 10. If the user again activates the first control 52, the screen of the live interface switches to the screen shown in FIG. 2B where the anchor user teaches an item.

The embodiment of the application displays a live broadcast interface of a live broadcast room on a viewer terminal so as to play a live broadcast program released by a host user in the live broadcast room on the live broadcast interface, if a preset live broadcast event occurs in the live broadcast program, a first control is displayed on the live broadcast interface, after a first operation acting on the first control is received, a picture of the live broadcast program is switched from a first live broadcast picture to a second live broadcast picture in response to the first operation, wherein the first live broadcast picture is a picture displayed when first live broadcast data are played, and the second live broadcast picture is a picture displayed when second live broadcast data are played. According to the embodiment of the application, the video data collected for the current explanation of the object of the anchor user can be used as the first direct broadcast data, the video data collected for the displayed object which is already explained by the anchor user is used as the second direct broadcast data, the first control is displayed on the direct broadcast interface when a preset direct broadcast event occurs in the direct broadcast program, and the audience user switches from the picture of the anchor explanation of the object to the display picture by triggering the first control, so that the display picture is displayed in the direct broadcast to display the object explained by the anchor user to the audience user, the audience user does not need to review the direct broadcast data of the anchor user after the anchor user plays or quit the current direct broadcast program to review the object list of the anchor user to learn the object explained by the anchor user, and the viewing experience of the audience user is improved.

Example two

Fig. 3A is a step flow chart of a live broadcast method according to a second embodiment of the present application, where the live broadcast method according to the first embodiment of the present application is optimized based on the first embodiment, specifically, as shown in fig. 3A, the live broadcast method according to the embodiment of the present application may include the following steps:

s310, displaying a live broadcast interface of a live broadcast room, wherein the live broadcast interface is used for playing live broadcast programs released by a host user in the live broadcast room.

The live broadcasting client can be installed on the audience terminal, after the audience user logs in the live broadcasting platform through the personal account number at the live broadcasting client, the live broadcasting client can display the live broadcasting room covers of a plurality of live broadcasting rooms on the front page of the live broadcasting client, when the live broadcasting client receives the operation of the audience terminal acting on the live broadcasting room covers, the live broadcasting interface of the live broadcasting room is displayed on the live broadcasting client, so that the live broadcasting programs released by the host user in the live broadcasting room are played on the live broadcasting interface, one or more paths of video data collected by the video collecting device are pushed to the server as live broadcasting data by the host broadcasting terminal, the live broadcasting data are pushed to the audience terminal by the server, and the live broadcasting data are played by the audience terminal so as to display the live broadcasting programs on the live broadcasting interface of the live broadcasting room. Alternatively, the live program of the embodiment of the present application may be a web live shopping program.

And S320, if a preset live event occurs in the live program, displaying a first control on the live interface.

As shown in fig. 1, in the embodiment of the present application, a display stand 10 may be placed in a live broadcast scene 100 of a host user, where the display stand 10 may be a physical display stand or a virtual display stand, and the display stand 10 is used to place an item that the host user finishes explaining, in the live broadcast scene 100, live broadcast data is acquired for the host user explaining the item through a first video acquisition device 12, live broadcast data is acquired for the host user explaining the item displayed on the display stand 10 through a second video acquisition device 13, and two paths of live broadcast data are transmitted to a viewer terminal 400 after passing through a host terminal 200 and a server 300. On the hosting terminal 200, a hosting user may set a live event, where the live event indicates that, when the hosting user hosts a live program, a camera is used to collect a picture of an item taught by the hosting user, and another camera is used to collect a picture of a display rack, and by way of example, the live event indicates that the hosting user explains a plurality of items, places the item that completes the explanation on the display rack, or places the item on the display rack, and of course, other live events may also be used. The live event is sent to the audience terminal 400 after passing through the anchor terminal 200 and the server 300, so that the audience terminal 400 determines that the live event is set in the live room of the anchor user, that is, it can be determined that the anchor terminal 200 is acquiring two paths of live data through two video acquisition devices, and then the first control can be displayed on the live interface of the audience terminal.

As shown in fig. 2B, the first control 52 may be displayed in a live broadcast picture area in a live broadcast interface, or of course, the first control 52 may be displayed in a comment area 51, or the first control 52 may be displayed directly in an activated state in the live broadcast interface, or the pre-displayed first control 52 that is not activated may be changed into an activated state.

S330, receiving a first operation acting on the first control.

S340, responding to the first operation, and switching the picture of the live program from a first live picture to a second live picture.

In the embodiment of the application, the server can receive two paths of live broadcast data pushed by the anchor terminal, one path of live broadcast data is data acquired for explaining objects to anchor users, and the other path of live broadcast data is data acquired for explaining objects displayed on a display frame by anchor users.

In response to the first operation, the picture of the live broadcast interface is switched from a first live broadcast picture to a second live broadcast picture, wherein the first live broadcast picture is a picture displayed when the first live broadcast data is played, the second live broadcast picture is a picture displayed when the second live broadcast data is played, and for example, if the first live broadcast picture is a picture of a subject user currently explaining an object, the second live broadcast picture is a display picture, and if the first live broadcast picture is a display picture, the second live broadcast picture is a picture of the subject user currently explaining the object, and the display picture is a picture of the object displayed and taught by the subject user.

In an alternative embodiment of the present application, the server sends a path of live broadcast data to the viewer terminal, and switching, in the viewer terminal, a picture of the live program from the first live broadcast picture to the second live broadcast picture may include: stopping requesting first direct broadcast data from the server, wherein the first direct broadcast data comprises a first direct broadcast picture, stopping playing the first direct broadcast data in a direct broadcast interface, stopping taking the first direct broadcast picture as a picture of a direct broadcast program, requesting second direct broadcast data from the server, wherein the second direct broadcast data comprises a second direct broadcast picture, and playing the second direct broadcast data in the direct broadcast interface to start the second direct broadcast picture as the picture of the direct broadcast program.

Specifically, the viewer terminal starts a rendering instance, the rendering instance decodes the first direct broadcast data and then renders the first direct broadcast data so as to display the first direct broadcast picture on the picture of the live broadcast program, when the viewer user operates the first control, the viewer terminal responds to the operation to stop sending the first direct broadcast data to the server, the picture of the live broadcast program stops displaying the first direct broadcast picture, meanwhile, the viewer terminal sends a request of the second direct broadcast data to the server, the server receives the request and sends the request of the second direct broadcast data to the viewer terminal, the rendering instance in the viewer terminal decodes and renders the second direct broadcast data, and the picture of the live broadcast program is switched from displaying the first direct broadcast picture to displaying the second direct broadcast picture. According to the embodiment of the application, the audience terminal requests one path of live broadcast data from the server at the same time, the network bandwidth occupied by the transmission of the live broadcast data is small, and the one path of live broadcast data is decoded and rendered at the same time, so that the resource consumption of the audience terminal is low, and the live broadcast program is played more smoothly.

In another alternative embodiment, the server sends two paths of live broadcast data to the audience terminal at the same time, and switching the picture of the live program in the audience terminal from the first live broadcast picture to the second live broadcast picture may include: simultaneously receiving first direct broadcast data and second direct broadcast data sent by a server, displaying a first direct broadcast picture when the first direct broadcast data is played, displaying a second direct broadcast picture when the second direct broadcast data is played, simultaneously rendering the first direct broadcast data and the second direct broadcast data, and switching from the rendered first direct broadcast data to the rendered second direct broadcast data in a direct broadcast interface so as to switch the picture of a direct broadcast program from the first direct broadcast picture to the second direct broadcast picture.

Specifically, when receiving first direct broadcast data and second direct broadcast data sent by a server at the same time, the audience terminal starts a first rendering instance and a second rendering instance, wherein the first rendering instance decodes and renders the first direct broadcast data, the second rendering instance renders the second direct broadcast data, the first rendering instance is called to display a first direct broadcast picture on a picture of a direct broadcast program, when an audience user operates a first control, the audience terminal responds to the operation to stop calling the first rendering instance to stop displaying the first direct broadcast picture on the picture of the direct broadcast program, and starts to call the second rendering instance to display the rendered second direct broadcast data on the picture of the direct broadcast program, so that the picture of the direct broadcast program is switched from the first direct broadcast picture to the second direct broadcast picture.

According to the embodiment of the application, two paths of live broadcast data can be received simultaneously, the two rendering examples are started to render the first live broadcast data and the second live broadcast data respectively, and the corresponding rendering examples are called to realize the switching of live broadcast pictures during the switching.

In yet another alternative embodiment, the server mixes the received two paths of live broadcast data to generate third live broadcast data, and switching, in the viewer terminal, a picture of the live program from the first live broadcast picture to the second live broadcast picture may include: receiving third live broadcast data sent by a server, wherein the third live broadcast data comprises multi-frame image data, and stopping extracting a preset first area from each frame of image data, and the first area comprises a first live broadcast picture; and extracting a preset second area from each frame of image data, wherein the second area comprises a second live broadcast picture, and playing third live broadcast data after the second area is extracted in a live broadcast interface.

Specifically, as shown in fig. 3B, the server mixes two paths of live broadcast data to generate third live broadcast data, where the third live broadcast data includes multiple frames of image data, each frame of image data includes a first area a and a second area B, the first area a includes a first live broadcast picture in one path of live broadcast data, the second area B includes a second live broadcast picture in another path of live broadcast data, after receiving the third live broadcast data, the viewer terminal extracts a live broadcast picture in one of the areas from each frame of image data of the third live broadcast data, and displays the extracted live broadcast picture in a picture of a live broadcast program, for example, a live broadcast picture for a main broadcast object in the first area a is displayed in a picture of the live broadcast program, and when a viewer user operates a first control, the viewer terminal stops extracting the live broadcast picture in the first area a in response to the operation, and extracts a picture for a display frame in the second area B from the second area B to display the picture in the live broadcast program, thereby implementing switching of the two paths from the first live broadcast picture to the second live broadcast picture. According to the embodiment of the application, the two paths of live broadcast data are mixed to generate the third live broadcast data, so that the network bandwidth can be saved, and the synchronization of the two paths of live broadcast data can be ensured.

And S350, when the picture of the live program is the display picture, displaying a second control for the object in the display picture.

In the embodiment of the application, if the picture of the live program is a display picture, detecting an article in the display picture on the picture of the live program to determine a first position of the article in the picture of the live program, determining a second position in the picture of the live program based on the first position and a preset control layout rule, and displaying a second control for the article on the second position.

When the screen of the live program is a display screen, the object in the display screen can be detected by the object detection algorithm. The object detection refers to detecting all the objects of interest in the display screen, the object detection can be divided into two tasks of object classification and object positioning, the object classification task is responsible for judging whether the objects in the display screen are present or not, and a series of labels with scores are output to indicate the possibility that the objects are present in the display screen. Meanwhile, the position and the range of the object in the display screen are determined through the target positioning task, and a bounding box of the object, or the center of the object, or the closed boundary of the object, or the like is output, wherein a square bounding box, that is Bounding Box, is generally used for representing the position information of the object, that is, the first position of the object, and the first position can be the display position of the object on the live screen.

After determining the first position of the object, determining the second position by combining the first position of the object and a preset control layout rule, wherein the preset control layout rule can be a layout rule of the second control on the live broadcast picture. Illustratively, the control layout rule may be a relative relationship of the second position of the second control to the first position of the item, e.g., the displayed position of the second control is above right, above left, below right, below left, etc. of the item. After determining the first position of the object on the screen, determining a second position of the second control according to the first position, a preset control layout rule and the size of the second control, and displaying the second control on the second position. As shown in fig. 3C, taking a display frame as an example, a display frame is displayed on a live broadcast frame, after determining a first position of an article 14, a right upper area in a storage compartment 15 where the article 14 is located may be determined as a second position according to the first position, then a second control 53 is displayed in the right upper area in the storage compartment 15, or of course, the second control 53 may be displayed in other positions in other areas in the storage compartment 15, or the second control 53 may be displayed in other areas outside the storage compartment 15, and a person skilled in the art may set different control layout rules according to different requirements to determine a display position of the second control 53.

S360, receiving a second operation acting on the second control.

In the embodiment of the present application, the second operation acting on the second control may be a click operation, a touch operation, or the like of the viewer user. The second operation may be a touch operation of the user, and when the user terminal is a personal computer, the second operation may be a mouse click operation of the user.

And S370, responding to the second operation, and switching the picture of the live program to a history picture, wherein the history picture is a picture of the host user for historically explaining the object in the live program.

In response to the second operation, the viewer terminal may request a history screen of the item from the server, the history screen being a screen of live data of a live user who history-teaches the item in the live program. In response to the second operation, the viewer terminal may generate a historical live data request including a location identification of the location of the item in the display.

Illustratively, as shown in fig. 3C, taking the display frame as an example of the frame 10, since the second control 53 is displayed in the display area of the object placing grids 15 on the display frame, each object placing grid 15 may be provided with a location identifier 16, when the second control 53 is triggered, a historical live broadcast data request carrying the location identifier 16 may be generated, after receiving the historical live broadcast data request, the server matches the historical live broadcast data of the object through the location identifier, and sends the historical live broadcast data of the object to the viewer terminal, and after receiving the historical live broadcast data of the object, the viewer terminal plays the historical live broadcast data to switch the frame of the live broadcast program to the historical frame.

When the picture of the live program is a display picture, a second control is displayed for the articles in the display picture, and the audience user can switch the picture of the live program to the history picture through operating the second control, so that the history review of the articles taught by the anchor user is realized, and when the audience user needs to watch the articles taught by the anchor user, the anchor user does not need to pause the articles taught by the anchor user to explain the articles again, the explanation of the current articles by the anchor user is not influenced, the history picture of the articles taught by the anchor user can be displayed to the audience user, the value of the articles can be judged by the aid of the history picture, and the reality of online shopping live broadcast can be reflected.

And S380, displaying the picture of the live program on the live interface after the play of the history picture is finished.

In the embodiment of the application, after the play of the history picture is finished, a second live picture can be automatically displayed on the live interface, and the second live picture is a display picture.

In an alternative embodiment of the present application, when the picture of the live program is a display picture, summary information of the item is displayed for the item in the display picture, a third operation acting on the summary information is received, and in response to the third operation, an order page is displayed, the order page being used for ordering the item.

For example, the first position of the item in the display screen may be detected on the screen of the live program, and a third position may be determined on the screen of the live program based on the first position and a preset summary layout rule, and summary information may be displayed on the third position for the item. The preset summary layout rule may be a layout rule of summary information of the article on a live broadcast picture, and specifically may be a relative relationship between a display position of the summary information of the article and a display position of the article. For example, the preset summary layout rule may be that summary information of the article is displayed in a designated area in the storage grid where the article is located. As shown in fig. 3C, taking a display screen as an example of the display stand 10, after the display stand 10 is displayed on the live broadcast screen, after determining the first position of the article 14, the lower half area in the storage grid 15 where the article 14 is located may be determined as the third position according to the first position, then the summary information 54 is displayed in the lower half area in the storage grid 15, of course, the summary information 54 may also be displayed in other positions in the display area of the storage grid 15, and the summary information 54 may also be displayed outside the display area of the storage grid 15, and a person skilled in the art may set different summary information layout rules according to different requirements to determine the display position of the summary information 54.

As shown in fig. 3C, when the summary information 54 is triggered, a summary information request carrying the location identifier 16 may be generated, and after the server receives the summary information request, the server matches the summary information of the item through the location identifier, and sends the summary information to the viewer terminal, where the viewer terminal displays the summary information at a third location after receiving the summary information of the item.

As shown in fig. 3C, the summary information may be brief information of the item, and may be at least one of a name, a material, a size, and a price of the item. The link between the summary information and the order page can be preconfigured in the server, when the picture of the live program is a display picture, the summary information of the article can be sent to the audience terminal, and the audience terminal displays the summary information of the article at the corresponding position after determining the display position of the summary information. The summary information can also be used as a link of a ordering page, and after clicking the summary information, the ordering page of the article can be displayed, so that the audience can watch more detailed information of the article and order the article on the ordering page.

When the picture of the live broadcast program is a display picture, the embodiment of the application displays the abstract information of the object aiming at the object in the display picture, receives the third operation acted on the abstract information, and responds to the third operation to display the ordering page, on one hand, the abstract information of each object in the display picture is displayed, so that the audience user can conveniently watch the basic attribute information of each object, on the other hand, the abstract information is used as an interface of the ordering page, the audience user can display the ordering page by clicking the abstract information, and the audience user can know the detailed information of the object and the ordered object on the ordering page.

In the embodiment of the application, a live interface of a live broadcasting room is displayed on a viewer terminal so as to play a live broadcasting program released by a host user in the live broadcasting room on the live broadcasting interface, if a preset live broadcasting event occurs in the live broadcasting program, a first control is displayed on the live broadcasting interface, after a first operation acting on the first control is received, a picture of the live broadcasting program is switched from a first live broadcasting picture to a second live broadcasting picture in response to the first operation, wherein the first live broadcasting picture is a picture displayed when first live broadcasting data is played, and the second live broadcasting picture is a picture displayed when second live broadcasting data is played. According to the embodiment of the application, the video data collected for the current explanation of the object of the anchor user can be used as the first direct broadcast data, the video data collected for the displayed object which is already explained by the anchor user is used as the second direct broadcast data, the first control is displayed when the anchor user places the explained object on the display rack, the audience user switches the display screen from the screen of the anchor explanation object to the display screen by triggering the first control, the display screen is displayed in the direct broadcast to display the object explained by the anchor user to the audience user, the audience user does not need to review the direct broadcast data of the anchor user after the anchor user plays or quit the current direct broadcast program to review the object list of the anchor user to learn the object explained by the anchor user, and the viewing experience of the audience user is improved.

Further, when the picture of the live program is a display picture, a second control is displayed for the articles in the display picture, and the audience user can switch the picture of the live program to a history picture through operating the second control, so that the history review of the articles taught by the audience user is realized, when the audience user needs to watch the articles taught by the audience user, the audience user does not need to pause the articles taught by the audience user to explain the articles again, the explanation of the current articles by the audience user is not influenced, the history picture of the articles taught by the audience user can be displayed to the audience user, the value of the articles can be judged through the history picture in an auxiliary mode, and meanwhile, the reality of online shopping live broadcast can be embodied.

Further, when the picture of the live broadcast program is a display picture, the summary information of the articles is displayed for the articles in the display picture, a third operation acting on the summary information is received, and an ordering page is displayed in response to the third operation, on one hand, the summary information of each article in the display picture is displayed, so that a viewer can watch the summary information of each article conveniently, on the other hand, the summary information is used as an interface of the ordering page, the viewer can display the ordering page by clicking the summary information, and the viewer can know the detailed information of the articles and the ordered articles on the ordering page.

Example III

Fig. 4 is a flowchart illustrating steps of a live broadcast method according to a third embodiment of the present application, where the embodiment of the present application is applicable to a case of pushing live broadcast data to a viewer terminal, the method may be performed by a live broadcast device according to the embodiment of the present application, and the live broadcast device may be implemented by hardware or software and integrated into an electronic device (such as a server 300 shown in fig. 1) according to the embodiment of the present application, and specifically, as shown in fig. 4, the live broadcast method according to the embodiment of the present application may include the following steps:

S410, interface data of a live interface of a live broadcasting room is sent to a viewer terminal, and the live broadcasting interface is used for playing live programs released by a host user in the live broadcasting room.

The audience terminal can be provided with a live broadcast client, after the live broadcast client logs in the live broadcast platform through a personal account, audience users can display the live broadcast room covers of a plurality of live broadcast rooms on the front page of the live broadcast client, when the live broadcast client receives the live broadcast room covers of a certain live broadcast room acted by the audience terminal, the server can receive the live broadcast interface loading request of the audience terminal, the server transmits the interface data of the live broadcast interface of the live broadcast room to the audience terminal, the interface data of the live broadcasting room can be data such as a display style of the live broadcasting interface, information of a host user, personalized settings of the live broadcasting room and the like, and when the interface data of the live broadcasting room is loaded by a viewer terminal, the live broadcasting interface is displayed on the viewer terminal and is used for playing a live broadcasting program which is hosted by the host user, and optionally, the live broadcasting program can be a network live broadcasting shopping program.

And S420, pushing one or more paths of live broadcast data to the audience terminal for playing.

After the host user plays, the server may receive live broadcast data from the host terminal, in this embodiment of the present application, the host user may use two video capturing devices to capture video data as live broadcast data, as shown in fig. 1, a display stand 10 may be disposed in a live broadcast scene 100 of one host user, where the display stand 10 may be an entity display stand or a virtual display stand, the display stand 10 is used to place an object for which the host user finishes explanation, in the live broadcast scene 100, the first video capturing device 12 captures live broadcast data for the host user, the second video capturing device 13 captures live broadcast data for the display stand 10, and the two paths of live broadcast data are sent to the server 300 via the host terminal 200, where the server may receive two paths of live broadcast data from the host terminal, where a live broadcast picture of one path of live broadcast data is an object for the host user and a live broadcast picture of the other path of live broadcast data is the display stand.

After receiving the two paths of live broadcast data, the server may first send one path of live broadcast data to the audience terminal, stop sending the current live broadcast data after responding to the operation of the audience user acting on the first control on the audience terminal, send the other path of live broadcast data to the audience terminal, or send the two paths of live broadcast data to the audience terminal at the same time, or mix the two paths of live broadcast data to generate third live broadcast data, and send the third live broadcast data to the audience terminal.

S430, determining that the main broadcasting terminal sets a live broadcasting event for the live broadcasting program.

In the embodiment of the present application, a live event may be set by a host user on the host terminal 200, where the live event represents a live program hosted by the host user, a picture of an item taught by the host user is acquired by using one camera, and a picture of a display rack is acquired by using another camera. The live event is sent to the server 300 through the anchor terminal 200, and when the server determines that the anchor user sets the live event for the live program, the server determines that a display frame is placed in a live scene of the anchor user, one path of live data is collected for the anchor through one video collecting device, and the other path of live data is collected for the display frame through the other video collecting device.

S440, the live event is sent to the audience terminal to support switching of the picture of the live program from a first live picture to a second live picture.

The server receives the live event and transmits the live event to the audience terminal 400, and after receiving the live event, the audience terminal 400 may determine that the anchor terminal 200 is acquiring two paths of live data through two video acquisition devices and has transmitted the two paths of live data to the server 300, at which time the audience terminal may display the first control on the live interface.

When the audience user operates the first control, the picture of the live broadcast interface is switched from a first live broadcast picture to a second live broadcast picture, wherein the first live broadcast picture is a picture displayed when the first live broadcast data is played, the second live broadcast picture is a picture displayed when the second live broadcast data is played, and for example, if the first live broadcast picture is a picture of a current explanation object of the host user, the second live broadcast picture is a display picture, and if the first live broadcast picture is a display picture, the second live broadcast picture is a picture of the current explanation object of the host user, and the display picture is a picture of the displayed and the explanation object of the host user.

In the embodiment of the application, the server transmits interface data of a live interface of a live broadcasting room to the audience terminal, pushes one or more paths of live broadcasting data to the audience terminal for playing, transmits a live broadcasting event to the audience terminal after determining that the live broadcasting event is set by the host broadcasting terminal for the live broadcasting program, displays a first control when the audience terminal determines that the live broadcasting event occurs in the live broadcasting program, and a viewer user operates the first control to switch a picture of the live broadcasting program from a first direct broadcasting picture to a second direct broadcasting picture, wherein the first direct broadcasting picture is a picture displayed when the first direct broadcasting data is played, and the second direct broadcasting picture is a picture displayed when the second direct broadcasting data is played. According to the embodiment of the application, the video data collected for the current explanation items of the anchor user can be used as the first direct broadcast data, the video data collected for the displayed items which are already explained by the anchor user are used as the second direct broadcast data, the first control is displayed when a preset direct broadcast event occurs in the direct broadcast program, the audience user switches from the picture of the explanation items of the anchor to the display picture by triggering the first control, the display picture is displayed in the direct broadcast to display the items explained by the anchor user to the audience user, the audience user does not need to review the direct broadcast data of the anchor user after the anchor user downloads the video data or quit the current direct broadcast program to review the item list of the anchor user to learn the items explained by the anchor user, and the watching experience of the audience user is improved.

Example IV

Fig. 5 is a step flowchart of a live broadcast method provided by a fourth embodiment of the present application, where the live broadcast method according to the present application is optimized based on the third embodiment, specifically, as shown in fig. 5, the live broadcast method according to the present application may include the following steps:

S510, interface data of a live interface of a live broadcasting room are sent to the audience terminal, and the live broadcasting interface is used for playing live programs released by a host user in the live broadcasting room.

S520, receiving first direct broadcast data and second direct broadcast data sent by a main broadcast terminal, wherein the first direct broadcast data comprises a first direct broadcast picture, and the second direct broadcast data comprises a second direct broadcast picture.

In the embodiment of the present application, as shown in fig. 1, a display stand 10 may be provided in a live scene 100 of a host user, where the display stand 10 may be a physical display stand or a virtual display stand, where the display stand 10 is used for placing an article that the host user finishes explanation, in the live scene 100, live broadcast data is collected for the host user by a first video collecting device 12, live broadcast data is collected for the display stand 10 by a second video collecting device 13, two paths of live broadcast data are sent to a server 300 through a host terminal 200, where the server may receive two paths of live broadcast data from the host terminal, where a live broadcast picture of one path of live broadcast data is a picture of the host currently explaining article, and a live broadcast picture of the other path of live broadcast data is a display picture, where the display picture is a picture of the article that the host user has explained, for example, may be displayed on the display stand, and the display picture may be a picture of the display stand.

And S530, pushing one or more paths of live broadcast data to the audience terminal for playing.

In one embodiment of the application, the server transmits the first direct broadcast data and/or the second direct broadcast data to the viewer terminal. For example, the server may first transmit the first direct broadcast data to the viewer terminal in response to the first direct broadcast data request transmitted by the viewer terminal, and stop transmitting the first direct broadcast data to the viewer terminal and transmit the second direct broadcast data to the viewer terminal when receiving the second direct broadcast data request transmitted by the viewer terminal. When the viewer terminal requests the first direct broadcast data and the second direct broadcast data at the same time, the server transmits the first direct broadcast data and the second direct broadcast data to the viewer terminal at the same time in response to the request.

In another embodiment of the present application, the server may further generate third live data, where the third live data includes multi-frame image data, a first live frame of the first live data is located in a first area of the image data, a second live frame of the second live data is located in a second area of the image data, and the third live data is transmitted to the viewer terminal. Specifically, as shown in fig. 3B, the server mixes two paths of live broadcast data to generate third live broadcast data, where the third live broadcast data includes multi-frame image data, each frame of image data includes a first area a and a second area B, the first area a includes a first live broadcast picture in one path of live broadcast data, and the second area B includes a second live broadcast picture of another path of live broadcast data.

S540, determining that the anchor terminal sets a live event for the live program.

In the embodiment of the present application, a live event may be set by a host user on the host terminal 200, where the live event represents a live program hosted by the host user, a picture of an item explained by the host user is acquired by using one camera, and a picture of a display rack is acquired by using another camera. The live event is sent to the server 300 through the anchor terminal 200, and represents that the anchor terminal 200 collects one path of live broadcast data of the current explanation object of the anchor user through the first video collecting device, collects the other path of live broadcast data of the display rack through the second video collecting device, and after the server determines that the anchor user sets the live event for the live program, determines that the display rack is placed in the live broadcast scene of the anchor user, collects one path of live broadcast data for the anchor through one video collecting device, and collects the other path of live broadcast data for the display rack through the other video collecting device.

S550, the live event is sent to the audience terminal so as to support switching of the picture of the live program from a first live picture to a second live picture.

The server receives the live event and transmits the live event to the audience terminal 400, and after receiving the live event, the audience terminal 400 may determine that the anchor terminal 200 is acquiring two paths of live data through two video acquisition devices and transmits the two paths of live data to the server 300, at which time the audience terminal may display the first control on the live interface.

When the audience user operates the first control, the picture of the live broadcast interface is switched from a first live broadcast picture to a second live broadcast picture, wherein the first live broadcast picture is a picture displayed when the first live broadcast data is played, and the second live broadcast picture is a picture displayed when the second live broadcast data is played. For example, if the first live view is a view of the object being taught by the anchor user, the second live view is a display view, and if the first live view is a display view, the second live view is a view of the object being taught by the anchor user, the display view may be a view of the object being displayed and taught by the anchor user, for example, the object may be displayed on a display shelf, and the display view may be a view of the display shelf.

S560, responding to a historical live broadcast data request sent by the audience terminal, determining historical live broadcast data of the article, wherein the historical picture sending request is a request generated after the audience terminal receives a second control, and the second control is a control for displaying the article in the display picture when the picture of the live broadcast program is the display picture.

The server may pre-generate historical live data for the item, and the process of the server generating the historical live data for the item is described below in connection with an example.

In one example, the server may determine the first direct broadcast data and the second direct broadcast data from two paths of direct broadcast data received by the anchor terminal, where a direct broadcast picture of the first direct broadcast data is a picture of the anchor user currently explaining an article, a direct broadcast picture of the second direct broadcast data is a display picture, then determine historical direct broadcast data of the article from the first direct broadcast data, play the historical direct broadcast data to display a historical picture of the anchor user explaining the article, determine a position identifier of the article from the second direct broadcast data, the position identifier is an identifier of a position of the article in the display picture, and finally store the historical direct broadcast data and the position identifier in an associated manner.

For example, the anchor terminal may identify each path of live broadcast data, so that a live broadcast picture identifying the live broadcast data is a current explanation object of the anchor user, or a live broadcast picture identifying the live broadcast data is a display picture, and after receiving two paths of live broadcast data, the server may determine the first live broadcast data and the second live broadcast data through the identification.

In order to obtain the historical live broadcast data of the object, the object can be detected in the image data of the first live broadcast data, the image data of the object appearing for the first time and the image data of the object appearing for the last time are determined, and the image data between the image data of the first time and the image data of the last time is taken as the historical live broadcast data of the object. For example, the first live data may be subject to object detection tracking to determine image data of the first occurrence of the item and image data of the first disappearance of the item, with image data between the image data of the first occurrence of the item and the image data of the first disappearance of the item being taken as historical live data of the item. According to the embodiment of the invention, the target detection algorithm is used for carrying out target detection tracking on the live broadcast data, so that the video clips of the item explained by the anchor user can be accurately determined from the live broadcast data to serve as historical live broadcast data of the item.

In another example, when the anchor user finishes an item explanation, service data, such as advertisement data, is usually required to be recommended, when the anchor user recommends service data, the server receives the service data recommendation request, historical live broadcast data of the item can be determined according to time when two adjacent service data recommendation requests are received, the server records a first time stamp when receiving a first service data recommendation request sent by an anchor terminal, records a second time stamp when receiving a second service data recommendation request sent by the anchor terminal, and takes live broadcast data between the first time stamp and the second time stamp as the historical live broadcast data of the item in the first live broadcast data.

Specifically, the service data recommendation request sent by the anchor terminal may be a request generated by an anchor user triggering a service recommendation control when the anchor user finishes explaining a current item, for example, the service recommendation control may be a control for delivering advertisements, when the anchor user finishes an item explanation, related advertisements generally need to be delivered, the anchor user triggers the service recommendation control to generate advertisement data and sends the advertisement data to a server, the server sends the advertisement data to an audience terminal, the audience terminal displays the advertisement data, and the server can determine historical live broadcast data of the item by receiving the service recommendation control. For example, the live broadcast data includes a time stamp, when the anchor user finishes explaining an item, a service recommendation control on the interface of the live broadcast room is triggered to generate a service data recommendation request and send the service data recommendation request to the server, the server can record the time stamp when the service data recommendation request is received between two adjacent times, and the live broadcast data between the two time stamps in the first live broadcast data is determined as the historical live broadcast data of the item. According to the embodiment of the invention, the time stamp of the item of the anchor user is recorded by receiving the service recommendation request sent by the anchor terminal, the video fragment of the item of the anchor user is determined from the live broadcast data as the historical live broadcast data of the item through the time stamp, the algorithm is simple, and the resource consumption of the server is low.

Similarly, target detection tracking can be performed on the second live broadcast data, the position identification of the article and the position of the article in the live broadcast picture is identified, then the historical live broadcast data of the article and the position identification are stored in an associated mode, and the associated storage can refer to taking the position identification as an index of a storage address of the historical live broadcast data, namely, the unique historical live broadcast data can be matched through the position identification.

According to the embodiment of the application, the historical live broadcast data of the article is generated by detecting the live broadcast data through the target detection algorithm, or the historical live broadcast data of the article is determined from the live broadcast data through the live broadcast behavior of the recommended service of the host user, and the historical live broadcast data is associated with the position identification of the article, so that on one hand, the historical live broadcast data of the article and the associated articles can be automatically generated without manual editing, the manual maintenance cost is reduced, and on the other hand, the historical live broadcast data of the associated articles is automatically associated with the position identification of the article after the placement position of the article on the display rack is changed, and the accuracy of the historical live broadcast data of the article can be ensured.

After the server generates the historical live broadcast data of the object, a second control is displayed for the object in the display screen when the screen of the live broadcast program is the display screen on the audience terminal, a second operation acting on the second control is received, and when the second operation is responded, the audience terminal can request the historical screen of the object to the server, namely the audience terminal can generate a historical live broadcast data request, and the historical live broadcast data request carries a position identifier. After receiving the request of the historical live broadcast data, the server acquires the position identification from the request, and searches target historical live broadcast data matched with the position identification in the prestored historical live broadcast data to serve as the historical live broadcast data of the article.

S570, sending the historical live broadcast data of the object to the audience terminal.

After the historical live broadcast data of the object are determined, the historical live broadcast data can be sent to the audience terminal, the historical live broadcast data are played after the audience terminal receives the historical live broadcast data of the object, and live broadcast pictures of the live broadcast programs are switched from pictures of the display rack to historical pictures of the object.

In the embodiment of the application, when the picture of the live program is a display picture, a second control is displayed for the articles in the display picture, and the audience user can respond to the historical live broadcast data request generated by the second control operation to determine the historical live broadcast data of the articles, send the historical live broadcast data to the audience terminal, play the historical live broadcast data by the audience terminal, and switch the picture of the live program to the historical picture, thereby realizing the historical review of the articles taught by the audience user, and when the audience user needs to watch the articles taught by the audience user, the audience user does not need to pause the articles taught at present to explain the articles again, so that the explanation of the current articles by the audience user is not influenced, the historical picture of the articles taught by the audience user can be displayed to the audience user, the value of the articles can be judged in an auxiliary way through the historical picture, and the reality of network shopping can be embodied.

In an alternative embodiment of the present application, when a picture of a live program in live broadcast data sent to a viewer terminal is a display picture, detecting an item in the display picture on the picture of the live program to obtain a position identification of the item, searching summary information matched with the position identification in pre-stored summary information, and sending the summary information of the item to the viewer terminal. Specifically, in one example, the server may generate summary information of the article in advance, for example, after generating the historical live broadcast data of the article, the server may perform voice recognition on the historical live broadcast data to obtain the summary information of the article, for example, perform voice recognition on audio data in the historical live broadcast data of the article to obtain at least one of a name, a material, a size and a price of the article, and store the summary information in association with a location identifier of the article, and further store the summary information in association with a link of a subscription page of the article, so that the subscription page of the article is sent to the audience terminal when the summary information is triggered.

Because the server generates the summary information of the article in advance and stores the summary information in association with the position identifier of the article, the target summary information matched with the position identifier can be searched for as the summary information of the article, and the summary information of the article is sent to the audience terminal, and the audience terminal can display the summary information on the live broadcast picture when the live broadcast picture is a display picture, as shown in fig. 3C, the summary information can be the brief information of the article, and can be at least one of the name, the material, the size and the price of the article.

In another alternative embodiment, the viewer user operates the summary information of the item and then requests a page for ordering, and the server transmits the page for ordering the item to the viewer terminal in response to the request, and in one example, may transmit a link (URL) of the page for ordering to the viewer terminal, through which the viewer terminal accesses the page for ordering the item.

When the picture of the live broadcast program is a display picture, the server of the embodiment of the application displays the abstract information of the object aiming at the object in the display picture, receives the third operation acted on the abstract information, and responds to the third operation to display the ordering page, on one hand, the abstract information of each object on the display picture is displayed, so that the audience user can watch the abstract information of each object conveniently, on the other hand, the abstract information is used as an interface of the ordering page, the audience user can display the ordering page by clicking the abstract information, and the audience user can know the detailed information of the object and the ordered object on the ordering page.

In the embodiment of the application, the server transmits interface data of a live interface of a live broadcasting room to the audience terminal, pushes one or more paths of live broadcasting data to the audience terminal for playing, transmits a live broadcasting event to the audience terminal after determining that the live broadcasting event is set by the host broadcasting terminal for the live broadcasting program, displays a first control when the audience terminal determines that the live broadcasting event occurs in the live broadcasting program, and a viewer user operates the first control to switch a picture of the live broadcasting program from a first direct broadcasting picture to a second direct broadcasting picture, wherein the first direct broadcasting picture is a picture displayed when the first direct broadcasting data is played, and the second direct broadcasting picture is a picture displayed when the second direct broadcasting data is played. According to the embodiment of the application, the video data collected for the current explanation items of the anchor user can be used as the first direct broadcast data, the video data collected for the displayed items which are already explained by the anchor user are used as the second direct broadcast data, the first control is displayed when a preset direct broadcast event occurs in a direct broadcast program, and the audience user switches from a picture for explaining the items of the anchor to a display picture by triggering the first control, so that the display picture is displayed in the direct broadcast to display the items explained by the anchor user to the audience user, the audience user does not need to review the direct broadcast data of the anchor user after the anchor user downloads the video data or quit the current direct broadcast program to review the item list of the anchor user to learn the items explained by the anchor user, and the viewing experience of the audience user is improved.

Further, in response to a historical live broadcast data request sent by the audience terminal, historical live broadcast data of the article are determined, the historical live broadcast data of the article are sent to the audience terminal, the audience terminal plays the historical live broadcast data, and the picture of a live broadcast program is switched to a historical picture, so that the historical review of the article taught by the anchor user is realized, when the audience user needs to watch the article taught by the anchor user, the anchor user does not need to pause the article taught by the current to explain the article again, the explanation of the current article by the anchor user is not influenced, the historical picture of the article taught by the anchor user can be displayed to the audience user, the value of the article can be judged through the assistance of the historical picture, and meanwhile, the reality of online shopping live broadcast can be embodied.

Further, the server generates summary information of the articles and links to the ordering pages of the articles, when the frames of the live broadcast programs are display frames, the summary information of the articles is sent to the audience terminal to display the summary information of the articles on the display frames, when the audience operates the summary information, the links to the ordering pages are sent to the audience terminal to display the ordering pages of the articles on the audience terminal, on one hand, the summary information of each article in the display frames is displayed, so that the audience user can watch the summary information of each article conveniently, on the other hand, the summary information is used as an interface of the ordering pages, the audience user can display the ordering pages by clicking the summary information, and the audience user can know the detailed information of the articles and the ordered articles on the ordering pages.

Example five

Fig. 6 is a flowchart of steps of a live broadcast method provided by a fifth embodiment of the present application, where the embodiment of the present application is applicable to a case where a hosting terminal pushes live broadcast data to a server, the method may be implemented by a live broadcast device according to an embodiment of the present application, where the live broadcast device may be implemented by hardware or software, and integrated into an electronic device provided by an embodiment of the present application (such as the hosting terminal 200 shown in fig. 1, and exemplarily applied to a live broadcast client running on the hosting terminal 200), and specifically, as shown in fig. 6, the live broadcast method according to an embodiment of the present application may include the following steps:

s610, publishing the live program in the live broadcast room.

In the embodiment of the application, the live program can be a network live shopping program hosted by a host user, the host user can create a live room after logging in the live platform by a personal account number at the host terminal, the live room is opened to release the live program, the cover of the live room of the host user is displayed in the live room list of the live client, and the audience user can enter the live room through the cover of the live room to watch the live program released by the host user.

S620, setting a live event for the live program.

As shown in fig. 1, in the embodiment of the present application, a display stand 10 may be placed in a live broadcast scene 100 of a host user, where the display stand 10 may be a physical display stand or a virtual display stand, and the display stand 10 is used to place an item for which the host user finishes explanation, in the live broadcast scene 100, live broadcast data is collected for the host user to explain the item by using a first video collecting device 12, live broadcast data is collected for the display stand 10 by using a second video collecting device 13, and two paths of live broadcast data are sent to a viewer terminal 400 after passing through the host terminal 200 and the server 300.

On the hosting terminal 200, a hosting user may set a live event, where the live event indicates that, when the hosting user hosts a live program, a camera is used to collect a picture of an item taught by the hosting user, and another camera is used to collect a picture of a display rack, and by way of example, the live event indicates that the hosting user explains a plurality of items, places the item that completes the explanation on the display rack, or places the item on the display rack, and of course, other live events may also be used. The live event is sent to the audience terminal 400 after passing through the anchor terminal 200 and the server 300, so that the audience terminal 400 determines that the live event is set in the live broadcasting room of the anchor user, namely, the audience terminal 400 can determine that a display rack is placed in a live broadcasting scene of the anchor user, collect one path of live broadcast data for explaining objects to the anchor user through one video collecting device, collect the other path of live broadcast data for the display rack through the other video collecting device, and the audience terminal can display a first control on the live broadcasting interface.

The setting of the live event by the anchor user for the live program may be that relevant options are checked in the live program setting, such as checking a display stand, checking a first video acquisition device and a second video acquisition device, setting the first video acquisition device to acquire first live data for the anchor, setting the second video acquisition device to acquire second live data for the display stand, and the like, after receiving the live event by the anchor user for the live program, the server may determine that the anchor user sets the live event and send the live event to the audience terminal, and after determining the live event, the audience terminal displays a first control on a picture of the live program, where the first control is used to trigger the live picture to switch from the first live picture to the second live picture.

S630, collecting one path of live broadcast data for the anchor user so as to obtain a picture of a live broadcast program.

As shown in fig. 1, in the embodiment of the present application, a live broadcast scene 100 of a host user includes a host user 11 and a display rack 10, and live broadcast data can be collected for explaining an article by the host user through a first video collecting device 12, so as to obtain a picture for explaining the article by the host user.

S640, collecting another path of live broadcast data for the displayed object to obtain a picture of another live broadcast program.

As shown in fig. 1, in the embodiment of the present application, the articles taught by the anchor user may be displayed on the display rack 10, and live broadcast data may be acquired from the display rack 10 through the second video acquisition device 13, so as to obtain a display frame, where the display frame is a frame of the displayed articles taught by the anchor user.

And S650, publishing the two paths of live broadcast data to a server so as to support switching the picture of the live broadcast program from a first live broadcast picture to a second live broadcast picture.

As shown in fig. 1, live broadcast data is collected for a host user through a first video collecting device 12, live broadcast data is collected for a display rack 10 through a second video collecting device 13, two paths of live broadcast data are sent to a server 300 through a host broadcast terminal 200, the server can receive two paths of live broadcast data from the host broadcast terminal, wherein a live broadcast picture of one path of live broadcast data is a picture of a host broadcast currently explaining an object, and a live broadcast picture of the other path of live broadcast data is a display picture.

In the audience terminal, a first control may be displayed on the live view, the first control being configured to trigger a switch of the live view from a first live view to a second live view. The first direct broadcast picture is a picture displayed when the first direct broadcast data is played, and the second direct broadcast picture is a picture displayed when the second direct broadcast data is played, and illustratively, if the first direct broadcast picture is a picture of a current explanation of an article of a host user, the second direct broadcast picture is a display picture, and if the first direct broadcast picture is a display picture, the second direct broadcast picture is a picture of the current explanation of the article of the host user.

In the embodiment of the application, a live broadcast event is set for a live broadcast program by a host user, one path of live broadcast data is collected for the host user to obtain a picture of one live broadcast program, the other path of live broadcast data is collected for a displayed object to obtain a picture of the other live broadcast program, and two paths of live broadcast data are issued to a server, so that a first control is displayed on the live broadcast program when the live broadcast event is determined by a audience terminal, the picture of the object to be taught by the host user is switched to a display picture by triggering the first control on a live broadcast interface, the purpose of displaying the display picture in the live broadcast to display the object taught by the host user to the audience user is achieved, the audience user does not need to review the live broadcast data of the host user after the host user plays or quit the current live broadcast program to review the object list of the host user to know the object taught by the host user, and the viewing experience of the audience user is improved.

In an alternative embodiment of the application, the service recommendation control is displayed on a live interface of the anchor terminal, an operation acting on the service recommendation control is received, a service data recommendation request is sent to the server in response to the operation, and the server is used for sending the service data to the audience terminal so as to display the service data at the audience terminal.

In one example, the service recommendation may be an advertisement service, a lottery service operation, or the like, taking the advertisement service as an example, the anchor user may preset the advertisement service to be delivered, and after the anchor user triggers the service recommendation control when completing the explanation of an article, the audience terminal generates service data of the advertisement service and sends the service data to the server to request the server to send the service data to the audience terminal, and after the audience terminal receives the service data, the service data is played to display the advertisement delivery effect. Optionally, the server may record a timestamp of the received service recommendation request when the service recommendation request is received, so as to determine historical live broadcast data of the item from the live broadcast data.

According to the embodiment of the application, the service recommendation control is displayed on the live broadcast interface of the anchor terminal, the operation acting on the service recommendation control is received, the service data recommendation request is sent to the server in response to the operation, the server is used for sending the service data to the audience terminal so as to display the service data on the audience terminal, the service recommendation function is provided for anchor users on the one hand, the anchor users can recommend the service, on the other hand, the server can record the time stamp of receiving the service recommendation request to determine the historical live broadcast data of the object from the live broadcast data when receiving the service recommendation request, the historical live broadcast data of the object is automatically generated by the server, and the background manual maintenance cost is saved.

Example six

Fig. 7 is a step flowchart of a live broadcast method provided by a sixth embodiment of the present application, where the embodiment of the present application is applicable to a live broadcast situation, and the live broadcast method may be applied to the live broadcast system shown in fig. 1, and specifically, as shown in fig. 7, the live broadcast method of the embodiment of the present application may include the following steps:

and S701, the anchor terminal transmits the two paths of live broadcast data to the server.

The main broadcasting terminal receives one path of live broadcast data acquired by the first video acquisition equipment and the other path of live broadcast data acquired by the second video acquisition equipment, and sends the two paths of live broadcast data to the server, wherein the picture of one path of live broadcast data is a picture for a main broadcasting user to explain a current object, the picture of the other path of live broadcast data is a display picture, and the display picture can be a picture of a display frame.

S702, the server sends the first direct broadcast data to the audience terminal.

S703, the audience terminal plays the first direct broadcast data so as to present the first direct broadcast picture and the first control on the picture of the direct broadcast program.

The first control is used for switching the picture of the live program from the first live picture to the second live picture.

S704, the audience terminal responds to the first operation acted on the first control to generate a second live broadcast data request.

And S705, sending a second live broadcast data request to the server.

S706, the server responds to the second live broadcast data request and sends second live broadcast data to the audience terminal.

And S707, the audience terminal responds to the first control operation to play the second live broadcast data, and the picture of the live broadcast program is switched from the first live broadcast picture to the second live broadcast picture.

If the first direct broadcast picture is a picture for the main broadcasting user to currently explain the object, the second direct broadcast picture is a display picture, and if the first direct broadcast picture is a display picture, the second direct broadcast picture is a picture for the main broadcasting user to currently explain the object.

And S708, when the picture of the live program is the display picture, the audience terminal displays a second control for the object in the display picture.

The second control is triggered to play a history screen of the item at the live interface, which may be a screen of the anchor user that historically teaches the item.

And S709, the audience terminal responds to the operation acted on the second control to generate a historical live broadcast data request of the article and send the request to the server.

And S710, the server responds to the historical live broadcast data request and sends the historical live broadcast data of the article to the audience terminal.

And S711, the audience terminal plays the historical live broadcast data so as to switch the picture of the live broadcast program to a historical picture.

According to the embodiment of the application, when the first control is displayed on the live broadcast picture of the live broadcast program, the audience user switches from the picture of the host user explaining the object to the display picture by triggering the first control on the live broadcast interface, so that the display picture is displayed in live broadcast to display the object taught by the host user to the audience user, the audience user does not need to review live broadcast data of the host user after the host user downloads the program or quit the current live broadcast program to review the object list of the host user to learn the object taught by the host user, and viewing experience of the audience user is improved.

Further, when the picture of the live broadcast program is a display picture, a second control is displayed on the picture of the live broadcast program, and a viewer user can switch the picture of the live broadcast program to a history picture through operating the second control, so that the history review of the articles taught by the viewer user is realized, and when the viewer user needs to watch the articles taught by the viewer user, the viewer user does not need to pause the articles taught by the viewer user to explain the articles again, so that the explanation of the current articles by the viewer user is not influenced, the history picture of the articles taught by the viewer user can be displayed to the viewer user, the value of the articles can be judged through the assistance of the history picture, and meanwhile, the reality of live broadcast of network shopping can be embodied.

Example seven

Fig. 8 is a block diagram of a live broadcast device according to a seventh embodiment of the present application, where, as shown in fig. 8, the live broadcast device according to the embodiment of the present application may specifically include the following modules:

The live broadcast interface display module 810 is configured to display a live broadcast interface of a live broadcast room, where the live broadcast interface is used to play a live broadcast program that is released by a host user in the live broadcast room;

A first control display module 820, configured to display a first control on the live interface if a preset live event occurs in the live program;

a first operation receiving module 830, configured to receive a first operation acting on the first control;

A live broadcast picture switching module 840, configured to switch a picture of the live broadcast program from a first live broadcast picture to a second live broadcast picture in response to the first operation;

In an optional embodiment, if the first direct broadcast picture is a picture of the anchor user currently explaining the object, the second direct broadcast picture is a display picture, and if the first direct broadcast picture is the display picture, the second direct broadcast picture is a picture of the anchor user currently explaining the object.

In an alternative embodiment, the live broadcast device further comprises:

the second control display module is used for displaying a second control for the object in the display picture when the picture of the live program is the display picture;

the second operation receiving module is used for receiving a second operation acting on the second control;

And the history picture switching module is used for responding to the second operation and switching the picture of the live program to a history picture, wherein the history picture is a picture of the host user for historically explaining the object in the live program.

In an alternative embodiment, the second control display module includes:

A first position determining sub-module, configured to detect, on a screen of the live program, the item in the display screen to obtain a first position of the item in the screen;

A second position determining sub-module, configured to determine a second position in a picture of the live program based on the first position and a preset control layout rule;

And the second control display sub-module is used for displaying a second control for the article at the second position.

In an alternative embodiment, the live broadcast device further comprises:

and the history picture playing and playing ending module is used for displaying the picture of the live program on the live interface after the history picture playing is ended.

In an alternative embodiment, the live broadcast device further comprises:

the summary information display module is used for displaying summary information of the articles in the display picture when the picture of the live program is the display picture;

a third operation receiving module for receiving a third operation acting on the summary information;

and the ordering page display module is used for responding to the third operation and displaying an ordering page, wherein the ordering page is used for ordering the articles.

In an alternative embodiment, the summary information display module includes:

A third position determining sub-module, configured to determine a third position in the picture of the live program based on the first position and a preset summary information layout rule;

and the summary information display sub-module is used for displaying summary information for the article at the third position.

In an alternative embodiment, the live view switching module 840 includes:

A first direct-broadcasting data stopping request sub-module, configured to stop requesting first direct-broadcasting data to a server, where the first direct-broadcasting data displays a first direct-broadcasting picture when being played;

a first direct-broadcasting data stopping playing sub-module, configured to stop playing the first direct-broadcasting data in the direct-broadcasting interface, so as to stop playing the first direct-broadcasting picture as a picture of the direct-broadcasting program;

The second live broadcast data request submodule is used for requesting second live broadcast data from the server, and displaying a second live broadcast picture when the second live broadcast data is played;

And the second live broadcast data playing sub-module is used for playing the second live broadcast data in the live broadcast interface so as to start the second live broadcast picture to serve as the picture of the live broadcast program.

In an alternative embodiment, the live view switching module 840 includes:

The live broadcast data receiving sub-module is used for simultaneously receiving first live broadcast data and second live broadcast data sent by the server, wherein a first live broadcast picture is displayed when the first live broadcast data is played, and a second live broadcast picture is displayed when the second live broadcast data is played;

a live broadcast data rendering sub-module for rendering the first live broadcast data and the second live broadcast data simultaneously;

And the live broadcast picture switching sub-module is used for switching the rendered first live broadcast data to the rendered second live broadcast data in the live broadcast interface so as to switch the picture of the live broadcast program from the first live broadcast picture to the second live broadcast picture.

In an alternative embodiment, the live view switching module 840 includes:

The third live broadcast data receiving sub-module is used for receiving third live broadcast data sent by the server, wherein the third live broadcast data comprises multi-frame image data;

a first region stopping extraction sub-module, configured to stop extracting a preset first region from the image data of each frame, where the first region includes a first direct-play picture;

A second region extraction sub-module, configured to start extracting a preset second region from the image data of each frame, where the second region includes a second live broadcast picture;

and the playing sub-module is used for playing the third live broadcast data after the second area is extracted in the live broadcast interface.

The live broadcast device provided by the embodiment of the application can execute the live broadcast method provided by the first embodiment and the second embodiment of the application, and has the corresponding functions and beneficial effects of the execution method.

Example eight

Fig. 9 is a block diagram of a live broadcast device according to an eighth embodiment of the present application, where, as shown in fig. 9, the live broadcast device according to the embodiment of the present application may specifically include the following modules:

A live broadcast interface sending module 910, configured to send interface data of a live broadcast interface of a live broadcast room to a viewer terminal, where the live broadcast interface is used to play a live broadcast program published by a host user in the live broadcast room;

The live broadcast data sending module 920 is configured to send one or more paths of live broadcast data to the audience terminal for playing;

a live event determining module 930, configured to determine that a live event is set by a hosting terminal for the live program;

A live event sending module 940, configured to send the live event to the audience terminal, so as to support switching a picture of the live program from a first live picture to a second live picture;

In an alternative embodiment, the live broadcast device further comprises:

The live broadcast data receiving module is used for receiving first live broadcast data and second live broadcast data sent by the main broadcast terminal, wherein the first live broadcast data comprises a first live broadcast picture, and the second live broadcast data comprises a second live broadcast picture.

In an alternative embodiment, the live data includes first live data and second live data, and the live data transmitting module 920 includes:

and the first sending module is used for sending the first direct broadcast data and/or the second direct broadcast data to the audience terminal.

the system comprises a third live broadcast data generation module, a second live broadcast data generation module and a first live broadcast data generation module, wherein the third live broadcast data comprises multi-frame image data, a first live broadcast picture of the first live broadcast data is positioned in a first area of the image data, and a second live broadcast picture of the second live broadcast data is positioned in a second area of the image data;

and the second sending module is used for sending the third live broadcast data to the audience terminal.

In an alternative embodiment, the live broadcast device further comprises:

The position identification determining module is used for detecting the article in the display picture on the picture of the live program when the picture of the live program in the live data sent to the audience terminal is the display picture, so as to obtain the position identification of the article;

the abstract information matching module is used for searching abstract information matched with the position identifier in the prestored abstract information;

And the abstract information sending module is used for sending the abstract information of the article to the audience terminal.

In an alternative embodiment, the live broadcast device further comprises:

The historical live broadcast data determining module is used for determining the historical live broadcast data of the object in response to a historical live broadcast data request sent by the audience terminal, wherein the historical picture sending request is a request generated after the audience terminal receives a second control, and the second control is a control for displaying the object in the display picture when the picture of the live broadcast program is the display picture;

The system comprises a historical live broadcast data sending module, a historical live broadcast data sending module and a viewer terminal, wherein the historical live broadcast data sending module is used for sending the historical live broadcast data of the object to the viewer terminal, the historical live broadcast data comprises a historical picture for a host user to explain the object, and the viewer terminal is used for playing the historical live broadcast data so as to switch the picture of the live broadcast program to the historical picture.

In an alternative embodiment, the live broadcast device further comprises:

The live broadcast data determining module is used for determining first live broadcast data and second live broadcast data from the received two paths of live broadcast data, wherein live broadcast pictures of the first live broadcast data are pictures for the main broadcasting user to currently explain the objects, and live broadcast pictures of the second live broadcast data are display pictures;

The historical live broadcast data determining module is used for determining the historical live broadcast data of the article from the first live broadcast data, and displaying a historical picture of the host user explaining the article when the historical live broadcast data is played;

The position identification determining module is used for determining a position identification of the object from the second live broadcast data, wherein the position identification is an identification of the position of the object in the display picture;

and the historical live broadcast data association storage module is used for storing the historical live broadcast data and the position identification in an association mode.

In an alternative embodiment, the historical live data determination module includes:

an item detection sub-module for detecting the item at the image data of the first direct broadcast data;

An image data determining sub-module, configured to determine first image data and second image data of the article detected, where the first image data is image data of the article detected for the first time, and the second image data is image data of the article detected for the last time;

And the first historical live broadcast data generation sub-module is used for taking live broadcast data between the first image data and the second image data as historical live broadcast data of the object in the first live broadcast data.

A first timestamp recording sub-module, configured to record a first timestamp when receiving a first service data recommendation request sent by the anchor terminal;

a second timestamp recording sub-module, configured to record a second timestamp when receiving a second service data recommendation request sent by the anchor terminal;

and the second historical live broadcast data generation sub-module is used for taking live broadcast data between the first time stamp and the second time stamp in the first live broadcast data as historical live broadcast data of the article.

In an alternative embodiment, the live broadcast device further comprises:

the voice recognition module is used for carrying out voice recognition on the historical live broadcast data to obtain abstract information of the article;

And the abstract information storage module is used for storing the abstract information and the position identification in an associated mode.

The live broadcast device provided by the embodiment of the application can execute the live broadcast method provided by the third embodiment and the fourth embodiment of the application, and has the corresponding functions and beneficial effects of the execution method.

Example nine

Fig. 10 is a block diagram of a live broadcast device according to a ninth embodiment of the present application, and as shown in fig. 10, the live broadcast device according to the embodiment of the present application may specifically include the following modules:

A live program publishing module 1010, configured to publish a live program in a live broadcast room;

A live event setting module 1020, configured to set a live event for the live program;

The first direct broadcast data acquisition module 1030 is configured to acquire a path of direct broadcast data for a host user to obtain a picture of a direct broadcast program;

The second live broadcast data acquisition module 1040 is configured to acquire another path of live broadcast data for a displayed object, so as to obtain a picture of another live broadcast program;

a live broadcast data sending module 1050, configured to issue two paths of live broadcast data to the server, so as to support switching a picture of the live broadcast program from a first live broadcast picture to a second live broadcast picture;

In an alternative embodiment, the live broadcast device further comprises:

the service recommendation control display module is used for displaying a service recommendation control in the live broadcasting room;

The operation receiving module is used for receiving the operation acting on the service recommendation control, wherein the operation is the operation of the service control and the action of the anchor user after the anchor user finishes explaining the current object;

and the service data recommendation request sending module is used for responding to the operation acted on the service recommendation control, sending a service data recommendation request to a server, and sending the service data to the audience terminal by the server so as to display the service data at the audience terminal.

The live broadcast device provided by the embodiment of the application can execute the live broadcast method provided by the fifth embodiment of the application, and has the corresponding functions and beneficial effects of the execution method.

Examples ten

Referring to fig. 11, a schematic structural diagram of an electronic device in one example of the application is shown. As shown in fig. 11, the electronic device may specifically include: a processor 1101, a memory 1102, a display screen 1103 having a touch function, an input device 1104, an output device 1105, and a communication device 1106. The number of processors 1101 in the electronic device may be one or more, one processor 1101 being illustrated in fig. 11. The amount of memory 1102 in the electronic device can be one or more, one memory 1102 being illustrated in fig. 11. The processor 1101, memory 1102, display 1103, input device 1104, output device 1105 and communication device 1106 of the apparatus may be connected by a bus or other means, for example in fig. 11.

The memory 1102 is used as a computer readable storage medium, and may be used to store a software program, a computer executable software program, and a module, where the program instructions/modules corresponding to the live broadcast method according to any embodiment of the present application (for example, the live interface display module 810, the first control display module 820, the first operation receiving module 830, and the live screen switching module 840 in the live broadcast device provided in the seventh embodiment, or the live interface transmitting module 910, the live data transmitting module 920, the live event determining module 930, and the live event transmitting module 940 in the live broadcast device provided in the eighth embodiment, or the live program publishing module 1010, the live event setting module 1020, the first live data acquisition module 1030, the second live data acquisition module 1040, and the live data transmitting module 1050 in the live broadcast device provided in the ninth embodiment of the present application), where the memory 1102 may mainly include a stored program area and a stored data area, and the stored program area may store an operating device, at least one function-required application program; the storage data area may store data created according to the use of the device, etc. In addition, memory 1102 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, the memory 1102 may further include memory located remotely from the processor 1101, which may be connected to the device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The display 1103 is a display 1103 with a touch function, which may be a capacitive screen. Generally, the display 1103 is configured to display data according to an instruction of the processor 1101, and also configured to receive a touch operation applied to the display 1103 and send a corresponding signal to the processor 1101 or other devices.

The communication device 1106 is used to establish a communication connection with other devices, which may be a wired communication device and/or a wireless communication device.

The input device 1104 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the apparatus. The output device 1105 may include an audio device such as a speaker. The specific composition of the input device 1104 and the output device 1105 may be set according to the actual situation.

The processor 1101 executes various functional applications of the device and data processing by running software programs, instructions, and modules stored in the memory 1102, i.e., implements the live method described above.

Specifically, in the embodiment, when the processor 1101 executes one or more programs stored in the memory 1102, the steps of the live broadcast method provided by the embodiment of the present application are specifically implemented.

Example eleven

An eleventh embodiment of the present application provides a computer-readable storage medium having stored thereon a computer program that, when executed by a processor, implements the live broadcast method in any embodiment of the present application.

Of course, the storage medium containing the computer executable instructions provided in the embodiments of the present application is not limited to the method operations described above, but may also perform the related operations of the live broadcast method provided in any embodiment on the electronic device.

It should be noted that, in the embodiments of the apparatus, the electronic device, and the storage medium, the description is relatively simple, and the relevant points refer to the part of the description of the method embodiments, since they are substantially similar to the method embodiments.

From the above description of embodiments, it will be clear to a person skilled in the art that the present application may be implemented by means of software and necessary general purpose hardware, but of course also by means of hardware, although in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software article, which may be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, etc., and include several instructions for causing an electronic device (which may be a personal computer, a mobile terminal, a server, or a network device, etc.) to execute the live method according to the embodiments of the present application.

It should be noted that, in the embodiment of the live broadcast apparatus, each unit and module included are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present application.

The above description is only of the preferred embodiments of the present application and is not intended to limit the present application, and various modifications and variations may be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A live broadcast method applied to a viewer terminal, the live broadcast method comprising:

If a preset live event occurs in the live program, displaying a first control on the live interface, wherein the live event indicates that a host user hosts the live program, acquiring a picture of the host user explaining an object by adopting a first video acquisition device, and acquiring a picture of a display rack by adopting a second video acquisition device;

receiving a first operation acting on the first control;

the first live broadcast picture is a picture displayed when the first live broadcast data is played, and the second live broadcast picture is a picture displayed when the second live broadcast data is played;

If the first direct broadcast picture is a picture which is acquired by the first video acquisition equipment and used for explaining the object currently by the anchor user, the second direct broadcast picture is a display picture which is acquired by the second video acquisition equipment, and if the first direct broadcast picture is a display picture which is acquired by the second video acquisition equipment, the second direct broadcast picture is a picture which is acquired by the first video acquisition equipment and used for explaining the object currently by the anchor user, and the display picture is a picture of the object which is displayed and explained by the anchor user.

2. The live broadcast method of claim 1, further comprising:

When the picture of the live program is the display picture, displaying a second control for the object in the display picture;

Receiving a second operation acting on the second control;

and responding to the second operation, switching the picture of the live program to a history picture, wherein the history picture is a picture of the host user in the live program for history teaching the articles.

3. The live broadcast method of claim 1, further comprising:

When the picture of the live program is the display picture, displaying abstract information of the object aiming at the object in the display picture;

Receiving a third operation acting on the summary information;

And in response to the third operation, displaying a ordering page, wherein the ordering page is used for ordering the article.

4. The live broadcast method of claim 1, wherein the switching the picture of the live program from a first live view to a second live view comprises:

Simultaneously receiving first direct broadcast data and second direct broadcast data sent by a server, wherein a first direct broadcast picture is displayed when the first direct broadcast data is played, and a second direct broadcast picture is displayed when the second direct broadcast data is played;

simultaneously rendering the first live data and the second live data;

switching from the rendered first live data to playing the rendered second live data in the live interface to switch a picture of the live program from the first live picture to the second live picture.

5. The live broadcast method of claim 1, wherein the switching the picture of the live program from a first live view to a second live view comprises:

receiving third live broadcast data sent by a server, wherein the third live broadcast data comprises multi-frame image data;

stopping extracting a preset first area from the image data of each frame, wherein the first area comprises a first direct-broadcasting picture;

starting to extract a preset second area from the image data of each frame, wherein the second area comprises a second live broadcast picture;

and playing the third live broadcast data after the second area is extracted in the live broadcast interface.

6.A live broadcast method, applied to a server, the live broadcast method comprising:

determining that a live broadcast event is set by a live broadcast terminal aiming at the live broadcast program, wherein the live broadcast event represents that when a live broadcast program is hosted by a live broadcast user, a first video acquisition device is adopted to acquire pictures of explanation objects of the live broadcast user, and a second video acquisition device is adopted to acquire pictures of a display rack;

Transmitting the live event to the audience terminal, wherein the audience terminal displays a first control on a picture of a live program so as to support switching the picture of the live program from a first live picture to a second live picture;

7. The live broadcast method of claim 6, wherein the live broadcast data includes first live broadcast data and second live broadcast data, and the pushing one or more paths of live broadcast data to the viewer terminal for playing includes:

and sending the first direct broadcast data and/or the second direct broadcast data to the audience terminal.

8. The live broadcast method of claim 6, wherein the live broadcast data includes first live broadcast data and second live broadcast data, and wherein pushing one or more paths of live broadcast data to the viewer terminal for playback includes:

Generating third live broadcast data, wherein the third live broadcast data comprises multi-frame image data, a first live broadcast picture of the first live broadcast data is positioned in a first area of the image data, and a second live broadcast picture of the second live broadcast data is positioned in a second area of the image data;

And sending the third live broadcast data to the audience terminal.

9. The live broadcast method of any of claims 6-8, further comprising:

detecting an article in a display picture when the picture of the live program in live broadcast data sent to the audience terminal is the display picture, so as to obtain a position identification of the article;

searching summary information matched with the position identifier in the pre-stored summary information;

And sending the abstract information of the article to the audience terminal.

10. The live broadcast method of claim 6, further comprising:

Responding to a historical live broadcast data request sent by the audience terminal, determining historical live broadcast data of the article, wherein the historical live broadcast data request is a request generated after the audience terminal receives a second control, and the second control is a control displayed for the article in the display picture when the picture of the live broadcast program is the display picture;

And sending the historical live broadcast data of the object to the audience terminal, wherein the historical live broadcast data display a historical picture for a host user to explain the object when being played, and the audience terminal is used for playing the historical live broadcast data so as to switch the picture of the live broadcast program to the historical picture.

11. The live broadcast method of claim 6, further comprising:

determining first direct broadcast data and second direct broadcast data from the received two paths of direct broadcast data, wherein the direct broadcast picture of the first direct broadcast data is a picture of the main broadcast user currently explaining the object, and the direct broadcast picture of the second direct broadcast data is the display picture;

Determining historical live broadcast data of the object from the first live broadcast data, and displaying a historical picture of the host user explaining the object when the historical live broadcast data is played;

Determining a position identifier of the object from the second live broadcast data, wherein the position identifier is an identifier of the position of the object in the display picture;

And storing the historical live broadcast data and the location identification in an associated mode.

12. The live broadcast method of claim 11, wherein the first live data comprises multi-frame image data, and wherein determining historical live broadcast data for the item from the first live data comprises:

Detecting the item at image data of the first direct broadcast data;

Determining first image data and second image data of the detected article, wherein the first image data is the image data of the first detected article, and the second image data is the image data of the last detected article;

And taking live broadcast data between the first image data and the second image data as historical live broadcast data of the article in the first live broadcast data.

13. The live method of claim 11, further comprising, after determining historical live data for the item from the first live data:

performing voice recognition on the historical live broadcast data to obtain abstract information of the article;

and storing the abstract information and the position identification in an associated mode.

14. A live broadcast method, applied to a hosting terminal, comprising:

Releasing a live program in a live broadcast room;

Setting a live event aiming at the live program, wherein the live event represents that when a live program is hosted by a host user, a first video acquisition device is adopted to acquire pictures of the host user for explaining objects, a second video acquisition device is adopted to acquire pictures of a display rack, a server sends the live event to a audience terminal when receiving the live event, and the audience terminal displays a first control on the pictures of the live program;

Publishing the two paths of live broadcast data to a server so as to support switching the picture of the live broadcast program from a first live broadcast picture to a second live broadcast picture;

15. A live broadcast apparatus for application to a viewer client, the live broadcast apparatus comprising:

The first control display module is used for displaying a first control on the live broadcast interface if a preset live broadcast event occurs in the live broadcast program, wherein the live broadcast event indicates that a host user hosts the live broadcast program, a first video acquisition device is adopted to acquire pictures of the host user explaining objects, and a second video acquisition device is adopted to acquire pictures of a display rack;

16. A live broadcast apparatus, for application to a server, the live broadcast apparatus comprising:

the live event determining module is used for determining that a live event is set by a host broadcasting terminal aiming at the live program, wherein the live event represents that when a host broadcasting user hosts the live program, a first video acquisition device is adopted to acquire pictures of explanation objects of the host broadcasting user, and a second video acquisition device is adopted to acquire pictures of a display rack;

The live event sending module is used for sending the live event to the audience terminal, and the audience terminal displays a first control on a picture of a live program so as to support switching the picture of the live program from a first live picture to a second live picture;

17. A live broadcast apparatus, for application to a hosting terminal, the live broadcast apparatus comprising:

The live event setting module is used for setting a live event aiming at the live program, wherein the live event represents that when a live program is hosted by a host user, a first video acquisition device is adopted to acquire pictures of the host user for explaining objects, a second video acquisition device is adopted to acquire pictures of a display rack, a server sends the live event to a spectator terminal when receiving the live event, and the spectator terminal displays a first control on the pictures of the live program;

Wherein, the first direct broadcast picture is a picture displayed when the first direct broadcast data is played, and the second direct broadcast picture is a picture displayed when the second direct broadcast data is played;

18. An electronic device, the electronic device comprising:

One or more processors;

Storage means for storing one or more programs,

The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the live method of any of claims 1-14.

19. A computer readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements a live method as claimed in any of claims 1-14.