CN114765692B

CN114765692B - Live broadcast data processing method, device, equipment and medium

Info

Publication number: CN114765692B
Application number: CN202110043747.5A
Authority: CN
Inventors: 谢少泽
Original assignee: Beijing ByteDance Network Technology Co Ltd
Current assignee: Beijing ByteDance Network Technology Co Ltd
Priority date: 2021-01-13
Filing date: 2021-01-13
Publication date: 2024-01-09
Anticipated expiration: 2041-01-13
Also published as: CN114765692A

Abstract

The embodiment of the disclosure relates to a live broadcast data processing method, a device, equipment and a medium, wherein the method is applied to a viewer terminal and comprises the following steps: displaying a first direct-broadcasting picture, wherein the first direct-broadcasting picture comprises a live broadcast content picture and a first direct-broadcasting background picture of display content from a main broadcasting terminal; and if the second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image, obtaining the second live broadcast image and displaying, wherein the second live broadcast background image is determined based on the target live broadcast type corresponding to the live broadcast content image. By adopting the technical scheme, the live background can be switched into the background image corresponding to the live content in the live broadcast process, and can be matched with the live content, so that the relevance is improved, the live broadcast atmosphere is more diversified, and the viewing experience of audiences is improved.

Description

Live broadcast data processing method, device, equipment and medium

Technical Field

The disclosure relates to the technical field of live broadcasting, and in particular relates to a live broadcasting data processing method, device, equipment and medium.

Background

With the rapid development of live technology, live broadcasting is received by more and more people due to the characteristics of real-time property and interactivity.

In the conventional implementation of live broadcast, the live broadcast background such as game live broadcast or explanation live broadcast is generally a uniformly arranged background related to a host broadcast, and the background is the same regardless of the game or content of the host broadcast, so that the relevance of the background and the live broadcast content is low, the live broadcast atmosphere is monotonous, and the viewing experience of audiences is influenced.

Disclosure of Invention

In order to solve the technical problems described above or at least partially solve the technical problems described above, the present disclosure provides a live broadcast data processing method, apparatus, device and medium.

The embodiment of the disclosure provides a live broadcast data processing method applied to a viewer terminal, comprising the following steps:

displaying a first direct-broadcasting picture, wherein the first direct-broadcasting picture comprises a direct-broadcasting content picture and a first direct-broadcasting background picture of display content from a main broadcasting terminal;

and if a second live broadcast background picture is received, switching the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture, obtaining a second live broadcast picture and displaying, wherein the second live broadcast background picture is determined based on a target live broadcast type corresponding to the live broadcast content picture.

The embodiment of the disclosure also provides a live broadcast data processing method, which is applied to the server, and comprises the following steps:

acquiring a live content graph of the display content from the anchor terminal;

determining a target live broadcast type corresponding to the live broadcast content map;

and determining a second live broadcast background picture based on the target live broadcast type, and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display a second live broadcast picture.

The embodiment of the disclosure also provides a live broadcast data processing device, which is configured at a viewer terminal and comprises:

the picture display module is used for displaying a first direct-broadcasting picture, wherein the first direct-broadcasting picture comprises a direct-broadcasting content picture of display content from a main broadcasting terminal and a first direct-broadcasting background picture;

and the background switching module is used for switching the first direct broadcast background picture in the first direct broadcast picture into the second direct broadcast background picture if the second direct broadcast background picture is received, obtaining and displaying a second direct broadcast picture, wherein the second direct broadcast background picture is determined based on a target direct broadcast type corresponding to the direct broadcast content picture.

The embodiment of the disclosure also provides a live broadcast data processing device, where the device is configured at a server, and includes:

the picture acquisition module is used for acquiring a live broadcast content picture of the display content from the anchor terminal;

the type determining module is used for determining a target live broadcast type corresponding to the live broadcast content map;

and the background sending module is used for determining a second live background image based on the target live broadcast type and sending the second live background image to the audience terminal so that the audience terminal can switch the first live background image in the first live image into the second live background image, and a second live image is obtained and displayed.

The embodiment of the disclosure also provides an electronic device, which comprises: a processor; a memory for storing the processor-executable instructions; the processor is configured to read the executable instructions from the memory and execute the instructions to implement a live data processing method as provided in an embodiment of the disclosure.

The present disclosure also provides a computer-readable storage medium storing a computer program for executing the live data processing method as provided by the embodiments of the present disclosure.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: according to the live broadcast data processing scheme provided by the embodiment of the disclosure, a first live broadcast picture is displayed by a viewer terminal, wherein the first live broadcast picture comprises a live broadcast content picture and a first live broadcast background picture of display content from a host broadcast terminal; and if the second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image, obtaining the second live broadcast image and displaying, wherein the second live broadcast background image is determined based on the target live broadcast type corresponding to the live broadcast content image. By adopting the technical scheme, the live background can be switched into the background image corresponding to the live content in the live broadcast process, and can be matched with the live content, so that the relevance is improved, the live broadcast atmosphere is more diversified, and the viewing experience of audiences is improved.

Drawings

The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.

Fig. 1 is a flow chart of a live broadcast data processing method according to an embodiment of the present disclosure;

fig. 2 is a schematic diagram of a live broadcast picture according to an embodiment of the present disclosure;

fig. 3 is a schematic diagram of another live view provided in an embodiment of the present disclosure;

fig. 4 is a flow chart of another live data processing method according to an embodiment of the disclosure;

fig. 5 is a schematic diagram of live data processing according to an embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of a live broadcast data processing apparatus according to an embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of another live broadcast data processing apparatus according to an embodiment of the present disclosure;

fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.

It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.

It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.

The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

Fig. 1 is a flow chart of a live data processing method according to an embodiment of the present disclosure, where the method may be performed by a live data processing apparatus, and the apparatus may be implemented by using software and/or hardware, and may generally be integrated in an electronic device. As shown in fig. 1, the method is applied to a viewer terminal, and includes:

and 101, displaying a first direct-broadcasting picture, wherein the first direct-broadcasting picture comprises a direct-broadcasting content picture and a first direct-broadcasting background picture of display content from a main broadcasting terminal.

The first direct broadcast picture is a direct broadcast picture of a main broadcast for being played at a viewer terminal, and the main broadcast is an initiator of a direct broadcast activity. The first direct broadcast picture may include a direct broadcast content image and a first direct broadcast background image, where the direct broadcast content image may be an image of a display content from a host broadcast terminal, and the embodiment of the present disclosure does not limit specific direct broadcast content, and may, for example, explain direct broadcast for a game, an event, or the like. The first direct-broadcasting background image refers to a default direct-broadcasting background image, which can be irrelevant to direct-broadcasting content, and can be specifically set according to practical situations, for example, the first direct-broadcasting background image can be related to a host, and the host head portrait is obtained by overlapping a cover layer with transparency after being subjected to Gaussian blur. The first direct broadcast background map may be generated by the viewer terminal or the server, and is not particularly limited.

In the embodiment of the disclosure, for a viewer entering a live broadcasting room of a main broadcasting, a viewer terminal can acquire a live broadcasting content image and a first direct broadcasting background forwarded by a server side, and synthesize the live broadcasting content image and a first direct broadcasting picture to obtain a first direct broadcasting picture, and display the first direct broadcasting picture in a live broadcasting page; the audience terminal can also acquire a live broadcast content graph sent by the server side, generate a default first direct broadcast background, synthesize to obtain a first direct broadcast picture, and display the first direct broadcast picture in a live broadcast page. And the audience terminal can also receive the audio content sent by the server and play the audio content corresponding to the first direct-broadcasting picture on the direct-broadcasting page, so that the user can hear the direct-broadcasting sound of the host broadcasting while watching the direct-broadcasting picture. The live page refers to a page of a live room for showing a host, and the page can be a webpage or a page in an application client.

Step 102, if a second live broadcast background map is received, switching the first live broadcast background map in the first live broadcast picture to the second live broadcast background map, obtaining and displaying the second live broadcast picture, wherein the second live broadcast background map is determined based on a target live broadcast type corresponding to the live broadcast content map.

The second live background map may be a background map related to the live content, and specifically may be determined based on a target live type corresponding to the live content map. The live broadcast type refers to classification of live broadcast according to content characteristics or general classification modes, and specifically may include types based on device division and/or types based on live broadcast content division, for example, for Game live broadcast, games may be classified into mobile games, host games, computer games, web games and the like according to Game devices, racing games, leisure games, role-playing games (RPG), multi-player online tactical Game games (Multiplayer Online Battle Arena, MOBA), first-Person shooter (FPS) games, sand box games, chess Game and the like, different types of games are different, each Game type may have specific core theme elements, and each Game type may correspond to a live broadcast type.

In an embodiment of the present disclosure, switching a first direct-broadcast background image in a first direct-broadcast picture to a second direct-broadcast background image to obtain a second direct-broadcast picture may include: and deleting the first direct broadcast background picture in the first direct broadcast picture, and synthesizing the direct broadcast content picture and the second direct broadcast background picture to obtain a second direct broadcast picture.

When the audience terminal receives the second live broadcast background image sent by the server, the audience terminal indicates that the live broadcast background image needs to be switched, the live broadcast content image in the first live broadcast image can be extracted, the first live broadcast background image is deleted, and the live broadcast content image and the second live broadcast background image are combined to obtain the second live broadcast image. And then, the audience terminal can display the second live broadcast picture, and the second live broadcast background picture is related to the live broadcast content picture, so that the audience terminal is more in line with the current live broadcast scene.

Fig. 2 is a schematic diagram of a live broadcast picture provided by an embodiment of the present disclosure, as shown in fig. 2, in which a schematic diagram of a first live broadcast picture is shown, the first live broadcast picture includes a live broadcast content picture 11 and a first live broadcast background picture 12, and a main cast head portrait, a main cast name and a focus key 13 of a current main cast are also shown in an upper left corner of the figure, where the main cast name is "small a". As shown in fig. 2, the first direct-broadcast background fig. 12 is obtained by overlapping a cover layer with transparency after the main cast head portrait is gaussian blurred, and is irrelevant to the direct broadcast content.

Fig. 3 is a schematic diagram of another live broadcast picture provided in an embodiment of the present disclosure, as shown in fig. 3, in which a schematic diagram of a second live broadcast picture is shown, where the second live broadcast picture includes a live broadcast content fig. 11 and a second live broadcast background fig. 14. As shown in fig. 3, the second live background view 14 is a background view including flame elements, and the second live background view in fig. 3 is more compatible with the gun in the live content view 11 than the first live background view 12 in fig. 2.

The live content fig. 11 in fig. 2 and fig. 3 are the same, but the second live background fig. 14 in fig. 3 is more in line with the style of the live content than the first live background fig. 12 in fig. 2, so as to improve the experience effect of watching live by the user. It will be appreciated that fig. 2 and 3 are merely examples, and are not intended to limit the live view.

According to the live broadcast data processing scheme provided by the embodiment of the disclosure, a first live broadcast picture is displayed by a viewer terminal, wherein the first live broadcast picture comprises a live broadcast content picture and a first live broadcast background picture of display content from a host broadcast terminal; and if the second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image, obtaining the second live broadcast image and displaying, wherein the second live broadcast background image is determined based on the target live broadcast type corresponding to the live broadcast content image. By adopting the technical scheme, the live background can be switched into the background image corresponding to the live content in the live broadcast process, and can be matched with the live content, so that the relevance is improved, the live broadcast atmosphere is more diversified, and the viewing experience of audiences is improved.

In some embodiments, when the first live background view is determined for an initial live type determined based on the anchor terminal or the historical moment, the second live background view is transmitted when the target live type determined based on the live content view is different from the initial live type.

The initial live broadcast type refers to a live broadcast type selected by a host at a host terminal during the starting or a live broadcast type determined based on a live broadcast content graph at a historical moment. The first direct broadcast background picture is a background picture corresponding to the initial direct broadcast type. The target live type refers to a live type determined in real time based on a live content map. The initial live type may be the same as or different from the target live type.

After the server receives the type information of the initial live broadcast type sent by the anchor terminal, a first direct broadcast background picture corresponding to the initial live broadcast type can be determined, and the live broadcast content picture and the first direct broadcast background picture are sent to the audience terminal; and the audience terminal synthesizes the live broadcast content image and the first direct broadcast background image to obtain a first direct broadcast picture which is displayed to the user. When the target live broadcast type determined by the server based on the live broadcast content map is different from the initial live broadcast type, a second live broadcast background map corresponding to the target live broadcast type can be determined, the second live broadcast background map is sent to the audience terminal, and the audience terminal switches the first live broadcast background map in the first live broadcast picture to the second live broadcast background map, so that a second live broadcast picture is obtained and displayed. And when the target live broadcast type determined by the server based on the live broadcast content map is the same as the initial live broadcast type, reserving the current first live broadcast background map.

In the above scheme, after the live broadcast type has been selected by the anchor terminal, the audience terminal can directly display the live broadcast background diagram corresponding to the live broadcast type determined by the anchor, if the live broadcast type determined by the server is inconsistent with the live broadcast type determined by the anchor terminal, the anchor is indicated to be possibly wrong in selection, the initial live broadcast background diagram needs to be switched, the corrected live broadcast background diagram can be issued for switching, matching of the live broadcast background and the live broadcast content is ensured, and the overall atmosphere of live broadcast is improved.

Optionally, as the main broadcast may switch the live broadcast content as the live broadcast proceeds, the first direct broadcast background map may be determined based on the initial live broadcast type corresponding to the live broadcast content map at the historical moment, and the second direct broadcast background map is sent when the target live broadcast type corresponding to the live broadcast content map at the current moment is different from the initial live broadcast type corresponding to the live broadcast content map at the historical moment. That is, the server may extract the live content map according to the set time interval, determine the live type corresponding to the live content map, and if the live type is different from the live type at the historical moment, generate a second live background map, send the second live background map to the audience terminal, and the audience terminal switches the first live background map to the latest second live background map. According to the scheme, along with the switching of the live broadcast content, the live broadcast background can be timely switched to be matched with the live broadcast content, so that the flexibility and diversity of the live broadcast background are improved.

In some embodiments, the live data processing method provided by the embodiments of the present disclosure may further include: and displaying a second live broadcast picture in the live broadcast preview interface. The live preview interface is an interface for displaying live preview streams, through which a user can see a preview window of a live room. Specifically, when the live broadcast page is switched from the first live broadcast picture to the second live broadcast picture, the second live broadcast picture can be switched in the live broadcast preview interface in response to ensure that the live broadcast pictures are consistent when a user enters the live broadcast page from the live broadcast preview interface, so that the experience effect of the user is improved.

Fig. 4 is a flow chart of another live broadcast data processing method according to an embodiment of the present disclosure, where the live broadcast data processing method is further optimized based on the foregoing embodiment. As shown in fig. 4, the method is applied to a server, and includes:

step 201, acquiring a live content graph of the display content from the anchor terminal.

The live content map may be an image pulled by the server from the anchor terminal for live broadcasting, and the live content map may be generated based on content shown by the anchor terminal, for example, when a game anchor plays a game live broadcast at the anchor terminal, the live content map may be generated based on a game picture shown by the anchor terminal or a game picture plus an image of the game anchor collected by the anchor terminal. The embodiments of the present disclosure are not limited to specific live content, and may be, for example, live for games or events, etc.

In an embodiment of the present disclosure, acquiring a live content graph of a presentation content from a hosting terminal may include: and extracting the live content graph in the live broadcast process according to the set time interval. The set time interval may be set according to practical situations, for example, the set time interval may be 30 seconds. The server side can extract the live content graph according to the set time interval in the live broadcast process, namely, in the process that the audience terminal displays the first live broadcast picture.

Step 202, determining a target live broadcast type corresponding to the live broadcast content map.

The live broadcast type refers to classification of live broadcast in combination with content characteristics or general classification modes, and specifically may include a type based on device division and/or a type based on live broadcast content division.

In an embodiment of the present disclosure, determining a target live type corresponding to a live content map may include: inputting the live broadcast content graph into a picture identification model, and extracting to obtain picture characteristics; and matching the picture characteristics with preset characteristics, and determining a target live broadcast type corresponding to the live broadcast content map based on the matching degree and/or the confidence degree. The picture recognition model refers to a deep learning model which is obtained through training in advance and used for recognizing core features of pictures. The preset features are pre-extracted picture features of different live broadcast types, and for example, for the live broadcast types of the game live broadcast, frames can be extracted from game pictures of each main stream game, core elements of the pictures are extracted by using a computer vision technology to form picture features, and each game can obtain corresponding preset features.

Specifically, the live content map is input into a picture identification model, picture features are extracted, the picture features are matched with a plurality of preset features one by one, and a live broadcast type corresponding to the preset feature with the highest matching degree and the confidence degree larger than a preset threshold value is determined as a target live broadcast type. The preset threshold may be set according to practical situations, for example, the preset threshold may be 95%.

Step 203, determining a second live background map based on the target live broadcast type, and sending the second live background map to the audience terminal, so that the audience terminal switches the first live background map in the first live frame to the second live background map, and obtains and displays the second live frame.

In an embodiment of the present disclosure, determining the second live background map based on the target live type may include: determining a background bottom plate diagram corresponding to the target live broadcast type; and inputting the live content image serving as a style image and a background floor image into an image style migration model to obtain a second live background image. The background floor map refers to a floor map preset for each live broadcast type, the floor map can be set according to actual situations, for example, the background floor map of the live broadcast of a game can be a black filled map. The picture style migration model refers to a deep learning model for migrating the style of one graph to another graph to obtain the same style graph.

Specifically, after the target live broadcast type corresponding to the live broadcast content map is determined, a background floor map corresponding to the target live broadcast type can be determined through searching, then the live broadcast content map is used as a style picture and the background floor map to be input into a picture style migration model, and the style of the live broadcast content map can be migrated into the background floor map to obtain a second live broadcast background map which is identical to the style of the live broadcast content map.

In an embodiment of the present disclosure, determining the second live background map based on the target live type may include: and determining a preset background image corresponding to the target live broadcast type as a second live broadcast background image. The preset background map may be background maps, which are set by an operator based on actual requirements, of different live broadcast types and conform to the style of the live broadcast types. After the server determines the target live broadcast type, the preset background map corresponding to the target live broadcast type can be determined through searching, and the preset background map corresponding to the target live broadcast type is determined to be the second live broadcast background map.

In the scheme, the server side can determine the second live background image corresponding to the live type of the live content image in two ways, so that the method and the device are more in line with actual application scenes, and the determination efficiency of the live background image is improved.

After the service end determines the second live background image based on the target live type, the second live background image can be sent to the audience terminal, so that the audience terminal switches the first live background image in the first live image to the second live background image, and the second live image is obtained and displayed.

In some embodiments, before acquiring the live content map of the presentation content from the anchor terminal, the method may further include: determining a corresponding initial live broadcast type based on type information sent by a main broadcasting terminal; and determining a preset background image corresponding to the initial live broadcast type as a first direct broadcast background image.

After the server receives the type information sent by the anchor terminal, the initial live broadcast type corresponding to the type information can be determined, and a preset background image corresponding to the initial live broadcast type is determined as a first direct broadcast background image. And then the live content image and the first direct-broadcasting background image can be sent to the audience terminal, and the audience terminal synthesizes the live content image and the first direct-broadcasting background image to obtain a first direct-broadcasting image for display to the user.

In some embodiments, determining a second live background map based on the target live type and transmitting the second live background map to the viewer terminal may include: if the initial live broadcast type determined by the main broadcasting terminal is different from the target live broadcast type, or the initial live broadcast type determined by the history time is different from the target live broadcast type, a second live broadcast background picture is determined based on the target live broadcast type, and the second live broadcast background picture is sent to the audience terminal.

When the target live broadcast type determined by the server based on the live broadcast content map is different from the initial live broadcast type, a second live broadcast background map corresponding to the target live broadcast type can be determined, the second live broadcast background map is sent to the audience terminal, and the audience terminal switches the first live broadcast background map in the first live broadcast picture to the second live broadcast background map, so that a second live broadcast picture is obtained and displayed. And when the target live broadcast type determined by the server based on the live broadcast content map is the same as the initial live broadcast type, reserving the current first live broadcast background map.

Optionally, the initial live broadcast type may also be a live broadcast type determined based on a live broadcast content graph at a historical time. As the live broadcast is performed, the host broadcast may switch the live broadcast content, the first live broadcast background map may be determined for the initial live broadcast type corresponding to the live broadcast content map based on the historical moment, and the second live broadcast background map is sent when the target live broadcast type corresponding to the live broadcast content map based on the current moment is different from the initial live broadcast type corresponding to the live broadcast content map at the historical moment. That is, the server may extract the live content map according to the set time interval, determine the live type corresponding to the live content map, and if the live type is different from the live type at the historical moment, generate a second live background map, send the second live background map to the audience terminal, and the audience terminal switches the first live background map to the latest second live background map. According to the scheme, along with the switching of the live broadcast content, the live broadcast background can be timely switched to be matched with the live broadcast content, so that the flexibility and diversity of the live broadcast background are improved.

According to the live broadcast data processing scheme provided by the embodiment of the disclosure, a server acquires a live broadcast content graph of display content from a main broadcast terminal; determining a target live broadcast type corresponding to the live broadcast content map; and determining a second live broadcast background picture based on the target live broadcast type, and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display a second live broadcast picture. By adopting the technical scheme, the live background can be switched into the background image corresponding to the live content in the live broadcast process, and can be matched with the live content, so that the relevance is improved, the live broadcast atmosphere is more diversified, and the viewing experience of audiences is improved.

The live data processing method in the embodiment of the present disclosure is further described below by way of a specific example. Fig. 5 is a schematic diagram of live data processing provided in an embodiment of the present disclosure, taking live game as an example, a specific process may include: and starting the game live broadcast. Video frames are extracted. And acquiring the live content graph according to the set time interval. Matching with the game identification model, and determining the classification of the corresponding game live broadcast. Judging whether the classification is successfully identified, if so, judging whether the classification has an artificial background image; otherwise, a default background map is issued. Judging whether the classification has an artificial background image or not, if so, issuing the artificial background image; otherwise, the background diagram is intelligently generated and issued. The new background map may then be presented in the client (i.e., the viewer terminal) and the process of continuing to perform video frame extraction may be returned until the live broadcast is completed.

The background map may be divided into 3 types, specifically including a default background map, an operation background map, and an intelligent generation background map. The default background map may be used in cases where the game classification is not recognized. The operation background image, namely the artificial background image, is a game classification background image manually set by operators, and meets certain activity requirements. The intelligent background map can automatically generate the background map based on a background map base plate by using the extracted game picture core elements and using a picture style migration technology.

When the host starts to play the live game, a frame can be drawn every 30s, the live game is matched with alternative game identification features one by one, the result with the highest matching degree and the confidence degree higher than 95% is a specific live game type. If the classification of the live game cannot be identified, a default background map can be issued; if the classification of the live game is identified and the classification is determined to have a preset artificial background image, the artificial background image can be issued; if the classification of the live game is identified, but it is determined that the classification does not have an artificial background image, an intelligent background image corresponding to the style of the live game content can be intelligently generated by using a picture style migration technology, and the intelligent background image is issued.

Besides, the background pictures after switching can be displayed in the live broadcast preview stream (Feed stream) besides the live broadcast room, so that the consistency of the experience before and after entering and exiting the live broadcast room is ensured, and the experience of audiences is improved.

Optionally, when the live broadcast room issues, the host will select a game class at the host terminal, and the background map of the game class will be automatically carried. When the classification and identification result of the server is out, if the game classification is inconsistent with the anchor selection, automatically correcting the classification and issuing a new background image; when the client receives the new background image, the old background image is replaced, so that the matching of the live broadcasting room background and the live broadcasting content is ensured, the whole atmosphere of the live broadcasting room is improved, and the watching experience is improved. And continuously identifying the game type in the live broadcast process, and automatically generating a new background image when the game type is changed, so that the flexibility of background switching is further improved.

Fig. 6 is a schematic structural diagram of a live data processing apparatus according to an embodiment of the present disclosure, where the apparatus may be implemented by software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 6, the apparatus is arranged in a viewer terminal, and includes:

the picture display module 301 is configured to display a first direct-broadcasting picture, where the first direct-broadcasting picture includes a live content picture of display content from a main broadcasting terminal and a first direct-broadcasting background picture;

And the background switching module 302 is configured to switch the first direct-broadcast background map in the first direct-broadcast picture to the second direct-broadcast background map if a second direct-broadcast background map is received, obtain a second direct-broadcast picture, and display the second direct-broadcast background map, where the second direct-broadcast background map is determined based on a target direct-broadcast type corresponding to the direct-broadcast content map.

Optionally, the context switch module 302 is specifically configured to:

and deleting the first direct broadcast background image in the first direct broadcast picture, and synthesizing the direct broadcast content image and the second direct broadcast background image to obtain the second direct broadcast picture.

Optionally, when the first direct broadcast background map is determined based on the initial live broadcast type determined by the anchor terminal or the history time, the second direct broadcast background map is sent when the target live broadcast type determined based on the live broadcast content map is different from the initial live broadcast type.

Optionally, the device further includes a preview module, configured to:

and displaying the second live broadcast picture in a live broadcast preview interface.

The live broadcast data processing device provided by the embodiment of the disclosure can execute the live broadcast data processing method provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

Fig. 7 is a schematic structural diagram of another live data processing apparatus according to an embodiment of the disclosure, where the apparatus may be implemented by software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 7, the device is configured at a server, and includes:

a picture acquisition module 401, configured to acquire a live content map of the display content from the anchor terminal;

a type determining module 402, configured to determine a target live type corresponding to the live content map;

the background sending module 403 is configured to determine a second live background map based on the target live broadcast type, and send the second live background map to an audience terminal, so that the audience terminal switches a first live background map in a first live frame to the second live background map, and obtains and displays a second live frame.

Optionally, the screen obtaining module 401 is specifically configured to:

and extracting the live content graph in the live broadcast process according to the set time interval.

Optionally, the type determining module 402 is specifically configured to:

inputting the live broadcast content graph into a picture identification model, and extracting to obtain picture characteristics;

and matching the picture characteristics with preset characteristics, and determining a target live broadcast type corresponding to the live broadcast content map based on the matching degree and/or the confidence degree.

Optionally, the background sending module 404 is specifically configured to:

determining a background bottom plate diagram corresponding to the target live broadcast type;

and taking the live content image as a style picture and inputting the style migration model of the picture with the background floor image to obtain the second live background image.

Optionally, the background sending module 404 is specifically configured to:

and determining a preset background image corresponding to the target live broadcast type as the second live broadcast background image.

Optionally, the target live type includes a type based on device division and/or a type based on live content division.

Optionally, the apparatus further includes an initial type module configured to: before acquiring a live content map of the presentation content from the anchor terminal,

determining a corresponding initial live broadcast type based on the type information sent by the anchor terminal;

and determining a preset background image corresponding to the initial live broadcast type as the first direct broadcast background image.

Optionally, the background sending module 403 is specifically configured to:

and if the initial live broadcast type determined by the anchor terminal is different from the target live broadcast type, or the initial live broadcast type determined by the history time is different from the target live broadcast type, determining a second live broadcast background picture based on the target live broadcast type, and transmitting the second live broadcast background picture to the audience terminal.

Fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. Referring now in particular to fig. 8, a schematic diagram of an electronic device 500 suitable for use in implementing embodiments of the present disclosure is shown. The electronic device 500 in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 8 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.

As shown in fig. 8, the electronic device 500 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 501, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data required for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM 502, and the RAM503 are connected to each other via a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.

In general, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 507 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 508 including, for example, magnetic tape, hard disk, etc.; and communication means 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 8 shows an electronic device 500 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or from the storage means 508, or from the ROM 502. When executed by the processing device 501, the computer program performs the above-described functions defined in the live data processing method of the embodiment of the present disclosure.

It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: displaying a first direct-broadcasting picture, wherein the first direct-broadcasting picture comprises a direct-broadcasting content picture and a first direct-broadcasting background picture of display content from a main broadcasting terminal; and if a second live broadcast background picture is received, switching the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture, obtaining a second live broadcast picture and displaying, wherein the second live broadcast background picture is determined based on a target live broadcast type corresponding to the live broadcast content picture.

Alternatively, the computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: acquiring a live content graph of the display content from the anchor terminal; determining a target live broadcast type corresponding to the live broadcast content map; and determining a second live broadcast background picture based on the target live broadcast type, and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display a second live broadcast picture.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, there is provided a live data processing method applied to a viewer terminal, including:

According to one or more embodiments of the present disclosure, in the live broadcast data processing method provided by the present disclosure, the switching the first direct broadcast background map in the first direct broadcast picture to the second direct broadcast background map to obtain a second direct broadcast picture includes:

According to one or more embodiments of the present disclosure, in the live broadcast data processing method provided by the present disclosure, when the first live background map is determined based on the initial live broadcast type determined by the anchor terminal or the history time, the second live background map is sent when the target live broadcast type determined based on the live broadcast content map is different from the initial live broadcast type.

According to one or more embodiments of the present disclosure, in the live broadcast data processing method provided by the present disclosure, further includes:

According to one or more embodiments of the present disclosure, the present disclosure provides a live broadcast data processing method, applied to a server, including:

acquiring a live content graph of the display content from the anchor terminal;

According to one or more embodiments of the present disclosure, in the live broadcast data processing method provided by the present disclosure, the obtaining a live broadcast content graph of a presentation content from a hosting terminal includes:

According to one or more embodiments of the present disclosure, in the live broadcast data processing method provided by the present disclosure, determining a target live broadcast type corresponding to the live broadcast content map includes:

According to one or more embodiments of the present disclosure, in the live data processing method provided by the present disclosure, determining a second live background map based on the target live type includes:

According to one or more embodiments of the present disclosure, in the live data processing method provided by the present disclosure, the target live type includes a type based on device division and/or a type based on live content division.

According to one or more embodiments of the present disclosure, before acquiring the live content map of the display content from the anchor terminal, the live data processing method further includes:

According to one or more embodiments of the present disclosure, in the live broadcast data processing method provided by the present disclosure, determining a second live broadcast background map based on the target live broadcast type, and transmitting the second live broadcast background map to a viewer terminal, including:

According to one or more embodiments of the present disclosure, the present disclosure provides a live data processing apparatus, including:

According to one or more embodiments of the present disclosure, in the live broadcast data processing apparatus provided by the present disclosure, the background switching module is specifically configured to:

According to one or more embodiments of the present disclosure, in the live broadcast data processing apparatus provided by the present disclosure, when the first live background map is determined based on the initial live broadcast type determined by the anchor terminal or the history time, the second live background map is sent when the target live broadcast type determined based on the live broadcast content map is different from the initial live broadcast type.

According to one or more embodiments of the present disclosure, in the live broadcast data processing apparatus provided by the present disclosure, the apparatus further includes a preview module, configured to:

According to one or more embodiments of the present disclosure, in the live broadcast data processing apparatus provided by the present disclosure, the picture obtaining module is specifically configured to:

According to one or more embodiments of the present disclosure, in the live broadcast data processing apparatus provided by the present disclosure, the type determining module is specifically configured to:

According to one or more embodiments of the present disclosure, in the live broadcast data processing apparatus provided by the present disclosure, the background sending module is specifically configured to:

According to one or more embodiments of the present disclosure, in the live data processing apparatus provided by the present disclosure, the target live type includes a type based on device division and/or a type based on live content division.

In accordance with one or more embodiments of the present disclosure, in a live data processing apparatus provided by the present disclosure, the apparatus further includes an initial type module configured to: before acquiring a live content map of the presentation content from the anchor terminal,

According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device comprising:

a processor;

a memory for storing the processor-executable instructions;

the processor is configured to read the executable instructions from the memory and execute the instructions to implement any of the live data processing methods provided in the present disclosure.

According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium storing a computer program for performing any one of the live data processing methods as provided by the present disclosure.

The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).

Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims

1. A live data processing method, applied to a viewer terminal, comprising:

if a second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image, obtaining a second live broadcast image and displaying, wherein the second live broadcast background image is determined based on a target live broadcast type corresponding to the live broadcast content image;

the determining of the second live background map includes: determining a background bottom plate diagram corresponding to the target live broadcast type; and migrating the style of the live content graph to a background floor graph to obtain the second live background graph.

2. The method of claim 1, wherein switching the first direct-broadcast background map in the first direct-broadcast picture to the second direct-broadcast background map, to obtain a second direct-broadcast picture, comprises:

3. The method of claim 1, wherein when the first live background map is determined for an initial live type determined based on the anchor terminal or historical moment, the second live background map is transmitted when a target live type determined based on the live content map is different from the initial live type.

4. The method as recited in claim 1, further comprising:

5. The live broadcast data processing method is characterized by being applied to a server and comprising the following steps:

acquiring a live content graph of the display content from the anchor terminal;

determining a second live broadcast background image based on the target live broadcast type, and sending the second live broadcast background image to a spectator terminal so that the spectator terminal switches a first live broadcast background image in a first live broadcast image into the second live broadcast background image to obtain a second live broadcast image and display the second live broadcast image;

6. The method of claim 5, wherein the obtaining a live content map of the presentation content from the anchor terminal comprises:

7. The method of claim 5, wherein determining the target live type for which the live content map corresponds comprises:

8. The method of claim 5, wherein determining a second live background map based on the target live type comprises:

9. The method of claim 5, wherein determining a second live background map based on the target live type comprises:

10. The method of claim 5, wherein the target live type comprises a type based on device partitioning and/or a type based on live content partitioning.

11. The method of claim 5, further comprising, prior to obtaining the live content map of the presentation content from the anchor terminal:

12. The method of claim 5 or 11, wherein determining a second live background map based on the target live type and transmitting the second live background map to an audience terminal comprises:

13. A live data processing apparatus, configured in a viewer terminal, comprising:

the background switching module is used for switching the first direct broadcast background picture in the first direct broadcast picture into the second direct broadcast background picture if a second direct broadcast background picture is received, obtaining and displaying a second direct broadcast picture, wherein the second direct broadcast background picture is determined based on a target direct broadcast type corresponding to the direct broadcast content picture;

14. A live broadcast data processing device, configured at a server, comprising:

the background sending module is used for determining a second live background image based on the target live broadcast type and sending the second live background image to the audience terminal so that the audience terminal can switch a first live background image in a first live image into the second live background image to obtain a second live image and display the second live image;

15. An electronic device, the electronic device comprising:

a processor;

a memory for storing the processor-executable instructions;

the processor being configured to read the executable instructions from the memory and execute the instructions to implement the live data processing method of any of the preceding claims 1-12.

16. A computer readable storage medium, characterized in that the storage medium stores a computer program for executing the live data processing method of any of the preceding claims 1-12.