CN114765692A - Live broadcast data processing method, device, equipment and medium - Google Patents

Live broadcast data processing method, device, equipment and medium Download PDF

Info

Publication number
CN114765692A
CN114765692A CN202110043747.5A CN202110043747A CN114765692A CN 114765692 A CN114765692 A CN 114765692A CN 202110043747 A CN202110043747 A CN 202110043747A CN 114765692 A CN114765692 A CN 114765692A
Authority
CN
China
Prior art keywords
live
live broadcast
picture
background
broadcast
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110043747.5A
Other languages
Chinese (zh)
Other versions
CN114765692B (en
Inventor
谢少泽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN202110043747.5A priority Critical patent/CN114765692B/en
Publication of CN114765692A publication Critical patent/CN114765692A/en
Application granted granted Critical
Publication of CN114765692B publication Critical patent/CN114765692B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Abstract

The embodiment of the disclosure relates to a live data processing method, a device, equipment and a medium, wherein the method is applied to audience terminals and comprises the following steps: displaying a first live-broadcasting picture, wherein the first live-broadcasting picture comprises a live-broadcasting content image and a first live-broadcasting background image of display content from a main broadcasting terminal; and if the second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image to obtain and display the second live broadcast image, wherein the second live broadcast background image is determined based on the target live broadcast type corresponding to the live broadcast content image. By adopting the technical scheme, the live background can be switched into the background image corresponding to the live content in the live broadcasting process, the live background can be matched with the live content, the relevance is improved, the live atmosphere is diversified, and the watching experience of audiences is improved.

Description

Live broadcast data processing method, device, equipment and medium
Technical Field
The present disclosure relates to the field of live broadcast technologies, and in particular, to a live broadcast data processing method, apparatus, device, and medium.
Background
With the rapid development of live broadcast technology, the entertainment form of live broadcast is received by more and more people due to the characteristics of real-time property and interactivity.
In the conventional realization of live broadcasting, the background of live broadcasting such as live broadcasting of games or live broadcasting of explanation is usually the uniformly set background related to the anchor, and no matter what game or content the anchor live broadcasts, the background is the same background, and the relevance between the background and the live broadcast content is low, so that the live broadcast atmosphere is monotonous, and the watching experience of audiences is influenced.
Disclosure of Invention
In order to solve the technical problems or at least partially solve the technical problems, the present disclosure provides a live data processing method, apparatus, device and medium.
The embodiment of the disclosure provides a live data processing method, which is applied to audience terminals, and the method comprises the following steps:
displaying a first live-broadcasting picture, wherein the first live-broadcasting picture comprises a live-broadcasting content picture and a first live-broadcasting background picture of display content from a main broadcasting terminal;
and if a second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image to obtain and display a second live broadcast image, wherein the second live broadcast background image is determined based on a target live broadcast type corresponding to the live broadcast content image.
The embodiment of the present disclosure further provides a live data processing method, which is applied to a server, and the method includes:
acquiring a live broadcast content graph of display content from a main broadcast terminal;
determining a target live type corresponding to the live content graph;
and determining a second live broadcast background picture based on the target live broadcast type, and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display the second live broadcast picture.
The embodiment of the present disclosure further provides a live data processing apparatus, where the apparatus is configured in a viewer terminal, and the apparatus includes:
the picture display module is used for displaying a first live-broadcast picture, wherein the first live-broadcast picture comprises a live-broadcast content picture and a first live-broadcast background picture of display content from a main broadcast terminal;
and the background switching module is used for switching the first live background image in the first live image into a second live background image to obtain and display a second live image if the second live background image is received, wherein the second live background image is determined based on a target live type corresponding to the live content image.
The embodiment of the present disclosure further provides a live data processing apparatus, where the apparatus is configured at a server, and includes:
the picture acquisition module is used for acquiring a live content picture of the display content from the anchor terminal;
the type determining module is used for determining a target live type corresponding to the live content graph;
and the background sending module is used for determining a second live broadcast background picture based on the target live broadcast type and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display the second live broadcast picture.
An embodiment of the present disclosure further provides an electronic device, which includes: a processor; a memory for storing the processor-executable instructions; the processor is used for reading the executable instructions from the memory and executing the instructions to realize the live broadcast data processing method provided by the embodiment of the disclosure.
The embodiment of the present disclosure further provides a computer-readable storage medium, where the storage medium stores a computer program, and the computer program is used to execute the live data processing method provided by the embodiment of the present disclosure.
Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: according to the live broadcast data processing scheme provided by the embodiment of the disclosure, a spectator terminal displays a first live broadcast picture, wherein the first live broadcast picture comprises a live broadcast content image and a first live broadcast background image of display content from a main broadcast terminal; and if the second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image to obtain and display the second live broadcast image, wherein the second live broadcast background image is determined based on the target live broadcast type corresponding to the live broadcast content image. By adopting the technical scheme, the live background can be switched into the background image corresponding to the live content in the live broadcasting process, the live background can be matched with the live content, the relevance is improved, the live atmosphere is diversified, and the watching experience of audiences is improved.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and components are not necessarily drawn to scale.
Fig. 1 is a schematic flow chart of a live data processing method according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a live view provided in an embodiment of the present disclosure;
fig. 3 is a schematic diagram of another live view provided by the embodiment of the present disclosure;
fig. 4 is a schematic flow chart of another live data processing method according to an embodiment of the present disclosure;
fig. 5 is a schematic diagram of a live data processing provided in an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of a live data processing apparatus according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of another live data processing apparatus according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a" or "an" in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will appreciate that references to "one or more" are intended to be exemplary and not limiting unless the context clearly indicates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
Fig. 1 is a flowchart illustrating a live data processing method according to an embodiment of the present disclosure, where the method may be executed by a live data processing apparatus, where the apparatus may be implemented by software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 1, the method is applied to a viewer terminal, and includes:
step 101, displaying a first live-broadcasting picture, wherein the first live-broadcasting picture comprises a live-broadcasting content picture and a first live-broadcasting background picture of display content from a main broadcasting terminal.
The first live broadcast picture is a live broadcast picture of a main broadcast played at a viewer terminal, and the main broadcast is an initiator of a live broadcast activity. The first live broadcast picture may include a live broadcast content map and a first live broadcast background map, where the live broadcast content map may be an image of display content from the anchor terminal. The first live broadcast background image is a default live broadcast background image, the first live broadcast background image may be unrelated to live broadcast content, and may be specifically set according to an actual situation, for example, the first live broadcast background image may be related to a anchor, and the anchor is obtained by superimposing a transparent cover layer on the anchor after gaussian blurring. The first live background image may be generated by the viewer terminal or the server, which is not limited in particular.
In the embodiment of the disclosure, for audiences who enter a live broadcasting room of a main broadcast, an audience terminal can obtain a live broadcasting content image and a first live broadcasting background forwarded by a server, synthesize the live broadcasting content image and the first live broadcasting image to obtain a first live broadcasting image, and display the first live broadcasting image in a live broadcasting page; the audience terminal can also obtain a live broadcast content image sent by the server side, generate a default first live broadcast background, synthesize to obtain a first live broadcast picture, and display the first live broadcast picture in a live broadcast page. And the audience terminal can also receive the audio content sent by the server side and play the audio content corresponding to the first live broadcast picture on the live broadcast page, so that the user can hear the live broadcast sound of the main broadcast while watching the live broadcast picture. The live broadcast page refers to a page of a live broadcast room for displaying the anchor, and the page may be a web page or a page in an application client.
And 102, if a second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image to obtain and display a second live broadcast image, wherein the second live broadcast background image is determined based on a target live broadcast type corresponding to the live broadcast content image.
The second live broadcast background map may be a background map related to the live broadcast content, and may be specifically determined based on a target live broadcast type corresponding to the live broadcast content map. The live broadcast type refers to a category of live broadcast performed by combining content characteristics or a general classification manner, and may specifically include a type divided based on equipment and/or a type divided based on live broadcast content, for example, for live Game, a Game may be divided into a mobile phone Game, a mainframe Game, a computer Game, a web Game, and the like according to Game equipment, and may be divided into a racing Game, a leisure Game, a Role Playing Game (RPG), a Multiplayer Online Battle sports Game (MOBA), a First-Person Shooting Game (FPS), a sandbox Game, a board Game, and the like according to Game content, where different Game types have different styles and specific core theme elements, and each Game type may correspond to one live broadcast type.
In this embodiment of the disclosure, switching the first live background image in the first live frame to the second live background image to obtain the second live frame may include: and deleting the first live broadcast background image in the first live broadcast picture, and synthesizing the live broadcast content image and the second live broadcast background image to obtain a second live broadcast picture.
When the audience terminal receives the second live background image sent by the server, the switching of the live background images is required, the live content image in the first live image can be extracted, the first live background image is deleted, and the live content image and the second live background image are synthesized to obtain the second live image. And then, the audience terminal can display the second live broadcast picture, and the second live broadcast background picture is related to the live broadcast content picture, so that the second live broadcast background picture is more consistent with the current live broadcast scene.
Exemplarily, fig. 2 is a schematic diagram of a live broadcast picture provided by an embodiment of the present disclosure, and as shown in fig. 2, the schematic diagram shows a first live broadcast picture, where the first live broadcast picture includes a live broadcast content fig. 11 and a first live broadcast background fig. 12, and the top left corner in the figure also shows a main broadcast avatar, a main broadcast name, and a focus button 13 of a current main broadcast, and the main broadcast name is "small a". As shown in fig. 2, the first live broadcast background fig. 12 is obtained by superimposing a gaussian blur of a main broadcast avatar on a transparent cover layer, and is independent of live broadcast content.
Fig. 3 is a schematic view of another live view provided in the embodiment of the present disclosure, and as shown in fig. 3, a schematic view of a second live view is shown, where the second live view includes a live content fig. 11 and a second live background fig. 14. As shown in fig. 3, the second live background map 14 is a background map including flame elements, and the second live background map in fig. 3 is more suitable for the gun battle in fig. 11 of the live content than the first live background map 12 in fig. 2.
The live content fig. 11 in fig. 2 and fig. 3 are the same, but the second live background image 14 in fig. 3 better conforms to the style of the live content than the first live background image 12 in fig. 2, so that the experience effect of the user in watching live content is improved. It should be understood that fig. 2 and 3 are only examples and are not intended to limit the live broadcast picture.
According to the live broadcast data processing scheme provided by the embodiment of the disclosure, a spectator terminal displays a first live broadcast picture, wherein the first live broadcast picture comprises a live broadcast content image and a first live broadcast background image of display content from a main broadcast terminal; and if the second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image to obtain and display the second live broadcast image, wherein the second live broadcast background image is determined based on the target live broadcast type corresponding to the live broadcast content image. By adopting the technical scheme, the live background can be switched into the background image corresponding to the live content in the live broadcasting process, the live background can be matched with the live content, the relevance is improved, the live atmosphere is diversified, and the watching experience of audiences is improved.
In some embodiments, when the first live background map is determined for an initial live type determined based on the anchor terminal or historical time, the second live background map is sent when a target live type determined based on the live content map is different from the initial live type.
The initial live type refers to a live type selected by a main broadcast terminal when the main broadcast is started or a live type determined based on a live content graph at a historical moment. The first live broadcast background image is a background image corresponding to the initial live broadcast type. The target live type refers to a live type determined in real time based on a live content graph. The initial live type and the target live type may be the same or different.
After receiving the type information of the initial live broadcast type sent by the anchor terminal, the server can determine a first live broadcast background image corresponding to the initial live broadcast type and send a live broadcast content image and the first live broadcast background image to the audience terminal; and the audience terminal synthesizes the live broadcast content image and the first live broadcast background image to obtain a first live broadcast image which is displayed to the user. When the target live broadcast type determined by the server based on the live broadcast content graph is different from the initial live broadcast type, a second live broadcast background graph corresponding to the target live broadcast type can be determined, the second live broadcast background graph is sent to the audience terminal, and the audience terminal switches the first live broadcast background graph in the first live broadcast picture into the second live broadcast background graph to obtain and display a second live broadcast picture. And when the target live type determined by the server based on the live content graph is the same as the initial live type, keeping the current first live background graph.
In the above scheme, when the anchor has selected the live broadcast type at the anchor terminal, the audience terminal can directly display the live broadcast background image corresponding to the live broadcast type determined by the anchor, and if the live broadcast type determined by the server is inconsistent with the live broadcast type determined by the anchor terminal, it indicates that the anchor may have a selection error, the initial live broadcast background image needs to be switched, and the modified live broadcast background image can be issued for switching, so as to ensure matching between the live broadcast background and the live broadcast content, and improve the overall live broadcast atmosphere.
Optionally, as the live broadcast is performed, the anchor broadcast may switch the live broadcast content, the first live broadcast background map may be determined based on an initial live broadcast type corresponding to the live broadcast content map at the historical time, and the second live broadcast background map is sent when a target live broadcast type corresponding to the live broadcast content map at the current time is different from the initial live broadcast type corresponding to the live broadcast content map at the historical time. That is, the server side can extract the live broadcast content image according to the set time interval and determine the live broadcast type corresponding to the live broadcast content image, if the live broadcast type is different from the live broadcast type at the historical moment, a second live broadcast background image can be generated, the second live broadcast background image is sent to the audience terminal, and the audience terminal switches the first live broadcast background image into the latest second live broadcast background image. Above-mentioned scheme is along with the switching of live content, and the live background also can in time switch in order to cooperate with live content, has improved the flexibility and the variety of live background.
In some embodiments, the live data processing method provided by the embodiment of the present disclosure may further include: and displaying a second live broadcast picture in a live broadcast preview interface. The live preview interface is an interface used for displaying a live preview stream, and a user can see a preview window of the live room through the interface. Specifically, when the live broadcast page is switched from the first live broadcast picture to the second live broadcast picture, the second live broadcast picture can be switched in response to the live broadcast preview interface, so that the consistency of the live broadcast pictures when a user enters the live broadcast page from the live broadcast preview interface is ensured, and the experience effect of the user is improved.
Fig. 4 is a schematic flow chart of another live data processing method according to the embodiment of the present disclosure, and the embodiment further optimizes the live data processing method on the basis of the above embodiment. As shown in fig. 4, the method is applied to the server, and includes:
step 201, acquiring a live content image of the display content from the anchor terminal.
The live content map may be an image that is pulled by the server from the anchor terminal and used for live broadcast, and the live content map may be generated based on content displayed by the anchor terminal, for example, when the game anchor performs game live broadcast at the anchor terminal, the live content map may be generated based on a game picture displayed by the anchor terminal or the game picture and an image of the game anchor collected by the anchor terminal. The embodiment of the present disclosure does not limit the specific live content, and for example, the live content may be a game live broadcast or an event explanation live broadcast.
In the embodiment of the present disclosure, acquiring a live content map of a display content from a main broadcast terminal may include: and extracting a live broadcast content graph in the live broadcast process according to a set time interval. The set time interval may be set according to actual conditions, and for example, the set time interval may be 30 seconds. The server side can extract the live broadcast content graph according to a set time interval in the live broadcast process, namely the process that the audience terminal displays the first live broadcast picture.
Step 202, determining a target live type corresponding to the live content graph.
The live broadcast type refers to a classification of live broadcast performed in combination with content characteristics or a general classification manner, and may specifically include a type based on device division and/or a type based on live broadcast content division.
In this embodiment of the present disclosure, determining a target live type corresponding to the live content graph may include: inputting the live broadcast content picture into a picture recognition model, and extracting to obtain picture characteristics; and matching the picture features with preset features, and determining a target live broadcast type corresponding to the live broadcast content graph based on the matching degree and/or the confidence coefficient. The picture recognition model is a deep learning model which is obtained by training in advance and used for recognizing the core features of the picture. The preset features refer to picture features extracted in advance by different live broadcast types, for example, for the live broadcast type of the game, frames can be extracted from the game picture of each mainstream game, core elements of the picture are extracted by using a computer vision technology to form the picture features, and each game can obtain the corresponding preset features.
Specifically, the live broadcast content graph is input into a picture recognition model, picture features are extracted, the picture features are matched with a plurality of preset features one by one, and the live broadcast type corresponding to the preset features with the highest matching degree and the confidence coefficient larger than a preset threshold value is determined as the target live broadcast type. The preset threshold may be set according to actual conditions, for example, the preset threshold may be 95%.
And 203, determining a second live broadcast background picture based on the target live broadcast type, and sending the second live broadcast background picture to the audience terminal, so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display the second live broadcast picture.
In this embodiment of the disclosure, determining the second live background map based on the target live type may include: determining a background picture corresponding to the target live broadcast type; and inputting the live broadcast content image serving as a style image and a background base plate image into the image style migration model to obtain a second live broadcast background image. The background floor map refers to a floor map which is preset for each live broadcast type, and the floor map can be set according to actual conditions, for example, the background floor map of the live broadcast game can be a black filled map. The picture style migration model refers to a deep learning model for migrating the style of one graph to another graph to obtain a graph with the same style.
Specifically, after a target live broadcast type corresponding to the live broadcast content graph is determined, a background floor graph corresponding to the target live broadcast type can be determined through searching, then the live broadcast content graph is used as a style picture and the background floor graph is input into the picture style migration model, the style of the live broadcast content graph can be migrated into the background floor graph, and a second live broadcast background graph with the same style as the live broadcast content graph is obtained.
In this embodiment of the disclosure, determining the second live background map based on the target live type may include: and determining a preset background image corresponding to the target live broadcast type as a second live broadcast background image. The preset background picture can be background pictures which are set by operators based on actual requirements and are in different live broadcast types and accord with the style of the live broadcast type. After the server determines the target live broadcast type, a preset background image corresponding to the target live broadcast type can be determined through searching, and the preset background image corresponding to the target live broadcast type is determined as a second live broadcast background image.
In the above scheme, the server can determine the second live background image corresponding to the live type of the live content image in two ways, so that the method better conforms to the actual application scene, and the determination efficiency of the live background image is improved.
After the server determines a second live broadcast background picture based on the target live broadcast type, the server can send the second live broadcast background picture to the audience terminal, so that the audience terminal can switch the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display the second live broadcast picture.
In some embodiments, before obtaining the live content map of the presentation content from the anchor terminal, the method may further include: determining a corresponding initial live type based on type information sent by a main broadcast terminal; and determining a preset background image corresponding to the initial live type as a first live background image.
After receiving the type information sent by the anchor terminal, the server may determine an initial live type corresponding to the type information, and determine a preset background map corresponding to the initial live type as a first live background map. And then, the live broadcast content image and the first live broadcast background image can be sent to the audience terminal, and the audience terminal synthesizes the live broadcast content image and the first live broadcast background image to obtain a first live broadcast picture to be displayed to the user.
In some embodiments, determining a second live background map based on the target live type and sending the second live background map to the viewer terminal may include: and if the initial live type determined by the anchor terminal is different from the target live type, or the initial live type determined at the historical moment is different from the target live type, determining a second live background picture based on the target live type, and sending the second live background picture to the audience terminal.
When the target live broadcast type determined by the server based on the live broadcast content image is different from the initial live broadcast type, a second live broadcast background image corresponding to the target live broadcast type can be determined, the second live broadcast background image is sent to the audience terminal, the audience terminal switches the first live broadcast background image in the first live broadcast image into the second live broadcast background image, and the second live broadcast image is obtained and displayed. And when the target live type determined by the server based on the live content graph is the same as the initial live type, keeping the current first live background graph.
In the above scheme, when the anchor has selected the live broadcast type at the anchor terminal, the audience terminal can directly display the live broadcast background image corresponding to the live broadcast type determined by the anchor, and if the live broadcast type determined by the server is inconsistent with the live broadcast type determined by the anchor terminal, it indicates that the anchor may have a selection error, the initial live broadcast background image needs to be switched, and the modified live broadcast background image can be issued for switching, so as to ensure matching between the live broadcast background and the live broadcast content, and improve the overall live broadcast atmosphere.
Optionally, the initial live type may also be a live type determined based on a live content map at a historical time. As the live broadcast is carried out, the anchor broadcast may switch the live broadcast content, the first live broadcast background image may be determined for an initial live broadcast type corresponding to the live broadcast content image based on the historical time, and the second live broadcast background image is sent when a target live broadcast type corresponding to the live broadcast content image based on the current time is different from the initial live broadcast type corresponding to the live broadcast content image based on the historical time. That is, the server can extract the live broadcast content image according to the set time interval and determine the live broadcast type corresponding to the live broadcast content image, if the live broadcast type is different from the live broadcast type at the historical moment, a second live broadcast background image can be generated, the second live broadcast background image is sent to the audience terminal, and the audience terminal switches the first live broadcast background image into the latest second live broadcast background image. Above-mentioned scheme is along with the switching of live content, and the live background also can in time switch in order to cooperate with live content, has improved the flexibility and the variety of live background.
According to the live broadcast data processing scheme provided by the embodiment of the disclosure, a server side obtains a live broadcast content graph of display content from an anchor terminal; determining a target live type corresponding to the live content graph; and determining a second live broadcast background picture based on the target live broadcast type, and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display the second live broadcast picture. By adopting the technical scheme, the live background can be switched into the background image corresponding to the live content in the live broadcasting process, the live background can be matched with the live content, the relevance is improved, the live atmosphere is diversified, and the watching experience of audiences is improved.
The live data processing method in the embodiment of the present disclosure is further described by a specific example. For example, fig. 5 is a schematic diagram of live data processing provided in an embodiment of the present disclosure, taking game live as an example, a specific process may include: and starting the live game. And (5) extracting frames from the video pictures. And acquiring a live broadcast content image according to a set time interval. And matching with the game identification model to determine the classification of the corresponding live game. Judging whether the classification is successfully identified, if so, judging whether the classification is an artificial background picture; otherwise, issuing a default background image. Judging whether the classification has an artificial background picture, if so, issuing the artificial background picture; otherwise, intelligently generating a background image and issuing the background image. And then, displaying a new background image in the client (namely, a viewer terminal), and returning to the step of continuously performing video picture frame extraction until the live broadcast is finished.
The background map can be divided into 3 types, and specifically comprises a default background map, an operation background map and an intelligent generation background map. A default background map may be used for situations where a game classification cannot be identified. The operation background picture, namely the artificial background picture, is a game classification background picture manually set by an operator, and meets the requirements of certain activities. The intelligent background image can utilize extracted game picture core elements to automatically generate the background image based on a background image base plate by using a picture style migration technology.
When the anchor starts to play the live game, one frame can be drawn every 30s, the frame is matched with the optional game identification features one by one, and the result with the highest matching degree and the confidence higher than 95% is taken as the specific live type. If the classification of the live game cannot be identified, a default background image can be issued; if the classification of the live game is identified and the classification is determined to have a preset artificial background image, the artificial background image can be issued; if the classification of the live game is identified, but the classification is determined to have no artificial background picture, an intelligent background picture corresponding to the style of the live content can be intelligently generated by using a picture style migration technology, and the intelligent background picture is issued.
Besides, the background image after switching can be displayed in the live broadcast preview stream (Feed stream) in addition to the live broadcast room, so that the consistent experience before and after the live broadcast room enters and exits is ensured, and the audience experience is improved.
Optionally, when the live broadcast is sent down, the anchor selects a game category at the anchor terminal, and at this time, the anchor automatically takes a background image of the game category. After the classification recognition result of the server is obtained, if the game classification is inconsistent with the selection of the anchor, the classification is automatically corrected, and a new background image is issued; when the client receives the new background image, the old background image is replaced, the matching between the background of the live broadcast room and the live broadcast content is ensured, the overall atmosphere of the live broadcast room is improved, and therefore the watching experience is improved. And the game type is continuously identified in the live broadcasting process, and a new background picture is automatically generated when the game type is changed, so that the flexibility of background switching is further improved.
Fig. 6 is a schematic structural diagram of a live data processing apparatus provided in an embodiment of the present disclosure, where the apparatus may be implemented by software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 6, the apparatus is configured at a viewer terminal, and includes:
the picture display module 301 is configured to display a first live-broadcast picture, where the first live-broadcast picture includes a live-broadcast content picture and a first live-broadcast background picture of display content from a main broadcast terminal;
a background switching module 302, configured to switch the first live broadcast background image in the first live broadcast picture to a second live broadcast background image if a second live broadcast background image is received, to obtain and display a second live broadcast picture, where the second live broadcast background image is determined based on a target live broadcast type corresponding to the live broadcast content image.
Optionally, the background switching module 302 is specifically configured to:
and deleting the first live broadcast background image in the first live broadcast picture, and synthesizing the live broadcast content image and the second live broadcast background image to obtain the second live broadcast picture.
Optionally, when the first live broadcast background map is determined based on an initial live broadcast type determined by the anchor terminal or the historical time, the second live broadcast background map is sent when a target live broadcast type determined based on the live broadcast content map is different from the initial live broadcast type.
Optionally, the apparatus further includes a preview module, configured to:
and displaying the second live broadcast picture in a live broadcast preview interface.
The live data processing device provided by the embodiment of the disclosure can execute the live data processing method provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
Fig. 7 is a schematic structural diagram of another live data processing apparatus provided in an embodiment of the present disclosure, where the apparatus may be implemented by software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 7, the apparatus is configured at the server, and includes:
a picture acquiring module 401, configured to acquire a live content map of a display content from a main broadcast terminal;
a type determining module 402, configured to determine a target live type corresponding to the live content graph;
a background sending module 403, configured to determine a second live broadcast background image based on the target live broadcast type, and send the second live broadcast background image to the audience terminal, so that the audience terminal switches the first live broadcast background image in the first live broadcast picture to the second live broadcast background image, and obtains and displays the second live broadcast picture.
Optionally, the image obtaining module 401 is specifically configured to:
and extracting a live broadcast content graph in the live broadcast process according to a set time interval.
Optionally, the type determining module 402 is specifically configured to:
inputting the live broadcast content picture into a picture recognition model, and extracting to obtain picture features;
and matching the picture features with preset features, and determining a target live broadcast type corresponding to the live broadcast content graph based on matching degree and/or confidence.
Optionally, the background sending module 404 is specifically configured to:
determining a background floor map corresponding to the target live broadcast type;
and inputting the live broadcast content image as a style image and the background base plate image into an image style migration model to obtain the second live broadcast background image.
Optionally, the background sending module 404 is specifically configured to:
and determining a preset background image corresponding to the target live broadcast type as the second live broadcast background image.
Optionally, the target live type includes a type based on device division and/or a type based on live content division.
Optionally, the apparatus further includes an initial type module, configured to: prior to obtaining a live content map of the presentation content from the anchor terminal,
determining a corresponding initial live type based on the type information sent by the anchor terminal;
and determining a preset background image corresponding to the initial live type as the first live background image.
Optionally, the background sending module 403 is specifically configured to:
and if the initial live type determined by the anchor terminal is different from the target live type, or the initial live type determined at the historical moment is different from the target live type, determining a second live background image based on the target live type, and sending the second live background image to the audience terminal.
The live data processing device provided by the embodiment of the disclosure can execute the live data processing method provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
Fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. Referring now specifically to fig. 8, a schematic diagram of an electronic device 500 suitable for use in implementing embodiments of the present disclosure is shown. The electronic device 500 in the disclosed embodiment may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle mounted terminal (e.g., a car navigation terminal), and the like, and a fixed terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 8 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 8, electronic device 500 may include a processing means (e.g., central processing unit, graphics processor, etc.) 501 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data necessary for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM 502, and the RAM503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
Generally, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 507 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage devices 508 including, for example, magnetic tape, hard disk, etc.; and a communication device 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 8 illustrates an electronic device 500 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may be alternatively implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or installed from the storage means 508, or installed from the ROM 502. The computer program performs the above-described functions defined in the live data processing method of the disclosed embodiment when executed by the processing apparatus 501.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: displaying a first live-broadcasting picture, wherein the first live-broadcasting picture comprises a live-broadcasting content picture and a first live-broadcasting background picture of display content from a main broadcasting terminal; and if a second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image to obtain and display a second live broadcast image, wherein the second live broadcast background image is determined based on a target live broadcast type corresponding to the live broadcast content image.
Alternatively, the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring a live broadcast content graph of display content from a main broadcast terminal; determining a target live type corresponding to the live content graph; and determining a second live broadcast background picture based on the target live broadcast type, and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display a second live broadcast picture.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, the present disclosure provides a live data processing method, applied to a viewer terminal, including:
displaying a first live-broadcasting picture, wherein the first live-broadcasting picture comprises a live-broadcasting content picture and a first live-broadcasting background picture of display content from a main broadcasting terminal;
and if a second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image to obtain and display a second live broadcast image, wherein the second live broadcast background image is determined based on a target live broadcast type corresponding to the live broadcast content image.
According to one or more embodiments of the present disclosure, in a live data processing method provided by the present disclosure, switching a first live broadcast background image in a first live broadcast picture to a second live broadcast background image to obtain a second live broadcast picture includes:
and deleting the first live broadcast background image in the first live broadcast picture, and synthesizing the live broadcast content image and the second live broadcast background image to obtain the second live broadcast picture.
According to one or more embodiments of the present disclosure, in a live data processing method provided by the present disclosure, when the first live broadcast background map is determined for an initial live broadcast type determined based on the anchor terminal or a historical time, the second live broadcast background map is sent when a target live broadcast type determined based on the live broadcast content map is different from the initial live broadcast type.
According to one or more embodiments of the present disclosure, the live data processing method further includes:
and displaying the second live broadcast picture in a live broadcast preview interface.
According to one or more embodiments of the present disclosure, the present disclosure provides a live data processing method, applied to a server, including:
acquiring a live broadcast content graph of display content from a main broadcast terminal;
determining a target live type corresponding to the live content graph;
and determining a second live broadcast background picture based on the target live broadcast type, and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display the second live broadcast picture.
According to one or more embodiments of the present disclosure, in a live data processing method provided by the present disclosure, the acquiring a live content map of a presentation content from a main broadcast terminal includes:
and extracting a live broadcast content graph in the live broadcast process according to a set time interval.
According to one or more embodiments of the present disclosure, in a live data processing method provided by the present disclosure, determining a target live type corresponding to the live content graph includes:
inputting the live broadcast content graph into a picture recognition model, and extracting to obtain picture features;
and matching the picture features with preset features, and determining a target live broadcast type corresponding to the live broadcast content graph based on matching degree and/or confidence.
According to one or more embodiments of the present disclosure, in a live data processing method provided by the present disclosure, determining a second live background map based on the target live type includes:
determining a background picture corresponding to the target live broadcast type;
and inputting the live broadcast content image as a style image and the background base plate image into an image style migration model to obtain the second live broadcast background image.
According to one or more embodiments of the present disclosure, in a live data processing method provided by the present disclosure, determining a second live background map based on the target live type includes:
and determining a preset background image corresponding to the target live broadcast type as the second live broadcast background image.
According to one or more embodiments of the present disclosure, in a live data processing method provided by the present disclosure, the target live type includes a type based on device partitioning and/or a type based on live content partitioning.
According to one or more embodiments of the present disclosure, before acquiring a live content map of a presentation content from a main broadcast terminal, a live data processing method provided by the present disclosure further includes:
determining a corresponding initial live type based on the type information sent by the anchor terminal;
and determining a preset background image corresponding to the initial live type as the first live background image.
According to one or more embodiments of the present disclosure, in a live data processing method provided by the present disclosure, determining a second live background image based on the target live type, and sending the second live background image to an audience terminal includes:
and if the initial live type determined by the anchor terminal is different from the target live type, or the initial live type determined at the historical moment is different from the target live type, determining a second live background image based on the target live type, and sending the second live background image to the audience terminal.
According to one or more embodiments of the present disclosure, there is provided a live data processing apparatus including:
the picture display module is used for displaying a first live-broadcast picture, wherein the first live-broadcast picture comprises a live-broadcast content picture and a first live-broadcast background picture of display content from an anchor terminal;
and the background switching module is used for switching the first live background image in the first live image into a second live background image to obtain and display a second live image if the second live background image is received, wherein the second live background image is determined based on a target live type corresponding to the live content image.
According to one or more embodiments of the present disclosure, in a live data processing apparatus provided by the present disclosure, the background switching module is specifically configured to:
and deleting the first live broadcast background image in the first live broadcast picture, and synthesizing the live broadcast content image and the second live broadcast background image to obtain the second live broadcast picture.
According to one or more embodiments of the present disclosure, in a live data processing apparatus provided by the present disclosure, when the first live broadcast background map is determined for an initial live broadcast type determined based on the anchor terminal or a historical time, the second live broadcast background map is transmitted when a target live broadcast type determined based on the live broadcast content map is different from the initial live broadcast type.
According to one or more embodiments of the present disclosure, in a live data processing apparatus provided by the present disclosure, the apparatus further includes a preview module, configured to:
and displaying the second live broadcast picture in a live broadcast preview interface.
According to one or more embodiments of the present disclosure, there is provided a live data processing apparatus including:
the picture acquisition module is used for acquiring a live content picture of the display content from the anchor terminal;
the type determining module is used for determining a target live type corresponding to the live content graph;
and the background sending module is used for determining a second live broadcast background picture based on the target live broadcast type and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display the second live broadcast picture.
According to one or more embodiments of the present disclosure, in a live data processing apparatus provided by the present disclosure, the picture obtaining module is specifically configured to:
and extracting a live broadcast content graph in the live broadcast process according to a set time interval.
According to one or more embodiments of the present disclosure, in a live data processing apparatus provided by the present disclosure, the type determining module is specifically configured to:
inputting the live broadcast content graph into a picture recognition model, and extracting to obtain picture features;
and matching the picture features with preset features, and determining a target live broadcast type corresponding to the live broadcast content graph based on matching degree and/or confidence.
According to one or more embodiments of the present disclosure, in a live data processing apparatus provided by the present disclosure, the background sending module is specifically configured to:
determining a background floor map corresponding to the target live broadcast type;
and inputting the live broadcast content image as a style image and the background floor image into an image style migration model to obtain the second live broadcast background image.
According to one or more embodiments of the present disclosure, in the live data processing apparatus provided by the present disclosure, the background sending module is specifically configured to:
and determining a preset background image corresponding to the target live broadcast type as the second live broadcast background image.
According to one or more embodiments of the present disclosure, in a live data processing apparatus provided by the present disclosure, the target live type includes a type based on device division and/or a type based on live content division.
According to one or more embodiments of the present disclosure, in the live data processing apparatus provided by the present disclosure, the apparatus further includes an initial type module configured to: prior to obtaining a live content map of the presentation content from the anchor terminal,
determining a corresponding initial live type based on the type information sent by the anchor terminal;
and determining a preset background image corresponding to the initial live type as the first live background image.
According to one or more embodiments of the present disclosure, in a live data processing apparatus provided by the present disclosure, the background sending module is specifically configured to:
and if the initial live type determined by the anchor terminal is different from the target live type, or the initial live type determined at the historical moment is different from the target live type, determining a second live background image based on the target live type, and sending the second live background image to the audience terminal.
In accordance with one or more embodiments of the present disclosure, there is provided an electronic device including:
a processor;
a memory for storing the processor-executable instructions;
the processor is used for reading the executable instructions from the memory and executing the instructions to realize any live data processing method provided by the present disclosure.
According to one or more embodiments of the present disclosure, there is provided a computer-readable storage medium storing a computer program for executing the live data processing method as any one of the methods provided by the present disclosure.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims (16)

1. A live data processing method is applied to a viewer terminal and comprises the following steps:
displaying a first live-broadcasting picture, wherein the first live-broadcasting picture comprises a live-broadcasting content picture and a first live-broadcasting background picture of display content from a main broadcasting terminal;
and if a second live broadcast background image is received, switching the first live broadcast background image in the first live broadcast image into the second live broadcast background image to obtain and display a second live broadcast image, wherein the second live broadcast background image is determined based on a target live broadcast type corresponding to the live broadcast content image.
2. The method of claim 1, wherein switching the first live background map in the first live view to the second live background map to obtain a second live view comprises:
deleting the first live broadcast background image in the first live broadcast image, and synthesizing the live broadcast content image and the second live broadcast background image to obtain the second live broadcast image.
3. The method of claim 1, wherein when the first live background map is determined for an initial live type determined based on the anchor terminal or a historical time, the second live background map is sent when a target live type determined based on the live content map is different from the initial live type.
4. The method of claim 1, further comprising:
and displaying the second live broadcast picture in a live broadcast preview interface.
5. A live data processing method is applied to a server and comprises the following steps:
acquiring a live broadcast content graph of display content from a main broadcast terminal;
determining a target live type corresponding to the live content graph;
and determining a second live broadcast background picture based on the target live broadcast type, and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display the second live broadcast picture.
6. The method of claim 5, wherein obtaining the live content map of the presentation content from the anchor terminal comprises:
and extracting a live broadcast content graph in the live broadcast process according to a set time interval.
7. The method of claim 5, wherein determining the target live type corresponding to the live content graph comprises:
inputting the live broadcast content picture into a picture recognition model, and extracting to obtain picture features;
and matching the picture features with preset features, and determining a target live broadcast type corresponding to the live broadcast content graph based on matching degree and/or confidence.
8. The method of claim 5, wherein determining a second live background map based on the target live type comprises:
determining a background picture corresponding to the target live broadcast type;
and inputting the live broadcast content image as a style image and the background floor image into an image style migration model to obtain the second live broadcast background image.
9. The method of claim 5, wherein determining a second live background map based on the target live type comprises:
and determining a preset background image corresponding to the target live broadcast type as the second live broadcast background image.
10. The method of claim 5, wherein the target live type comprises a type based on device partitioning and/or a type based on live content partitioning.
11. The method of claim 5, wherein prior to obtaining the live content map of the presentation content from the anchor terminal, further comprising:
determining a corresponding initial live type based on the type information sent by the anchor terminal;
and determining a preset background image corresponding to the initial live type as the first live background image.
12. The method of claim 5 or 11, wherein determining a second live background map based on the target live type and sending the second live background map to a viewer terminal comprises:
and if the initial live type determined by the anchor terminal is different from the target live type, or the initial live type determined at the historical moment is different from the target live type, determining a second live background image based on the target live type, and sending the second live background image to the audience terminal.
13. A live data processing apparatus, configured at a viewer terminal, comprising:
the picture display module is used for displaying a first live-broadcast picture, wherein the first live-broadcast picture comprises a live-broadcast content picture and a first live-broadcast background picture of display content from a main broadcast terminal;
and the background switching module is used for switching the first live background image in the first live frame to the second live background image if the second live background image is received, so as to obtain and display the second live frame, wherein the second live background image is determined based on the target live type corresponding to the live content image.
14. A live data processing apparatus, configured to a server, comprising:
the picture acquisition module is used for acquiring a live content picture of the display content from the anchor terminal;
the type determining module is used for determining a target live broadcast type corresponding to the live broadcast content graph;
and the background sending module is used for determining a second live broadcast background picture based on the target live broadcast type and sending the second live broadcast background picture to the audience terminal so that the audience terminal switches the first live broadcast background picture in the first live broadcast picture into the second live broadcast background picture to obtain and display the second live broadcast picture.
15. An electronic device, characterized in that the electronic device comprises:
a processor;
a memory for storing the processor-executable instructions;
the processor is configured to read the executable instructions from the memory and execute the instructions to implement the live data processing method of any one of claims 1 to 12.
16. A computer-readable storage medium, characterized in that the storage medium stores a computer program for executing the live data processing method of any of the above claims 1-12.
CN202110043747.5A 2021-01-13 2021-01-13 Live broadcast data processing method, device, equipment and medium Active CN114765692B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110043747.5A CN114765692B (en) 2021-01-13 2021-01-13 Live broadcast data processing method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110043747.5A CN114765692B (en) 2021-01-13 2021-01-13 Live broadcast data processing method, device, equipment and medium

Publications (2)

Publication Number Publication Date
CN114765692A true CN114765692A (en) 2022-07-19
CN114765692B CN114765692B (en) 2024-01-09

Family

ID=82363776

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110043747.5A Active CN114765692B (en) 2021-01-13 2021-01-13 Live broadcast data processing method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN114765692B (en)

Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080134250A1 (en) * 2006-01-20 2008-06-05 Huawei Technologies Co., Ltd. Method, server, set top box and system for customizing an electronic program guide interface
CN106791893A (en) * 2016-11-14 2017-05-31 北京小米移动软件有限公司 Net cast method and device
CN107277615A (en) * 2017-06-30 2017-10-20 北京奇虎科技有限公司 Live stylized processing method, device, computing device and storage medium
US20170359599A1 (en) * 2015-08-05 2017-12-14 Tencent Technology (Shenzhen) Company Limited Live data broadcast method and apparatus
CN107920256A (en) * 2017-11-30 2018-04-17 广州酷狗计算机科技有限公司 Live data playback method, device and storage medium
WO2018121556A1 (en) * 2016-12-27 2018-07-05 北京奇虎科技有限公司 Live broadcast data processing method, apparatus, program and medium
CN108650523A (en) * 2018-05-22 2018-10-12 广州虎牙信息科技有限公司 The display of direct broadcasting room and virtual objects choosing method, server, terminal and medium
CN109218697A (en) * 2018-09-20 2019-01-15 太平洋未来科技（深圳）有限公司 Rendering method, device and the electronic equipment at a kind of video content association interface
CN109348299A (en) * 2018-11-08 2019-02-15 北京微播视界科技有限公司 Comment on answering method, device, equipment and storage medium
CN109660853A (en) * 2017-10-10 2019-04-19 腾讯科技（北京）有限公司 Interactive approach, apparatus and system in net cast
CN110012336A (en) * 2019-03-12 2019-07-12 广州虎牙信息科技有限公司 Picture configuration method, terminal and the device at interface is broadcast live
US20190320211A1 (en) * 2016-11-10 2019-10-17 Guangzhou Huaduo Network Technology Co., Ltd. Method, device and system for in-sequence live streaming
CN110418149A (en) * 2016-12-06 2019-11-05 广州华多网络科技有限公司 Net cast method, apparatus, equipment and storage medium
US20190364303A1 (en) * 2018-05-22 2019-11-28 Beijing Baidu Netcom Science Technology Co., Ltd. Live broadcast processing method, apparatus, device, and storage medium
CN110930295A (en) * 2019-10-25 2020-03-27 广东开放大学（广东理工职业学院） Image style migration method, system, device and storage medium
US20200160056A1 (en) * 2018-11-21 2020-05-21 Samsung Electronics Co., Ltd. Image processing apparatus and control method thereof
US20200169785A1 (en) * 2018-11-28 2020-05-28 Capital One Services, Llc Systems and methods for dynamically modifying image and video content based on user preferences
CN111277845A (en) * 2020-01-15 2020-06-12 网易（杭州）网络有限公司 Game live broadcast control method and device, computer storage medium and electronic equipment
CN111343467A (en) * 2020-02-10 2020-06-26 腾讯科技（深圳）有限公司 Live broadcast data processing method and device, electronic equipment and storage medium
CN111432235A (en) * 2020-04-01 2020-07-17 网易（杭州）网络有限公司 Live video generation method and device, computer readable medium and electronic equipment
CN111652830A (en) * 2020-06-28 2020-09-11 Oppo广东移动通信有限公司 Image processing method and device, computer readable medium and terminal equipment
CN111951157A (en) * 2020-09-02 2020-11-17 深圳传音控股股份有限公司 Image processing method, apparatus and storage medium
CN111970527A (en) * 2020-08-18 2020-11-20 广州虎牙科技有限公司 Live broadcast data processing method and device
CN112019907A (en) * 2019-05-30 2020-12-01 上海哔哩哔哩科技有限公司 Live broadcast picture distribution method, computer equipment and readable storage medium

Patent Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080134250A1 (en) * 2006-01-20 2008-06-05 Huawei Technologies Co., Ltd. Method, server, set top box and system for customizing an electronic program guide interface
US20170359599A1 (en) * 2015-08-05 2017-12-14 Tencent Technology (Shenzhen) Company Limited Live data broadcast method and apparatus
US20190320211A1 (en) * 2016-11-10 2019-10-17 Guangzhou Huaduo Network Technology Co., Ltd. Method, device and system for in-sequence live streaming
CN106791893A (en) * 2016-11-14 2017-05-31 北京小米移动软件有限公司 Net cast method and device
CN110418149A (en) * 2016-12-06 2019-11-05 广州华多网络科技有限公司 Net cast method, apparatus, equipment and storage medium
WO2018121556A1 (en) * 2016-12-27 2018-07-05 北京奇虎科技有限公司 Live broadcast data processing method, apparatus, program and medium
CN107277615A (en) * 2017-06-30 2017-10-20 北京奇虎科技有限公司 Live stylized processing method, device, computing device and storage medium
CN109660853A (en) * 2017-10-10 2019-04-19 腾讯科技（北京）有限公司 Interactive approach, apparatus and system in net cast
CN107920256A (en) * 2017-11-30 2018-04-17 广州酷狗计算机科技有限公司 Live data playback method, device and storage medium
CN108650523A (en) * 2018-05-22 2018-10-12 广州虎牙信息科技有限公司 The display of direct broadcasting room and virtual objects choosing method, server, terminal and medium
US20190364303A1 (en) * 2018-05-22 2019-11-28 Beijing Baidu Netcom Science Technology Co., Ltd. Live broadcast processing method, apparatus, device, and storage medium
CN109218697A (en) * 2018-09-20 2019-01-15 太平洋未来科技（深圳）有限公司 Rendering method, device and the electronic equipment at a kind of video content association interface
CN109348299A (en) * 2018-11-08 2019-02-15 北京微播视界科技有限公司 Comment on answering method, device, equipment and storage medium
US20200160056A1 (en) * 2018-11-21 2020-05-21 Samsung Electronics Co., Ltd. Image processing apparatus and control method thereof
US20200169785A1 (en) * 2018-11-28 2020-05-28 Capital One Services, Llc Systems and methods for dynamically modifying image and video content based on user preferences
CN110012336A (en) * 2019-03-12 2019-07-12 广州虎牙信息科技有限公司 Picture configuration method, terminal and the device at interface is broadcast live
CN112019907A (en) * 2019-05-30 2020-12-01 上海哔哩哔哩科技有限公司 Live broadcast picture distribution method, computer equipment and readable storage medium
CN110930295A (en) * 2019-10-25 2020-03-27 广东开放大学（广东理工职业学院） Image style migration method, system, device and storage medium
CN111277845A (en) * 2020-01-15 2020-06-12 网易（杭州）网络有限公司 Game live broadcast control method and device, computer storage medium and electronic equipment
CN111343467A (en) * 2020-02-10 2020-06-26 腾讯科技（深圳）有限公司 Live broadcast data processing method and device, electronic equipment and storage medium
CN111432235A (en) * 2020-04-01 2020-07-17 网易（杭州）网络有限公司 Live video generation method and device, computer readable medium and electronic equipment
CN111652830A (en) * 2020-06-28 2020-09-11 Oppo广东移动通信有限公司 Image processing method and device, computer readable medium and terminal equipment
CN111970527A (en) * 2020-08-18 2020-11-20 广州虎牙科技有限公司 Live broadcast data processing method and device
CN111951157A (en) * 2020-09-02 2020-11-17 深圳传音控股股份有限公司 Image processing method, apparatus and storage medium

Also Published As

Publication number Publication date
CN114765692B (en) 2024-01-09

Similar Documents

Publication Publication Date Title
CN109167950B (en) Video recording method, video playing method, device, equipment and storage medium
CN106254311B (en) Live broadcast method and device and live broadcast data stream display method and device
CN109525853B (en) Live broadcast room cover display method and device, terminal, server and readable medium
CN112637622A (en) Live broadcasting singing method, device, equipment and medium
CN112259062B (en) Special effect display method and device, electronic equipment and computer readable medium
WO2020207080A1 (en) Video capture method and apparatus, electronic device and storage medium
CN106792147A (en) A kind of image replacement method and device
CN109600559B (en) Video special effect adding method and device, terminal equipment and storage medium
CN108635863B (en) Live webcast data processing method and device
CN106604147A (en) Video processing method and apparatus
CN113490004B (en) Live broadcast interaction method and related device
CN110930517A (en) Panoramic video interaction system and method
KR20230026321A (en) Methods and apparatus for composite video imaging, electronic devices and computer readable media
CN112714327A (en) Interaction method, device and equipment based on live application program and storage medium
CN106686463A (en) Video role replacing method and apparatus
CN114581566A (en) Animation special effect generation method, device, equipment and medium
CN114630057B (en) Method and device for determining special effect video, electronic equipment and storage medium
CN112804578A (en) Atmosphere special effect generation method and device, electronic equipment and storage medium
CN110336957B (en) Video production method, device, medium and electronic equipment
US20240062479A1 (en) Video playing method and apparatus, electronic device, and storage medium
CN113852767B (en) Video editing method, device, equipment and medium
CN114173139A (en) Live broadcast interaction method, system and related device
CN114302160A (en) Information display method, information display device, computer equipment and medium
TW201917556A (en) Multi-screen interaction method and apparatus, and electronic device
WO2024001802A1 (en) Image processing method and apparatus, and electronic device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant