CN113766296B - Live broadcast picture display method and device - Google Patents

Live broadcast picture display method and device Download PDF

Info

Publication number
CN113766296B
CN113766296B CN202110507350.7A CN202110507350A CN113766296B CN 113766296 B CN113766296 B CN 113766296B CN 202110507350 A CN202110507350 A CN 202110507350A CN 113766296 B CN113766296 B CN 113766296B
Authority
CN
China
Prior art keywords
target
live broadcast
picture
initial
materials
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110507350.7A
Other languages
Chinese (zh)
Other versions
CN113766296A (en
Inventor
陈春勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202110507350.7A priority Critical patent/CN113766296B/en
Publication of CN113766296A publication Critical patent/CN113766296A/en
Application granted granted Critical
Publication of CN113766296B publication Critical patent/CN113766296B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles

Abstract

The application discloses a live broadcast picture display method and device, and relates to the field of artificial intelligence; the method comprises the steps of displaying an initial live broadcast page, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room; when detecting that the content change of the current live broadcast picture meets the preset condition, switching and displaying a target live broadcast page under a target picture scene, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture formed by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene. The embodiment of the application can perform real-time scene atmosphere rendering on the live content based on scene identification, and is beneficial to improving the efficiency and convenience of live scene atmosphere rendering.

Description

Live broadcast picture display method and device
Technical Field
The application relates to the technical field of computers, in particular to a live broadcast picture display method and device.
Background
With the development of computer technology and network technology, a live broadcast mode of sharing data in real time by utilizing the internet and streaming media technology gradually becomes the next popular interactive communication mode. As a network interaction mode, network live broadcast attracts more users in a novel form, and is also increasingly widely used in shopping, entertainment, learning and other aspects. In practical application, a live broadcast room can be created by a live broadcast user through a live broadcast client, and online live broadcast is carried out through the live broadcast room, and a spectator user can enter the live broadcast room through a spectator client to watch live broadcast content of the live broadcast user.
For live broadcast, a few material pictures of atmosphere propaganda are generally required to be prepared in advance, so that the material pictures can be prepared in the live broadcast process, for example, in the live broadcast process of product propaganda, and the product related pictures are used for rendering according to live broadcast contents in live broadcast process, so that the effect of product propaganda atmosphere is enhanced. However, the method is low in efficiency and not convenient enough, and real-time scene atmosphere rendering can not be performed according to live content.
Disclosure of Invention
The embodiment of the application provides a live image display method and device, which can conduct real-time scene atmosphere rendering on live contents based on scene identification, and are beneficial to improving the efficiency and convenience of live scene atmosphere rendering.
The embodiment of the application provides a display method of a live broadcast picture, which comprises the following steps:
displaying an initial live broadcast page, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room;
when detecting that the content change of the current live broadcast picture meets the preset condition, switching and displaying a target live broadcast page under a target picture scene, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture formed by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene.
The embodiment of the application provides another display method of a live broadcast picture, which comprises the following steps:
receiving a page detection request aiming at an initial live broadcast page sent by a terminal, and detecting the content of the initial live broadcast page according to the page detection request, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room;
when detecting that the content change of the current live broadcast picture meets a preset condition, carrying out scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture;
fusing a target material with a live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture, wherein the target material is a material related to a target picture scene;
and sending the target live broadcast picture to the terminal so as to display a target live broadcast page through the terminal, wherein the target live broadcast page comprises the target live broadcast picture.
Correspondingly, the embodiment of the application provides a display device of a live broadcast picture, which comprises:
the first display unit is used for displaying an initial live broadcast page, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room;
and the second display unit is used for switching and displaying a target live broadcast page under a target picture scene when detecting that the content change of the current live broadcast picture meets a preset condition, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture formed by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene.
Correspondingly, the embodiment of the application provides another display device of a live broadcast picture, which comprises:
the receiving unit is used for receiving a page detection request aiming at an initial live broadcast page sent by the terminal, and detecting the content of the initial live broadcast page according to the page detection request, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room;
the identification unit is used for carrying out scene identification on the current live broadcast picture when detecting that the content change of the current live broadcast picture meets the preset condition so as to obtain a target picture scene corresponding to the current live broadcast picture;
the fusion unit is used for fusing the target material with the live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture, wherein the target material is a material related to the scene of the target picture;
and the sending unit is used for sending the target live broadcast picture to the terminal so as to display a target live broadcast page through the terminal, wherein the target live broadcast page comprises the target live broadcast picture.
Optionally, in some embodiments of the present application, the second display unit may include a first display subunit, a determining subunit, a picture fusion subunit, and a second display subunit, as follows:
The first display subunit is configured to display a switching preview page, where the switching preview page includes a scene switching control and a preview live broadcast picture, the preview live broadcast picture is a preview picture obtained by fusing the current live broadcast picture and an initial material, and the initial material is a material associated with the target picture scene;
the determining subunit is configured to determine, in response to a scene switching operation on the scene switching control, an initial material corresponding to a preview live broadcast picture currently displayed on the switching preview page as the target material;
the picture fusion subunit is used for fusing the live broadcast picture to be displayed in the next frame based on the target material to obtain the target live broadcast picture;
and the second display subunit is used for switching and displaying the target live broadcast page in the target picture scene.
Optionally, in some embodiments of the present application, the switching preview page further includes a material replacement control; the second display unit may further include an acquisition subunit and a third display subunit, as follows:
the obtaining subunit is configured to obtain, in response to an operation for the material replacement control, a new material associated with the target picture scene as an updated target material;
And the third display subunit is used for displaying the updated preview live broadcast picture in the switching preview page, wherein the updated preview live broadcast picture is a preview picture obtained by fusing the updated target material and the current live broadcast picture.
Optionally, in some embodiments of the present application, the second display unit may include a fourth display subunit, an identification subunit, a fifth display subunit, and a return subunit, as follows:
the fourth display subunit is used for switching and displaying a target live broadcast page in a target picture scene;
the identification subunit is used for carrying out scene identification on the target live broadcast picture when detecting that the content change of the target live broadcast picture meets the preset condition, and taking a scene corresponding to the target live broadcast picture as a new target picture scene;
a fifth display subunit, configured to switch and display a new target live broadcast page in the new target picture scene, where the new target live broadcast page includes a new target live broadcast picture, the new target live broadcast picture is a picture obtained by fusing a live broadcast picture to be displayed in a next frame with a new target material, and the new target material is a material associated with the new target picture scene;
And the return subunit is used for returning to execute the scene recognition and subsequent steps on the target live broadcast picture when the content change of the target live broadcast picture is detected to meet the preset condition.
Optionally, in some embodiments of the present application, the display apparatus of the live broadcast picture may further include a generating unit, where the generating unit may be configured to generate a target live broadcast picture;
the generating unit may include a scene recognition subunit, a calculation subunit, a selection subunit, and a fusion subunit, as follows:
the scene recognition subunit is used for performing scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture;
the calculating subunit is used for calculating the association degree between the candidate materials in the preset material library and the target picture scene;
a selecting subunit, configured to select a target material from the candidate materials according to the association degree;
and the fusion subunit is used for fusing the target material with the live broadcast picture to be displayed in the next frame to generate a target live broadcast picture.
Optionally, in some embodiments of the present application, the target material includes a target foreground atmosphere material and a target background atmosphere material; the fusion subunit is specifically configured to fuse the target foreground atmosphere material with a live broadcast picture to be displayed in a next frame when the display mode of the target live broadcast room is a first mode, so as to generate a target live broadcast picture; and when the display mode of the target live broadcasting room is a second mode, fusing the target foreground atmosphere material, the target background atmosphere material and the live broadcasting picture to be displayed in the next frame to generate a target live broadcasting picture.
Alternatively, in some embodiments of the present application, the first presentation unit may include a preview acquisition subunit, an initial fusion subunit, and an initial presentation subunit, as follows:
the preview acquisition subunit is used for acquiring live broadcast preview information and selecting initial target materials from candidate materials based on the association degree between the live broadcast preview information and the candidate materials in a preset material library;
an initial fusion subunit, configured to fuse the current live broadcast picture with the initial target material to obtain an initial live broadcast picture;
the initial display subunit is used for displaying an initial live broadcast page, and the initial live broadcast page comprises the initial live broadcast picture.
The electronic device provided by the embodiment of the application comprises a processor and a memory, wherein the memory stores a plurality of instructions, and the processor loads the instructions to execute the steps in the live broadcast picture display method provided by the embodiment of the application.
In addition, the embodiment of the application also provides a storage medium, on which a computer program is stored, wherein the computer program realizes the steps in the live broadcast picture display method provided by the embodiment of the application when being executed by a processor.
The embodiment of the application provides a method and a device for displaying live pictures, which can display an initial live page, wherein the initial live page comprises a current live picture of a target live room; when detecting that the content change of the current live broadcast picture meets the preset condition, switching and displaying a target live broadcast page under a target picture scene, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture formed by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene. The embodiment of the application can perform real-time scene atmosphere rendering on the live content based on scene identification, and is beneficial to improving the efficiency and convenience of live scene atmosphere rendering.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1a is a schematic view of a scenario of a live broadcast picture display method according to an embodiment of the present application;
fig. 1b is a flowchart of a live broadcast picture display method according to an embodiment of the present application;
fig. 1c is a schematic page diagram of a live broadcast picture display method according to an embodiment of the present application;
fig. 1d is another page schematic diagram of a live frame display method according to an embodiment of the present application;
fig. 1e is another page schematic diagram of a live broadcast picture display method according to an embodiment of the present application;
fig. 1f is another page schematic diagram of a live broadcast picture display method according to an embodiment of the present application;
fig. 2a is another flowchart of a live broadcast picture display method according to an embodiment of the present application;
fig. 2b is another flowchart of a live broadcast picture display method according to an embodiment of the present application;
fig. 3a is a schematic structural diagram of a display device for live broadcasting pictures according to an embodiment of the present application;
fig. 3b is another schematic structural diagram of a display device for live broadcasting pictures according to an embodiment of the present application;
fig. 3c is another schematic structural diagram of a display device for live broadcasting pictures according to an embodiment of the present application;
fig. 3d is another schematic structural diagram of a display device for live broadcasting pictures according to an embodiment of the present application;
Fig. 3e is another schematic structural diagram of a display device for live broadcasting pictures according to an embodiment of the present application;
fig. 3f is another schematic structural diagram of a display device for live pictures according to an embodiment of the present application;
fig. 3g is another schematic structural diagram of a display device for live pictures according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to fall within the scope of the application.
The embodiment of the application provides a live broadcast picture display method and device. The display device of the live broadcast picture can be integrated in electronic equipment, and the electronic equipment can be equipment such as a terminal or a server.
It can be understood that the method for displaying the live broadcast picture in this embodiment may be executed on the terminal, or may be executed on the server, or may be executed by both the terminal and the server. The above examples should not be construed as limiting the application.
As shown in fig. 1a, an example is a method in which a terminal and a server execute live broadcast pictures together. The display system of the live broadcast picture provided by the embodiment of the application comprises a terminal 10, a server 11 and the like; the terminal 10 and the server 11 are connected through a network, for example, a wired or wireless network connection, wherein the display device of the live broadcast picture may be integrated in the terminal.
Wherein, terminal 10 can be used for: displaying an initial live broadcast page, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room; when detecting that the content change of the current live broadcast picture meets the preset condition, switching and displaying a target live broadcast page under a target picture scene, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture formed by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene. The terminal 10 may include a mobile phone, a smart tv, a tablet computer, a notebook computer, or a personal computer (PC, personal Computer), among others. A client may also be provided on the terminal 10, which may be an application client or a browser client, etc.
The server 11 may be configured to receive a page detection request for an initial live broadcast page sent by the terminal 10, and perform content detection on the initial live broadcast page according to the page detection request, where the initial live broadcast page includes a current live broadcast picture of a target live broadcast room; when detecting that the content change of the current live broadcast picture meets a preset condition, carrying out scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture; fusing a target material with a live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture, wherein the target material is a material related to a target picture scene; the target live broadcast picture is sent to the terminal 10 to display a target live broadcast page through the terminal, wherein the target live broadcast page comprises the target live broadcast picture. The server 11 may be a single server, or may be a server cluster or cloud server composed of a plurality of servers. The application discloses a display method or device of a live broadcast picture, wherein a plurality of servers can be formed into a block chain, and the servers are nodes on the block chain.
The step of generating the target live view by the server 11 may be executed by the terminal 10.
The application provides a live broadcast picture display method, and relates to a computer vision technology in the field of artificial intelligence. The embodiment of the application can perform real-time scene atmosphere rendering on the live content based on scene identification, and is beneficial to improving the efficiency and convenience of live scene atmosphere rendering.
Among these, artificial intelligence (AI, artificial Intelligence) is the theory, method, technique and application system that uses a digital computer or a digital computer-controlled machine to simulate, extend and expand human intelligence, sense the environment, acquire knowledge and use knowledge to obtain optimal results. In other words, artificial intelligence is an integrated technology of computer science that attempts to understand the essence of intelligence and to produce a new intelligent machine that can react in a similar way to human intelligence. Artificial intelligence, i.e. research on design principles and implementation methods of various intelligent machines, enables the machines to have functions of sensing, reasoning and decision. The artificial intelligence technology is a comprehensive subject, and relates to the technology with wide fields, namely the technology with a hardware level and the technology with a software level. The artificial intelligence software technology mainly comprises a computer vision technology, a voice processing technology, a natural language processing technology, machine learning/deep learning and other directions.
The Computer Vision technology (CV) is a science for researching how to make a machine "look at", and more specifically, a camera and a Computer are used to replace human eyes to perform machine Vision such as identifying, tracking and measuring on a target, and further perform graphic processing, so that the Computer is processed into an image more suitable for human eyes to observe or transmit to an instrument to detect. As a scientific discipline, computer vision research-related theory and technology has attempted to build artificial intelligence systems that can acquire information from images or multidimensional data. Computer vision techniques typically include image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content/behavior recognition, three-dimensional object reconstruction, 3D techniques, virtual reality, augmented reality, synchronous positioning, and map construction, among others, as well as common biometric recognition techniques such as face recognition, fingerprint recognition, and others.
The following will describe in detail. The following description of the embodiments is not intended to limit the preferred embodiments.
The embodiment will be described from the perspective of a live-broadcast picture display device, which may be integrated in an electronic device, and the electronic device may be a server or a terminal, etc.
The live picture display method provided by the embodiment of the application can be applied to various live scenes. For example, by the live picture display method provided by the embodiment, the scene in the live broadcast process of a certain product brand can be rapidly identified, the target material matched with the current live broadcast atmosphere is obtained, the target live broadcast picture is generated based on the target material and the current live broadcast picture, and the efficiency and convenience of live broadcast scene atmosphere rendering are improved.
As shown in fig. 1b, the specific flow of the live broadcast picture display method may be as follows:
101. and displaying an initial live broadcast page, wherein the initial live broadcast page comprises a current live broadcast picture of the target live broadcast room.
The initial live broadcast page is an initial live broadcast page of a certain live broadcast client, and the live broadcast client can be a spectator client or a main broadcast client. The live client may be a browser client or an application client. The type of live broadcast is not limited in this embodiment. The target live broadcast room is the live broadcast room where the live broadcast client is located.
In some embodiments, the host broadcast may issue a live broadcast preview before the live broadcast, and in a scenario with the live broadcast preview, the server may acquire live broadcast preview information corresponding to the live broadcast preview, and identify the live broadcast preview information in parallel with big data, so as to extract feature information corresponding to the live broadcast preview information, acquire materials matched with the live broadcast preview information according to the feature information, and use the materials in the live broadcast, which is beneficial to enhancing propaganda strength of related products in the target live broadcast room.
The live preview information may include, among other things, live time, live topic, anchor head portrait, anchor nickname, anchor identification information (id, identity document), live profile, live merchandise, etc. The type of the live preview information may be various, and may include video, image, audio, text, and the like, which is not limited in this embodiment.
Big data (Big data) refers to a data set which cannot be captured, managed and processed by a conventional software tool within a certain time range, and is a massive, high-growth-rate and diversified information asset which needs a new processing mode to have stronger decision-making ability, insight discovery ability and flow optimization ability. With the advent of the cloud age, big data has attracted more and more attention, and special techniques are required for big data to effectively process a large amount of data within a tolerant elapsed time. Technologies applicable to big data include massively parallel processing databases, data mining, distributed file systems, distributed databases, cloud computing platforms, the internet, and scalable storage systems.
Optionally, in this embodiment, before the step of "displaying the initial live page", the method further includes:
Acquiring live broadcast forecast information, and selecting initial target materials from candidate materials based on the association degree between the live broadcast forecast information and the candidate materials in a preset material library;
the step of "showing the initial live page" may include:
fusing the current live broadcast picture and the initial target material to obtain an initial live broadcast picture;
and displaying an initial live broadcast page, wherein the initial live broadcast page comprises the initial live broadcast picture.
Among other things, the candidate stories may include various scene atmosphere images and brand praise image elements, among others. According to the live broadcast forecast information, the embodiment can select the materials matched with the live broadcast from candidate materials.
The initial target material can comprise an initial foreground atmosphere material and an initial background atmosphere material; the step of fusing the current live broadcast picture and the initial target material to obtain an initial live broadcast picture may specifically include:
when the display mode of the target live broadcasting room is a first mode, fusing the initial foreground atmosphere material with the current live broadcasting picture to obtain an initial live broadcasting picture;
and when the display mode of the target live broadcasting room is a second mode, fusing the initial foreground atmosphere material, the initial background atmosphere material and the current live broadcasting picture to obtain an initial live broadcasting picture.
In some embodiments, the first mode may specifically be a vertical screen mode, and a display effect of a current live broadcast picture in the vertical screen mode is: the length of the current live broadcast picture is smaller than the width; the second mode may specifically be a horizontal screen mode, and the display effect of the current live broadcast picture in the horizontal screen mode is as follows: the length of the current live view is greater than the width.
The initial foreground atmosphere material can comprise brand praise image elements, top atmosphere image elements and the like; the initial background atmosphere material may comprise a scene atmosphere image or the like.
In some embodiments, the initial target material may include an initial foreground atmosphere material and an initial background atmosphere material; the step of fusing the current live broadcast picture and the initial target material to obtain an initial live broadcast picture may specifically include:
fusing the initial background atmosphere material and the current live broadcast picture to obtain a fused initial basic live broadcast picture;
and fusing the initial foreground atmosphere material and the fused initial basic live broadcast picture to obtain an initial live broadcast picture.
In some embodiments, the initial target material may include an initial foreground atmosphere material and an initial background atmosphere material; the step of fusing the current live broadcast picture and the initial target material to obtain an initial live broadcast picture may specifically include:
Element identification is carried out on the current live broadcast picture so as to determine foreground picture elements and background picture elements in the current live broadcast picture;
fusing the initial foreground atmosphere material and the foreground picture element to obtain an initial front Jing Huamian after fusion;
fusing the initial background atmosphere material and the background picture element to obtain a fused initial background picture;
and acquiring an initial live broadcast picture according to the fused initial foreground picture and the fused initial background picture.
Specifically, the foreground screen elements may include an operation area image element and the like (the operation area may be specifically used for bullet screen publishing, sharing, collection and the like), the background screen elements may include a live broadcast screen and the like, the initial foreground atmosphere material may include a brand praise image element, a top layer atmosphere image element and the like, and the initial background atmosphere material may include a scene atmosphere image and the like. The embodiment can fuse the initial foreground picture after fusion and the initial background picture after fusion to obtain the initial live broadcast picture.
The step of selecting an initial target material from candidate materials based on the association degree between the live broadcast forecast information and the candidate materials in a preset material library may include:
Extracting features of the live broadcast forecast information to obtain feature information corresponding to the live broadcast forecast information;
extracting characteristics of candidate materials in a preset material library to obtain characteristic information corresponding to the candidate materials;
determining the association degree between the live broadcast forecast information and the candidate materials according to the live broadcast forecast information and the characteristic information corresponding to the candidate materials;
and selecting initial target materials from the candidate materials according to the association degree.
The method comprises the steps of calculating vector distance between characteristic information of live broadcasting forecast information and characteristic information of candidate materials; and determining the association degree between the live broadcasting forenotice information and the candidate materials according to the vector distance. The smaller the vector distance is, the larger the association degree is; conversely, the greater the vector distance, the less the degree of association. Optionally, candidate materials with the association degree larger than the preset association degree can be used as initial target materials; and the candidate materials can be ranked according to the degree of association from large to small to obtain ranked candidate materials, the candidate materials of the front N in the ranked candidate materials are used as initial target materials, and N is a positive integer.
Optionally, after the initial target material is obtained, whether the initial target material is used in the target live broadcasting room or not, that is, whether an initial live broadcasting picture obtained by fusing the initial target material with the current live broadcasting picture is displayed in the live broadcasting process can be determined based on a scene setting instruction of the host broadcasting.
Specifically, as shown in page 1 in fig. 1c, the live preview information includes live time, live topic, main broadcast nickname, live profile, live commodity, live preview cover, etc. In some embodiments, the live preview information may be analyzed, for example, how you play with cool movies may be taught by the main scene name "photo xxx" and live theme "may analyze live broadcasts related to a photographic category, where the server may screen the big data for associated materials based on brand keywords (e.g. photography) under the category, for example, may generate brand-related praise image elements and background decoration elements (i.e. associated initial target materials), such as the photo-related praise image elements are: camera, love heart, etc.; the background decoration element may be a background atmosphere image related to a photography class generated based on a live subject, at this time, live brand customization elements (including praise image elements and background decoration elements) generated by the server are transmitted back to the live client, and when the host broadcast starts to live, the audience can see a customized live room scene, that is, an initial live picture obtained by fusing an initial target material and a current live picture, as shown in a page 2 in fig. 1 c.
102. When detecting that the content change of the current live broadcast picture meets the preset condition, switching and displaying a target live broadcast page under a target picture scene, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture formed by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene.
After the anchor is played, the live broadcast picture can be detected to determine whether the content change of the live broadcast picture meets the preset condition, if so, the scene identification can be performed on the current live broadcast picture, and the target picture scene corresponding to the current live broadcast picture is determined. The preset condition may be set according to an actual situation, and this embodiment is not limited thereto, and may be set according to a requirement for rendering a scene atmosphere, for example. The time interval for detecting the live broadcast picture can be set according to practical situations, for example, the time interval can be set to be one minute for detecting the live broadcast picture.
The live broadcast picture is obtained by converting information such as light or sound into electrical information (i.e., information that can be recognized by a machine) through a sensor.
Optionally, in this embodiment, before the step of "switching the target live page in the display target screen scene", the method further includes:
performing scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture;
calculating the association degree between candidate materials in a preset material library and the target picture scene;
selecting target materials from the candidate materials according to the association degree;
and fusing the target material with the live broadcast picture to be displayed in the next frame to generate a target live broadcast picture.
The scene recognition may be performed on the current live view through a scene recognition model, which may specifically be a convolutional neural Network (CNN, convolutional Neural Networks), a visual geometry group Network (VGGNet, visual Geometry Group Network), a Residual Network (res net, residual Network), a densely connected convolutional Network (densanenet, dense Convolutional Network), or the like, but it should be understood that the scene recognition model of the present embodiment is not limited to only the above-listed types.
The method comprises the steps of extracting material characteristic information of candidate materials and scene characteristic information of a target picture scene, and calculating vector distance between the material characteristic information of the candidate materials and the scene characteristic information of the target picture scene; and determining the association degree between the candidate materials and the target picture scene according to the vector distance. The smaller the vector distance is, the larger the association degree is; conversely, the greater the vector distance, the less the degree of association. The vector distance may include a euclidean distance, a cosine distance, and the like, which is not limited by the present embodiment.
In some embodiments, candidate materials with a relevance greater than a preset relevance can be selected as target materials, and the preset relevance can be set according to actual conditions; the candidate materials can be ranked from large to small according to the association degree, the first N candidate materials in the ranked candidate materials are selected as target materials, and N is a positive integer.
Optionally, in this embodiment, the step of performing scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture may include:
extracting features of the current live broadcast picture to obtain feature information of the current live broadcast picture;
and based on the characteristic information, performing scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture.
The current live image may be preprocessed before feature extraction, and the preprocessing process may include denoising, smoothing, transforming, etc. operations in image processing, where the important features of the image in the current live image may be enhanced by preprocessing.
Optionally, in this embodiment, the step of "extracting features of the current live broadcast picture to obtain feature information of the current live broadcast picture" may include:
Performing convolution processing on the current live broadcast picture to obtain convolution information of the current live broadcast picture;
and carrying out downsampling treatment on the convolution information to obtain the characteristic information of the current live broadcast picture.
In particular, the scene recognition model may include a convolutional layer and a convergence layer. The convolution layer may disperse the current live view into small pixel blocks (e.g., 3*3/5*5 pixel blocks) by a convolution kernel, each pixel block may be considered as a tile, the tiles are arranged in a group of tiles, the content of each tile in the group of tiles is represented by a number axis, which may include a height, a width, and a color, and thus a three-dimensional numerical representation of each tile is obtained. The convergence layer combines the spatial dimension of the image group with the sampling function to output a joint array which only contains relatively important parts in the image, and the joint array is the characteristic information of the current live broadcast picture.
In this embodiment, the classifier may be used to perform scene recognition on the current live broadcast picture based on the feature information, so as to obtain a target picture scene corresponding to the current live broadcast picture. The classifier may specifically be a support vector machine (SVM, support Vector Machine), a cyclic neural network, a fully connected deep neural network (DNN, deep Neual Networks), or the like, which is not limited in this embodiment. The classifier design is to obtain an identification rule through training, and a characteristic classification can be obtained through the identification rule, so that relevant labels and categories are formed, and further classification decision is made and scene categories of live pictures are identified.
The scene recognition process utilizes the principle of strong relevance and strong similarity of adjacent pixels in the same image; i.e. two adjacent pixels in an image have a higher correlation than two separate pixels in the image. Therefore, the current live-broadcast picture can be dispersed into pixel blocks, and the pixels in each pixel block have strong relevance and can be regarded as containing the same or similar characteristics.
Optionally, in this embodiment, when detecting that the content change of the current live broadcast picture meets the preset condition, a reminder may be generated and sent to the anchor, where the reminder is used to remind the anchor of the scene change in the target live broadcast room, and the anchor may determine whether to perform the scene switching operation on the current live broadcast picture based on the reminder.
Optionally, in this embodiment, the step of "switching the target live page in the display target screen scene" may include:
displaying a switching preview page, wherein the switching preview page comprises a scene switching control and a preview live broadcast picture, the preview live broadcast picture is a preview picture obtained by fusing the current live broadcast picture and initial materials, and the initial materials are materials related to the target picture scene;
Responding to the scene switching operation of the scene switching control, and determining an initial material corresponding to a preview live broadcast picture currently displayed by the switching preview page as the target material;
fusing the live broadcast picture to be displayed of the next frame based on the target material to obtain the target live broadcast picture;
and switching and displaying the target live broadcast page under the target picture scene.
The switch preview page may specifically be a switch preview page of the anchor client.
The initial material may be specifically selected from candidate materials in a preset material library according to a degree of association between the candidate materials and the target picture scene. In some embodiments, after an initial material associated with a target picture scene is selected, determining the initial material corresponding to a preview live broadcast picture currently displayed on a preview page to be the target material in response to a scene switching operation of a scene switching control by a host; in other embodiments, the initial material may also be directly considered as the target material.
The scene switching operation may specifically be clicking, sliding operation, etc. of the scene switching control, and may specifically be set according to actual situations, which is not limited in this embodiment.
The anchor can preview the effect of the target live page in the target picture scene in advance by previewing the live picture so as to determine whether to perform scene switching operation.
Optionally, in this embodiment, the switching preview page further includes a material replacement control; the method for displaying the live broadcast picture can further comprise the following steps:
responding to the operation of the material replacement control, and acquiring new materials related to the target picture scene as updated target materials;
and displaying the updated preview live broadcast picture in the switching preview page, wherein the updated preview live broadcast picture is a preview picture obtained by fusing the updated target material and the current live broadcast picture.
The operation of the material replacement control may specifically be clicking or sliding operation of the material replacement control, which is not limited in this embodiment.
In some embodiments, before the step of displaying the switching preview page, a target material may be selected from the candidate materials based on a degree of association between the candidate materials and the target picture scene; and fusing the target material with the live broadcast picture to be displayed in the next frame to generate a target live broadcast picture.
In some embodiments, based on the association degree between the candidate materials and the target picture scene, selecting target materials from the candidate materials, and specifically, sorting the candidate materials from large to small based on the association degree between the candidate materials and the target picture scene to obtain sorted candidate materials; and selecting the material with the first rank from the ranked candidate materials as a target material. When detecting the operation of changing the control on the materials, selecting new materials as updated target materials based on the sequence of the sequenced candidate materials, for example, selecting the second sequenced material in the sequenced candidate materials as updated target materials; when the operation of the material replacement control is detected again, the material with the third arranged in the sorted candidate materials can be selected as the updated target material, and so on.
In other embodiments, the association degree between the candidate material and the target picture scene may also be calculated, and the candidate material with the association degree greater than the preset association degree is added to the target material set, where the target material set includes at least one target material. When detecting the operation of the material replacement control, a new target material can be selected from the target material set to serve as an updated target material.
In a specific scene, as shown in fig. 1d, a page a is a live broadcasting room picture when a user directly opens in a main broadcasting horizontal screen mode, and a default live broadcasting room of the system is shown, wherein praise image elements are icons such as a conventional 'love heart', 'praise gesture'. When the anchor is started, the system obtains a target picture scene corresponding to the current live picture based on scene identification, and obtains a preview live picture fused by the current live picture and materials related to the target picture scene, namely, a brand customized live broadcasting room is generated, the live broadcasting room is customized according to the target picture scene obtained through scene identification, and the target picture scene corresponding to the live broadcasting room is specifically a certain automobile brand related scene. The preview live broadcast picture can be displayed in a switching preview page of a live broadcast client of a host user, as shown in a page b, a preview sub-window is shot out in the live broadcast client, the preview sub-window comprises the preview live broadcast picture, a scene switching control, a material replacement control and a cancellation control, and the control corresponding to the icon which is used for determining in the page b is the scene switching control in the embodiment. The anchor can preview the live broadcasting room effect after the custom-made product cards through previewing the live broadcasting picture, and can click a control corresponding to 'change one' (namely a material change control) if the current effect is not satisfied; if the anchor does not want to switch scenes, the cancel control can be clicked. After the anchor clicks the icon of 'confirm use', the system can directly replace the target live broadcast picture after brand customization in the live broadcast client, for example, the page c can see that the praise image element is replaced by the icon of 'gasoline', 'steering wheel', 'tyre' and the like associated with the automobile, the background in the target live broadcast picture also comprises the scene atmosphere image of the automobile, the top of the target live broadcast picture comprises the trademark of the automobile brand and the like, and the brand atmosphere can be improved.
As shown in fig. 1e, the page d is a live broadcast room picture when directly playing in the anchor vertical screen mode, and shows a default live broadcast room of the system, wherein the praise image elements are icons such as a conventional "love heart", "praise gesture", and the like. After the anchor is started, the system obtains a target picture scene corresponding to the current live picture based on scene identification, and obtains a preview live picture fused by the current live picture and materials related to the target picture scene, namely, a brand customized live broadcasting room is generated, the brand customized live broadcasting room is customized according to the target picture scene obtained through scene identification, the target picture scene corresponding to the live broadcasting room is specifically a mall related live broadcasting scene, specifically, the virtual image of the mall is a 'cat bringing in wealth', and the materials related to the target picture scene can comprise 'cat bringing in wealth' image elements. The preview live broadcast picture can be displayed in a switching preview page of a live broadcast client of a host user, as shown in a page e, a preview sub-window is shot out in the live broadcast client, the preview sub-window comprises the preview live broadcast picture, a scene switching control, a material replacement control and a cancellation control, and a control corresponding to a 'confirm use' icon in the page e is the scene switching control in the embodiment. The anchor can preview the live broadcasting room effect after the custom-made product cards through previewing the live broadcasting picture, and can click the control corresponding to 'change one' (namely, the material change control) if the current effect is not satisfied; if the anchor does not want to switch scenes, the cancel control can be clicked. After the anchor clicks the icon of "confirm use", the system can directly replace the target live broadcast picture after brand customization in the live broadcast client, for example, the icon corresponding to the virtual image "cat bringing in wealth" of the mall, which is replaced by the praise image element, can be seen from the page f, and the top of the target live broadcast picture also comprises the virtual image of the mall, and the like, so that the brand atmosphere of the mall can be improved.
Optionally, in this embodiment, the step of "switching the target live page in the display target screen scene" may include:
switching a target live broadcast page under a target picture scene;
when detecting that the content change of the target live broadcast picture meets the preset condition, carrying out scene identification on the target live broadcast picture, and taking a scene corresponding to the target live broadcast picture as a new target picture scene;
switching and displaying a new target live broadcast page under the new target picture scene, wherein the new target live broadcast page comprises a new target live broadcast picture, the new target live broadcast picture is a picture obtained by fusing a live broadcast picture to be displayed in the next frame and a new target material, and the new target material is a material associated with the new target picture scene;
and returning to execute the scene recognition and subsequent steps for the target live broadcast picture when the content change of the target live broadcast picture is detected to meet the preset condition.
In the live broadcast process of the anchor, the content of the live broadcast picture may be detected in real time to determine whether the picture scene corresponding to the live broadcast picture changes, specifically, the time interval for detecting the content of the live broadcast picture may be set according to the actual situation, which is not limited in this embodiment, for example, the content of the live broadcast picture may be detected once every one minute.
Optionally, in this embodiment, the target material includes a target foreground atmosphere material and a target background atmosphere material; the step of fusing the target material with the live broadcast picture to be displayed in the next frame to generate a target live broadcast picture may include:
when the display mode of the target live broadcasting room is a first mode, fusing the target foreground atmosphere material with a live broadcasting picture to be displayed in the next frame to generate a target live broadcasting picture;
and when the display mode of the target live broadcasting room is a second mode, fusing the target foreground atmosphere material, the target background atmosphere material and the live broadcasting picture to be displayed in the next frame to generate a target live broadcasting picture.
In some embodiments, the first mode may specifically be a vertical screen mode, and a display effect of the live broadcast picture in the vertical screen mode is: the length of the live broadcast picture is smaller than the width; the second mode may specifically be a horizontal screen mode, and the display effect of the live broadcast picture in the horizontal screen mode is as follows: the length of the live view picture is greater than the width.
The target foreground atmosphere material can comprise brand praise image elements, top atmosphere image elements and the like; the target background atmosphere material may comprise a scene atmosphere image or the like.
Optionally, in this embodiment, the target material includes a target foreground atmosphere material and a target background atmosphere material; the step of fusing the target material with the live broadcast picture to be displayed in the next frame to generate a target live broadcast picture may include:
element identification is carried out on the live broadcast picture to be displayed in the next frame so as to determine foreground picture elements and background picture elements in the live broadcast picture to be displayed in the next frame;
fusing the target foreground atmosphere material and the foreground picture element to obtain a fused front Jing Huamian;
fusing the target background atmosphere material and the background picture element to obtain a fused background picture;
and acquiring a target live broadcast picture according to the fused foreground picture and the fused background picture.
Wherein in some embodiments, the live view may be decomposable, that is, the live view is composed of a plurality of layers. And carrying out element identification on the live broadcast picture, namely carrying out layer decomposition on the live broadcast picture, and obtaining a foreground picture element and a background picture element of the live broadcast picture.
For example, the foreground screen element of the live broadcast screen may be an icon corresponding to a praise control, a bullet screen area, etc. in the live broadcast screen; the background picture element of the live-broadcast picture may include a picture obtained by live-broadcast shooting, and the like.
The fusion between the layer material and the picture element can specifically determine the placement position of the layer material, and cover the layer material on the picture element based on the placement position.
The step of obtaining the target live broadcast picture according to the fused foreground picture and the fused background picture may include:
and fusing the fused foreground picture and the fused background picture to obtain a target live broadcast picture.
Optionally, in this embodiment, the target material includes a target foreground atmosphere material and a target background atmosphere material; the step of fusing the target material with the live broadcast picture to be displayed in the next frame to generate a target live broadcast picture may include:
fusing the target background atmosphere material and the live broadcast picture to be displayed of the next frame to obtain a fused basic live broadcast picture;
and fusing the target foreground atmosphere material and the fused basic live broadcast picture to obtain a target live broadcast picture.
Optionally, the live broadcast picture may be specifically non-decomposable, and specifically, only one layer of picture data corresponding to the live broadcast picture may be used.
As shown in fig. 1f, the target material may be divided into a target foreground atmosphere material and a target background atmosphere material. The target foreground atmosphere material, namely the brand customizing layer, can highlight brand head images and the like, can comprise live title decorations, praise image elements and the like in a target picture scene, and can comprise gasoline, steering wheels, tires and the like in an automobile brand related scene. The target background atmosphere material, i.e. the brand atmosphere layer, may highlight the brand atmosphere and may comprise a brand atmosphere background map. The target material can be fused with a live basic control layer to highlight a live theme, and the basic control layer can comprise a live picture, a public screen message area, operation controls (i.e. operation area image elements such as operation controls of barrage publishing, sharing, collection and the like) and the like.
Specifically, the conventional praise image element may be a red envelope, love heart, praise gesture, or the like. If the target picture scene is a propaganda live broadcasting room of a certain automobile brand, the generated praise image elements can be steering wheels, gasoline, tires, automobile brand marks and the like; if the target picture scene is a mall-related live broadcast room, the generated praise image element can be an avatar of the mall, such as a cat bringing in wealth.
Optionally, in this embodiment, the step of fusing the target foreground atmosphere material and the fused basic live broadcast picture to obtain a target live broadcast picture may include:
and covering the target foreground atmosphere material on a preset position of the fused basic live broadcast picture based on the transparent channel parameters of the target foreground atmosphere material to obtain a target live broadcast picture.
In some embodiments, a fusion area (i.e., an area corresponding to a preset position) in the fused basic live broadcast picture may be determined first, the fusion area is scratched out from the fused basic live broadcast picture, the target foreground atmosphere material and the fusion area are fused to obtain a mixed image area, and the mixed image area and the scratched fused basic live broadcast picture are subjected to synthesis processing to obtain the target live broadcast picture.
The transparent Channel is an Alpha Channel (Alpha Channel), which refers to transparency and translucency of a picture, and the Alpha Channel value can be used to set the transparency of the picture. During the processing of video images, it is often necessary to make various special effects using the alpha channel. The alpha channel data may be represented by an eight-bit binary number, storing additional information representing the transparency of each pixel point in the image file. The transparent characteristic of the alpha channel is utilized to create rich image effects, and the method has a great deal of application in the aspects of not only multimedia works, but also films, televisions, animations and the like. For example, the superposition and synthesis of special pictures can be completed by utilizing an alpha transparent channel, so that a certain part of the image is transparent according to different principles, and the selected color or brightness is removed from the image, so that the image part with the color removed is transparent to the background, and the part without the color removed still keeps the original image.
In some embodiments, if the target foreground atmosphere material does not have a transparent channel, the transparent channel of the target foreground atmosphere material may be first established, and the transparent channel parameters of each pixel of the transparent channel may be determined. For each pixel, the transparency of that pixel can be changed by adjusting its transparency channel parameters. The larger the transparent channel parameter, the smaller the transparency, and conversely, the smaller the transparent channel parameter, the higher the transparency.
The pixel color of the target foreground atmosphere material can be regarded as a foreground color, and the pixel color of the fused basic live broadcast picture can be regarded as a background color. For a red, green and blue color channel with 256-order brightness, when the transparent channel parameter of the pixel of the target foreground atmosphere material is 255, the pixel is opaque, namely the pixel is all foreground color; when the transparent channel parameter of the pixel of the target foreground atmosphere material is 0, the pixel is completely transparent, namely the pixel is completely background color. For the pixels of the target foreground atmosphere material to be presented, the parameters of the transparent channel of the pixels can be set to be larger; for pixels of the target foreground atmosphere material that do not need to be presented, their transparency channel parameters can be set smaller.
It can be understood that the fusion of other pictures may be based on the parameters of the transparent channel, which is not described in detail herein, and reference may be made to the fusion process in the foregoing embodiment.
The existing live broadcasting platform is lack of brand customization and atmosphere sense when merchants of different brands live in a live broadcasting room, and is not beneficial to brand owner exposure. If merchants want to deeply customize brand atmosphere in a living broadcast room and an official cooperation, the merchants need to prepare material pictures of some atmosphere propaganda in advance, which is not convenient enough.
The method and the system can intelligently identify the brand business owner of the current live broadcast in real time before and during live broadcast based on scene identification and big data, and intelligently generate the target material matched with the target picture scene of the current live broadcast according to the characteristics of the brand business owner, so as to fuse the target material with the live broadcast picture to obtain the target live broadcast picture. The scheme not only can improve the brand exposure of brands in a live broadcasting room and enhance the brand atmosphere, but also can improve the chips of the platform sponsor cooperation, thereby creating the influence of the platform.
In a specific embodiment, when the live broadcasting room scene is identified as a scene in the library, a background atmosphere map (one of target materials) matched with the scene, such as a school background map, a library background map and the like, is acquired; the praise image element corresponding to the scene can be a book, a pen, etc. Through scene identification and big data combination, immersive brandy live broadcast room atmosphere decoration can be generated in real time based on the anchor's broadcast content and scene. And displaying the target live broadcast picture under the target picture scene.
Optionally, in this embodiment, the server performs score ranking based on the candidate materials generated by the big data, and defaults to select the material with the highest score ranking as the target material. When the anchor is not satisfied with the generated target material, the material replacement control of the preview page can be operated, and the server can transmit the corresponding material back to the live client according to the ranking of the candidate materials until the anchor is satisfied. If the anchor does not want to use the scene customization scheme, the scene customization can be cancelled at any time, and then the server does not perform real-time scene detection on the live broadcasting room.
As can be seen from the above, the embodiment can display an initial live broadcast page, where the initial live broadcast page includes a current live broadcast picture of a target live broadcast room; when detecting that the content change of the current live broadcast picture meets the preset condition, switching and displaying a target live broadcast page under a target picture scene, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture formed by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene. The embodiment of the application can perform real-time scene atmosphere rendering on the live content based on scene identification, and is beneficial to improving the efficiency and convenience of live scene atmosphere rendering.
The method described in the foregoing embodiments will be described in further detail below with the specific integration of the live-view display device in the server.
The embodiment of the application provides a live broadcast picture display method, as shown in fig. 2a, the specific flow of the live broadcast picture display method can be as follows:
201. and receiving a page detection request for an initial live broadcast page sent by a terminal, and detecting the content of the initial live broadcast page according to the page detection request, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room.
The page detection request specifically detects content change of a current live broadcast picture in an initial live broadcast page to determine whether a scene corresponding to the current live broadcast picture changes.
In some embodiments, a host broadcast may issue a live broadcast preview before live broadcast, in a scene with the live broadcast preview, a server may acquire live broadcast preview information corresponding to the live broadcast preview, and identify the live broadcast preview information in parallel with big data, so as to extract feature information corresponding to the live broadcast preview information, acquire materials matched with the live broadcast preview information according to the feature information, and use the materials in live broadcast, specifically acquire initial target materials matched with the live broadcast preview information, and after the live broadcast starts, fuse a current live broadcast picture with the initial target materials, so as to obtain an initial live broadcast picture, and trigger a terminal to display the initial live broadcast picture through an initial live broadcast page, thereby being beneficial to enhancing propaganda strength of related products in a target live broadcast room.
The live preview information may include, among other things, live time, live topic, anchor head portrait, anchor nickname, anchor identification information (id, identity document), live profile, live merchandise, etc. The type of the live preview information may be various, and may include video, image, audio, text, and the like, which is not limited in this embodiment.
Optionally, in this embodiment, the method for displaying a live broadcast picture may further include:
acquiring live broadcast forecast information, and selecting initial target materials from candidate materials based on the association degree between the live broadcast forecast information and the candidate materials in a preset material library;
fusing the current live broadcast picture and the initial target material to obtain an initial live broadcast picture;
and sending the initial live broadcast picture to the terminal so as to display the initial live broadcast picture through an initial live broadcast page of the terminal.
202. And when detecting that the content change of the current live broadcast picture meets the preset condition, carrying out scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture.
After the anchor is played, the server can detect the live broadcast picture to determine whether the content change of the live broadcast picture meets the preset condition, if so, the scene identification can be carried out on the current live broadcast picture to determine the target picture scene corresponding to the current live broadcast picture. The preset condition may be set according to an actual situation, and this embodiment is not limited thereto, and may be set according to a requirement for rendering a scene atmosphere, for example. The time interval for detecting the live broadcast picture can be set according to practical situations, for example, the time interval can be set to be one minute for detecting the live broadcast picture.
The scene recognition may be performed on the current live view through a scene recognition model, which may specifically be a convolutional neural Network (CNN, convolutional Neural Networks), a visual geometry group Network (VGGNet, visual Geometry Group Network), a Residual Network (res net, residual Network), a densely connected convolutional Network (densanenet, dense Convolutional Network), or the like, but it should be understood that the scene recognition model of the present embodiment is not limited to only the above-listed types.
Optionally, in this embodiment, the step of performing scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture may include:
extracting features of the current live broadcast picture to obtain feature information of the current live broadcast picture;
and based on the characteristic information, performing scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture.
The current live image may be preprocessed before feature extraction, and the preprocessing process may include denoising, smoothing, transforming, etc. operations in image processing, where the important features of the image in the current live image may be enhanced by preprocessing.
Optionally, in this embodiment, the step of "extracting features of the current live broadcast picture to obtain feature information of the current live broadcast picture" may include:
performing convolution processing on the current live broadcast picture to obtain convolution information of the current live broadcast picture;
and carrying out downsampling treatment on the convolution information to obtain the characteristic information of the current live broadcast picture.
203. And fusing the target material with the live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture, wherein the target material is a material related to the target picture scene.
Optionally, in this embodiment, before the step of fusing the target material with the live broadcast picture to be displayed in the next frame to obtain the target live broadcast picture, the method further includes:
calculating the association degree between candidate materials in a preset material library and the target picture scene;
and selecting target materials from the candidate materials according to the association degree.
The method comprises the steps of extracting material characteristic information of candidate materials and scene characteristic information of a target picture scene, and calculating vector distance between the material characteristic information of the candidate materials and the scene characteristic information of the target picture scene; and determining the association degree between the candidate materials and the target picture scene according to the vector distance. The smaller the vector distance is, the larger the association degree is; conversely, the greater the vector distance, the less the degree of association. The vector distance may include a euclidean distance, a cosine distance, and the like, which is not limited by the present embodiment.
In some embodiments, candidate materials with a relevance greater than a preset relevance can be selected as target materials, and the preset relevance can be set according to actual conditions; the candidate materials can be ranked from large to small according to the association degree, the first N candidate materials in the ranked candidate materials are selected as target materials, and N is a positive integer.
Optionally, in this embodiment, the target material includes a target foreground atmosphere material and a target background atmosphere material; the step of fusing the target material with the live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture may include:
when the display mode of the target live broadcasting room is a first mode, fusing the target foreground atmosphere material with a live broadcasting picture to be displayed in the next frame to generate a target live broadcasting picture;
and when the display mode of the target live broadcasting room is a second mode, fusing the target foreground atmosphere material, the target background atmosphere material and the live broadcasting picture to be displayed in the next frame to generate a target live broadcasting picture.
In some embodiments, the first mode may specifically be a vertical screen mode, and a display effect of the live broadcast picture in the vertical screen mode is: the length of the live broadcast picture is smaller than the width; the second mode may specifically be a horizontal screen mode, and the display effect of the live broadcast picture in the horizontal screen mode is as follows: the length of the live view picture is greater than the width.
Optionally, in this embodiment, the target material includes a target foreground atmosphere material and a target background atmosphere material; the step of fusing the target material with the live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture may include:
element identification is carried out on the live broadcast picture to be displayed in the next frame so as to determine foreground picture elements and background picture elements in the live broadcast picture to be displayed in the next frame;
fusing the target foreground atmosphere material and the foreground picture element to obtain a fused front Jing Huamian;
fusing the target background atmosphere material and the background picture element to obtain a fused background picture;
and acquiring a target live broadcast picture according to the fused foreground picture and the fused background picture.
Optionally, in this embodiment, the target material includes a target foreground atmosphere material and a target background atmosphere material; the step of fusing the target material with the live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture may include:
fusing the target background atmosphere material and the live broadcast picture to be displayed of the next frame to obtain a fused basic live broadcast picture;
And fusing the target foreground atmosphere material and the fused basic live broadcast picture to obtain a target live broadcast picture.
204. And sending the target live broadcast picture to the terminal so as to display a target live broadcast page through the terminal, wherein the target live broadcast page comprises the target live broadcast picture.
In a specific embodiment, a host computer issues a live broadcast forecast, a server can acquire the live broadcast forecast information, for example, the server can record a host computer head portrait, host computer identification information, host computer forecast content and the like, and the host computer can link big data to identify the live broadcast forecast information to obtain content characteristic information of the live broadcast forecast information, and according to the content characteristic information, live broadcast atmosphere materials (namely initial target materials in the embodiment) corresponding to brands in the live broadcast forecast information are selected from candidate materials, and are sent to a live broadcast client, and the host computer can select the live broadcast atmosphere materials to be used in a live broadcast process through the live broadcast client. During live broadcasting, a material picture customized by brand live broadcasting can be displayed in a live broadcasting client (the material picture is obtained by fusing live broadcasting atmosphere materials and a current live broadcasting picture); in addition, in the live broadcast process, the server can also detect live broadcast pictures in real time, when detecting that the content in the live broadcast pictures changes, the server can link big data to carry out scene recognition on the live broadcast pictures, so that new target materials matched with the new target picture scenes are obtained based on the new target picture scenes obtained through recognition (namely new live broadcast atmosphere materials corresponding to the new target picture scenes are generated), the new live broadcast atmosphere materials are returned to the live broadcast client, the new live broadcast atmosphere materials are selected to be used through a host broadcast, and the live broadcast pictures fused with the new live broadcast atmosphere materials are displayed in the live broadcast client.
The specific flow of performing the real-time scene atmosphere rendering on the live content is as follows, referring to fig. 2b:
2001. the anchor publishes live broadcasting forenotice;
2002. the server records live broadcast forecast information, wherein the live broadcast forecast information can comprise a head portrait of a host, identification information, host broadcast forecast content and the like;
2003. the server links big data to identify the live broadcast forecast information and determine a target brand corresponding to the live broadcast forecast information;
2004. generating a live atmosphere material corresponding to the target brand based on the big data content;
2005. the server transmits the live atmosphere material back to the live client;
2006. the anchor selects the live broadcast atmosphere material;
2007. the live broadcast client displays a brand live broadcast customized material picture, wherein the material picture is obtained by fusing live broadcast atmosphere materials and live broadcast pictures;
2008. the server detects that the live content of the anchor changes based on scene recognition;
2009. the server links the big data to identify the scene content, determines the picture scene of the live broadcast picture, further determines a new target brand corresponding to the picture scene, and returns to the step 2004 to execute the step of generating the live broadcast atmosphere material corresponding to the target brand based on the big data content and the subsequent steps.
As can be seen from the above, in this embodiment, a server may receive a page detection request for an initial live broadcast page sent by a terminal, and perform content detection on the initial live broadcast page according to the page detection request, where the initial live broadcast page includes a current live broadcast picture of a target live broadcast room; when detecting that the content change of the current live broadcast picture meets a preset condition, carrying out scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture; fusing a target material with a live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture, wherein the target material is a material related to a target picture scene; and sending the target live broadcast picture to the terminal so as to display a target live broadcast page through the terminal, wherein the target live broadcast page comprises the target live broadcast picture. The embodiment of the application can perform real-time scene atmosphere rendering on the live content based on scene identification, and is beneficial to improving the efficiency and convenience of live scene atmosphere rendering.
In order to better implement the method, the embodiment of the application also provides a display system of the live broadcast picture. The live broadcast picture display system comprises a first live broadcast picture display device 31 and a second live broadcast picture display device 32. As shown in fig. 3a, the display device 31 of the first direct-play picture may include a first display unit 3101 and a second display unit 3102; as shown in fig. 3b, the display device 32 of the second live view may include a receiving unit 3201, an identifying unit 3202, a fusing unit 3203, and a transmitting unit 3204, as follows:
(1) A first display unit 3101;
the first display unit 3101 is configured to display an initial live page, where the initial live page includes a current live frame of the target live room.
Alternatively, in some embodiments of the present application, the first presentation unit 3101 may include a preview acquisition subunit 31011, an initial fusion subunit 31012, and an initial presentation subunit 31013, see fig. 3c, as follows:
the preview obtaining subunit 31011 is configured to obtain live broadcast preview information, and select an initial target material from candidate materials based on a degree of association between the live broadcast preview information and the candidate materials in a preset material library;
an initial fusion subunit 31012, configured to fuse the current live broadcast picture and the initial target material to obtain an initial live broadcast picture;
an initial display subunit 31013 is configured to display an initial live page, where the initial live page includes the initial live frame.
(2) A second display unit 3102;
the second display unit 3102 is configured to switch and display, when detecting that a content change of the current live broadcast picture meets a preset condition, a target live broadcast page in a target picture scene, where the target live broadcast page includes a target live broadcast picture, the target live broadcast picture is a picture obtained by fusing a live broadcast picture to be displayed in a next frame and a target material, the target picture scene is determined by performing scene recognition on the current live broadcast picture, and the target material is a material associated with the target picture scene.
Optionally, in some embodiments of the present application, the second display unit 3102 may include a first display subunit 31021, a determining subunit 31022, a screen fusion subunit 31023, and a second display subunit 31024, see fig. 3d, as follows:
the first display subunit 31021 is configured to display a switching preview page, where the switching preview page includes a scene switching control and a preview live-broadcast picture, the preview live-broadcast picture is a preview picture obtained by fusing the current live-broadcast picture and an initial material, and the initial material is a material associated with the target picture scene;
a determining subunit 31022, configured to determine, in response to a scene switching operation on the scene switching control, an initial material corresponding to a preview live broadcast picture currently displayed on the switching preview page as the target material;
a picture fusion subunit 31023, configured to fuse a live broadcast picture to be displayed in a next frame based on the target material, so as to obtain the target live broadcast picture;
a second display subunit 31024 is configured to switch and display the target live page in the target screen scene.
Optionally, in some embodiments of the present application, the switching preview page further includes a material replacement control; the second display unit 3102 may further comprise an acquisition subunit 31025 and a third display subunit 31026, see fig. 3e, as follows:
The obtaining subunit 31025 is configured to obtain, in response to an operation for the material replacement control, new material associated with the target screen scene as updated target material;
and a third display subunit 31026, configured to display an updated preview live-broadcast picture in the switching preview page, where the updated preview live-broadcast picture is a preview picture obtained by fusing the updated target material and the current live-broadcast picture.
Optionally, in some embodiments of the present application, the second display unit 3102 may include a fourth display subunit 31027, an identification subunit 31028, a fifth display subunit 31029, and a return subunit 310210, see fig. 3f, as follows:
the fourth display subunit 31027 is configured to switch and display a target live page in a target picture scene;
an identifying subunit 31028, configured to identify, when detecting that a content change of the target live broadcast picture meets a preset condition, a scene of the target live broadcast picture, and use a scene corresponding to the target live broadcast picture as a new target picture scene;
a fifth display subunit 31029, configured to switch and display a new target live broadcast page under the new target picture scene, where the new target live broadcast page includes a new target live broadcast picture, the new target live broadcast picture is a picture obtained by fusing a live broadcast picture to be displayed in a next frame with a new target material, and the new target material is a material associated with the new target picture scene;
And the return subunit 310210 is configured to return to executing the scene recognition and subsequent steps for the target live broadcast picture when the content change of the target live broadcast picture is detected to meet the preset condition.
Optionally, in some embodiments of the present application, the display device 31 of the first live view may further include a generating unit 3103, where the generating unit 3103 may be configured to generate a target live view;
the generating unit 3103 may include a scene recognition subunit 31031, a computing subunit 31032, a selecting subunit 31033, and a fusing subunit 31034, see fig. 3g, as follows:
the scene recognition subunit 31031 is configured to perform scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture;
a calculating subunit 31032, configured to calculate a degree of association between the candidate materials in the preset materials library and the target picture scene;
a selecting subunit 31033, configured to select a target material from the candidate materials according to the association degree;
and a fusion subunit 31034, configured to fuse the target material with a live broadcast picture to be displayed in a next frame, so as to generate a target live broadcast picture.
Optionally, in some embodiments of the present application, the target material includes a target foreground atmosphere material and a target background atmosphere material; the fusing subunit 31034 may be specifically configured to fuse, when the display mode of the target live room is the first mode, the target foreground atmospheric material with a live broadcast picture to be displayed in a next frame, so as to generate a target live broadcast picture; and when the display mode of the target live broadcasting room is a second mode, fusing the target foreground atmosphere material, the target background atmosphere material and the live broadcasting picture to be displayed in the next frame to generate a target live broadcasting picture.
(3) A receiving unit 3201;
the receiving unit 3201 is configured to receive a page detection request for an initial live broadcast page sent by a terminal, and perform content detection on the initial live broadcast page according to the page detection request, where the initial live broadcast page includes a current live broadcast picture of a target live broadcast room.
(4) An identification unit 3202;
and the identifying unit 3202 is configured to identify a scene of the current live broadcast picture when detecting that the content change of the current live broadcast picture meets a preset condition, so as to obtain a target picture scene corresponding to the current live broadcast picture.
(5) A fusion unit 3203;
and a fusion unit 3203, configured to fuse a target material with a live broadcast picture to be displayed in a next frame, to obtain a target live broadcast picture, where the target material is a material associated with a target picture scene.
(6) A transmission unit 3204;
and the sending unit 3204 is configured to send the target live broadcast picture to the terminal, so that a target live broadcast page is displayed through the terminal, where the target live broadcast page includes the target live broadcast picture.
As can be seen from the foregoing, in this embodiment, the first display unit 3101 may display an initial live broadcast page, where the initial live broadcast page includes a current live broadcast picture of the target live broadcast room; when detecting that the content change of the current live broadcast picture meets a preset condition, switching and displaying a target live broadcast page under a target picture scene through a second display unit 3102, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture obtained by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene;
Or alternatively, the process may be performed,
receiving a page detection request for an initial live broadcast page sent by a terminal by a receiving unit 3201, and detecting content of the initial live broadcast page according to the page detection request, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room; when detecting that the content change of the current live broadcast picture meets a preset condition, performing scene recognition on the current live broadcast picture through a recognition unit 3202 to obtain a target picture scene corresponding to the current live broadcast picture; the fusion unit 3203 fuses the target material with the live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture, wherein the target material is a material related to the target picture scene; and sending the target live broadcast picture to the terminal through a sending unit 3204 so as to display a target live broadcast page through the terminal, wherein the target live broadcast page comprises the target live broadcast picture.
The embodiment of the application can perform real-time scene atmosphere rendering on the live content based on scene identification, and is beneficial to improving the efficiency and convenience of live scene atmosphere rendering.
The embodiment of the application also provides an electronic device, as shown in fig. 4, which shows a schematic structural diagram of the electronic device according to the embodiment of the application, where the electronic device may be a terminal or a server, specifically:
The electronic device may include one or more processing cores 'processors 401, one or more computer-readable storage media's memory 402, power supply 403, and input unit 404, among other components. Those skilled in the art will appreciate that the electronic device structure shown in fig. 4 is not limiting of the electronic device and may include more or fewer components than shown, or may combine certain components, or may be arranged in different components. Wherein:
the processor 401 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 402, and calling data stored in the memory 402, thereby performing overall monitoring of the electronic device. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application program, etc., and the modem processor mainly processes wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 401.
The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by executing the software programs and modules stored in the memory 402. The memory 402 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the electronic device, etc. In addition, memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.
The electronic device further comprises a power supply 403 for supplying power to the various components, preferably the power supply 403 may be logically connected to the processor 401 by a power management system, so that functions of managing charging, discharging, and power consumption are performed by the power management system. The power supply 403 may also include one or more of any of a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
The electronic device may further comprise an input unit 404, which input unit 404 may be used for receiving input digital or character information and generating keyboard, mouse, joystick, optical or trackball signal inputs in connection with user settings and function control.
Although not shown, the electronic device may further include a display unit or the like, which is not described herein. In particular, in this embodiment, the processor 401 in the electronic device loads executable files corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 401 executes the application programs stored in the memory 402, so as to implement various functions as follows:
displaying an initial live broadcast page, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room;
when detecting that the content change of the current live broadcast picture meets a preset condition, switching and displaying a target live broadcast page under a target picture scene, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture formed by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene;
Or alternatively, the process may be performed,
receiving a page detection request aiming at an initial live broadcast page sent by a terminal, and detecting the content of the initial live broadcast page according to the page detection request, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room;
when detecting that the content change of the current live broadcast picture meets a preset condition, carrying out scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture;
fusing a target material with a live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture, wherein the target material is a material related to a target picture scene;
and sending the target live broadcast picture to the terminal so as to display a target live broadcast page through the terminal, wherein the target live broadcast page comprises the target live broadcast picture.
The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.
As can be seen from the above, the embodiment can display an initial live broadcast page, where the initial live broadcast page includes a current live broadcast picture of a target live broadcast room; when detecting that the content change of the current live broadcast picture meets the preset condition, switching and displaying a target live broadcast page under a target picture scene, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture formed by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene. The embodiment of the application can perform real-time scene atmosphere rendering on the live content based on scene identification, and is beneficial to improving the efficiency and convenience of live scene atmosphere rendering.
Those of ordinary skill in the art will appreciate that all or a portion of the steps of the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in a computer-readable storage medium and loaded and executed by a processor.
To this end, an embodiment of the present application provides a storage medium storing a plurality of instructions that can be loaded by a processor to execute steps in any of the live-view display methods provided in the embodiments of the present application. For example, the instructions may perform the steps of:
displaying an initial live broadcast page, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room;
when detecting that the content change of the current live broadcast picture meets a preset condition, switching and displaying a target live broadcast page under a target picture scene, wherein the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture formed by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, and the target materials are materials related to the target picture scene;
Or alternatively, the process may be performed,
receiving a page detection request aiming at an initial live broadcast page sent by a terminal, and detecting the content of the initial live broadcast page according to the page detection request, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room;
when detecting that the content change of the current live broadcast picture meets a preset condition, carrying out scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture;
fusing a target material with a live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture, wherein the target material is a material related to a target picture scene;
and sending the target live broadcast picture to the terminal so as to display a target live broadcast page through the terminal, wherein the target live broadcast page comprises the target live broadcast picture.
The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.
Wherein the storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.
The instructions stored in the storage medium can execute the steps in any live broadcast picture display method provided by the embodiment of the present application, so that the beneficial effects of any live broadcast picture display method provided by the embodiment of the present application can be achieved, and detailed descriptions of the foregoing embodiments are omitted.
According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions are read from the computer-readable storage medium by a processor of a computer device, and executed by the processor, cause the computer device to perform the methods provided in various alternative implementations of the presentation aspects of live pictures described above.
The foregoing describes in detail a method and apparatus for displaying a live broadcast picture provided by the embodiments of the present application, and specific examples are applied to illustrate the principles and embodiments of the present application, where the foregoing description of the embodiments is only for helping to understand the method and core ideas of the present application; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, the present description should not be construed as limiting the present application.

Claims (8)

1. The display method of the live broadcast picture is characterized by comprising the following steps of:
acquiring live broadcast forecast information, and selecting initial target materials from candidate materials based on the association degree between the live broadcast forecast information and the candidate materials in a preset material library, wherein the initial target materials comprise initial target foreground atmosphere materials and initial target background atmosphere materials, the initial target foreground atmosphere materials are initial target brand customizing layers and are used for highlighting the initial target brand information, and the initial target background atmosphere materials are initial target brand atmosphere layers and are used for highlighting brand atmosphere among live broadcast targets;
Fusing the current live broadcast picture and the initial target material to obtain an initial live broadcast picture;
displaying an initial live broadcast page, wherein the initial live broadcast page is a current live broadcast picture of a target live broadcast room, and the initial live broadcast page comprises the initial live broadcast picture;
when detecting that the brand content change of the current live broadcast picture meets a preset condition, displaying a switching preview page, wherein the switching preview page comprises a scene switching control and a preview live broadcast picture, the preview live broadcast picture is a preview picture obtained by fusing the current live broadcast picture and initial materials, and the initial materials are materials related to the scene of the target picture;
responding to the scene switching operation of the scene switching control, and determining an initial material corresponding to a preview live broadcast picture currently displayed by the switching preview page as the target material;
fusing the live broadcast picture to be displayed of the next frame based on the target material to obtain the target live broadcast picture;
the method comprises the steps that a target live broadcast page under a target picture scene is switched and displayed, the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture obtained by fusing a live broadcast picture to be displayed in the next frame and a target material, the target picture scene is determined by carrying out scene identification on the current live broadcast picture, the target material is a material related to the target picture scene, the target picture scene comprises a scene corresponding to a target brand, the target material comprises a material corresponding to the target brand, the target material comprises a target foreground atmosphere material and a target background atmosphere, the target foreground atmosphere material is a target brand customization layer and is used for highlighting target brand information, and the target background atmosphere material is a target brand atmosphere layer and is used for highlighting brand atmosphere of a target live broadcasting room.
2. The method of claim 1, wherein the toggle preview page further comprises a material replacement control; the method further comprises the steps of:
responding to the operation of the material replacement control, and acquiring new materials related to the target picture scene as updated target materials;
and displaying the updated preview live broadcast picture in the switching preview page, wherein the updated preview live broadcast picture is a preview picture obtained by fusing the updated target material and the current live broadcast picture.
3. The method of claim 1, wherein after the switching the target live page in the target scene, the method further comprises:
when detecting that the content change of the target live broadcast picture meets the preset condition, carrying out scene identification on the target live broadcast picture, and taking a scene corresponding to the target live broadcast picture as a new target picture scene;
switching and displaying a new target live broadcast page under the new target picture scene, wherein the new target live broadcast page comprises a new target live broadcast picture, the new target live broadcast picture is a picture obtained by fusing a live broadcast picture to be displayed in the next frame and a new target material, and the new target material is a material associated with the new target picture scene;
And returning to execute the scene recognition and subsequent steps for the target live broadcast picture when the content change of the target live broadcast picture is detected to meet the preset condition.
4. The method of claim 1, wherein before the switching reveals the target live page in the target picture scene, further comprising:
performing scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture;
calculating the association degree between candidate materials in a preset material library and the target picture scene;
selecting target materials from the candidate materials according to the association degree;
and fusing the target material with the live broadcast picture to be displayed in the next frame to generate a target live broadcast picture.
5. The method of claim 4, wherein the fusing the target material with the next frame of live video to be presented to generate the target live video comprises:
when the display mode of the target live broadcasting room is a first mode, fusing the target foreground atmosphere material with a live broadcasting picture to be displayed in the next frame to generate a target live broadcasting picture;
and when the display mode of the target live broadcasting room is a second mode, fusing the target foreground atmosphere material, the target background atmosphere material and the live broadcasting picture to be displayed in the next frame to generate a target live broadcasting picture.
6. The display method of the live broadcast picture is characterized by comprising the following steps of:
receiving a page detection request sent by a terminal and aiming at an initial live broadcast page, and carrying out content detection on the initial live broadcast page according to the page detection request, wherein the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room, the initial live broadcast page comprises initial target materials, the initial target materials comprise materials corresponding to an initial target brand, the initial target materials comprise initial target foreground atmosphere materials and initial target background atmosphere materials, the initial target foreground atmosphere materials are initial target brand customization layers and are used for highlighting initial target brand information, the initial target background atmosphere materials are initial target brand atmosphere layers and are used for highlighting brand atmosphere of the target live broadcast room;
when detecting that the content change of the current live broadcast picture meets a preset condition, carrying out scene recognition on the current live broadcast picture to obtain a target picture scene corresponding to the current live broadcast picture;
fusing target materials with a live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture, wherein the target materials are materials related to a target picture scene, the target picture scene comprises a scene corresponding to a target brand, the target materials comprise materials corresponding to the target brand, the target materials comprise target foreground atmosphere materials and target background atmosphere materials, the target foreground atmosphere materials are target brand customizing layers and are used for highlighting the target brand information, the target background atmosphere materials are target brand atmosphere layers and are used for highlighting brand atmosphere in the target live broadcast room;
And sending the target live broadcast picture to the terminal so as to display a target live broadcast page through the terminal, wherein the target live broadcast page comprises the target live broadcast picture.
7. A live-broadcast picture display device, comprising:
the device comprises an acquisition unit, a display unit and a display unit, wherein the acquisition unit is used for acquiring live broadcast forecast information, selecting initial target materials from candidate materials based on the association degree between the live broadcast forecast information and the candidate materials in a preset material library, wherein the initial target materials comprise initial target foreground atmosphere materials and initial target background atmosphere materials, the initial target foreground atmosphere materials are initial target brand customization layers and are used for highlighting the initial target brand information, and the initial target background atmosphere materials are initial target brand atmosphere layers and are used for highlighting brand atmosphere among target live broadcast rooms;
the first fusion unit is used for fusing the current live broadcast picture and the initial target material to obtain an initial live broadcast picture;
the first display unit is used for displaying an initial live broadcast page, wherein the initial live broadcast page is a current live broadcast picture of a target live broadcast room, and the initial live broadcast page comprises the initial live broadcast picture;
The second display unit is used for displaying a switching preview page when detecting that the brand content change of the current live broadcast picture meets a preset condition, wherein the switching preview page comprises a scene switching control and a preview live broadcast picture, the preview live broadcast picture is a preview picture obtained by fusing the current live broadcast picture and initial materials, and the initial materials are materials related to the scene of the target picture;
the determining unit is used for responding to the scene switching operation of the scene switching control, and determining the initial material corresponding to the preview live broadcast picture currently displayed by the switching preview page as the target material;
the second fusion unit is used for fusing the live broadcast picture to be displayed in the next frame based on the target material to obtain the target live broadcast picture;
the third display unit is used for switching and displaying the target live broadcast page under the target picture scene, the target live broadcast page comprises a target live broadcast picture, the target live broadcast picture is a picture obtained by fusing a live broadcast picture to be displayed in the next frame and target materials, the target picture scene is determined by carrying out scene recognition on the current live broadcast picture, the target materials are materials related to the target picture scene, the target picture scene comprises a scene corresponding to a target brand, the target materials comprise materials corresponding to the target brand, the target materials comprise a target foreground atmosphere material and a target background atmosphere material, the target foreground atmosphere material is a target brand customizing layer and is used for highlighting the target brand information, and the target background atmosphere material is a target brand atmosphere layer and is used for highlighting the brand atmosphere of the target live broadcast room.
8. A live-broadcast picture display device, comprising:
the device comprises a receiving unit, a content detection unit and a content display unit, wherein the receiving unit is used for receiving a page detection request for an initial live broadcast page sent by a terminal, and carrying out content detection on the initial live broadcast page according to the page detection request, the initial live broadcast page comprises a current live broadcast picture of a target live broadcast room, the initial live broadcast page comprises initial target materials, the initial target materials comprise materials corresponding to an initial target brand, the initial target materials comprise initial target foreground atmosphere materials and initial target background atmosphere materials, the initial target foreground atmosphere materials are initial target brand customization layers and are used for highlighting initial target brand information, the initial target background atmosphere materials are initial target brand atmosphere layers and are used for highlighting brand atmosphere between target live broadcast rooms;
the identification unit is used for carrying out scene identification on the current live broadcast picture when detecting that the content change of the current live broadcast picture meets the preset condition so as to obtain a target picture scene corresponding to the current live broadcast picture;
the fusion unit is used for fusing target materials with a live broadcast picture to be displayed in the next frame to obtain a target live broadcast picture, wherein the target materials are materials related to a target picture scene, the target picture scene comprises a scene corresponding to a target brand, the target materials comprise materials corresponding to the target brand, the target materials comprise target foreground atmosphere materials and target background atmosphere materials, the target foreground atmosphere materials are target brand customizing layers and are used for highlighting target brand information, the target background atmosphere materials are target brand atmosphere layers and are used for highlighting brand atmosphere in the target live broadcast room;
And the sending unit is used for sending the target live broadcast picture to the terminal so as to display a target live broadcast page through the terminal, wherein the target live broadcast page comprises the target live broadcast picture.
CN202110507350.7A 2021-05-10 2021-05-10 Live broadcast picture display method and device Active CN113766296B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110507350.7A CN113766296B (en) 2021-05-10 2021-05-10 Live broadcast picture display method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110507350.7A CN113766296B (en) 2021-05-10 2021-05-10 Live broadcast picture display method and device

Publications (2)

Publication Number Publication Date
CN113766296A CN113766296A (en) 2021-12-07
CN113766296B true CN113766296B (en) 2023-10-13

Family

ID=78787097

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110507350.7A Active CN113766296B (en) 2021-05-10 2021-05-10 Live broadcast picture display method and device

Country Status (1)

Country Link
CN (1) CN113766296B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125569B (en) * 2022-01-27 2022-07-15 阿里巴巴（中国）有限公司 Live broadcast processing method and device
CN114449252B (en) * 2022-02-12 2023-08-01 北京蜂巢世纪科技有限公司 Method, device, equipment, system and medium for dynamically adjusting field video based on explanation audio
CN115002555B (en) * 2022-06-01 2024-01-05 无限魔方(深圳)科技有限公司 Theme making method, device and equipment applied to live broadcasting room
CN115065876A (en) * 2022-08-18 2022-09-16 广州市千钧网络科技有限公司 Method and device for changing live title and cover and related product

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106203990A (en) * 2016-07-05 2016-12-07 深圳市星尚天空科技有限公司 A kind of method and system utilizing virtual decorative article to beautify net cast interface
CN108650523A (en) * 2018-05-22 2018-10-12 广州虎牙信息科技有限公司 The display of direct broadcasting room and virtual objects choosing method, server, terminal and medium
CN109525853A (en) * 2018-11-29 2019-03-26 北京字节跳动网络技术有限公司 Direct broadcasting room cover methods of exhibiting, device, terminal, server and readable medium
CN109660853A (en) * 2017-10-10 2019-04-19 腾讯科技（北京）有限公司 Interactive approach, apparatus and system in net cast
CN111263227A (en) * 2020-02-10 2020-06-09 腾讯科技（深圳）有限公司 Multimedia playing method, device and storage medium
CN111800661A (en) * 2020-07-08 2020-10-20 网易（杭州）网络有限公司 Live broadcast room display control method, electronic device and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106203990A (en) * 2016-07-05 2016-12-07 深圳市星尚天空科技有限公司 A kind of method and system utilizing virtual decorative article to beautify net cast interface
CN109660853A (en) * 2017-10-10 2019-04-19 腾讯科技（北京）有限公司 Interactive approach, apparatus and system in net cast
CN108650523A (en) * 2018-05-22 2018-10-12 广州虎牙信息科技有限公司 The display of direct broadcasting room and virtual objects choosing method, server, terminal and medium
CN109525853A (en) * 2018-11-29 2019-03-26 北京字节跳动网络技术有限公司 Direct broadcasting room cover methods of exhibiting, device, terminal, server and readable medium
CN111263227A (en) * 2020-02-10 2020-06-09 腾讯科技（深圳）有限公司 Multimedia playing method, device and storage medium
CN111800661A (en) * 2020-07-08 2020-10-20 网易（杭州）网络有限公司 Live broadcast room display control method, electronic device and storage medium

Also Published As

Publication number Publication date
CN113766296A (en) 2021-12-07

Similar Documents

Publication Publication Date Title
CN113766296B (en) Live broadcast picture display method and device
WO2021232978A1 (en) Video processing method and apparatus, electronic device and computer readable medium
US11551424B2 (en) Interaction analysis systems and methods
CN108664651B (en) Pattern recommendation method, device and storage medium
CN111491187B (en) Video recommendation method, device, equipment and storage medium
WO2014004864A1 (en) Determining how interested a particular person is in an image
TWI781554B (en) Method of determining item name of object, device, computer equipment and storage medium
CN103686344A (en) Enhanced video system and method
TWI617930B (en) Method and system for sorting a search result with space objects, and a computer-readable storage device
CN113010703B (en) Information recommendation method and device, electronic equipment and storage medium
CN114697703B (en) Video data generation method and device, electronic equipment and storage medium
CN117337430A (en) Shortcut based on scanning operation in message system
CN113194256B (en) Shooting method, shooting device, electronic equipment and storage medium
CN114372172A (en) Method and device for generating video cover image, computer equipment and storage medium
US20170013309A1 (en) System and method for product placement
CN113596574A (en) Video processing method, video processing apparatus, electronic device, and readable storage medium
CN113610953A (en) Information processing method and device and computer readable storage medium
CN115494987A (en) Video-based interaction method and device, computer equipment and storage medium
CN117396849A (en) Combining functionality into shortcuts within a messaging system
CN113676734A (en) Image compression method and image compression device
CN113515336A (en) Live broadcast room joining method, live broadcast room creating method, live broadcast room joining device, live broadcast room creating device, live broadcast room equipment and storage medium
CN113873080B (en) Multimedia file acquisition method and device
CN114245174B (en) Video preview method and related equipment
CN115171014B (en) Video processing method, video processing device, electronic equipment and computer readable storage medium
WO2024077909A1 (en) Video-based interaction method and apparatus, computer device, and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant