CN115720279B - Method and device for showing arbitrary special effects in live broadcast scene - Google Patents

Method and device for showing arbitrary special effects in live broadcast scene Download PDF

Info

Publication number
CN115720279B
CN115720279B CN202211448017.4A CN202211448017A CN115720279B CN 115720279 B CN115720279 B CN 115720279B CN 202211448017 A CN202211448017 A CN 202211448017A CN 115720279 B CN115720279 B CN 115720279B
Authority
CN
China
Prior art keywords
live
area
special effect
image
live broadcast
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211448017.4A
Other languages
Chinese (zh)
Other versions
CN115720279A (en
Inventor
王海霞
雷迅
胡东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Facing Information Technology Co ltd
Original Assignee
Hangzhou Facing Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Facing Information Technology Co ltd filed Critical Hangzhou Facing Information Technology Co ltd
Priority to CN202211448017.4A priority Critical patent/CN115720279B/en
Publication of CN115720279A publication Critical patent/CN115720279A/en
Application granted granted Critical
Publication of CN115720279B publication Critical patent/CN115720279B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Studio Circuits (AREA)

Abstract

The application provides a method and a device for showing any special effect in a live broadcast scene, which are applied to the technical field of network live broadcast, wherein the method is characterized in that sound data in a live broadcast stream is analyzed and processed by acquiring the live broadcast stream, converted into characters, and image data in the live broadcast stream is analyzed and processed to divide an image into a plurality of areas; the plurality of regions includes: a portrait area, a things area and a blank area; inquiring a live broadcast special effect database according to the characters, and determining the live broadcast special effect to be used; and then, according to the size of the blank area, the size of the live special effect is adjusted, and the live special effect is displayed in the blank area. According to the method and the device, the sound of the host during live broadcasting can be automatically identified, the corresponding interaction special effect is matched according to the identification result, the special effect is displayed in the blank area according to the image identification, and under the condition that the live broadcasting content is not affected, a powerful game interaction feeling can be created to attract eyeballs of audiences to stay in a live broadcasting room, so that the number of online watching people in the live broadcasting room at the current time is increased.

Description

Method and device for showing arbitrary special effects in live broadcast scene
Technical Field
The present application relates to the field of network live broadcasting technologies, and in particular, to a method, an apparatus, an electronic device, and a storage medium for displaying arbitrary special effects in a live broadcasting scene.
Background
With the development of network technology, live broadcast technology has been raised in recent years, video live broadcast is also endowed with entertainment and social properties, and live broadcast watching has become the next mainstream entertainment form. The special effect technology is also applied to live broadcast in a large range, and better experience and participation can be shown to audiences through the live broadcast special effect, but the abuse of the special effect can lead to the reduction of customer experience, and how to use the special effect correctly becomes important.
Therefore, when the special effect is used, the factors such as live broadcast content, live broadcast scene and time of a host are required to be considered, at present, because the influence of noise, accent, too fast speech speed and the like exists in live broadcast, analysis errors exist, and Chinese has a plurality of homophonic words and homophonic words, if the machine is difficult to correctly identify without connecting with a context, the used special effect is unsuitable, and the like. In addition, when the special effect is displayed, because semantic analysis is needed to judge the used special effect, delay exists in displaying the special effect, and if many people or objects exist in the live broadcast picture, the displayed special effect can shield the people and objects, so that the watching experience of the audience is poor.
Disclosure of Invention
The application provides a method, device electronic equipment and storage medium for showing any special effect in a live broadcast scene, which can automatically identify the sound of a host broadcast in live broadcast, match corresponding interactive special effects according to identification results, and show the special effects in a blank area according to image identification, so that a hot game interaction feeling can be created to attract eyeballs of audiences to stay in a live broadcast room under the condition of not influencing live broadcast content, and the online watching number of the live broadcast room at the current time is improved.
In a first aspect, an embodiment of the present application provides a method for displaying arbitrary special effects in a live scene, including:
acquiring a live stream; the live stream includes image data and sound data;
analyzing and processing the sound data, and converting the sound data into characters;
analyzing and processing the image data, and dividing the image into a plurality of areas;
wherein the plurality of regions comprises: a portrait area, a things area and a blank area;
inquiring a live special effect database according to the characters, and determining the live special effect to be used;
wherein the live effect includes one or more of the following: linking countdown special effects, live house theme decorated special effects, or full screen poster campaign promotional special effects;
and according to the size of the blank area, the size of the live special effect is adjusted, and the live special effect is displayed in the blank area.
According to the technical scheme, the voice during live broadcasting can be automatically recognized, corresponding interactive special effects are matched according to voice content, a popular game interaction feeling is created to attract eyeballs of audiences to stay in a live broadcasting room, or live broadcasting room welfare is displayed to attract audiences to stay in the live broadcasting room, the number of online viewers in the live broadcasting room at the current time is improved, the special effects are displayed in a blank area through image recognition, and the heat of live broadcasting is increased under the condition that live broadcasting content is not influenced.
Optionally, acquiring the live stream includes:
acquiring application information corresponding to the application according to the window title and the brief introduction of the application;
judging the type of the application according to the application information;
and if the application is a live application, acquiring a live stream of the live application.
Through the technical scheme, the live stream can be directly acquired, the voice and the picture in the live stream are analyzed, the acquisition steps of images and voice are reduced, and the timeliness of special effect display can be improved.
Optionally, the analyzing the image data to divide the image into a plurality of areas includes:
according to the portrait identification model, a portrait area in the image is determined;
determining object areas in the image according to the object identification model, and labeling the types of objects in the image;
the areas other than the portrait area and the object area in the image are divided into blank areas.
Through the technical scheme, the live image can be analyzed and processed in time, the image is divided into different areas, and the special effect can be displayed in the correct area.
Optionally, querying a live special effect database according to the text to determine the live special effect to be used, including:
analyzing and processing the characters through a semantic analysis model, and determining the semantics corresponding to the characters;
and determining the live broadcast special effect matched with the semantics according to the semantic query live broadcast special effect database.
According to the technical scheme, the talk content of the anchor during live broadcast can be accurately analyzed, and the optimal special effect can be quickly matched through semantic analysis, so that the talk content is displayed on a live broadcast interface.
Optionally, adjusting the size of the live special effect according to the size of the blank area, and displaying the live special effect in the blank area, including:
and displaying the live broadcast special effect in the blank area through a picture layer superposition technology and a green matting technology.
Optionally, the method further comprises:
presenting windows of all live applications in a user interface;
the window of the live broadcast application is used for user selection to add the live broadcast special effect.
In a second aspect, an embodiment of the present application provides an apparatus for displaying arbitrary special effects in a live scene, including:
the acquisition module is used for acquiring the live stream;
wherein the live stream includes image data and sound data;
the analysis processing module is used for analyzing and processing the sound data and converting the sound data into characters; analyzing and processing the image data, and dividing the image into a plurality of areas;
wherein the plurality of regions comprises: a portrait area, a things area and a blank area;
the determining module is used for inquiring the live broadcast special effect database according to the characters and determining the live broadcast special effect to be used;
wherein the live effect includes one or more of the following: linking countdown special effects, live house theme decorated special effects, or full screen poster campaign promotional special effects;
and the display module is used for adjusting the size of the live special effect according to the size of the blank area and displaying the live special effect in the blank area.
Optionally, the apparatus further comprises:
a selection module for presenting windows of all live applications in a user interface;
the window of the live broadcast application is used for user selection to add the live broadcast special effect.
In a third aspect, an embodiment of the present application provides an electronic device, including a memory and a processor, where the memory stores a computer program, and the processor implements the method according to any implementation manner of the first aspect when executing the program.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method according to any of the implementations of the first aspect.
The application provides a method and a device for showing any special effect in a live broadcast scene, wherein the method is characterized in that a live broadcast stream is acquired, sound data in the live broadcast stream is analyzed and processed, the sound data are converted into characters, image data in the live broadcast stream are analyzed and processed, and an image is divided into a plurality of areas; the plurality of regions includes: a portrait area, a things area and a blank area; inquiring a live broadcast special effect database according to the characters, and determining the live broadcast special effect to be used; and then, according to the size of the blank area, the size of the live special effect is adjusted, and the live special effect is displayed in the blank area. According to the method and the device, the sound of the host during live broadcasting can be automatically identified, the corresponding interaction special effect is matched according to the identification result, the special effect is displayed in the blank area according to the image identification, and under the condition that the live broadcasting content is not affected, a powerful game interaction feeling can be created to attract eyeballs of audiences to stay in a live broadcasting room, so that the number of online watching people in the live broadcasting room at the current time is increased.
It should be understood that the description in this summary is not intended to limit the critical or essential features of the embodiments of the application, nor is it intended to limit the scope of the application. Other features of the present application will become apparent from the description that follows.
Drawings
The above and other features, advantages and aspects of embodiments of the present application will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, the same or similar reference numerals denote the same or similar elements.
FIG. 1 is a flowchart of a method for displaying arbitrary special effects in a live scene according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a device for displaying arbitrary special effects in a live scene according to an embodiment of the present application;
fig. 3 is a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to enable a person skilled in the art to better understand the technical solutions in one or more embodiments of the present specification, the technical solutions in one or more embodiments of the present specification will be clearly and completely described below with reference to the drawings in one or more embodiments of the present specification, and it is obvious that the described embodiments are only some embodiments of the present specification, not all embodiments. All other embodiments, which can be made by one or more embodiments of the present disclosure without inventive faculty, are intended to be within the scope of the present disclosure.
It should be noted that, the description of the embodiment of the present application is only for the purpose of more clearly describing the technical solution of the embodiment of the present application, and does not constitute a limitation on the technical solution provided by the embodiment of the present application.
Fig. 1 is a flowchart of a method for displaying arbitrary special effects in a live scene according to an embodiment of the present application. As shown in fig. 1, the method includes:
s101, acquiring a live stream.
Optionally, the live stream includes image data and sound data.
Optionally, acquiring the live stream includes:
acquiring application information corresponding to the application according to the window title and the brief introduction of the application;
judging the type of the application according to the application information;
and if the application is a live application, acquiring a live stream of the live application.
The live voice can be automatically collected through the sound collector, the live picture can be collected through the camera device, and then the live voice and the live picture are analyzed and processed.
S102, analyzing and processing the sound data, and converting the sound data into characters; the image data is analyzed and processed to divide the image into a plurality of areas.
Optionally, the plurality of regions comprises: a portrait area, a things area and a blank area.
Alternatively, one image may have a plurality of portrait areas and business areas.
Optionally, the analyzing the image data to divide the image into a plurality of areas includes:
according to the portrait identification model, a portrait area in the image is determined;
determining object areas in the image according to the object identification model, and labeling the types of objects in the image;
the areas other than the portrait area and the object area in the image are divided into blank areas.
By way of example, different live broadcast pictures can be obtained, and the live broadcast pictures are processed and then used as training samples to train to obtain a human image recognition model. The model can be used for identifying the portrait area in the live broadcast picture, dividing the area and marking the area.
For example, a partially live anchor may recommend various types of merchandise to a viewer, and images of the merchandise may be acquired and used as training samples to train to obtain a transaction recognition model. The model can be used for identifying information such as the types and names of some commodities in the live broadcast picture, and can mark the information such as the types and names of the commodities in the object region when the object region is divided.
Illustratively, other areas except for the portrait area and the object area in the live broadcast picture are divided into blank areas, and the areas are marked with "for showing special effects".
S103, inquiring a live special effect database according to the characters, and determining the live special effect.
Optionally, the live effect includes one or more of the following: link countdown special effects, live room theme decorated special effects, or full screen poster campaign promotional special effects.
Optionally, querying a live special effect database according to the text to determine the live special effect to be used, including:
analyzing and processing the characters through a semantic analysis model, and determining the semantics corresponding to the characters;
and determining the live broadcast special effect matched with the semantics according to the semantic query live broadcast special effect database.
Illustratively, a host in a live broadcasting room introduces a product A, performs semantic analysis on the introduction content of the host, performs analysis processing on the introduction content of the host by using a semantic analysis model to obtain information such as the name and price of the product A, links of the product to be recommended and the like, then queries a broadcast special effect database according to the product name, and finds a link countdown special effect corresponding to the product from the broadcast special effect database.
S104, adjusting the size of the live special effect according to the size of the blank area, and displaying the live special effect in the blank area.
Optionally, adjusting the size of the live special effect according to the size of the blank area, and displaying the live special effect in the blank area, including:
and displaying the live broadcast special effect in the blank area through a picture layer superposition technology and a green matting technology.
For example, if it is determined in step S103 that the special effect to be used is the direct broadcasting room theme decoration special effect, the green matting technique or the blue matting technique is used to replace the background of the direct broadcasting room, and the direct broadcasting room theme decoration special effect is changed into the background of the direct broadcasting room. The personalized live broadcasting room can be built through the technical means, and the displayed special effects can enable the audience to know the live broadcasting action of the current link, so that the interaction is realized, the live broadcasting room can be more hot, and the time of the audience staying in the live broadcasting room is prolonged.
Illustratively, if it is determined in step S103 that the special effect to be used is a link countdown special effect, the link countdown special effect is added in the blank area by using the graph layer stacking technique, and the size of the link countdown special effect is adjusted.
Optionally, if the special effect determined in step S103 has a large area required for clear display and a small blank area, and it is difficult to clearly display the special effect in the blank area, the importance of the portrait area and the object area may be determined according to the nature of the live broadcast content, and the display mode of the special effect may be determined according to the determination result.
Optionally, weights are set for the portrait area and the object area according to the property of the content in the live broadcasting room, if the live broadcasting with the performance property is performed, the weights of the portrait area are set to be higher than the weights of the object area, and if the live broadcasting with the cargo property is performed, the weights of the object area are set to be higher than the weights of the portrait area.
Further, weights can be set for different portrait areas and different object areas according to the importance degree of the people in the living broadcasting room and the importance degree of the objects in the living broadcasting room.
For example, if the weight of the portrait area is higher than that of the object area, the special effect is adjusted to be displayed in the object area and the blank area.
Further, the transparency of the object area layer can be adjusted, and the display of the special effect is not affected as much as possible.
Optionally, the method for displaying any special effects in the live scene further comprises:
presenting windows of all live applications in a user interface;
the window of the live broadcast application is used for user selection to add the live broadcast special effect.
For example, an application zhitou. Exe may be opened, clicking the "add live view" button in the application interface, entering the secondary interface; the 'add materials' button can be clicked in the secondary interface, the application zhitou. Exe obtains all windows which are currently opened from the screen position of the operating system, and reduces and displays all windows which are currently opened, and the live broadcast window which needs to display special effects is selected by clicking the windows.
Optionally, the method for displaying any special effects in the live scene further comprises:
the live content can be known in advance, and a display plan of the live special effect can be formulated according to the live content, and the plan can comprise: and displaying the special effect in the preset area of the live broadcast picture when the keyword appears in the live broadcast, and displaying the special effect in the preset area of the live broadcast picture when the live broadcast is carried out at a certain moment. By the method, the delay of special effect display in live broadcast can be further reduced, and the viewing experience of a user is improved.
The embodiment of the application provides a method for showing any special effect in a live broadcast scene, which comprises the steps of acquiring a live broadcast stream, analyzing and processing sound data in the live broadcast stream, converting the sound data into characters, analyzing and processing image data in the live broadcast stream, and dividing an image into a plurality of areas; the plurality of regions includes: a portrait area, a things area and a blank area; inquiring a live broadcast special effect database according to the characters, and determining the live broadcast special effect to be used; and then, according to the size of the blank area, the size of the live special effect is adjusted, and the live special effect is displayed in the blank area. According to the embodiment of the application, the sound of the host during live broadcast can be automatically identified, the corresponding interactive special effect is matched according to the identification result, the special effect is displayed in the blank area according to the image identification, and under the condition that the live broadcast content is not influenced, a powerful game interaction feeling can be created to attract eyeballs of audiences to stay in a live broadcast room, so that the number of online viewers in the live broadcast room at the current time is increased.
The following describes in detail the device provided by the embodiment of the application with reference to fig. 2, which can execute the method for displaying any special effect in the live scene.
Fig. 2 is a schematic structural diagram of an apparatus for displaying arbitrary special effects in a live scene according to an embodiment of the present application; as shown in fig. 2, the special effect presentation apparatus 20 includes:
an acquisition module 201, configured to acquire a live stream;
wherein the live stream includes image data and sound data;
the analysis processing module 202 is used for analyzing and processing the sound data and converting the sound data into characters; analyzing and processing the image data, and dividing the image into a plurality of areas;
wherein the plurality of regions comprises: a portrait area, a things area and a blank area;
the determining module 203 is configured to query a live broadcast special effect database according to the text, and determine a live broadcast special effect to be used;
wherein the live effect includes one or more of the following: linking countdown special effects, live house theme decorated special effects, or full screen poster campaign promotional special effects;
and the display module 204 is configured to adjust the size of the live special effect according to the size of the blank area, and display the live special effect in the blank area.
The special effect presentation apparatus 20 further includes:
a selection module 205, configured to present windows of all live applications in the user interface;
the window of the live broadcast application is used for user selection to add the live broadcast special effect.
Optionally, the obtaining module 201 is further configured to obtain application information corresponding to the application according to a window title and a profile of the application; judging the type of the application according to the application information; and if the application is a live application, acquiring a live stream of the live application.
Optionally, the analysis processing module 202 is further configured to determine a portrait area in the image according to a portrait identification model; determining object areas in the image according to the object identification model, and labeling the types of objects in the image; the areas other than the portrait area and the object area in the image are divided into blank areas.
Optionally, the determining module 203 is further configured to analyze the text through a semantic analysis model, and determine semantics corresponding to the text; and then, according to the semantic query live special effect database, determining the live special effect matched with the semantic.
Optionally, the display module 204 is further configured to display the live special effect in the blank area through a layer stacking technology and a green matting technology.
The embodiment of the present application also provides a computer electronic device, fig. 3 shows a schematic diagram of a structure of an electronic device to which the embodiment of the present application can be applied, and as shown in fig. 3, the computer electronic device includes a central processing module (CPU) 301 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 302 or a program loaded from a storage section 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data required for the system operation are also stored. The CPU 301, ROM 302, and RAM 303 are connected to each other through a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.
The following components are connected to the I/O interface 305: an input section 306 including a keyboard, a mouse, and the like; an output portion 307 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, a speaker, and the like; a storage section 308 including a hard disk or the like; and a communication section 309 including a network interface card such as a LAN card, a modem, or the like. The communication section 309 performs communication processing via a network such as the internet. The drive 310 is also connected to the I/O interface 305 as needed. A removable medium 311 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed on the drive 310 as needed, so that a computer program read out therefrom is installed into the storage section 308 as needed.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules or modules involved in the embodiments of the present application may be implemented in software or in hardware. The described modules or modules may also be provided in a processor, for example, as: a processor includes an acquisition module 201, an analysis processing module 202, a determination module 203, and a display module 204, where the names of these modules do not in some cases define the module itself, for example, the display module 204 may also be described as "a display module 204 for adjusting the size of a live effect according to the size of a blank area, and displaying the live effect in the blank area".
As another aspect, the present application also provides a computer-readable storage medium, which may be a computer-readable storage medium contained in an apparatus for exhibiting any special effects in a live scene as described in the above embodiments; or may be a computer-readable storage medium, alone, that is not incorporated into an electronic device. The computer-readable storage medium stores one or more programs for use by one or more processors to perform a method of exhibiting any special effects in a live scene as described in the present application.
The above description is only illustrative of the preferred embodiments of the present application and of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the application referred to in the present application is not limited to the specific combinations of the technical features described above, but also covers other technical features formed by any combination of the technical features described above or their equivalents without departing from the inventive concept. Such as the above-mentioned features and the technical features disclosed in the present application (but not limited to) having similar functions are replaced with each other.

Claims (9)

1. A method for exhibiting arbitrary special effects in a live scene, comprising:
acquiring a live stream; the live stream includes image data and sound data;
analyzing and processing the sound data, and converting the sound data into characters;
analyzing and processing the image data, and dividing the image into a plurality of areas; the plurality of regions includes: a portrait area, a things area and a blank area;
inquiring a live special effect database according to the characters, and determining the live special effect to be used; the live effect includes one or more of the following: linking countdown special effects, live house theme decorated special effects, or full screen poster campaign promotional special effects;
according to the size of the blank area, the size of the live special effect is adjusted, and the live special effect is displayed in the blank area;
the analyzing the image data to divide the image into a plurality of areas includes:
according to the portrait identification model, a portrait area in the image is determined;
determining an object area in the image according to the object identification model, and labeling information of objects in the image in the object area;
dividing an area except a portrait area and a thing area in the image into blank areas;
if the special effect clearly shows that the required area is large and the blank area is small, setting weights for the portrait area and the object area according to the property of the content in the live broadcasting room, setting the weights of the portrait area to be higher than the weights of the object area if the live broadcasting with performance property is performed, and setting the weights of the object area to be higher than the weights of the portrait area if the live broadcasting with cargo property is performed; and carrying out special effect display by combining the blank areas according to the weights of the different areas.
2. The method of claim 1, wherein the acquiring the live stream comprises:
acquiring application information corresponding to an application according to a window title and a brief introduction of the application;
judging the type of the application according to the application information;
and if the application is a live application, acquiring a live stream of the live application.
3. The method of claim 1, wherein the determining the live effect to use based on the text query live effect database comprises:
analyzing and processing the characters through a semantic analysis model, and determining the semantics corresponding to the characters;
and according to the semantic query, the live special effect database is queried, and the live special effect matched with the semantic is determined.
4. The method of claim 1, wherein the adjusting the size of the live effect according to the size of the blank area, and displaying the live effect in the blank area, comprises:
and displaying the live broadcast special effect in the blank area through a picture layer laminating technology and a green matting technology.
5. The method of any one of claims 1-4, further comprising:
presenting windows of all live applications in a user interface; and the window of the live broadcast application is used for user selection to add the live broadcast special effect.
6. An apparatus for displaying arbitrary special effects in a live scene, comprising:
the acquisition module is used for acquiring the live stream; the live stream includes image data and sound data;
the analysis processing module is used for analyzing and processing the sound data and converting the sound data into characters; analyzing and processing the image data, and dividing the image into a plurality of areas; the plurality of regions includes: a portrait area, a things area and a blank area;
the determining module is used for inquiring the live broadcast special effect database according to the characters and determining the live broadcast special effect to be used; the live effect includes one or more of the following: linking countdown special effects, live house theme decorated special effects, or full screen poster campaign promotional special effects;
the display module is used for adjusting the size of the live special effect according to the size of the blank area and displaying the live special effect in the blank area;
the analysis processing module is also used for determining a portrait area in the image according to a portrait identification model; determining an object area in the image according to the object identification model, and labeling information of objects in the image in the object area; dividing an area except a portrait area and a thing area in the image into blank areas;
if the special effect clearly shows that the required area is large and the blank area is small, setting weights for the portrait area and the object area according to the property of the content in the live broadcasting room, setting the weights of the portrait area to be higher than the weights of the object area if the live broadcasting with performance property is performed, and setting the weights of the object area to be higher than the weights of the portrait area if the live broadcasting with cargo property is performed; and carrying out special effect display by combining the blank areas according to the weights of the different areas.
7. The apparatus as recited in claim 6, further comprising:
a selection module for presenting windows of all live applications in a user interface; and the window of the live broadcast application is used for user selection to add the live broadcast special effect.
8. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program, the processor implementing the method according to any of claims 1 to 5 when the computer program is executed.
9. A computer readable storage medium, characterized in that a computer program is stored, which computer program, when being executed by a processor, implements the method according to any of claims 1 to 5.
CN202211448017.4A 2022-11-18 2022-11-18 Method and device for showing arbitrary special effects in live broadcast scene Active CN115720279B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211448017.4A CN115720279B (en) 2022-11-18 2022-11-18 Method and device for showing arbitrary special effects in live broadcast scene

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211448017.4A CN115720279B (en) 2022-11-18 2022-11-18 Method and device for showing arbitrary special effects in live broadcast scene

Publications (2)

Publication Number Publication Date
CN115720279A CN115720279A (en) 2023-02-28
CN115720279B true CN115720279B (en) 2023-09-15

Family

ID=85255601

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211448017.4A Active CN115720279B (en) 2022-11-18 2022-11-18 Method and device for showing arbitrary special effects in live broadcast scene

Country Status (1)

Country Link
CN (1) CN115720279B (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105578255A (en) * 2015-12-31 2016-05-11 合一网络技术(北京)有限公司 Advertisement playing method and device
CN107347166A (en) * 2016-08-19 2017-11-14 北京市商汤科技开发有限公司 Processing method, device and the terminal device of video image
CN108073669A (en) * 2017-01-12 2018-05-25 北京市商汤科技开发有限公司 Business object methods of exhibiting, device and electronic equipment
CN108322788A (en) * 2018-02-09 2018-07-24 武汉斗鱼网络科技有限公司 Advertisement demonstration method and device in a kind of net cast
AU2018282283A1 (en) * 2018-12-18 2020-07-02 Canon Kabushiki Kaisha Method, system and apparatus for displaying virtual content
CN111669612A (en) * 2019-03-08 2020-09-15 腾讯科技(深圳)有限公司 Live broadcast-based information delivery method and device and computer-readable storage medium
CN112040263A (en) * 2020-08-31 2020-12-04 腾讯科技(深圳)有限公司 Video processing method, video playing method, video processing device, video playing device, storage medium and equipment
CN113129045A (en) * 2019-12-31 2021-07-16 阿里巴巴集团控股有限公司 Video data processing method, video data display method, video data processing device, video data display device, electronic equipment and storage medium
CN113453030A (en) * 2021-06-11 2021-09-28 广州方硅信息技术有限公司 Audio interaction method and device in live broadcast, computer equipment and storage medium
CN113810729A (en) * 2021-09-16 2021-12-17 中国平安人寿保险股份有限公司 Live broadcast atmosphere special effect matching method, device, equipment and medium
CN114025219A (en) * 2021-11-01 2022-02-08 广州博冠信息科技有限公司 Rendering method, device, medium and equipment for augmented reality special effect
CN114025188A (en) * 2021-10-28 2022-02-08 广州虎牙科技有限公司 Live broadcast advertisement display method, system, device, terminal and readable storage medium
CN114095749A (en) * 2022-01-19 2022-02-25 阿里巴巴(中国)有限公司 Recommendation and live interface display method, computer storage medium and program product
CN114567805A (en) * 2022-02-24 2022-05-31 北京字跳网络技术有限公司 Method and device for determining special effect video, electronic equipment and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9264750B2 (en) * 2010-12-23 2016-02-16 Verizon Patent And Licensing Inc. Advertising insertion for playback of video streams on user devices
KR101694967B1 (en) * 2012-02-02 2017-01-10 한국전자통신연구원 Method and apparatus of interactive advertising service in digital broadcast system
WO2018033137A1 (en) * 2016-08-19 2018-02-22 北京市商汤科技开发有限公司 Method, apparatus, and electronic device for displaying service object in video image

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105578255A (en) * 2015-12-31 2016-05-11 合一网络技术(北京)有限公司 Advertisement playing method and device
CN107347166A (en) * 2016-08-19 2017-11-14 北京市商汤科技开发有限公司 Processing method, device and the terminal device of video image
CN108073669A (en) * 2017-01-12 2018-05-25 北京市商汤科技开发有限公司 Business object methods of exhibiting, device and electronic equipment
CN108322788A (en) * 2018-02-09 2018-07-24 武汉斗鱼网络科技有限公司 Advertisement demonstration method and device in a kind of net cast
AU2018282283A1 (en) * 2018-12-18 2020-07-02 Canon Kabushiki Kaisha Method, system and apparatus for displaying virtual content
CN111669612A (en) * 2019-03-08 2020-09-15 腾讯科技(深圳)有限公司 Live broadcast-based information delivery method and device and computer-readable storage medium
CN113129045A (en) * 2019-12-31 2021-07-16 阿里巴巴集团控股有限公司 Video data processing method, video data display method, video data processing device, video data display device, electronic equipment and storage medium
CN112040263A (en) * 2020-08-31 2020-12-04 腾讯科技(深圳)有限公司 Video processing method, video playing method, video processing device, video playing device, storage medium and equipment
CN113453030A (en) * 2021-06-11 2021-09-28 广州方硅信息技术有限公司 Audio interaction method and device in live broadcast, computer equipment and storage medium
CN113810729A (en) * 2021-09-16 2021-12-17 中国平安人寿保险股份有限公司 Live broadcast atmosphere special effect matching method, device, equipment and medium
CN114025188A (en) * 2021-10-28 2022-02-08 广州虎牙科技有限公司 Live broadcast advertisement display method, system, device, terminal and readable storage medium
CN114025219A (en) * 2021-11-01 2022-02-08 广州博冠信息科技有限公司 Rendering method, device, medium and equipment for augmented reality special effect
CN114095749A (en) * 2022-01-19 2022-02-25 阿里巴巴(中国)有限公司 Recommendation and live interface display method, computer storage medium and program product
CN114567805A (en) * 2022-02-24 2022-05-31 北京字跳网络技术有限公司 Method and device for determining special effect video, electronic equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
融媒体时代下视频弹幕的美学特性与受众分析;李鹏;;大众文艺(04);全文 *

Also Published As

Publication number Publication date
CN115720279A (en) 2023-02-28

Similar Documents

Publication Publication Date Title
CN108322788B (en) Advertisement display method and device in live video
US9271035B2 (en) Detecting key roles and their relationships from video
US9043860B2 (en) Method and apparatus for extracting advertisement keywords in association with situations of video scenes
CN110740387A (en) bullet screen editing method, intelligent terminal and storage medium
WO2021136363A1 (en) Video data processing and display methods and apparatuses, electronic device, and storage medium
WO2020259510A1 (en) Method and apparatus for detecting information embedding region, electronic device, and storage medium
CN111556332B (en) Live broadcast method, electronic device and readable storage medium
CN111131876B (en) Control method, device and terminal for live video and computer readable storage medium
WO2016173180A1 (en) Image-based information acquisition method and device
US11854238B2 (en) Information insertion method, apparatus, and device, and computer storage medium
CN114095749B (en) Recommendation and live interface display method, computer storage medium and program product
CN112911324B (en) Content display method and device for live broadcast room, server and storage medium
US20220415360A1 (en) Method and apparatus for generating synopsis video and server
CN111417024A (en) Scene recognition-based program recommendation method, system and storage medium
CN111432282A (en) Video recommendation method and device
CN111694983A (en) Information display method, information display device, electronic equipment and storage medium
CN113850627A (en) Elevator advertisement display method and device and electronic equipment
CN115720279B (en) Method and device for showing arbitrary special effects in live broadcast scene
CN112822539A (en) Information display method, device, server and storage medium
CN113076436A (en) VR device theme background recommendation method and system
KR20150031918A (en) Method of preparing an advertisement images on image materials, preparation system using the same, and playing method on prepared image data
CN113051481A (en) Content recommendation method and device, electronic equipment and medium
Lei [Retracted] Design of Digital Media Advertisement from the Perspective of Base Image Schema Based on Web
US20200226379A1 (en) Computer system, pavilion content changing method and program
CN112085532B (en) Advertisement insertion method, device, computer equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant