CN111277854A - Display method and device of virtual live broadcast room, electronic equipment and storage medium - Google Patents
Display method and device of virtual live broadcast room, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111277854A CN111277854A CN202010144594.9A CN202010144594A CN111277854A CN 111277854 A CN111277854 A CN 111277854A CN 202010144594 A CN202010144594 A CN 202010144594A CN 111277854 A CN111277854 A CN 111277854A
- Authority
- CN
- China
- Prior art keywords
- special effect
- virtual
- live broadcast
- article
- video data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000000694 effects Effects 0.000 claims abstract description 209
- 230000009471 action Effects 0.000 claims abstract description 24
- 238000004590 computer program Methods 0.000 claims description 18
- 230000006399 behavior Effects 0.000 claims description 16
- 230000003542 behavioural effect Effects 0.000 claims description 3
- 235000019646 color tone Nutrition 0.000 description 12
- 238000010586 diagram Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 9
- 230000002452 interceptive effect Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000001172 regenerating effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26291—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for providing content or additional data updates, e.g. updating software modules, stored at the client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention provides a display method and device of a virtual live broadcast room, electronic equipment and a storage medium, wherein the display method comprises the following steps: generating initial video data of a virtual live broadcast room; when a presenting action event sent by a client is received, determining a virtual article corresponding to the presenting action event; generating a gift special effect data packet containing the current color system information of the virtual live broadcast room aiming at the virtual article; generating target video data based on the initial video data and the gift special effect data packet; sending the target video data to a client; and the client is used for displaying the gift sending special effect of the virtual article according to the gift special effect data packet when the initial video data is played. The embodiment of the invention can realize the consistency of the color key of the virtual live broadcast room and the color key of the special effect of the given virtual article, and improve the consistency of the color key of the display picture of the virtual live broadcast room.
Description
Technical Field
The present invention relates to the field of live broadcast technologies, and in particular, to a method and an apparatus for displaying a virtual live broadcast room, an electronic device, and a storage medium.
Background
With the development of computer technology and network technology, more and more users watch live video, and live network has been widely popularized. Live users can present talent to audience users on a live video system by creating a live video room. When watching the live broadcast, the audience users can give gift information to the favorite live broadcast users so as to improve the interactive experience with the live broadcast users.
Currently, when a gift information is presented by a viewer user, a client generally sends a gift message protocol to a service end, the service end receives the message protocol, performs gift service behavior judgment, returns data of success and failure in presentation to the user to the client, and the client performs the next interactive behavior.
Because the gift interaction is realized based on the service server, when the service server is not responsible for video data transmission and the special effect is added to the video data triggered by the gift information, the client cannot synchronously display the gift information and the special effect in the video data.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are provided to provide a method for presenting a virtual live broadcast room, and a corresponding apparatus, electronic device and storage medium for presenting a virtual live broadcast room, which overcome or at least partially solve the above problems.
In order to solve the above problem, an embodiment of the present invention discloses a display method for a virtual live broadcast room, including:
generating initial video data of a virtual live broadcast room;
when a presenting action event sent by a client is received, determining a virtual article corresponding to the presenting action event;
generating a gift special effect data packet containing the current color system information of the virtual live broadcast room aiming at the virtual article;
generating target video data based on the initial video data and the gift special effect data packet;
sending the target video data to a client; and the client is used for displaying the gift sending special effect of the virtual article according to the gift special effect data packet when the initial video data is played.
Preferably, the gift special effect data package comprises background special effect data and item special effect data; the step of generating a gift special effect data packet containing current color system information of the virtual live broadcast room for the virtual article includes:
determining the current color system information of the virtual live broadcast room;
determining background special effect information and article special effect information corresponding to the virtual article;
generating background special effect data by adopting the color system information and the background special effect information;
generating article special effect data by adopting the color system information, the article special effect information and a preset trigger;
and generating gift special effect data based on the background special effect data and the article special effect data.
Preferably, the initial video data includes a plurality of frames of image information; the generating of the target video data based on the initial video data and the gift special effect data packet includes:
inserting the background special effect data and the article special effect data into the image information to generate target video data;
wherein the article special effect data corresponds to the first image information into which the background special effect data is inserted.
Preferably, the client is configured to display the article special effect information according to the color system information when the trigger is detected.
Preferably, after the sending the target video data to the client, the method further comprises:
when the duration of sending the target video data reaches a preset time threshold, stopping sending the target video data to a client;
generating the display stopping data by adopting the color system information, the article special effect information and the stopping mark;
sending the stop display data and the initial video data to the client; and the client is used for playing the initial video data and stopping displaying the article special effect information according to the color system information when the stop mark is detected.
Preferably, the step of determining the current color system information of the virtual live broadcast room includes:
identifying the color tone of the current live broadcast background of the virtual live broadcast room;
generating color system information corresponding to the color key;
the live broadcast background comprises any one of a real scene and a virtual scene.
Preferably, the method further comprises:
and when the live background of the virtual live broadcast room is changed, updating the color system information.
Preferably, the virtual article contains an article identification; after the determining the virtual item corresponding to the complimentary behavioral event, the method further comprises:
judging whether the article identification is consistent with any preset special effect identification;
and if so, executing the virtual article and generating a gift special effect data packet containing the current color system information of the virtual live broadcast room.
The embodiment of the invention also discloses a display device of the virtual live broadcast room, which comprises the following components:
the initial module is used for generating initial video data of a virtual live broadcast room;
the determining module is used for determining a virtual article corresponding to a presentation behavior event when the presentation behavior event sent by a client is received;
the generation module is used for generating a gift special effect data packet containing the current color system information of the virtual live broadcast room aiming at the virtual article;
a target module for generating target video data based on the initial video data and the gift special effect data packet;
the sending module is used for sending the target video data to a client; and the client is used for displaying the gift sending special effect of the virtual article according to the gift special effect data packet when the initial video data is played.
Preferably, the gift special effect data package comprises background special effect data and item special effect data; the generation module comprises:
the color system determining submodule is used for determining the current color system information of the virtual live broadcast room;
the special effect determining submodule is used for determining background special effect information and article special effect information corresponding to the virtual article;
the background special effect data submodule generates background special effect data by adopting the color system information and the background special effect information;
the article special effect data submodule is used for generating article special effect data by adopting the color system information, the article special effect information and a preset trigger;
and the gift special effect data submodule is used for generating gift special effect data based on the background special effect data and the article special effect data.
Preferably, the initial video data includes a plurality of frames of image information; the goal module 404 includes:
the inserting sub-module is used for inserting the background special effect data and the article special effect data into the image information to generate target video data;
wherein the article special effect data corresponds to the first image information into which the background special effect data is inserted.
Optionally, the client is configured to display the article special effect information according to the color system information when the trigger is detected.
Optionally, the apparatus further comprises:
the time threshold module is used for stopping executing the sending of the target video data to the client when the duration of sending the target video data reaches a preset time threshold;
the stopping data module is used for generating stopping display data by adopting the color system information, the article special effect information and the stopping mark;
the display stopping module is used for sending the display stopping data and the initial video data to the client; and the client is used for playing the initial video data and stopping displaying the article special effect information according to the color system information when the stop mark is detected.
Optionally, the color system determining sub-module includes:
the key tone identification unit is used for identifying the color key tone of the current live broadcast background of the virtual live broadcast room;
a color system information generating unit configured to generate color system information corresponding to the color key;
the live broadcast background comprises any one of a real scene and a virtual scene.
Optionally, the apparatus further comprises:
and the color system updating module is used for updating the color system information when the live background of the virtual live broadcast room is changed.
Optionally, the virtual item contains an item identification; the device further comprises:
the identification judgment module is used for judging whether the article identification is consistent with any preset special-effect identification;
and the identification consistency module is used for calling the generation module if the article identification is consistent with any preset special effect identification.
The embodiment of the invention also discloses electronic equipment which comprises a processor, a memory and a computer program which is stored on the memory and can run on the processor, wherein the computer program realizes the steps of the display method of the virtual live broadcast room when being executed by the processor.
The embodiment of the invention also discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and the computer program realizes the steps of the display method of the virtual live broadcast room when being executed by the processor.
The embodiment of the invention has the following advantages:
after receiving the presenting action event sent by the client, the server identifies the color key of the current virtual live broadcast room for the virtual article corresponding to the presenting action event, and then generates gift special effect data containing color system information corresponding to the current color key of the virtual live broadcast room. The gift special effect data is added into the initial video data to generate the target video data, so that when the client receives the target video data, the client can normally play the initial video data, and can display the gift sending special effect of the virtual article according to the color system information, the color tone of the virtual live broadcast room is consistent with that of the virtual article special effect, the consistency of the display image color tone of the virtual live broadcast room is improved, the display synchronism of the gift special effect and the background color tone of the virtual live broadcast room is ensured, and further, the interactive experience of audience users and anchor users is improved.
Drawings
FIG. 1 is a flowchart illustrating steps of an embodiment of a method for displaying a virtual live broadcast room according to the present invention;
FIG. 2 is a schematic diagram illustrating the display effect of a virtual live broadcast room according to the present invention;
FIG. 3 is a schematic view of a display process of a virtual live broadcast room according to the present invention;
fig. 4 is a block diagram of a display device of a virtual live broadcast room according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Referring to fig. 1, a flowchart illustrating steps of an embodiment of a method for displaying a virtual live broadcast room according to the present invention is shown.
The embodiment of the invention can be applied to the server side, and the server side is connected with the client side for communication. The clients may include a anchor user client as well as a viewer user client. The server specifically refers to a video streaming server, and the video streaming server is responsible for transmitting live video data to each client.
The virtual live room may be any type of live room on a live platform, and may include, for example and without limitation, a game-type live room, a movie-type live room, a life-type live room, an integrated-type live room, and so on. The virtual live room here can be any live room. When the audience user enters the virtual live broadcast room, the client side initializes the virtual live broadcast room player and the video stream gift code.
In one example, the virtual live broadcast station player may be flv.js, which plays the data by acquiring the data in flv format from the server and converting the data in flv format into data in mp4(MPEG-4) format.
The embodiment of the invention specifically comprises the following steps:
the server may collect anchor video data of an anchor user, and the anchor video data may be data collected by an anchor user client. The server may use the anchor video data as the initial video data of the virtual live broadcast room, or use the anchor video data as the initial video data after image processing (e.g., adding a filter effect, adding a virtual background, etc.).
audience users can log in any one virtual live broadcast room, a virtual article (such as a live broadcast room gift) list can be arranged in the virtual live broadcast room, and the audience users can trigger presentation behavior events aiming at different virtual articles, such as: and after any virtual item is selected from the list, selecting to be given to the anchor user of the virtual live broadcast room.
The client of the audience user can collect the corresponding presentation behavior event and send the presentation behavior event to the server. When receiving the presenting action event, the server side can analyze the presenting action event and extract relevant information including virtual articles, audience user information and the like corresponding to the presenting action event.
103, generating a gift special effect data packet containing the current color system information of the virtual live broadcast room aiming at the virtual article;
after determining the virtual article corresponding to the presenting action event, the server may generate gift special effect data including the current color system information of the virtual live broadcast room based on the virtual article. And matching the current color system information of the virtual live broadcast room with the current color key of the virtual live broadcast room.
104, generating target video data based on the initial video data and the gift special effect data packet;
and combining the initial video data and the gift special effect data packet to generate target video data.
And the server side sends the generated target video data to the client side. And after receiving the target video data, the client analyzes the target video data, and displays the gift sending special effect of the virtual article according to the gift special effect data packet while playing the initial video data.
In the embodiment of the invention, after the presenting action event sent by the client is received, the gift special effect data containing the color system information corresponding to the current color key of the virtual live broadcast room is generated after the color key of the current virtual live broadcast room is identified for the virtual article corresponding to the presenting action event. The gift special effect data is added into the initial video data to generate the target video data, so that when the client receives the target video data, the client can normally play the initial video data, and can display the gift sending special effect of the virtual article according to the color system information, the color tone of the virtual live broadcast room is consistent with that of the virtual article special effect, the consistency of the display image color tone of the virtual live broadcast room is improved, the display synchronism of the gift special effect and the background color tone of the virtual live broadcast room is ensured, and further, the interactive experience of audience users and anchor users is improved.
In one embodiment of the invention, the gift effect data package includes background effect data and item effect data; the step 103 may include: determining the current color system information of the virtual live broadcast room; determining background special effect information and article special effect information corresponding to the virtual article; generating background special effect data by adopting the color system information and the background special effect information; generating article special effect data by adopting the color system information, the article special effect information and a preset trigger; and generating a gift special effect data packet based on the background packet special effect data and the article special effect data.
The color of the background of the virtual live broadcast room can be identified, and the current color system information of the virtual live broadcast room is determined.
The background special effect information may refer to a plurality of pieces of background image information, and when the target video data is generated, the background image information is inserted into the image information of each piece of initial video data, so that the client can play the initial video data and the background characteristic data at the same time.
In a specific implementation, the article special effect information may include, but is not limited to, a head portrait URL corresponding to the presentation behavior event, a nickname, and an SVGA (Uniform Resource Locator) special effect URL (Uniform Resource Locator) corresponding to the virtual article, and the like, and when the client displays the article special effect data, the client can display the head portrait corresponding to the head portrait URL and display a special effect corresponding to the SVGA special effect URL.
In one embodiment of the present invention, the initial video data includes a plurality of frames of image information; step 104 comprises: inserting the background special effect data and the article special effect data into the image information to generate target video data; wherein the article special effect data corresponds to the first image information into which the background special effect data is inserted.
Target video data is generated by inserting background special effect data and item special effect data into the initial video data. The article characteristic data is inserted into the first image information inserted with the background characteristic data, so that high synchronism of the background characteristic data and article special effect data displayed in the client is guaranteed.
Referring to fig. 2, which illustrates a schematic view of a display effect of a virtual live broadcast room in an embodiment of the present invention, background special effect data (as shown in 201) may refer to animation added in the virtual live broadcast room (e.g., animal animation, plant animation, object animation, etc.), and article characteristic data (as shown in 202) may refer to an image displayed in the virtual live broadcast to represent corresponding information of a give-away behavior event.
In an embodiment of the present invention, the client is configured to display the article special effect information according to the color system information when the trigger is detected.
The article special effect data may be a NALU (Network Abstract Layer Unit) package, and a trigger represented by a specified character string (for example, a soft _ type, which is a trigger when the soft _ type is 1) may be set in the article special effect data. The client is provided with an inserting code for detecting whether the data sent by the server contains a trigger mark, and when the inserting code detects the trigger mark, the client is controlled to display the characteristic data of the article.
In an embodiment of the present invention, after the sending the target video data to the client, the method further includes: when the duration of sending the target video data reaches a preset time threshold, stopping sending the target video data to a client; generating the display stopping data by adopting the color system information, the article special effect information and the stopping mark; sending the stop display data and the initial video data to the client; and the client is used for playing the initial video data and stopping displaying the article special effect information according to the color system information when the stop mark is detected.
The server may be provided with a presentation delay, and the server may count the time for transmitting the target video data after generating the target video data, and enter a flow of stopping presentation of the background characteristic data and the gift characteristic data when the count reaches a time threshold. And then generating display stopping data, stopping inserting background special effect data into the initial video data, sending the initial video data and the display stopping data to the client, and stopping playing the article characteristic data while keeping playing the initial video data after the client receives the display stopping data.
The stop presentation data may be a NALU packet, and a trigger (e.g., a soft _ type, or a stop flag when the soft _ type is 0) represented by a specified string may be set in the stop presentation data. And the client is provided with an inserting code for detecting whether the data sent by the server contains a stop mark, and when the inserting code detects the stop mark, the client is controlled to stop displaying the characteristic data of the article.
In an embodiment of the present invention, the step of determining the current color system information of the virtual live broadcast room includes: identifying the color tone of the current live broadcast background of the virtual live broadcast room; generating color system information corresponding to the color key; the live broadcast background comprises any one of a real scene and a virtual scene.
The current color key of the virtual live broadcast room can be determined by identifying the current virtual live broadcast room, and corresponding color system information is generated based on the color key.
For example: and when the current scene of the virtual live broadcast room is identified to be mainly red, generating color system information corresponding to the red. The color system information may be encoded by ordered characters, such as: the RED, the # FF3030, the 255,0, and the like, in the embodiment of the present invention, the encoding method of the color system information is limited, and only the color system information needs to be recognized by the server and the client.
As an example, the live background may be a virtual scene, and the server may provide the virtual scene with a plurality of different color tones for the anchor user to select. The current color key of the virtual live broadcast room is determined by determining the latest virtual background (or color key) selection of the anchor user, and further the current color system information is determined.
As another example, the live broadcast background may be a real scene, and color recognition may be directly performed on the background of the virtual live broadcast room, so as to determine the current color system information of the virtual live broadcast room.
In one embodiment of the invention, the method further comprises: and when the live background of the virtual live broadcast room is changed, updating the color system information.
And when recognizing that the background of the virtual live broadcast room is changed, the server re-determines the current color key of the virtual live broadcast room and updates the color system information. And regenerating background special effect data and article special effect data according to the updated color system information, so that the background special effect data and the article special effect data in the virtual live broadcast room are highly consistent with the color key of the virtual live broadcast room.
In one embodiment of the invention, the virtual item comprises an item identifier; after the determining the virtual item corresponding to the complimentary behavioral event, the method may further include: judging whether the article identification is consistent with any preset special effect identification; if the article identifier is consistent with any preset special effect identifier, the step 103 is executed.
The virtual live broadcast room can provide non-effective gifts (namely virtual articles which do not trigger background special effect data and do not trigger article special effect data) and special effect gifts (namely virtual articles which trigger background special effect data and trigger article special effect data) for audience users at the same time. The preset special effect identification corresponds to the special effect gift, the server compares the article identification corresponding to the presenting action event with the characteristic identification, so as to judge whether the virtual article corresponding to the presenting action event is the characteristic gift, and if the virtual article is the special effect gift, step 103 is executed.
In the embodiment of the invention, after receiving the presenting behavior event sent by the client, the server can identify the color key of the current virtual live broadcast room to generate the corresponding color system information, and generate the background special effect data and the article special effect data corresponding to the color system information for the virtual article corresponding to the presenting behavior event. By adding the background special effect data and the article special effect data into the initial video data to generate the target video data, when the client receives the target video data, the client can normally play the initial video data and can also play the background special effect data and the article special effect data according to the color system information, so that the color tone of a virtual live broadcast room is consistent with the background characteristic data of a given virtual article and the color tone of the article special effect data, the consistency of the color tone of a display picture of the virtual live broadcast room is improved, the synchronism of the display of the background special effect data and the article special effect data is ensured, and further, the interactive experience of audience users and anchor users is improved.
The following further illustrates an embodiment of the present invention by way of an example.
Referring to fig. 3, a flowchart of a method for displaying a virtual live broadcast room according to the present invention is shown. The user client may first initialize the live broadcast room, which may include initializing the player and initializing the item fields where the spectator user may select the complimentary virtual item.
This example may specifically include the following steps:
s001: the user client triggers the virtual live broadcast room gift sending behavior, and the user client informs the video streaming server through websocket service.
S002: and the video streaming server checks the gift sending logic and judges that the gift sending behavior fails to succeed.
S003: and (5) checking that the gift sending behavior is successful, and triggering a video stream gift flow. The process is as follows: 1. the virtual live room video stream adds a gift MP4 background package. 2. The NALU gift special effect trigger packet is inserted into the data of the background packet and the frame of the add-on gift MP 4. 3. Setting a video stream special effect gift delay (for example, 10 seconds, 20 seconds, 30 seconds and the like) closing operation, removing a gift MP4 background packet when a closing point is reached (namely, the video stream special effect gift delay is met), and inserting a NALU gift special effect closing packet in the data of the removed gift MP4 background packet and a frame.
S004: and subtracting the gift amount from the balance of the user aiming at the database.
S005: NALU gift package monitoring. The user client initiates player process instrumentation (monitoring of NALU packets), finds a NALU gift special effect packet (type of this NALU packet is equal to 0x1f (16 systems), 31 decimal), and then triggers video stream gift special effect action:
1) when the nalu package gift _ type is 1, the gift special effect is triggered, and the client plays the SVGA gift special effect.
2) When the nalu packet gift _ type is 0, the gift special effect is closed, and the client removes the SVGA gift special effect.
R001: and the video streaming server returns the gift delivery failure information.
R002: and closing the gift interaction by the video streaming server, and removing the SVGA gift special effect.
R003: and the video streaming server triggers the successful gift delivery interaction and plays the SVGA gift special effect.
R004: and the video streaming server returns the gift sending success information.
R005: and triggering a gift delivery failure reminding interaction by the video streaming server.
The S series of steps is a process that the client side uploads to the server side, and the R series of steps is a process that the server side returns to the client side.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 4, a block diagram of a structure of an embodiment of a presentation apparatus of a virtual live broadcast room in the present invention is shown, which may specifically include the following modules:
an initial module 401, configured to generate initial video data of a virtual live broadcast room;
a determining module 402, configured to determine, when a presenting action event sent by a client is received, a virtual item corresponding to the presenting action event;
a generating module 403, configured to generate, for the virtual article, a gift special effect data packet including current color system information of the virtual live broadcast room;
a target module 404, configured to generate target video data based on the initial video data and the gift special effect data packet;
a sending module 405, configured to send the target video data to a client; and the client is used for displaying the gift sending special effect of the virtual article according to the gift special effect data packet when the initial video data is played.
In an optional embodiment of the invention, the gift effect data package comprises background effect data and item effect data; the generating module 403 includes:
the color system determining submodule is used for determining the current color system information of the virtual live broadcast room;
the special effect determining submodule is used for determining background special effect information and article special effect information corresponding to the virtual article;
the background special effect data submodule generates background special effect data by adopting the color system information and the background special effect information;
the article special effect data submodule is used for generating article special effect data by adopting the color system information, the article special effect information and a preset trigger;
and the gift special effect data submodule is used for generating gift special effect data based on the background special effect data and the article special effect data.
In an optional embodiment of the present invention, the initial video data comprises a plurality of frames of image information; the goal module 404 includes:
the inserting sub-module is used for inserting the background special effect data and the article special effect data into the image information to generate target video data;
wherein the article special effect data corresponds to the first image information into which the background special effect data is inserted.
In an optional embodiment of the present invention, the client is configured to, when the trigger is detected, display the article special effect information according to the color system information.
In an optional embodiment of the invention, the apparatus further comprises:
the time threshold module is used for stopping executing the sending of the target video data to the client when the duration of sending the target video data reaches a preset time threshold;
the stopping data module is used for generating stopping display data by adopting the color system information, the article special effect information and the stopping mark;
the display stopping module is used for sending the display stopping data and the initial video data to the client; and the client is used for playing the initial video data and stopping displaying the article special effect information according to the color system information when the stop mark is detected.
In an optional embodiment of the invention, the color system determining sub-module comprises:
the key tone identification unit is used for identifying the color key tone of the current live broadcast background of the virtual live broadcast room;
a color system information generating unit configured to generate color system information corresponding to the color key;
the live broadcast background comprises any one of a real scene and a virtual scene.
In an optional embodiment of the invention, the apparatus further comprises:
and the color system updating module is used for updating the color system information when the live background of the virtual live broadcast room is changed.
In an optional embodiment of the invention, the virtual article comprises an article identification; the device further comprises:
the identification judgment module is used for judging whether the article identification is consistent with any preset special-effect identification;
and the identification consistency module is used for calling the generation module if the article identification is consistent with any preset special effect identification.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiment of the invention also discloses electronic equipment which comprises a processor, a memory and a computer program which is stored on the memory and can run on the processor, wherein the computer program realizes the steps of the display method of the virtual live broadcast room when being executed by the processor.
The embodiment of the invention also discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and the computer program realizes the steps of the display method of the virtual live broadcast room when being executed by the processor.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The method for displaying the virtual live broadcast room, the device for displaying the virtual live broadcast room, the electronic device and the storage medium provided by the invention are described in detail, specific examples are applied in the text to explain the principle and the implementation of the invention, and the description of the above embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (11)
1. A display method of a virtual live broadcast room is characterized by comprising the following steps:
generating initial video data of a virtual live broadcast room;
when a presenting action event sent by a client is received, determining a virtual article corresponding to the presenting action event;
generating a gift special effect data packet containing the current color system information of the virtual live broadcast room aiming at the virtual article;
generating target video data based on the initial video data and the gift special effect data packet;
sending the target video data to a client; and the client is used for displaying the gift sending special effect of the virtual article according to the gift special effect data packet when the initial video data is played.
2. The method of claim 1, wherein the gift special effect data package includes background special effect data and item special effect data; the step of generating a gift special effect data packet containing current color system information of the virtual live broadcast room for the virtual article includes:
determining the current color system information of the virtual live broadcast room;
determining background special effect information and article special effect information corresponding to the virtual article;
generating background special effect data by adopting the color system information and the background special effect information;
generating article special effect data by adopting the color system information, the article special effect information and a preset trigger;
and generating gift special effect data based on the background special effect data and the article special effect data.
3. The method of claim 2, wherein the initial video data comprises a plurality of frames of image information; the generating of the target video data based on the initial video data and the gift special effect data packet includes:
inserting the background special effect data and the article special effect data into the image information to generate target video data;
wherein the article special effect data corresponds to the first image information into which the background special effect data is inserted.
4. The method of claim 2,
and the client is used for displaying the article special effect information according to the color system information when the trigger mark is detected.
5. The method of claim 2, wherein after the sending the target video data to a client, the method further comprises:
when the duration of sending the target video data reaches a preset time threshold, stopping sending the target video data to a client;
generating the display stopping data by adopting the color system information, the article special effect information and the stopping mark;
sending the stop display data and the initial video data to the client; and the client is used for playing the initial video data and stopping displaying the article special effect information according to the color system information when the stop mark is detected.
6. The method of claim 1, wherein the step of determining the current color family information of the virtual live broadcast room comprises:
identifying the color tone of the current live broadcast background of the virtual live broadcast room;
generating color system information corresponding to the color key;
the live broadcast background comprises any one of a real scene and a virtual scene.
7. The method of claim 6, further comprising:
and when the live background of the virtual live broadcast room is changed, updating the color system information.
8. The method of claim 1, wherein the virtual item comprises an item identifier; after the determining the virtual item corresponding to the complimentary behavioral event, the method further comprises:
judging whether the article identification is consistent with any preset special effect identification;
and if so, executing the virtual article and generating a gift special effect data packet containing the current color system information of the virtual live broadcast room.
9. A presentation device of a virtual live broadcast room, comprising:
the initial module is used for generating initial video data of a virtual live broadcast room;
the determining module is used for determining a virtual article corresponding to a presentation behavior event when the presentation behavior event sent by a client is received;
the generation module is used for generating a gift special effect data packet containing the current color system information of the virtual live broadcast room aiming at the virtual article;
a target module for generating target video data based on the initial video data and the gift special effect data packet;
the sending module is used for sending the target video data to a client; and the client is used for displaying the gift sending special effect of the virtual article according to the gift special effect data packet when the initial video data is played.
10. An electronic device comprising a processor, a memory, and a computer program stored on the memory and capable of running on the processor, the computer program, when executed by the processor, implementing the steps of the presentation method of a virtual live broadcast room as claimed in any one of claims 1 to 8.
11. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the presentation method of a virtual live broadcast room according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010144594.9A CN111277854A (en) | 2020-03-04 | 2020-03-04 | Display method and device of virtual live broadcast room, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010144594.9A CN111277854A (en) | 2020-03-04 | 2020-03-04 | Display method and device of virtual live broadcast room, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111277854A true CN111277854A (en) | 2020-06-12 |
Family
ID=70999339
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010144594.9A Pending CN111277854A (en) | 2020-03-04 | 2020-03-04 | Display method and device of virtual live broadcast room, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111277854A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111669640A (en) * | 2020-06-18 | 2020-09-15 | 广州繁星互娱信息科技有限公司 | Virtual article transfer special effect display method, device, terminal and storage medium |
| CN111784418A (en) * | 2020-07-27 | 2020-10-16 | 网易（杭州）网络有限公司 | Display control method and device for live broadcast room, computer medium and electronic equipment |
| CN112118477A (en) * | 2020-09-21 | 2020-12-22 | 北京达佳互联信息技术有限公司 | Virtual gift display method, device, equipment and storage medium |
| CN113163253A (en) * | 2021-03-23 | 2021-07-23 | 五八有限公司 | Live broadcast interaction method and device, electronic equipment and readable storage medium |
| CN113360034A (en) * | 2021-05-20 | 2021-09-07 | 广州博冠信息科技有限公司 | Picture display method and device, computer equipment and storage medium |
| CN114095751A (en) * | 2021-09-30 | 2022-02-25 | 广州方硅信息技术有限公司 | Background processing method of live related page, electronic device and storage medium |
| CN114374852A (en) * | 2020-10-14 | 2022-04-19 | 武汉斗鱼鱼乐网络科技有限公司 | Method, device, equipment and medium for constructing special effect |
| CN114501041A (en) * | 2021-04-06 | 2022-05-13 | 北京字节跳动网络技术有限公司 | Special effect display method, device, equipment, storage medium and product |
| CN115225923A (en) * | 2022-06-09 | 2022-10-21 | 广州博冠信息科技有限公司 | Gift special effect rendering method and device, electronic equipment and live broadcast server |
| CN115460435A (en) * | 2022-08-25 | 2022-12-09 | 广州博冠信息科技有限公司 | Special effect animation playing method and device, storage medium and computer equipment |
| WO2023040970A1 (en) * | 2021-09-15 | 2023-03-23 | 北京字跳网络技术有限公司 | Interactive method and apparatus, electronic device, and storage medium |
| CN116366909A (en) * | 2023-05-31 | 2023-06-30 | 北京达佳互联信息技术有限公司 | Virtual article processing method and device, electronic equipment and storage medium |
| WO2023221761A1 (en) * | 2022-05-17 | 2023-11-23 | 北京字跳网络技术有限公司 | Special effect display method and apparatus, electronic device, and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106375775A (en) * | 2016-09-26 | 2017-02-01 | 广州华多网络科技有限公司 | Virtual gift display method and apparatus |
| CN106911937A (en) * | 2017-03-31 | 2017-06-30 | 武汉斗鱼网络科技有限公司 | The collocation method and system of a kind of live middle present banner background colour |
| US20180098028A1 (en) * | 2015-09-08 | 2018-04-05 | Tencent Technology (Shenzhen) Company Limited | Display control method and apparatus |
| CN109246452A (en) * | 2018-08-09 | 2019-01-18 | 广州酷狗计算机科技有限公司 | virtual gift display method and device |
| CN110418155A (en) * | 2019-08-08 | 2019-11-05 | 腾讯科技（深圳）有限公司 | Living broadcast interactive method, apparatus, computer readable storage medium and computer equipment |
| CN110493630A (en) * | 2019-09-11 | 2019-11-22 | 广州华多网络科技有限公司 | The treating method and apparatus of virtual present special efficacy, live broadcast system |
-
2020
- 2020-03-04 CN CN202010144594.9A patent/CN111277854A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180098028A1 (en) * | 2015-09-08 | 2018-04-05 | Tencent Technology (Shenzhen) Company Limited | Display control method and apparatus |
| CN106375775A (en) * | 2016-09-26 | 2017-02-01 | 广州华多网络科技有限公司 | Virtual gift display method and apparatus |
| CN106911937A (en) * | 2017-03-31 | 2017-06-30 | 武汉斗鱼网络科技有限公司 | The collocation method and system of a kind of live middle present banner background colour |
| CN109246452A (en) * | 2018-08-09 | 2019-01-18 | 广州酷狗计算机科技有限公司 | virtual gift display method and device |
| CN110418155A (en) * | 2019-08-08 | 2019-11-05 | 腾讯科技（深圳）有限公司 | Living broadcast interactive method, apparatus, computer readable storage medium and computer equipment |
| CN110493630A (en) * | 2019-09-11 | 2019-11-22 | 广州华多网络科技有限公司 | The treating method and apparatus of virtual present special efficacy, live broadcast system |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111669640A (en) * | 2020-06-18 | 2020-09-15 | 广州繁星互娱信息科技有限公司 | Virtual article transfer special effect display method, device, terminal and storage medium |
| CN111784418A (en) * | 2020-07-27 | 2020-10-16 | 网易（杭州）网络有限公司 | Display control method and device for live broadcast room, computer medium and electronic equipment |
| CN111784418B (en) * | 2020-07-27 | 2023-08-08 | 网易（杭州）网络有限公司 | Display control method and device for live broadcasting room, computer medium and electronic equipment |
| CN112118477A (en) * | 2020-09-21 | 2020-12-22 | 北京达佳互联信息技术有限公司 | Virtual gift display method, device, equipment and storage medium |
| CN114374852B (en) * | 2020-10-14 | 2024-05-14 | 武汉斗鱼鱼乐网络科技有限公司 | Special effect construction method, device, equipment and medium |
| CN114374852A (en) * | 2020-10-14 | 2022-04-19 | 武汉斗鱼鱼乐网络科技有限公司 | Method, device, equipment and medium for constructing special effect |
| CN113163253A (en) * | 2021-03-23 | 2021-07-23 | 五八有限公司 | Live broadcast interaction method and device, electronic equipment and readable storage medium |
| CN113163253B (en) * | 2021-03-23 | 2023-03-24 | 五八有限公司 | Live broadcast interaction method and device, electronic equipment and readable storage medium |
| CN114501041A (en) * | 2021-04-06 | 2022-05-13 | 北京字节跳动网络技术有限公司 | Special effect display method, device, equipment, storage medium and product |
| CN114501041B (en) * | 2021-04-06 | 2023-07-14 | 抖音视界有限公司 | Special effect display method, device, equipment and storage medium |
| CN113360034A (en) * | 2021-05-20 | 2021-09-07 | 广州博冠信息科技有限公司 | Picture display method and device, computer equipment and storage medium |
| WO2023040970A1 (en) * | 2021-09-15 | 2023-03-23 | 北京字跳网络技术有限公司 | Interactive method and apparatus, electronic device, and storage medium |
| CN114095751A (en) * | 2021-09-30 | 2022-02-25 | 广州方硅信息技术有限公司 | Background processing method of live related page, electronic device and storage medium |
| WO2023221761A1 (en) * | 2022-05-17 | 2023-11-23 | 北京字跳网络技术有限公司 | Special effect display method and apparatus, electronic device, and storage medium |
| CN115225923A (en) * | 2022-06-09 | 2022-10-21 | 广州博冠信息科技有限公司 | Gift special effect rendering method and device, electronic equipment and live broadcast server |
| CN115225923B (en) * | 2022-06-09 | 2024-03-22 | 广州博冠信息科技有限公司 | Method and device for rendering gift special effects, electronic equipment and live broadcast server |
| CN115460435A (en) * | 2022-08-25 | 2022-12-09 | 广州博冠信息科技有限公司 | Special effect animation playing method and device, storage medium and computer equipment |
| CN116366909B (en) * | 2023-05-31 | 2023-10-17 | 北京达佳互联信息技术有限公司 | Virtual article processing method and device, electronic equipment and storage medium |
| CN116366909A (en) * | 2023-05-31 | 2023-06-30 | 北京达佳互联信息技术有限公司 | Virtual article processing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111277854A (en) | Display method and device of virtual live broadcast room, electronic equipment and storage medium | |
| CN109089154B (en) | Video extraction method, device, equipment and medium | |
| CN109089127B (en) | Video splicing method, device, equipment and medium | |
| CN108184144B (en) | Live broadcast method and device, storage medium and electronic equipment | |
| CN103763626B (en) | A kind of information-pushing method, equipment and system | |
| CN107666619B (en) | Live data transmission method, device, electronic equipment, server and storage medium | |
| US20160316233A1 (en) | System and method for inserting, delivering and tracking advertisements in a media program | |
| CN110731085B (en) | Detecting and responding to presentation of interactive video content | |
| CN108182607A (en) | The advertisement monitoring system and method uploaded based on terminal sectional drawing | |
| EP2679002B1 (en) | Broadcasting an information signal having special content for triggering an appropriate action in a user device. | |
| KR101883018B1 (en) | Method and device for providing supplementary content in 3d communication system | |
| CN108521584B (en) | Interactive information processing method, device, anchor side equipment and medium | |
| CN108171160B (en) | Task result identification method and device, storage medium and electronic equipment | |
| US20150358507A1 (en) | Timing recovery for embedded metadata | |
| CN110519627B (en) | Audio data synchronization method and device | |
| CN111444415B (en) | Barrage processing method, server, client, electronic equipment and storage medium | |
| CN101232612A (en) | Assistant medium playing method triggered based on video contents | |
| CN108574877B (en) | Live broadcast method, anchor terminal, audience terminal, equipment, system and storage medium | |
| US9961415B2 (en) | Method and system for identifying events in a streaming media program | |
| CN110139128B (en) | Information processing method, interceptor, electronic equipment and storage medium | |
| CN110809172A (en) | Interactive special effect display method and device and electronic equipment | |
| CN112492324A (en) | Data processing method and system | |
| WO2022155107A1 (en) | Synchronizing secondary audiovisual content based on frame transitions in streaming content | |
| EP1049984A1 (en) | Method and system for client-server interaction in interactive communications | |
| CN109999490B (en) | Method and system for reducing networking cloud application delay |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200612 |