CN112637618B - Live broadcast playback video generation method and device, electronic equipment and computer medium - Google Patents
Live broadcast playback video generation method and device, electronic equipment and computer medium Download PDFInfo
- Publication number
- CN112637618B CN112637618B CN202011446418.7A CN202011446418A CN112637618B CN 112637618 B CN112637618 B CN 112637618B CN 202011446418 A CN202011446418 A CN 202011446418A CN 112637618 B CN112637618 B CN 112637618B
- Authority
- CN
- China
- Prior art keywords
- gift
- video
- live
- sending
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47214—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
Abstract
The disclosure relates to a method and a device for generating live broadcast playback video, electronic equipment and a computer readable medium, and belongs to the technical field of live broadcast. The method comprises the following steps: responding to a gift sending operation on a live audience client, and displaying a gift sending video collection control related to the gift sending operation on a live broadcast interface of the anchor client and/or a live broadcast interface of the audience client corresponding to the gift sending operation; responding to gift video collection operation acted on the gift video collection control on any client side, and acquiring gift playback video corresponding to the gift operation; and generating a gift icon corresponding to the gift playback video, and displaying the gift icon in a favorite of a client live interface corresponding to the gift video collection operation. According to the method and the device, the live video clips of the user gift sending process are obtained and stored in the favorites, so that the requirement of the user for reviewing the gift sending process at any time can be met.
Description
Technical Field
The disclosure relates to the field of live broadcast technology, and in particular relates to a method for generating live broadcast playback video, a device for generating live broadcast playback video, electronic equipment and a computer readable medium.
Background
With the rapid development of the network live broadcast industry, more and more users are on the network, and live broadcast room gift sending is one of the most common functions in the process of watching live broadcast by users, and the host will also give a certain response to gifts sent by users.
For many users, the gifts sent out in the living broadcast room often go through along with the display of the gifts special effects, if the user wants to review the self gifts and the reactions of the host, the user can only download the complete living broadcast video and search for the corresponding time point to watch by dragging the progress bar.
In view of the foregoing, there is a need in the art for a method of generating live playback video that is capable of rapidly playing back a user gifting process.
It should be noted that the information disclosed in the above background section is only for enhancing understanding of the background of the present disclosure and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
The present disclosure is directed to a method for generating a live playback video, an apparatus for generating a live playback video, an electronic device, and a computer-readable medium, so as to help a user to quickly play back a video clip of a gift sending process at least to some extent.
According to a first aspect of the present disclosure, there is provided a method for generating live playback video, including:
responding to a gift sending operation on a live audience client, and displaying a gift sending video collection control related to the gift sending operation on a live broadcast interface of the anchor client and/or a live broadcast interface of the audience client corresponding to the gift sending operation;
responding to gift video collection operation acted on the gift video collection control on any client side, and acquiring gift playback video corresponding to the gift operation;
and generating a gift icon corresponding to the gift playback video, and displaying the gift icon in a favorite of a client live interface corresponding to the gift video collection operation.
In an exemplary embodiment of the present disclosure, after the displaying the gift icon in the favorites of the client live interface corresponding to the gift video collection operation, the method further includes:
and responding to the gift process playback operation acted on the gift icon, acquiring a gift playback video corresponding to the gift icon, and playing the gift playback video on the current client.
In an exemplary embodiment of the present disclosure, the responding to the gift video collection operation acted on the gift video collection control on any one client, obtaining a gift playback video corresponding to the gift operation, includes:
Responding to gift sending video collection operation acted on the gift sending video collection control on any client to acquire a live video stream and a corresponding gift special effect file in the gift sending process;
and synthesizing the live video stream in the gift sending process and the corresponding gift special effect file to obtain a gift sending playback video corresponding to the gift sending operation.
In an exemplary embodiment of the present disclosure, the acquiring the live video stream of the gift sending process and the corresponding gift special effect file includes:
acquiring gift sending time corresponding to the gift sending operation, and acquiring gift special effect display time from the gift special effect file;
and intercepting a live video stream in the gift sending process according to the gift sending time and the gift special effect display time.
In an exemplary embodiment of the present disclosure, the acquiring the live video stream of the gift sending process and the corresponding gift special effect file includes:
acquiring a gift special effect file and a section of live video stream containing the preset time length of the gift sending process;
and responding to the video interception operation on the live video stream with the preset time length to obtain the live video stream in the gift sending process.
In an exemplary embodiment of the present disclosure, the displaying, in response to a gift operation on a live audience client, a gift video collection control related to the gift operation on a live interface of the anchor client and/or a live interface of an audience client corresponding to the gift operation includes:
and responding to the gift sending operation on the live audience client, and displaying a gift sending video collection control related to the gift sending operation on a live interface of the anchor client and/or a live interface of the audience client corresponding to the gift sending operation when the gift value is greater than or equal to the gift value threshold.
In an exemplary embodiment of the present disclosure, the displaying, in response to a gift operation on a live audience client, a gift video collection control related to the gift operation on a live interface of the anchor client and/or a live interface of an audience client corresponding to the gift operation includes:
and responding to the gift sending operation on the live audience client, and displaying a gift sending video collection control related to the gift sending operation on a live interface of the anchor client and/or a live interface of the audience client corresponding to the gift sending operation when the number of gifts is greater than or equal to a gift number threshold.
In an exemplary embodiment of the present disclosure, the displaying, on the live interface of the anchor client and/or the live interface of the viewer client corresponding to the gift sending operation, a gift sending video collection control related to the gift sending operation includes:
and displaying gift sending video collection controls related to the gift sending operation at the appointed positions of the bullet screen information corresponding to the gift sending operation and displayed on the live broadcast interface of the host client and/or the live broadcast interface of the audience client corresponding to the gift sending operation.
In an exemplary embodiment of the present disclosure, the displaying the gift icon in a favorites of a client live interface corresponding to the gift video collection operation includes:
and acquiring the gift collection time corresponding to the gift sending video collection operation, displaying the gift icon, the corresponding gift name and the gift collection time in the favorites of the client live interface corresponding to the gift sending video collection operation.
In an exemplary embodiment of the present disclosure, the method further comprises:
responsive to a gift operation on the spectator client, displaying a return control associated with the gift operation on a live interface of the anchor client;
And responding to the gift returning operation acted on the gift returning control on the anchor client, and sending out the gift from the anchor client to the audience client corresponding to the gift sending operation.
In an exemplary embodiment of the present disclosure, the method further comprises:
responsive to a gifting operation on the spectator client, displaying a follow-up control related to the gifting operation on a live interface of other spectator clients except for the spectator client corresponding to the gifting operation;
and sending out gifts to the anchor client by the other audience clients in response to a follow-up operation acting on the follow-up control on the other audience clients.
According to a second aspect of the present disclosure, there is provided a generation apparatus of live playback video, including:
the collection control display module is used for responding to the gift sending operation on the live audience client, and displaying a gift sending video collection control related to the gift sending operation on a live broadcast interface of the anchor client and/or a live broadcast interface of the audience client corresponding to the gift sending operation;
the playback video acquisition module is used for responding to the gift video collection operation acted on the gift video collection control on any client to acquire a gift playback video corresponding to the gift operation;
And the playback video collection module is used for generating a gift icon corresponding to the gift playback video and displaying the gift icon in a favorite of a client live interface corresponding to the gift video collection operation. .
According to a third aspect of the present disclosure, there is provided an electronic device comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the method of generating live playback video of any one of the above via execution of the executable instructions.
According to a fourth aspect of the present disclosure, there is provided a computer readable medium having stored thereon a computer program which, when executed by a processor, implements the method of generating live playback video of any one of the above.
Exemplary embodiments of the present disclosure may have the following advantageous effects:
in the method for generating the live broadcast playback video in the exemplary embodiment of the disclosure, the live broadcast video segments of the user gift sending process are obtained by responding to the gift sending video collection operation of the user and stored in the favorites, so that on one hand, the requirement of the user on the gift sending process can be met, the video segments of the whole live broadcast video in the gift sending process are not required to be searched, and the review time cost of the user can be reduced; on the other hand, only the gift video clips which are interested by the user are stored according to the collection operation of the user, and live video and data in the whole live broadcast process are not required to be stored, so that the storage space can be greatly saved, and the waste of storage resources is reduced.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure. It will be apparent to those of ordinary skill in the art that the drawings in the following description are merely examples of the disclosure and that other drawings may be derived from them without undue effort.
FIG. 1 is a schematic diagram of an exemplary system architecture of a method and apparatus for generating live playback video to which embodiments of the present invention may be applied;
fig. 2 shows a flow diagram of a method of generating live playback video in an example embodiment of the present disclosure;
FIG. 3 schematically illustrates a schematic view of controls and a gift video favorites according to one embodiment of the present disclosure;
FIG. 4 illustrates a flow diagram of acquiring a gift-playback video in accordance with an example embodiment of the present disclosure;
FIG. 5 shows a schematic diagram schematically illustrating gift-playback video according to one embodiment of the present disclosure;
FIG. 6 illustrates a flow diagram of a return operation of an exemplary embodiment of the present disclosure;
FIG. 7 shows a schematic flow diagram of a follow-up operation of an example embodiment of the present disclosure;
fig. 8 shows a block diagram of a generation apparatus of live playback video of an example embodiment of the present disclosure;
fig. 9 shows a schematic diagram of a computer system suitable for use in implementing embodiments of the present disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the present disclosure. One skilled in the relevant art will recognize, however, that the aspects of the disclosure may be practiced without one or more of the specific details, or with other methods, components, devices, steps, etc. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus a repetitive description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software or in one or more hardware modules or integrated circuits or in different networks and/or processor devices and/or microcontroller devices.
Fig. 1 is a schematic diagram of a system architecture of an exemplary application environment to which a method and an apparatus for generating live playback video according to embodiments of the present invention may be applied.
As shown in fig. 1, the system architecture 100 may include a plurality of mobile terminals 101, 102, 103, a network 104, and a server 105. The network 104 is the medium used to provide communication links between the mobile terminals 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wireless communication links, etc.
It should be understood that the number of mobile terminals, networks and servers in fig. 1 is merely illustrative. There may be any number of mobile terminals, networks and servers, as desired for implementation. For example, the server 105 may be a server cluster formed by a plurality of servers.
The mobile terminals 101, 102, 103 may be various electronic devices with processors including, but not limited to, smartphones, tablets, portable computers, and the like. The server 105 may be a server providing various services. For example, the mobile terminals 101, 102, 103 may display, via the processor, a giftor video collection control associated with a giftor operation on a live interface of a host client and/or a live interface of a viewer client corresponding to the giftor operation. The server 105 may obtain a gift playback video corresponding to a gift operation in response to a gift video collection operation acting on a gift video collection control on any one of the clients. The mobile terminals 101, 102, 103 may also complete the entire process from displaying the associated gift video collection control in response to the gift operation on the viewer's client to displaying the gift icon in the favorites of the client live interface corresponding to the gift video collection operation.
In some related embodiments, when a user views a live program through a network, if he wants to review the content that has been live, he can save live data in the form of a file in the last period of time (for example, three days), and provide a schedule to display the correspondence with the playing position of the program. And if the user selects the played back program, the stored live broadcast data is downloaded from the server, which is equivalent to the one-time on-demand downloading process.
However, the above method needs to store live data for a long period of time, and if a user only wants to review a video clip of a small segment in a certain live process, for example, for a short-time video clip playback such as a live gift playback, the storage of live data in a long-time end wastes a lot of storage space.
In view of the above problems, the present exemplary embodiment first provides a method for generating live playback video. Referring to fig. 2, the method for generating live playback video may include the following steps:
and S210, responding to the gift sending operation on the live audience client, and displaying a gift sending video collection control related to the gift sending operation on a live broadcast interface of the anchor client and/or a live broadcast interface of the audience client corresponding to the gift sending operation.
And S220, responding to gift sending video collection operation acted on the gift sending video collection control on any client side, and acquiring gift sending playback video corresponding to the gift sending operation.
And S230, generating a gift icon corresponding to the gift playback video, and displaying the gift icon in a favorite of a client live interface corresponding to the gift video collection operation.
In the method for generating the live broadcast playback video in the exemplary embodiment of the disclosure, the live broadcast video segments of the user gift sending process are obtained by responding to the gift sending video collection operation of the user and stored in the favorites, so that on one hand, the requirement of the user on the gift sending process can be met, the video segments of the whole live broadcast video in the gift sending process are not required to be searched, and the review time cost of the user can be reduced; on the other hand, only the gift video clips which are interested by the user are stored according to the collection operation of the user, and the live video and data in the whole live broadcast process are not required to be stored, so that the storage space can be greatly saved, and the waste of storage resources is avoided.
Next, the above steps of the present exemplary embodiment will be described in more detail with reference to fig. 3 to 6.
In step S210, in response to the gift operation on the live audience client, a gift video collection control associated with the gift operation is displayed on the live interface of the anchor client and/or the live interface of the audience client corresponding to the gift operation.
In this example embodiment, the anchor client refers to a client used by a network anchor, and the viewer client refers to a client used by a user viewing a live broadcast. The gift video collection control is a virtual control which is displayed on the public screen information and can collect the corresponding gift video collection segment.
A schematic of a live interface is shown in fig. 3. Suppose the live interface 301 is a live interface of a hosting client or a client of a viewer corresponding to a gifting operation, and the client of the viewer corresponding to the gifting operation, that is, the client used by user 1. After the user 1 sends out 10 gifts, the corresponding gift sending bullet screen 302 appears on the public screen information, and a gift sending video collection control 303 is displayed beside the gift sending bullet screen 302, so that the user 1 or the host can trigger the gift sending video collection function corresponding to the gift sending video collection control 303 through clicking, long pressing and other types of operations.
In this example embodiment, the corresponding gift video collection function may be triggered after the gift delivered by the user reaches a certain condition.
For example, the corresponding stowage function may be triggered based on the value of the outgoing gift. Specifically, in response to a gift operation on a live audience client, when the gift value is greater than or equal to the gift value threshold, a gift video collection control associated with the gift operation is displayed on a live interface of the anchor client and/or a live interface of the audience client corresponding to the gift operation.
For example, the gift sending video collection control may be displayed beside the corresponding gift sending bullet screen only when the value of the gift sent by the user reaches 100 yuan or 200 yuan, and if the value of the gift sent by the user is low, the collection control is not displayed.
For another example, the corresponding stowage function may be triggered according to the number of gifts sent. Specifically, in response to a gifting operation on a live audience client, when the number of gifts is greater than or equal to a threshold number of gifts, a gifting video collection control related to the gifting operation is displayed on a live interface of the anchor client and/or a live interface of the audience client corresponding to the gifting operation.
The gift sending video collection control related to the gift sending operation can be displayed on the live broadcast interface of the anchor client and the live broadcast interface of the audience client corresponding to the gift sending operation when the gift sent by the user reaches a certain number, for example, the user sends 10 gifts continuously.
In this example embodiment, the display position of the gift video collection control may be specifically defined, that is, the gift video collection control related to the gift operation may be displayed at the designated position of the bullet screen information corresponding to the gift operation displayed on the live interface of the anchor client and/or the live interface of the viewer client corresponding to the gift operation.
Referring to fig. 3, the gift video collection control 303 may be displayed on the right side of the gift barrage 302 corresponding to the gift operation, or may be displayed at a suitable location in the live interface of the anchor client and/or the live interface of the audience client corresponding to the gift operation, depending on the particular design of the interface display.
In step S220, in response to the gift video collection operation acting on the gift video collection control on any one of the clients, a gift playback video corresponding to the gift operation is acquired.
The gift video collection operation refers to an operation including clicking, long pressing, double clicking, etc. type of operation that acts on the gift video collection control, and may be typically implemented by clicking. Gift playback video refers to video of a gift effect displayed on a live interface for a period of time after a user has sent out the gift.
In this example embodiment, as shown in fig. 4, in response to a gift video collection operation acting on a gift video collection control on any one client, the method may specifically include the following steps:
and S410, responding to gift sending video collection operation acted on the gift sending video collection control on any client, and acquiring a live video stream and a corresponding gift special effect file in the gift sending process.
The live video stream of the gift sending process can comprise video clips of corresponding live broadcasting pictures of the host in the gift sending process, and can also comprise public screen bullet screen information displayed in the period of time. The gift effect file refers to a file for playing the gift effect.
In this example embodiment, the live video stream of the gift sending process may be obtained by two methods, precisely and freely.
If the gift sending operation is performed by the accurate intercepting method, the gift sending time corresponding to the gift sending operation is obtained, and the gift special effect display time is obtained from the gift special effect file; and intercepting a live video stream in the gift sending process according to the gift sending time and the gift special effect display time.
The method for precisely intercepting refers to acquiring live video streams in the same time period according to the time of gift special effect display. For example, the display time of the gift effect is 50 minutes 30 seconds, and the display time of the gift effect is 5 seconds, and then the live video stream within 50 minutes 30 seconds to 50 minutes 35 seconds is directly intercepted.
If the gift special effect file is obtained by a free interception method, a section of live video stream containing the preset time length of the gift sending process is obtained; and responding to the video interception operation on the live video stream with the preset time length, and obtaining the live video stream in the gift sending process.
The method of free interception means that the user can intercept the wanted clip according to the wanted video length, for example, the feedback given by the user after the host broadcasting sees the gift is also saved, and the method of free interception is more suitable. First, the server or the client may provide a video for a long time including the gifting process, for example, the gifting time is 50 minutes 30 seconds to 50 minutes 35 seconds, and may provide a video clip for a long time including 50 minutes 30 seconds to 50 minutes 35 seconds, may be 30 seconds or 1 minute, etc., for example, the provided video clip is 50 minutes to 51 minutes, and then the user may intercept the desired video clip according to his own needs, for example, the user may intercept the video of 50 minutes 30 seconds to 50 minutes 50 seconds, and use the video clip as a live video stream of the gifting process.
And S420, synthesizing the live video stream in the gift sending process and the corresponding gift special effect file to obtain a gift sending playback video corresponding to the gift sending operation.
And after the live video stream and the corresponding gift special effect file in the gift sending process are obtained, synthesizing the live video stream and the corresponding gift special effect file according to the corresponding time axis by a synthesis technology to obtain a gift sending playback video corresponding to the gift sending operation.
A schematic diagram of gift playback video is shown in fig. 5. In the live playback interface 501, a live screen 502 of a host, public screen bullet screen information 503, and a gift special effect 504 that is sent out are included.
In step S230, a gift icon corresponding to the gift playback video is generated, and the gift icon is displayed in a favorites of the client live interface corresponding to the gift video collection operation.
In this example embodiment, the gift videos collected by the user or the host may be displayed in the favorites in the form of gift icons. As shown in FIG. 3, a plurality of gift icons 305 corresponding to the collected gift videos are displayed in the favorites 304.
In this example embodiment, while displaying the gift icon in the favorites of the client live interface corresponding to the gift sending video collection operation, the gift collection time corresponding to the gift sending video collection operation may also be obtained, and the gift icon, the corresponding gift name and the gift collection time may be displayed in the favorites of the client live interface corresponding to the gift sending video collection operation.
Since the gift icons corresponding to the gift videos collected by the user may not be distinguished or identified, the gift collection time corresponding to the gift video collection operation and the corresponding gift names may be displayed at designated positions near the gift icons, as shown in fig. 3, below the gift icons, above or on the left and right sides of the gift icons, or within the gift icons, which is not particularly limited in this exemplary embodiment.
In this example embodiment, after displaying the gift icon in the favorites of the client live interface corresponding to the gift video collection operation in step S230, the method may further include:
and responding to the gift process playback operation acted on the gift icon, acquiring a gift playback video corresponding to the gift icon, and playing the gift playback video on the current client.
After the gift icon is displayed in the favorite of the client live interface corresponding to the gift video collection operation, if the user plays back the operation through clicking the gift process of the gift icon and other modes, the gift video playback function can be triggered, a section of gift playback video corresponding to the gift icon is played back on the interface of the current client.
In the present exemplary embodiment, functions such as gift returning and follow-up may be provided in addition to the function of collecting after gift sending.
As shown in FIG. 6, the return operation may specifically include the following steps:
and S610, responding to the gift sending operation on the client side of the audience, and displaying a gift returning control related to the gift sending operation on a live interface of the anchor client side.
And S620, responding to the gift returning operation on the anchor client side acting on the gift returning control, and sending out the gift from the anchor client side to the audience client side corresponding to the gift sending operation.
If the user watching live broadcast is in a live voice scene, the user watching live broadcast can be a host, so that the function of a return gift can be provided in the example embodiment. When the user sends out the gift, a gift-returning control related to the gift-sending operation, such as the gift-returning control 306 in fig. 3, may be displayed on the live interface of the anchor client where the current anchor is located, and may also be displayed beside the corresponding bullet screen information. If the current anchor clicks the return control, the same gift may be returned to the gifter or a gift may be reselected for delivery.
As shown in fig. 7, the follow-up operation may specifically include the following steps:
Step S710, responding to the gift sending operation on the audience client, and displaying follow-up controls related to the gift sending operation on live broadcast interfaces of other audience clients except the audience client corresponding to the gift sending operation.
And S720, sending out the gift to the anchor client by the other audience clients in response to the follow-up operation acting on the follow-up control on the other audience clients.
For other audience clients that watch live broadcast, in addition to the client of the anchor and the audience client corresponding to the gift operation, the following function may be provided in this example embodiment. When the user sends out the gift, a follow-up control related to the gift sending operation, such as follow-up control 307 in fig. 3, may be displayed on a live interface of other audience clients watching live broadcast, and may also be displayed beside the corresponding bullet screen information. If other users click the follow-up control, the same gift can be sent to the host, so that the gift sending rate can be increased, and the consumption of the living broadcast room is further promoted.
It should be noted that although the steps of the methods in the present disclosure are depicted in the accompanying drawings in a particular order, this does not require or imply that the steps must be performed in that particular order, or that all illustrated steps be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform, etc.
Further, the present disclosure also provides a device for generating live playback video. Referring to fig. 8, the generating apparatus of live playback video may include a collection control display module 810, a playback video acquisition module 820, and a playback video collection module 830. Wherein:
the collection control display module 810 may be configured to display a gift video collection control associated with a gift operation on a live interface of a hosting client and/or a live interface of a viewer client corresponding to the gift operation in response to the gift operation on the live viewer client;
the playback video acquisition module 820 may be configured to acquire a gift playback video corresponding to a gift operation in response to a gift video collection operation acting on a gift video collection control on any one of the clients;
the playback video collection module 830 may be configured to generate a gift icon corresponding to the gift playback video and display the gift icon in a favorites folder of the client live interface corresponding to the gift video collection operation.
In some exemplary embodiments of the present disclosure, a generation apparatus for live broadcast playback video provided by the present disclosure may further include a gift video playback module that may be configured to obtain a gift playback video corresponding to a gift icon in response to a gift process playback operation acting on the gift icon, and play the gift playback video on a current client.
In some exemplary embodiments of the present disclosure, the playback video acquisition module 820 may include a video file acquisition unit and a video file composition unit. Wherein:
the video file acquisition unit can be used for responding to gift sending video collection operation acted on a gift sending video collection control on any client to acquire a live video stream and a corresponding gift special effect file in the gift sending process;
the video file synthesis unit can be used for synthesizing the live video stream in the gift sending process and the corresponding gift special effect file to obtain the gift sending playback video corresponding to the gift sending operation.
In some exemplary embodiments of the present disclosure, the video file acquisition unit may include a gift presentation time acquisition unit and a video stream interception unit. Wherein:
the gift display time obtaining unit can be used for obtaining gift sending time corresponding to gift sending operation and obtaining gift special effect display time from the gift special effect file;
the video stream intercepting unit can be used for intercepting live video streams in the gift delivering process according to the gift delivering time and the gift special effect displaying time.
In some exemplary embodiments of the present disclosure, the video file acquisition unit may further include a video stream acquisition unit and a video stream interception unit. Wherein:
The video stream obtaining unit can be used for obtaining gift special effect files and a section of live video stream containing the preset time length of the gift sending process;
the video stream intercepting unit can be used for responding to the video intercepting operation on the live video stream with the preset time length to obtain the live video stream in the gift sending process.
In some example embodiments of the present disclosure, the collection control display module 810 may include a gift value condition collection control display unit that may be configured to display a gift video collection control associated with a gift operation on a live interface of a host client and/or a live interface of a viewer client corresponding to the gift operation when the gift value is greater than or equal to a gift value threshold in response to the gift operation on the live viewer client.
In some exemplary embodiments of the present disclosure, the collection control display module 810 may further include a gift quantity condition collection control display unit that may be configured to display a gift video collection control associated with a gift operation on a live interface of a host client and/or a live interface of a viewer client corresponding to the gift operation when the gift quantity is greater than or equal to a gift quantity threshold in response to the gift operation on the live viewer client.
In some exemplary embodiments of the present disclosure, the collection control display module 810 may further include a control display position determining unit that may be used to display the gift video collection control related to the gift operation at a designated position of the bullet screen information corresponding to the gift operation displayed on the live interface of the anchor client and/or the live interface of the viewer client corresponding to the gift operation.
In some exemplary embodiments of the present disclosure, the playback video collection module 830 may include a gift information display unit that may be used to obtain a gift collection time corresponding to the gift video collection operation, and display the gift icon and the corresponding gift name and the gift collection time simultaneously in a favorites of a client live interface corresponding to the gift video collection operation.
In some exemplary embodiments of the present disclosure, a generation apparatus for live playback video provided by the present disclosure may further include a gift-returning control display module and a gift-returning operation execution module. Wherein:
the gift-return control display module may be configured to display, in response to a gift operation on the spectator client, a gift-return control associated with the gift operation on a live interface of the anchor client;
The gift returning operation execution module may be configured to send out the gift from the anchor client to the viewer client corresponding to the gift sending operation in response to the gift returning operation acting on the anchor client.
In some exemplary embodiments of the present disclosure, a generation apparatus for live playback video provided by the present disclosure may further include a follow-up control display module and a follow-up operation execution module. Wherein:
the follow-up control display module can be used for responding to the gift sending operation on the audience client, and displaying follow-up controls related to the gift sending operation on the live broadcast interfaces of other audience clients except the audience client corresponding to the gift sending operation;
the follow-up operation execution module may be configured to send the gift from the other spectator client to the anchor client in response to a follow-up operation on the other spectator client acting on the follow-up control.
The specific details of each module/unit in the live playback video generation apparatus are described in detail in the corresponding method embodiment section, and are not described herein.
Fig. 9 shows a schematic diagram of a computer system suitable for use in implementing an embodiment of the invention.
It should be noted that, the computer system 900 of the electronic device shown in fig. 9 is only an example, and should not impose any limitation on the functions and the application scope of the embodiments of the present invention.
As shown in fig. 9, the computer system 900 includes a Central Processing Unit (CPU) 901, which can execute various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 902 or a program loaded from a storage section 908 into a Random Access Memory (RAM) 903. In the RAM 903, various programs and data required for system operation are also stored. The CPU 901, ROM 902, and RAM 903 are connected to each other through a bus 904. An input/output (I/O) interface 905 is also connected to the bus 904.
The following components are connected to the I/O interface 905: an input section 906 including a keyboard, a mouse, and the like; an output portion 907 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage portion 908 including a hard disk or the like; and a communication section 909 including a network interface card such as a LAN card, a modem, or the like. The communication section 909 performs communication processing via a network such as the internet. The drive 910 is also connected to the I/O interface 905 as needed. A removable medium 911 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed as needed on the drive 910 so that a computer program read out therefrom is installed into the storage section 908 as needed.
In particular, according to embodiments of the present application, the processes described below with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from the network via the communication portion 909 and/or installed from the removable medium 911. When the computer program is executed by a Central Processing Unit (CPU) 901, various functions defined in the system of the present application are performed.
It should be noted that the computer readable medium shown in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
As another aspect, the present application also provides a computer-readable medium that may be contained in the electronic device described in the above embodiment; or may exist alone without being incorporated into the electronic device. The computer-readable medium carries one or more programs which, when executed by one of the electronic devices, cause the electronic device to implement the methods described in the embodiments below.
It should be noted that although in the above detailed description several modules of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functions of two or more modules described above may be embodied in one module in accordance with embodiments of the present disclosure. Conversely, the features and functions of one module described above may be further divided into a plurality of modules to be embodied.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A method for generating live playback video, comprising:
Responding to gift sending operation on a live audience client, and displaying a gift sending video collection control related to the gift sending operation at a designated position of bullet screen information corresponding to the gift sending operation, which is displayed on a live interface of a host client and/or a live interface of the audience client corresponding to the gift sending operation, when the gift value is greater than or equal to a gift value threshold value or the gift quantity is greater than or equal to a gift quantity threshold value;
responding to the gift sending video collection operation acted on the gift sending video collection control on the anchor client side and/or the audience client side corresponding to the gift sending operation, and acquiring a gift sending playback video corresponding to the gift sending operation;
generating a gift icon corresponding to the gift playback video, and displaying the gift icon in a favorite of a client live interface corresponding to the gift video collection operation;
and responding to the gift process playback operation acted on the gift icon, acquiring a gift playback video corresponding to the gift icon, and playing the gift playback video on the current client.
2. The method according to claim 1, wherein the obtaining, in response to the gift video collection operation acting on the gift video collection control on the anchor client and/or the viewer client corresponding to the gift operation, the gift playback video corresponding to the gift operation includes:
Responding to the gift sending video collection operation acted on the gift sending video collection control on the anchor client and/or the audience client corresponding to the gift sending operation, and acquiring a live video stream and a corresponding gift special effect file in the gift sending process;
and synthesizing the live video stream in the gift sending process and the corresponding gift special effect file to obtain a gift sending playback video corresponding to the gift sending operation.
3. The method for generating live playback video according to claim 2, wherein the acquiring the live video stream and the corresponding gift special effect file in the gift sending process includes:
acquiring gift sending time corresponding to the gift sending operation, and acquiring gift special effect display time from the gift special effect file;
and intercepting a live video stream in the gift sending process according to the gift sending time and the gift special effect display time.
4. The method for generating live playback video according to claim 2, wherein the acquiring the live video stream and the corresponding gift special effect file in the gift sending process includes:
acquiring a gift special effect file and a section of live video stream containing the preset time length of the gift sending process;
And responding to the video interception operation on the live video stream with the preset time length to obtain the live video stream in the gift sending process.
5. The method for generating live playback video according to claim 1, wherein displaying the gift icon in a favorites of a client live interface corresponding to the gift video collection operation comprises:
and acquiring the gift collection time corresponding to the gift sending video collection operation, displaying the gift icon, the corresponding gift name and the gift collection time in the favorites of the client live interface corresponding to the gift sending video collection operation.
6. The method of generating live playback video of claim 1, further comprising:
responsive to a gift operation on the spectator client, displaying a return control associated with the gift operation on a live interface of the anchor client;
and responding to the gift returning operation acted on the gift returning control on the anchor client, and sending out the gift from the anchor client to the audience client corresponding to the gift sending operation.
7. The method of generating live playback video of claim 1, further comprising:
Responsive to a gifting operation on the spectator client, displaying a follow-up control related to the gifting operation on a live interface of other spectator clients except for the spectator client corresponding to the gifting operation;
and sending out gifts to the anchor client by the other audience clients in response to a follow-up operation acting on the follow-up control on the other audience clients.
8. A generation apparatus for live playback video, comprising:
the system comprises a collection control display module, a display module and a display module, wherein the collection control display module is used for responding to the gift sending operation on a live audience client, and displaying a gift sending video collection control related to the gift sending operation at a designated position of bullet screen information displayed on a live broadcast interface of a host client and/or a live broadcast interface of the audience client corresponding to the gift sending operation when the gift value is greater than or equal to a gift value threshold or the gift quantity is greater than or equal to a gift quantity threshold;
the playback video acquisition module is used for responding to the gift sending video collection operation acted on the gift sending video collection control on the anchor client and/or the audience client corresponding to the gift sending operation to acquire gift sending playback video corresponding to the gift sending operation;
The playback video collection module is used for generating a gift icon corresponding to the gift playback video and displaying the gift icon in a favorite of a client live interface corresponding to the gift video collection operation;
and the gift video playback module is used for responding to the gift process playback operation acted on the gift icon, acquiring the gift playback video corresponding to the gift icon, and playing the gift playback video on the current client.
9. An electronic device, comprising:
a processor; and
a memory for storing one or more programs that, when executed by the one or more processors, cause the one or more processors to implement the method of generating live playback video as recited in any one of claims 1 to 7.
10. A computer readable medium, on which a computer program is stored, characterized in that the program, when executed by a processor, implements a method of generating a live playback video as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011446418.7A CN112637618B (en) | 2020-12-08 | 2020-12-08 | Live broadcast playback video generation method and device, electronic equipment and computer medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011446418.7A CN112637618B (en) | 2020-12-08 | 2020-12-08 | Live broadcast playback video generation method and device, electronic equipment and computer medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112637618A CN112637618A (en) | 2021-04-09 |
| CN112637618B true CN112637618B (en) | 2023-09-08 |
Family
ID=75309622
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011446418.7A Active CN112637618B (en) | 2020-12-08 | 2020-12-08 | Live broadcast playback video generation method and device, electronic equipment and computer medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112637618B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115079908A (en) * | 2021-03-12 | 2022-09-20 | 北京字节跳动网络技术有限公司 | Media content collection method and device, electronic equipment and computer readable storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106254910A (en) * | 2016-07-29 | 2016-12-21 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus recording image |
| CN106954080A (en) * | 2017-03-17 | 2017-07-14 | 武汉斗鱼网络科技有限公司 | Net cast method, device and user terminal |
| CN107801106A (en) * | 2017-10-24 | 2018-03-13 | 维沃移动通信有限公司 | A kind of video segment intercept method and electronic equipment |
| CN108062409A (en) * | 2017-12-29 | 2018-05-22 | 北京奇艺世纪科技有限公司 | Generation method, device and the electronic equipment of live video summary |
| WO2018113140A1 (en) * | 2016-12-22 | 2018-06-28 | 武汉斗鱼网络科技有限公司 | Method and system for displaying virtual gift during live video broadcast |
| CN110124317A (en) * | 2019-05-23 | 2019-08-16 | 网易（杭州）网络有限公司 | Interactive approach, device, equipment and storage medium in game live streaming |
| CN111050205A (en) * | 2019-12-13 | 2020-04-21 | 广州酷狗计算机科技有限公司 | Video clip acquisition method, device, apparatus, storage medium, and program product |
| CN111107421A (en) * | 2019-12-31 | 2020-05-05 | 北京达佳互联信息技术有限公司 | Video processing method and device, terminal equipment and storage medium |
| CN111147878A (en) * | 2019-12-30 | 2020-05-12 | 广州酷狗计算机科技有限公司 | Stream pushing method and device in live broadcast and computer storage medium |
| CN111541909A (en) * | 2020-04-30 | 2020-08-14 | 广州华多网络科技有限公司 | Panoramic live broadcast gift delivery method, device, equipment and storage medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9003051B2 (en) * | 2008-04-11 | 2015-04-07 | Mobitv, Inc. | Content server media stream management |
| US20100257040A1 (en) * | 2009-03-19 | 2010-10-07 | Shop.Com | Multi-Merchant Reward Points Payment System |
| WO2013149204A1 (en) * | 2012-03-31 | 2013-10-03 | Gift Card Impressions, LLC | Video gift card holder and system |
| US20150348012A1 (en) * | 2014-06-03 | 2015-12-03 | First Data Corporation | Systems and Methods for Managing Funds |
| US10771736B2 (en) * | 2014-06-30 | 2020-09-08 | Microsoft Technology Licensing, Llc | Compositing and transmitting contextual information during an audio or video call |
| US20170171638A1 (en) * | 2015-12-15 | 2017-06-15 | Le Holdings (Beijing) Co., Ltd. | Method and Terminal for Video Play |
-
2020
- 2020-12-08 CN CN202011446418.7A patent/CN112637618B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106254910A (en) * | 2016-07-29 | 2016-12-21 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus recording image |
| WO2018113140A1 (en) * | 2016-12-22 | 2018-06-28 | 武汉斗鱼网络科技有限公司 | Method and system for displaying virtual gift during live video broadcast |
| CN106954080A (en) * | 2017-03-17 | 2017-07-14 | 武汉斗鱼网络科技有限公司 | Net cast method, device and user terminal |
| CN107801106A (en) * | 2017-10-24 | 2018-03-13 | 维沃移动通信有限公司 | A kind of video segment intercept method and electronic equipment |
| CN108062409A (en) * | 2017-12-29 | 2018-05-22 | 北京奇艺世纪科技有限公司 | Generation method, device and the electronic equipment of live video summary |
| CN110124317A (en) * | 2019-05-23 | 2019-08-16 | 网易（杭州）网络有限公司 | Interactive approach, device, equipment and storage medium in game live streaming |
| CN111050205A (en) * | 2019-12-13 | 2020-04-21 | 广州酷狗计算机科技有限公司 | Video clip acquisition method, device, apparatus, storage medium, and program product |
| CN111147878A (en) * | 2019-12-30 | 2020-05-12 | 广州酷狗计算机科技有限公司 | Stream pushing method and device in live broadcast and computer storage medium |
| CN111107421A (en) * | 2019-12-31 | 2020-05-05 | 北京达佳互联信息技术有限公司 | Video processing method and device, terminal equipment and storage medium |
| CN111541909A (en) * | 2020-04-30 | 2020-08-14 | 广州华多网络科技有限公司 | Panoramic live broadcast gift delivery method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112637618A (en) | 2021-04-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109413483B (en) | Live content preview method, device, equipment and medium | |
| CN106792242B (en) | Method and device for pushing information | |
| WO2021196903A1 (en) | Video processing method and device, readable medium and electronic device | |
| CN111836112B (en) | Multimedia file output method, device, medium and electronic equipment | |
| CN111629251B (en) | Video playing method and device, storage medium and electronic equipment | |
| CN113286197A (en) | Information display method and device, electronic equipment and storage medium | |
| CN110110101B (en) | Multimedia content recommendation method, device, terminal, server and readable medium | |
| US20230101302A1 (en) | Method and apparatus for displaying live broadcast interface | |
| CN108650547A (en) | A kind of video sharing method, apparatus and equipment | |
| CN112714329B (en) | Display control method and device for live broadcasting room, storage medium and electronic equipment | |
| CN109168012B (en) | Information processing method and device for terminal equipment | |
| CN111818383B (en) | Video data generation method, system, device, electronic equipment and storage medium | |
| US20240028189A1 (en) | Interaction method and apparatus, electronic device and computer readable medium | |
| CN113589982A (en) | Resource playing method and device, electronic equipment and storage medium | |
| CN107181969B (en) | A kind of promotion method and device of third party's information | |
| CN115190366A (en) | Information display method and device, electronic equipment and computer readable medium | |
| CN112637618B (en) | Live broadcast playback video generation method and device, electronic equipment and computer medium | |
| CN109635131B (en) | Multimedia content list display method, pushing method, device and storage medium | |
| CN112218144B (en) | Screen projection control method and device, electronic equipment and computer readable medium | |
| CN110673886A (en) | Method and device for generating thermodynamic diagram | |
| CN111309428B (en) | Information display method, information display device, electronic apparatus, and storage medium | |
| CN111147885B (en) | Live broadcast room interaction method and device, readable medium and electronic equipment | |
| CN109948082B (en) | Live broadcast information processing method and device, electronic equipment and storage medium | |
| CN111382039A (en) | Method, device, electronic equipment and storage medium for reporting user behavior event | |
| CN113965768B (en) | Live broadcasting room information display method and device, electronic equipment and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |