CN113115117B - Interactive video playing method and device, storage medium and electronic equipment - Google Patents
Interactive video playing method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN113115117B CN113115117B CN202110281669.2A CN202110281669A CN113115117B CN 113115117 B CN113115117 B CN 113115117B CN 202110281669 A CN202110281669 A CN 202110281669A CN 113115117 B CN113115117 B CN 113115117B
- Authority
- CN
- China
- Prior art keywords
- interactive
- playing
- video
- node
- time length
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26258—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The disclosure relates to an interactive video playing method, an interactive video playing device, a storage medium and electronic equipment. The method comprises the following steps: under the condition of playing resources corresponding to a first interactive node in an interactive video, determining one or more second interactive nodes according to a preset playing sequence of each interactive node in the interactive video, wherein the interactive video comprises a plurality of interactive nodes, each interactive node corresponds to one playing resource, and the second interactive node is an interactive node which is adjacent to the playing sequence of the first interactive node and is positioned behind the first interactive node in the plurality of interactive nodes of the interactive video; downloading the playing resource corresponding to the second interactive node from the server; according to the interactive operation input by the user, determining a target interactive node to be played from one or more second interactive nodes; and playing the playing resources corresponding to the target interactive node, thereby reducing the buffering time in the interactive video playing process and reducing video blockage.
Description
Technical Field
The present disclosure relates to the field of video technologies, and in particular, to an interactive video playing method, an interactive video playing device, a storage medium, and an electronic device.
Background
With the popularization of online education, in order to facilitate the pre-class pre-study and the post-class review of students, it becomes a common means to play recorded teaching videos in an interactive video mode. However, in the playing of the interactive video, a video pause phenomenon occurs, and the problem is more prominent particularly in the case of insufficient network bandwidth.
Disclosure of Invention
In order to solve the above problems, the present disclosure provides an interactive video playing method, an interactive video playing device, a storage medium, and an electronic device.
In a first aspect, the present disclosure provides an interactive video playing method, applied to a client, the method including:
under the condition of playing resources corresponding to a first interactive node in an interactive video, determining one or more second interactive nodes according to a preset playing sequence of each interactive node in the interactive video, wherein the interactive video comprises a plurality of interactive nodes, each interactive node corresponds to one playing resource, and the second interactive node is an interactive node which is adjacent to the playing sequence of the first interactive node and is positioned behind the first interactive node in the plurality of interactive nodes of the interactive video;
downloading the playing resources corresponding to the second interactive node from a server;
determining a target interactive node to be played from one or more second interactive nodes according to the interactive operation input by the user aiming at the first interactive node;
and playing the downloaded playing resources corresponding to the target interactive node.
Optionally, the downloading, from the server, the play resource corresponding to the second interactive node includes:
downloading the playing resources corresponding to the second interactive node from a server under the condition that the playing resources of the second interactive node are not stored in the client; alternatively, the first and second electrodes may be,
and under the condition that the client stores part of the playing resources of the second interactive node, downloading other playing resources except the part of the playing resources in the playing resources corresponding to the second interactive node from a server, and combining the part of the playing resources and the other playing resources into the complete playing resources of the second interactive node.
Optionally, the playing resources corresponding to the downloaded target interactive node include:
under the condition that the downloading of the playing resources of the target interaction node is not completed, the locally stored target resources of the target interaction node are obtained, the target resources are played, and the part which is not stored in the playing resources is downloaded from the server when the target resources are played.
Optionally, the playing resources include a main video and an auxiliary video, and the playing the target resource includes:
playing the stored target resource of the main video;
and synchronously playing the auxiliary video according to the played time length of the main video, wherein the played time length of the auxiliary video is less than or equal to the played time length of the main video.
Optionally, the method further comprises:
in the process of synchronously playing the auxiliary video, periodically acquiring a first playable time length of a downloaded part of the auxiliary video;
and under the condition that the time length difference value between the first playable time length and the played time length of the main video is less than or equal to a first preset time length difference threshold value, pausing the playing of the main video, and continuing to download the auxiliary video until the playing of the main video is resumed under the condition that the time length difference value is greater than the first preset time length difference threshold value.
Optionally, the play resource of the second interactive node includes multiple channels of videos; the downloading of the play resource corresponding to the second interactive node from the server includes:
downloading the multi-channel videos from the server in parallel;
periodically acquiring a second playable time length of the downloaded part of each path of video;
calculating the difference value between the maximum second playable time length and the minimum second playable time length in the second playable time lengths of the multi-channel videos to obtain a target time length difference value;
adjusting the downloading bandwidth of each path of video according to the target time length difference;
and downloading the multi-channel video according to the downloading bandwidth so that the target time length difference value is smaller than a second preset time length difference threshold value.
Optionally, the adjusting the download bandwidth of each video according to the target duration difference includes:
taking the sum of the current download bandwidths of the multiple channels of videos as the total download bandwidth and taking the sum of the second playable durations of the multiple channels of videos as the total playable duration under the condition that the target duration difference is greater than or equal to the second preset duration difference threshold;
calculating the distribution bandwidth of each path of video according to the total download bandwidth, the total playable time length and the second playable time length of each path of video;
and taking the allocated bandwidth as the download bandwidth of each video.
Optionally, after downloading the play resource corresponding to the second interactive node from the server, the method further includes:
acquiring a third playable time length of a playing resource corresponding to the second interactive node;
determining one or more third interactive nodes according to a preset playing sequence of each interactive node in the interactive video under the condition that the third playable time length is less than or equal to a preset playable time length threshold value, wherein the third interactive nodes are the interactive nodes which are adjacent to the playing sequence of the second interactive node and are positioned behind the second interactive node in the plurality of interactive nodes of the interactive video;
and downloading the playing resources corresponding to the third interactive node from the server.
Optionally, after the determining a target interactive node to be played from one or more second interactive nodes, the method further includes:
under the condition that a plurality of second interactive nodes are provided, determining whether the downloading of the playing resources corresponding to other interactive nodes except the target interactive node in the second interactive nodes is completed;
and under the condition that the playing resources corresponding to the other interactive nodes are not downloaded, stopping downloading the playing resources corresponding to the other interactive nodes.
In a second aspect, the present disclosure provides an interactive video playing apparatus, applied to a client, the apparatus including:
the interactive node to be downloaded determining module is used for determining one or more second interactive nodes according to a preset playing sequence of each interactive node in the interactive video under the condition that a playing resource corresponding to a first interactive node in the interactive video is played, wherein the second interactive nodes are the interactive nodes which are adjacent to the playing sequence of the first interactive node and are positioned behind the first interactive node in the plurality of interactive nodes of the interactive video;
the resource downloading module is used for downloading the playing resources corresponding to the second interactive node from the server;
the interactive node to be played determining module is used for determining a target interactive node to be played from one or more second interactive nodes according to the interactive operation input by the user aiming at the first interactive node;
and the resource playing module is used for playing the downloaded playing resources corresponding to the target interactive node.
In a third aspect, the present disclosure provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method of the first aspect of the present disclosure.
In a fourth aspect, the present disclosure provides an electronic device comprising: a memory having a computer program stored thereon; a processor for executing the computer program in the memory to implement the steps of the method of the first aspect of the disclosure.
By adopting the technical scheme, under the condition that a playing resource corresponding to a first interactive node in an interactive video is played, one or more second interactive nodes are determined according to a preset playing sequence of each interactive node in the interactive video, wherein the interactive video comprises a plurality of interactive nodes, each interactive node corresponds to one playing resource, and the second interactive node is an interactive node which is adjacent to the playing sequence of the first interactive node and is positioned behind the first interactive node in the plurality of interactive nodes of the interactive video; downloading the playing resource corresponding to the second interactive node from the server; according to the interactive operation input by the user, determining a target interactive node to be played from one or more second interactive nodes; and playing the playing resources corresponding to the target interactive node. Therefore, the buffering time in the interactive video playing process can be reduced, video blockage is reduced, and the experience of watching the interactive video by a user is improved.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure, but do not constitute a limitation of the disclosure. In the drawings:
fig. 1 is a schematic view of a scene of an online education application through interactive video playing according to an embodiment of the present disclosure;
fig. 2 is a flowchart of an interactive video playing method provided by an embodiment of the present disclosure;
fig. 3 is a schematic diagram of an interactive node list of an interactive video provided by an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an interactive video playing device according to an embodiment of the present disclosure;
fig. 5 is a block diagram of an electronic device provided by an embodiment of the disclosure;
fig. 6 is a block diagram of another electronic device provided by embodiments of the present disclosure.
Detailed Description
The following detailed description of specific embodiments of the present disclosure is provided in connection with the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating the present disclosure, are given by way of illustration and explanation only, not limitation.
It is noted that, in the present disclosure, the terms "first," "second," and the like are used for descriptive purposes only and not for purposes of indicating or implying relative importance, nor for purposes of indicating or implying order; the terms "S101", "S102", "S201", "S202", etc. are used to distinguish the steps and are not necessarily to be construed as performing method steps in a particular order or sequence; when the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated.
First, an application scenario of the present disclosure will be explained. The method and the device can be applied to the field of online education, and particularly can be used for online education scenes through interactive video playing. In the process of online education through interactive video, when the interactive video jumps from one node to the next node, a target interactive node to be played needs to be determined according to the interactive operation of a user, and a playing resource corresponding to the target interactive node is downloaded.
In order to solve the above problems, the present disclosure provides an interactive video playing method, an apparatus, a storage medium, and an electronic device, where the method may download, from a server in advance, playing resources corresponding to one or more second interactive nodes that are adjacent to a playing sequence of a first interactive node currently being played and located behind the first interactive node, according to a preset playing sequence of each interactive node in an interactive video; after a target interactive node to be played is determined from one or more second interactive nodes according to the interactive operation of the user, the playing resource corresponding to the target interactive node can be directly played without waiting for downloading buffer. Therefore, the buffering time in the interactive video playing process can be shortened, video blockage is reduced, and the experience of watching the interactive video by a user is improved.
The following detailed description of specific embodiments of the present disclosure is provided in connection with the accompanying drawings.
Fig. 1 is a schematic view of a scenario of an online education application through interactive video playing provided by an embodiment of the present disclosure, as shown in fig. 1, the scenario may include a server 101 and a client 102, and the client 102 may be one or more, for example, the client 102 may include a first client 1021, a second client 1022, a \8230;, an nth client 102N, and the client 102 is configured to download a playing resource of an interactive video from the server 101, play the interactive video to a user, and complete interaction with the user, thereby completing an online education task.
Fig. 2 is an interactive video playing method provided by an embodiment of the present disclosure, as shown in fig. 2, an execution subject of the method may be the client, and the method includes:
s201, under the condition that a playing resource corresponding to a first interactive node in an interactive video is played, one or more second interactive nodes are determined according to a preset playing sequence of each interactive node in the interactive video.
The interactive video comprises a plurality of interactive nodes, each interactive node corresponds to one playing resource, and the second interactive node is an interactive node which is adjacent to the playing sequence of the first interactive node and behind the first interactive node in the plurality of interactive nodes of the interactive video.
The preset playing sequence of each interactive node in the interactive video can be stored on the server in an interactive node list mode, and the interactive node list comprises all interactive nodes of the interactive video and the preset playing sequence among the interactive nodes. Before playing the interactive video, the client may first download the interactive node list to obtain a preset playing sequence of each interactive node.
For example, fig. 3 is a schematic diagram of an interactive node list of an interactive video, as shown in fig. 3, the interactive video includes 10 interactive nodes, where node 1 is a start node of the interactive video, and node 5 is an end node of the interactive video. The interactive nodes adjacent to the playing sequence of the node 1 and behind the node 1 are the node 2-1 and the node 2-2; the interactive nodes adjacent to the playing sequence of the node 2-1 and behind the node 2-1 are the node 3-1, the node 3-2 and the node 3-3; and the preset playing sequence among other interactive nodes is analogized in turn. Thus, when the client plays the play resource corresponding to the node 1 (first interactive node), the node 2-1 and the node 2-2 after the node 1 can be determined as the second interactive node according to the preset play sequence in the interactive node list.
It should be noted that, if the first interactive node being played is the end node (node 5 in this example), it is not necessary to determine the second interactive node and perform the subsequent steps. And determining a second interactive node and executing subsequent steps only under the condition that the first interactive node is a non-end node.
S202, downloading the playing resources corresponding to the second interactive node from the server.
It should be noted that, the playing resource corresponding to each interactive node may be a video, a picture, a sound, or a game, which is not limited in this disclosure. In this step, the playing resources may be directly downloaded from the server to the local client for storage through a wireless or wired network.
In this step, the playing resource corresponding to the second interactive node may be downloaded by adopting one of the following manners according to whether the client stores the playing resource:
in the first mode, under the condition that the client does not store the playing resource of the second interactive node, the playing resource corresponding to the second interactive node is downloaded from the server.
And secondly, under the condition that the client stores part of the playing resources of the second interactive node, downloading other playing resources except the part of the playing resources in the playing resources corresponding to the second interactive node from the server, and combining the part of the playing resources and the other playing resources into a complete playing resource of the second interactive node.
And thirdly, under the condition that the client stores all the playing resources of the second interactive node, the downloading is not required to be carried out again.
S203, determining a target interactive node to be played from one or more second interactive nodes according to the interactive operation input by the user aiming at the first interactive node.
In this step, the interactive operation may be a confirmation operation of the user on the target interactive option of the first interactive node. Illustratively, the first interaction node includes one or more interaction options, each interaction option corresponds to one second interaction node, and when a user selects one of the target interaction options through an interactive operation, the second interaction node corresponding to the target interaction option may be used as a target interaction node to be played.
Optionally, the interactive operation may also be an answer operation of the user for the interactive practice question in the first interactive node, that is, the target interactive node to be played may be determined from one or more second interactive nodes according to an answer result of the user for the interactive practice question in the first interactive node. Illustratively, the playing resource of the first interactive node comprises a first teaching video and a first interactive practice question, after the first teaching video is played, the first interactive practice question is played, the user answers the first interactive practice question, if the answer is correct, a second interactive node corresponding to the correct answer is selected as a target interactive node to be played, for example, the target interactive node can be a second teaching video of a next chapter; if the answer is wrong, selecting a second interactive node corresponding to the answer error as a target interactive node to be played, for example, the target interactive video may be a first review video corresponding to the first teaching video, and the first review video may be used for explaining the interactive exercise.
S204, playing the downloaded playing resources corresponding to the target interactive node.
It should be noted that, after receiving the interaction operation of the user and determining the target interaction node, the playing resource corresponding to the target interaction node may have already been downloaded at this time, and may also have not been downloaded. Different treatments are required according to different situations, including:
and under the condition that the downloading of the playing resources of the target interactive node is completed, the playing resources which are locally stored by the target interactive node can be obtained, and the playing resources are played.
Or, under the condition that the downloading of the playing resource of the target interactive node is not completed, acquiring the locally stored target resource of the target interactive node, playing the target resource, and downloading the part which is not stored in the playing resource from the server when the target resource is played. Therefore, the video playing can be realized while downloading, and the problem that the video is blocked because the video cannot be played in the buffering process is avoided.
By adopting the method, one or more second interactive nodes which are adjacent to the playing sequence of the first interactive node currently playing and are positioned behind the first interactive node can be downloaded from the server in advance according to the preset playing sequence of each interactive node in the interactive video; after a target interactive node to be played is determined from one or more second interactive nodes according to the interactive operation of the user, the playing resource corresponding to the target interactive node can be directly played without waiting for downloading buffer. Therefore, the buffering time in the interactive video playing process can be reduced, video blockage is reduced, and the experience of watching the interactive video by a user is improved.
Optionally, after the client determines a playing link of the interactive video according to the user instruction, an HTTP (HyperText Transfer Protocol) proxy may be created, and the interactive node list of the interactive video and a playing resource corresponding to each interactive node are downloaded from the server through the HTTP proxy. In this embodiment, the playing resource corresponding to the second interactive node may be downloaded from the server to the client through the HTTP proxy, and stored in the preset local buffer; after the client determines a target interactive node to be played according to an interactive operation input by a user, it may first determine whether a playing resource corresponding to the target interactive node exists in the local buffer through an HTTP proxy, and then execute the following steps:
if the playing resource is determined to be completely stored in the local buffer area, the playing resource is directly obtained from the local buffer area and played;
if the local buffer area is determined to have the partial playing resources of the target interaction node, firstly, the partial playing resources are obtained from the local buffer area and played, and meanwhile, the part which is not stored in the playing resources is downloaded through an HTTP proxy;
if the local buffer zone is determined not to have the playing resource, the playing resource is downloaded through the HTTP proxy and played after being downloaded.
Therefore, the downloading of the playing resources is realized through the HTTP proxy, and the playing of the interactive video can be completed in parallel, so that the buffering time is reduced, and the video is prevented from being blocked.
In another embodiment of the present disclosure, the playing resource corresponding to the target interactive node may include multiple channels of videos, where the multiple channels of videos include one channel of main video and one or more channels of auxiliary videos, and in order to ensure a playing effect, the multiple channels of auxiliary videos need to be synchronized with a playing progress of the main video, that is, playing durations of the multiple channels of auxiliary videos are the same. Exemplarily, in an interactive video teaching scene, the main video may be a teaching Document playing video, and the teaching Document may be in a PPT (PowerPoint) Format, a PDF (Portable Document Format) Format, a WORD Format, or the like; the secondary video may be a teacher explanation video.
Aiming at a target interactive node of which the playing resources comprise multiple paths of videos, under the condition that the downloading of the playing resources of the target interactive node is not finished, the stored target resources of the main video can be played firstly; synchronously playing the auxiliary video according to the played time length of the main video, wherein the played time length of the auxiliary video is less than or equal to the played time length of the main video; and downloading the parts of the main video and the auxiliary video which are not stored locally from the server while playing the main video and the auxiliary video.
Thus, synchronous playing of the main video and the auxiliary video can be realized. In the above example, the synchronization of the classroom explanation video and the teaching document playing video can be realized, and the teaching effect is prevented from being influenced by the inconsistency between the classroom explanation video and the teaching document playing video.
Further, in the process of synchronously playing the auxiliary video, if the auxiliary video is not completely downloaded, the first playable duration of the downloaded part of the auxiliary video can be periodically obtained; and under the condition that the time length difference value between the first playable time length and the played time length of the main video is less than or equal to a first preset time length difference threshold value, pausing the playing of the main video, and continuing to download the auxiliary video until the playing of the main video is resumed under the condition that the time length difference value is greater than the first preset time length difference threshold value.
In this step, the first playable time length of the downloaded portion of the auxiliary video may be obtained through the following formula:
T1＝D1/D0*T0，
wherein, T1 represents the first playable duration of the downloaded portion of the auxiliary video, D1 represents the number of bytes of the downloaded portion of the auxiliary video, D0 represents the total number of bytes of the auxiliary video, and T0 represents the total playable duration of the auxiliary video. D0 and T0 may be obtained from the file header of the secondary video.
It should be noted that the period of obtaining the first playable time length of the downloaded portion of the auxiliary video may be any time length between 0.1 second and 3 seconds, which is preset, and for example, may be 0.25 second, 0.5 second, or 1 second. The first preset time difference threshold may be any preset time between 0 second and 3 seconds, and may be, for example, 0.1 second, 0.5 second, or 1 second.
Therefore, in order to ensure the synchronous playing of the auxiliary video and the main video, the playing progress of the main video is actively controlled according to the time length difference value between the first playable time length of the downloaded part of the auxiliary video and the played time length of the main video, so that the synchronous playing of the auxiliary video and the main video is realized.
Optionally, if there are multiple auxiliary videos, the first playable time length is a minimum value of playable time lengths of downloaded portions of the multiple auxiliary videos.
Further, since the main video is preferentially played during the playing process, if the downloaded part of the main video is already played, the interactive video is not played any more, in this embodiment, the manner of downloading the part, which is not stored locally, of the main video and the auxiliary video from the server may include any one of the following manners:
in the first mode, when the byte number of the file of the main video is less than or equal to the threshold value of the byte number of the preset file, the main video can be downloaded preferentially, and the auxiliary video is downloaded after the main video is downloaded.
The number of bytes of the preset file can be any number between 100KB and 2MB, and the method is suitable for the situation that the number of bytes of the main video file is small, for example, the main video in the teaching video is a teaching document playing video generally, and the number of bytes of the video file is small generally.
And secondly, when the byte number of the file of the main video is larger than the preset threshold value of the byte number of the file, the download bandwidth allocated to the main video can be set to be larger than the download bandwidth allocated to the auxiliary video. Illustratively, the primary video may be allocated twice the download bandwidth as the secondary video.
By the method, the main video can be preferentially downloaded, the interactive video can be normally played, and the blockage is avoided.
In another embodiment of the present disclosure, the playing resource corresponding to the second interactive node may include multiple channels of videos, and the downloading of the playing resource corresponding to the second interactive node from the server in the step S202 may include the following specific manners:
first, the multiple videos are downloaded in parallel from the server.
In this step, the multiple videos may be downloaded in parallel from the server according to the download bandwidth allocated to each video. The method for distributing the download bandwidth for each path of video can be that the download bandwidth is distributed for multiple paths of video evenly; or allocating download bandwidth for multiple channels of video according to the proportion of the file size of the multiple channels of video. Illustratively, if the multi-path video includes three-path videos, and the file sizes are 10MB, 20MB, and 30MB, respectively, the download bandwidth may be allocated for the three-path videos in a ratio of 1.
And secondly, periodically acquiring second playable time lengths of the downloaded parts of each path of video, and calculating the difference value between the maximum second playable time length and the minimum second playable time length in the second playable time lengths of the paths of video to obtain a target time length difference value.
It should be noted that, the manner of obtaining the second playable time length is the same as that of obtaining the first playable time length, and is not described herein again.
And thirdly, the downloading bandwidth of each path of video is adjusted according to the target time length difference value.
In this step, under the condition that the target time length difference is smaller than the second preset time length difference threshold, the current download bandwidth of each path of video can be maintained without adjustment.
When the target time length difference is greater than or equal to the second preset time length difference threshold, the download bandwidth of one path of video corresponding to the minimum second playable time length can be doubled, and accordingly, the download bandwidths of other paths of video are averagely reduced under the condition that the total download bandwidth is not changed. In this way, the target time period difference can be reduced.
Optionally, when the target duration difference is greater than or equal to the second preset duration difference threshold, the sum of the current download bandwidths of the multiple channels of videos may also be used as the total download bandwidth, and the sum of the second playable durations of the multiple channels of videos may also be used as the total playable duration; calculating the distribution bandwidth of each path of video according to the total download bandwidth, the total playable time length and the second playable time length of each path of video; the allocated bandwidth is used as the download bandwidth of each video. Wherein, the allocated bandwidth of each video can be calculated by the following formula:
Wi＝W general assembly *(1–Ti/T General assembly )，
Where Wi represents the allocated bandwidth of the ith video, W General assembly The total download bandwidth of the multi-path video is shown, ti shows the second playable time length of the ith path video, and T General assembly Indicating the total playable time of the multi-channel video.
Wherein the second preset time difference threshold may be any preset time between 0 second and 3 seconds, and may be, for example, 0.1 second, 0.5 second, or 1 second.
And finally, downloading the multi-channel video according to the downloading bandwidth so that the target time length difference value is smaller than a second preset time length difference threshold value.
Therefore, by the mode, under the condition that the total download bandwidth is fixed, the respective download bandwidths of the multiple paths of videos are adjusted and distributed, so that the download progress of the multiple paths of videos is basically kept consistent, and under the condition that the multiple paths of videos are played under the condition that the videos are not downloaded, the synchronous playing of the multiple paths of videos can be ensured.
In another embodiment of the present disclosure, after downloading the play resource corresponding to the second interactive node from the server, the method may further include:
first, a third playable duration of the playing resource corresponding to the second interactive node is obtained.
The third playable time length is a total playable time length of the playback resource, and the total playable time length can be obtained from a file header of the playback resource.
In this step, if there are a plurality of second interactive nodes, the playable duration of the playing resource corresponding to each second interactive node may be first obtained, and the minimum value of the playable durations may be used as the third playable duration; the average value of the plurality of playable time periods may also be used as the third playable time period.
Secondly, under the condition that the third playable time length is less than or equal to a preset playable time length threshold value, one or more third interaction nodes are determined according to the preset playing sequence of each interaction node in the interaction video.
The third interactive node is an interactive node which is adjacent to the playing sequence of the second interactive node and is positioned behind the second interactive node in the plurality of interactive nodes of the interactive video.
The preset playable time period threshold may be any time period between 1 second and 60 seconds, which is preset, and may be 5 seconds, 10 seconds, or 30 seconds, for example.
And finally, downloading the playing resources corresponding to the third interactive node from the server.
Therefore, under the condition that the playable time of the pre-downloaded second interactive node is short, the next-level third interactive node can be continuously pre-downloaded, so that the playable time of the buffer storage of the client is long, and the problem of pause of interactive video playing can be further avoided.
Further, after determining a target interactive node to be played from one or more second interactive nodes in step S203, the method may further include:
determining whether the downloading of the playing resources corresponding to other interactive nodes except the target interactive node in the second interactive node is finished under the condition that the number of the second interactive nodes is multiple;
and under the condition that the playing resources corresponding to the other interactive nodes are not downloaded, stopping downloading the playing resources corresponding to the other interactive nodes.
Therefore, unnecessary interactive nodes can be stopped from being downloaded, the interactive nodes which are currently played and are about to be played are downloaded by using effective bandwidth resources, and the downloading efficiency of the interactive video is improved.
Fig. 4 is a schematic structural diagram of an interactive video playing apparatus provided in an embodiment of the present disclosure, as shown in fig. 4, the apparatus may be applied to a client, and the apparatus includes:
a to-be-downloaded interactive node determining module 401, configured to determine one or more second interactive nodes according to a preset playing sequence of each interactive node in an interactive video when a playing resource corresponding to a first interactive node in the interactive video is played, where the second interactive node is an interactive node that is adjacent to the playing sequence of the first interactive node and is located behind the first interactive node, in the multiple interactive nodes of the interactive video;
a resource downloading module 402, configured to download, from the server, the playing resource corresponding to the second interactive node;
a to-be-played interactive node determining module 403, configured to determine, according to an interactive operation input by a user for the first interactive node, a target interactive node to be played from one or more second interactive nodes;
and a resource playing module 404, configured to play the downloaded playing resource corresponding to the target interactive node.
Optionally, the resource downloading module 402 is configured to, in a case that the client does not store the playing resource of the second interactive node, download the playing resource corresponding to the second interactive node from the server; or, in a case that the client stores a part of the playing resources of the second interactive node, downloading, from the server, other playing resources except the part of the playing resources in the playing resources corresponding to the second interactive node, and merging the part of the playing resources and the other playing resources into a complete playing resource of the second interactive node.
Optionally, the resource playing module 404 is configured to, in a case that the downloading of the playing resource of the target interactive node is not completed, obtain a target resource that is already locally stored by the target interactive node, play the target resource, and download an unstored part of the playing resource from the server when playing the target resource.
Optionally, the playing resource includes a main video and an auxiliary video, and the resource playing module 404 is specifically configured to play a target resource stored in the main video; and synchronously playing the auxiliary video according to the played time length of the main video, wherein the played time length of the auxiliary video is less than or equal to the played time length of the main video.
Optionally, the resource downloading module 402 is further configured to periodically obtain a first playable duration of the downloaded portion of the auxiliary video in the process of synchronously playing the auxiliary video; and under the condition that the time length difference value between the first playable time length and the played time length of the main video is less than or equal to a first preset time length difference threshold value, pausing the playing of the main video, and continuing to download the auxiliary video until the playing of the main video is resumed under the condition that the time length difference value is greater than the first preset time length difference threshold value.
Optionally, the playing resource of the second interactive node includes multiple channels of videos; the resource downloading module 402 is further configured to download the multiple videos from the server in parallel; periodically acquiring a second playable time length of the downloaded part of each path of video; calculating the difference value between the maximum second playable time length and the minimum second playable time length in the second playable time lengths of the multi-channel videos to obtain a target time length difference value; adjusting the downloading bandwidth of each path of video according to the target time length difference; and downloading the multi-channel video according to the downloading bandwidth so that the target time length difference value is smaller than a second preset time length difference threshold value.
Optionally, the resource downloading module 402 is specifically configured to, when the target duration difference is greater than or equal to the second preset duration difference threshold, use a sum of current downloading bandwidths of the multiple channels of videos as a total downloading bandwidth, and use a sum of second playable durations of the multiple channels of videos as a total playable duration; calculating the distribution bandwidth of each path of video according to the total download bandwidth, the total playable time length and the second playable time length of each path of video; the allocated bandwidth is used as the download bandwidth of each video.
Optionally, the resource downloading module 402 is further configured to obtain a third playable duration of the playing resource corresponding to the second interactive node after the playing resource corresponding to the second interactive node is downloaded from the server; determining one or more third interactive nodes according to a preset playing sequence of each interactive node in the interactive video under the condition that the third playable time length is less than or equal to a preset playable time length threshold value, wherein the third interactive nodes are the interactive nodes which are adjacent to the playing sequence of the second interactive node and are positioned behind the second interactive node in the plurality of interactive nodes of the interactive video; and downloading the playing resources corresponding to the third interactive node from the server.
Optionally, the resource downloading module 402 is further configured to, after determining a target interactive node to be played from one or more second interactive nodes, determine whether downloading of playing resources corresponding to other interactive nodes except the target interactive node in the second interactive node is completed under the condition that there are a plurality of second interactive nodes; and under the condition that the playing resources corresponding to the other interactive nodes are not downloaded, stopping downloading the playing resources corresponding to the other interactive nodes.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 5 is a block diagram of an electronic device 500 shown in accordance with an example embodiment. As shown in fig. 5, the electronic device 500 may include: a processor 501 and a memory 502. The electronic device 500 may also include one or more of a multimedia component 503, an input/output (I/O) interface 504, and a communication component 505.
The processor 501 is configured to control the overall operation of the electronic device 500, so as to complete all or part of the steps in the above-mentioned interactive video playing method. The memory 502 is used to store various types of data to support operation at the electronic device 500, such as instructions for any application or method operating on the electronic device 500 and application-related data, such as contact data, messaging, pictures, audio, video, and the like. The Memory 502 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically Erasable Programmable Read-Only Memory (EEPROM), erasable Programmable Read-Only Memory (EPROM), programmable Read-Only Memory (PROM), read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk or optical disk. The multimedia component 503 may include a screen and an audio component. Wherein the screen may be, for example, a touch screen and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving an external audio signal. The received audio signal may further be stored in the memory 502 or transmitted through the communication component 505. The audio assembly also includes at least one speaker for outputting audio signals. The I/O interface 504 provides an interface between the processor 501 and other interface modules, such as a keyboard, mouse, buttons, and the like. These buttons may be virtual buttons or physical buttons. The communication component 505 is used for wired or wireless communication between the electronic device 500 and other devices. Wireless Communication, such as Wi-Fi, bluetooth, near Field Communication (NFC), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, or combinations thereof, which is not limited herein. The corresponding communication component 505 may thus comprise: wi-Fi module, bluetooth module, NFC module, etc.
In an exemplary embodiment, the electronic Device 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components for executing the above-mentioned interactive video playing method.
In another exemplary embodiment, a computer readable storage medium including program instructions for implementing the steps of the interactive video playing method described above when executed by a processor is also provided. For example, the computer readable storage medium may be the memory 502 described above that includes program instructions executable by the processor 501 of the electronic device 500 to perform the interactive video playback method described above.
Fig. 6 is a block diagram illustrating an electronic device 600 according to an example embodiment. For example, the electronic device 600 may be provided as a server. Referring to fig. 6, the electronic device 600 includes a processor 622, which may be one or more in number, and a memory 632 for storing computer programs executable by the processor 622. The computer program stored in memory 632 may include one or more modules that each correspond to a set of instructions. Further, the processor 622 can be configured to execute the computer program to perform the above-described interactive video playing method.
Additionally, electronic device 600 may also include a power component 626 that may be configured to perform power management of electronic device 600 and a communication component 650 that may be configured to enable communication, e.g., wired or wireless communication, of electronic device 600. The electronic device 600 may also include input/output (I/O) interfaces 658. The electronic device 600 may operate based on an operating system, such as Windows Server, mac OS, unix, linux, etc., stored in the memory 632.
In another exemplary embodiment, a computer readable storage medium comprising program instructions which, when executed by a processor, implement the steps of the interactive video playback method described above is also provided. For example, the computer readable storage medium can be the memory 632 described above that includes program instructions that can be executed by the processor 622 of the electronic device 600 to perform the interactive video playback method described above.
In another exemplary embodiment, a computer program product is also provided, which comprises a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-mentioned interactive video playback method when executed by the programmable apparatus.
The preferred embodiments of the present disclosure are described in detail with reference to the accompanying drawings, however, the present disclosure is not limited to the specific details of the above embodiments, and various simple modifications may be made to the technical solution of the present disclosure within the technical idea of the present disclosure, and these simple modifications all belong to the protection scope of the present disclosure.
It should be noted that the various features described in the above embodiments may be combined in any suitable manner without departing from the scope of the invention. In order to avoid unnecessary repetition, various possible combinations will not be separately described in this disclosure.
In addition, any combination of various embodiments of the present disclosure may be made, and the same should be considered as the disclosure of the present disclosure, as long as it does not depart from the spirit of the present disclosure.
Claims (11)
1. An interactive video playing method is applied to a client, and the method comprises the following steps:
under the condition of playing a playing resource corresponding to a first interactive node in an interactive video, determining one or more second interactive nodes according to a preset playing sequence of each interactive node in the interactive video, wherein the interactive video comprises a plurality of interactive nodes, each interactive node corresponds to one playing resource, and the second interactive nodes are the interactive nodes which are adjacent to the playing sequence of the first interactive node and positioned behind the first interactive node in the plurality of interactive nodes of the interactive video;
downloading the playing resources corresponding to the second interactive node from a server;
determining a target interactive node to be played from one or more second interactive nodes according to the interactive operation input by the user aiming at the first interactive node;
playing the downloaded playing resources corresponding to the target interactive node;
the playing resource of the second interactive node comprises a plurality of paths of videos; the downloading of the play resource corresponding to the second interactive node from the server includes:
downloading the multi-channel videos from the server in parallel;
periodically acquiring a second playable time length of the downloaded part of each path of video;
calculating the difference value between the maximum second playable time length and the minimum second playable time length in the second playable time lengths of the multi-channel videos to obtain a target time length difference value;
adjusting the downloading bandwidth of each path of video according to the target time length difference;
and downloading the multi-channel video according to the downloading bandwidth so that the target time length difference value is smaller than a second preset time length difference threshold value.
2. The method according to claim 1, wherein the downloading the playback resource corresponding to the second interactive node from the server comprises:
downloading the playing resources corresponding to the second interactive node from a server under the condition that the playing resources of the second interactive node are not stored in the client; alternatively, the first and second electrodes may be,
and under the condition that the client stores part of the playing resources of the second interactive node, downloading other playing resources except the part of the playing resources in the playing resources corresponding to the second interactive node from a server, and combining the part of the playing resources and the other playing resources into the complete playing resources of the second interactive node.
3. The method according to claim 2, wherein the playing the downloaded playing resource corresponding to the target interactive node comprises:
under the condition that the downloading of the playing resources of the target interaction node is not completed, the locally stored target resources of the target interaction node are obtained, the target resources are played, and the part which is not stored in the playing resources is downloaded from the server when the target resources are played.
4. The method of claim 3, wherein the playback resources comprise a primary video and a secondary video, and wherein playing the target resource comprises:
playing the stored target resource of the main video;
and synchronously playing the auxiliary video according to the played time length of the main video, wherein the played time length of the auxiliary video is less than or equal to the played time length of the main video.
5. The method of claim 4, further comprising:
in the process of synchronously playing the auxiliary video, periodically acquiring a first playable time length of a downloaded part of the auxiliary video;
and under the condition that the time length difference value between the first playable time length and the played time length of the main video is less than or equal to a first preset time length difference threshold value, pausing the playing of the main video, and continuing to download the auxiliary video until the playing of the main video is resumed under the condition that the time length difference value is greater than the first preset time length difference threshold value.
6. The method of claim 1, wherein the adjusting the download bandwidth of each video according to the target duration difference comprises:
taking the sum of the current download bandwidths of the multiple paths of videos as the total download bandwidth and taking the sum of the second playable durations of the multiple paths of videos as the total playable duration under the condition that the target duration difference is greater than or equal to the second preset duration difference threshold;
calculating the distribution bandwidth of each path of video according to the total download bandwidth, the total playable time length and the second playable time length of each path of video;
and taking the allocated bandwidth as the download bandwidth of each video.
7. The method according to any one of claims 1 to 6, wherein after downloading the playing resource corresponding to the second interactive node from the server, the method further comprises:
acquiring a third playable duration of a playing resource corresponding to the second interactive node;
determining one or more third interactive nodes according to a preset playing sequence of each interactive node in the interactive video under the condition that the third playable time length is less than or equal to a preset playable time length threshold value, wherein the third interactive nodes are the interactive nodes which are adjacent to the playing sequence of the second interactive node and are positioned behind the second interactive node in the plurality of interactive nodes of the interactive video;
and downloading the playing resources corresponding to the third interactive node from a server.
8. The method according to any of claims 1 to 6, wherein after determining a target interactive node to be played from the one or more second interactive nodes, the method further comprises:
under the condition that a plurality of second interactive nodes are provided, determining whether the downloading of the playing resources corresponding to other interactive nodes except the target interactive node in the second interactive nodes is completed;
and under the condition that the playing resources corresponding to the other interactive nodes are not downloaded, stopping downloading the playing resources corresponding to the other interactive nodes.
9. An interactive video playing device, applied to a client, the device comprising:
the interactive node determining module is used for determining one or more second interactive nodes according to the preset playing sequence of each interactive node in the interactive video under the condition that a playing resource corresponding to a first interactive node in the interactive video is played, wherein the second interactive nodes are the interactive nodes which are adjacent to the playing sequence of the first interactive node and are positioned behind the first interactive node in the plurality of interactive nodes of the interactive video;
the resource downloading module is used for downloading the playing resources corresponding to the second interactive node from a server; the playing resources of the second interactive node comprise multiple paths of videos;
the interactive node to be played determining module is used for determining a target interactive node to be played from one or more second interactive nodes according to the interactive operation input by the user aiming at the first interactive node;
the resource playing module is used for playing the downloaded playing resources corresponding to the target interactive node;
the resource downloading module is used for downloading the multi-channel videos from the server in parallel; periodically acquiring a second playable time length of the downloaded part of each path of video; calculating the difference value between the maximum second playable time length and the minimum second playable time length in the second playable time lengths of the multi-channel videos to obtain a target time length difference value; adjusting the downloading bandwidth of each path of video according to the target time length difference; and downloading the multi-channel video according to the downloading bandwidth so that the target time length difference value is smaller than a second preset time length difference threshold value.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 8.
11. An electronic device, comprising:
a memory having a computer program stored thereon;
a processor for executing the computer program in the memory to carry out the steps of the method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110281669.2A CN113115117B (en) | 2021-03-16 | 2021-03-16 | Interactive video playing method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110281669.2A CN113115117B (en) | 2021-03-16 | 2021-03-16 | Interactive video playing method and device, storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113115117A CN113115117A (en) | 2021-07-13 |
| CN113115117B true CN113115117B (en) | 2022-12-23 |
Family
ID=76711373
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110281669.2A Active CN113115117B (en) | 2021-03-16 | 2021-03-16 | Interactive video playing method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113115117B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114125532A (en) * | 2021-10-30 | 2022-03-01 | 杭州当虹科技股份有限公司 | Interactive video seamless cutting method and device |
| CN113891170B (en) * | 2021-11-23 | 2024-05-03 | 维沃移动通信有限公司 | Downloading method, downloading device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1653415A (en) * | 2002-05-14 | 2005-08-10 | Lg电子株式会社 | System and method for synchronous reproduction of local and remote content in a communication network |
| CN105117999A (en) * | 2015-08-28 | 2015-12-02 | 上海第九城市教育科技股份有限公司 | Mandatory interaction system and method of multimedia courseware |
| CN105117381A (en) * | 2015-08-28 | 2015-12-02 | 上海第九城市教育科技股份有限公司 | Method and system for generating interactive multimedia courseware |
| CN106851424A (en) * | 2017-04-07 | 2017-06-13 | 腾讯科技（深圳）有限公司 | Video broadcasting method and device |
| WO2018107346A1 (en) * | 2016-12-13 | 2018-06-21 | 天彩电子（深圳）有限公司 | Usb-based data transmission method and system thereof |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2542174B (en) * | 2015-09-10 | 2018-04-04 | Openwave Mobility Inc | An intermediate network entity for controlling bandwidth for an adaptive bit rate stream |
-
2021
- 2021-03-16 CN CN202110281669.2A patent/CN113115117B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1653415A (en) * | 2002-05-14 | 2005-08-10 | Lg电子株式会社 | System and method for synchronous reproduction of local and remote content in a communication network |
| CN105117999A (en) * | 2015-08-28 | 2015-12-02 | 上海第九城市教育科技股份有限公司 | Mandatory interaction system and method of multimedia courseware |
| CN105117381A (en) * | 2015-08-28 | 2015-12-02 | 上海第九城市教育科技股份有限公司 | Method and system for generating interactive multimedia courseware |
| WO2018107346A1 (en) * | 2016-12-13 | 2018-06-21 | 天彩电子（深圳）有限公司 | Usb-based data transmission method and system thereof |
| CN106851424A (en) * | 2017-04-07 | 2017-06-13 | 腾讯科技（深圳）有限公司 | Video broadcasting method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113115117A (en) | 2021-07-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111372090B (en) | Method and device for realizing wheat connection, electronic equipment and storage medium | |
| CN113115117B (en) | Interactive video playing method and device, storage medium and electronic equipment | |
| CN109107167B (en) | Interactive control method in game, electronic device and storage medium | |
| US10516718B2 (en) | Platform for multiple device playout | |
| KR101503121B1 (en) | Streaming data downloading method and computer readable recording medium thereof | |
| CN112752109B (en) | Video playing control method and system | |
| US20170359607A1 (en) | Distributed and synchronized media switching | |
| CN110856011B (en) | Method for grouping live broadcast interaction, electronic equipment and storage medium | |
| US10084987B2 (en) | Remote control of distributed video presentations on a plurality of viewer systems | |
| CN111212294B (en) | Method and device for updating state of live broadcast room and readable storage medium | |
| US11259063B2 (en) | Method and system for setting video cover | |
| US9866602B2 (en) | Adaptive bit rates during broadcast transmission in distributed content delivery networks | |
| CN106231367B (en) | Beautifying processing method and device | |
| CN112203111A (en) | Multimedia resource preloading method and device, electronic equipment and storage medium | |
| US20230247234A1 (en) | Method and apparatus for playing livestreaming video, electronic device, storage medium, and program product | |
| US11736755B2 (en) | Methods, systems, and media for synchronized media content playback on multiple devices | |
| CN106101745A (en) | A kind of video broadcasting method and system | |
| US9692831B1 (en) | Pausing interactive sessions | |
| KR102483884B1 (en) | Method and apparatus for syncronizing state information of plural terminals | |
| KR102051985B1 (en) | Synchronization of Media Rendering in Heterogeneous Networking Environments | |
| KR20220032229A (en) | Method for controlling data transmission in distributed network and appratuses perfroming the same | |
| CN109348242B (en) | Live network scheduling method, device, medium and electronic equipment | |
| US11470362B1 (en) | Providing audio data for a video frame | |
| JP6331820B2 (en) | PROGRAM INFORMATION DISTRIBUTION DEVICE, PROGRAM INFORMATION DISTRIBUTION SYSTEM, PROGRAM INFORMATION RECEPTION DEVICE, PROGRAM INFORMATION DISTRIBUTION METHOD, PROGRAM INFORMATION RECEPTION METHOD, PROGRAM INFORMATION DISTRIBUTION PROGRAM, AND PROGRAM INFORMATION RECEPTION PROGRAM | |
| KR102609728B1 (en) | Method and apparatus for providing a service that synchronizes the playback time of video content in real time |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |