CN114205638A

CN114205638A - Video delay playing method and device

Info

Publication number: CN114205638A
Application number: CN202010909446.1A
Authority: CN
Inventors: 刘晓玲; 陈云海
Original assignee: China Telecom Corp Ltd
Current assignee: China Telecom Corp Ltd
Priority date: 2020-09-02
Filing date: 2020-09-02
Publication date: 2022-03-18

Abstract

The disclosure relates to a method and a device for delayed playing of a video, and relates to the technical field of computers. The delayed playing method comprises the following steps: responding to a video frame to be delayed in a video to be coded into a coded video frame, and acquiring a current timestamp of the coded video frame; under the condition that the current timestamp of the coded video frame meets a delay condition, caching the coded video frame; and inserting the delayed video before the video frame is coded, and outputting the coded video frame after the delayed video is output.

Description

Video delay playing method and device

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a video delay playing method, a video delay playing apparatus, and a non-volatile computer-readable storage medium.

Background

Due to the regulatory requirements of video content security, delayed processing is required for video broadcasting (such as cloud-directed broadcasting for live broadcasting). Within the delay time, video content supervisors or supervisory programs can review the video content to avoid broadcasting illegal content.

In the related art center, the stored original bare frame data is inserted before the decoded video frame to realize delayed playing.

Disclosure of Invention

The inventors of the present disclosure found that the following problems exist in the above-described related art: limited by a large amount of occupied memory, only short time delay can be supported, and the delayed broadcasting effect is poor.

In view of this, the present disclosure provides a technical scheme for delayed playing of a video, which can reduce memory usage and support a longer delay, thereby improving a delayed playing effect.

According to some embodiments of the present disclosure, a method for delayed playing of a video is provided, including: responding to a video frame to be delayed in a video to be coded into a coded video frame, and acquiring a current timestamp of the coded video frame; under the condition that the current timestamp of the coded video frame meets a delay condition, caching the coded video frame; and inserting the delayed video before the video frame is coded, and outputting the coded video frame after the delayed video is output.

In some embodiments, buffering the encoded video frame in the event that the current timestamp of the encoded video frame satisfies the latency condition comprises: and under the condition that the current timestamp of the coded video frame is matched with the delay timestamp, caching the coded video frame, wherein the delay timestamp is calculated according to the acquired delay parameter and the acquired current timestamp of the video frame to be delayed.

In some embodiments, the method further comprises: and determining the video frame with the first current timestamp not later than the delay timestamp in the video as the video frame to be delayed.

In some embodiments, the encoded video frame of which the first current timestamp is greater than or equal to the delay timestamp in the video is determined as the encoded video frame that needs to be buffered.

In some embodiments, the method further comprises: and under the condition that the current timestamp of the coded video frame does not meet the delay condition, outputting the coded video frame.

In some embodiments, each video frame in the video is encoded after being decapsulated, decoded, and special effect synthesized.

In some embodiments, the duration of the delayed video is set according to a delay condition.

According to other embodiments of the present disclosure, there is provided a video delay playing apparatus, including: the acquisition unit is used for responding to the condition that a video frame to be delayed in a video is coded into a coded video frame, and acquiring a current timestamp of the coded video frame; the buffer unit is used for buffering the coded video frame under the condition that the current timestamp of the coded video frame meets the delay condition; and the output unit is used for inserting the delayed video before the encoded video frame and outputting the encoded video frame after the delayed video is output.

In some embodiments, the buffering unit buffers the encoded video frame in case that the current timestamp of the encoded video frame matches the delay timestamp, which is calculated from the obtained delay parameter and the obtained current timestamp of the video frame to be delayed.

In some embodiments, the buffering unit determines the first encoded video frame of the video whose current timestamp is greater than or equal to the delay timestamp as the encoded video frame to be buffered.

In some embodiments, the apparatus further comprises: and the extracting unit is used for responding to a delay request initiated by a user and extracting a delay parameter in the delay request, wherein the delay parameter is used for determining a delay condition.

In some embodiments, the output unit outputs the encoded video frame if the current timestamp of the encoded video frame does not satisfy the delay condition.

According to still other embodiments of the present disclosure, there is provided a delayed playing apparatus for a video, including: a memory; and a processor coupled to the memory, the processor configured to execute the delayed play method of video in any of the above embodiments based on instructions stored in the memory device.

According to still further embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a time-lapse playing method of a video in any of the above embodiments.

In the above embodiment, when the video frame has been encoded and is to be output encapsulated, the delayed video is inserted. Therefore, the delayed playing can be realized only by buffering the coded video frame, the memory occupation can be reduced, and the delay of a longer time is supported, so that the delayed playing effect is improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description, serve to explain the principles of the disclosure.

The present disclosure can be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:

fig. 1 illustrates a flow diagram of some embodiments of a method of delayed play of a video of the present disclosure;

FIG. 2 illustrates a flow diagram of further embodiments of the disclosed video delay play method;

FIG. 3 illustrates a flow diagram of further embodiments of the disclosed video delay play method;

FIG. 4 illustrates a block diagram of some embodiments of a delayed play apparatus of a video of the present disclosure;

FIG. 5 shows a block diagram of further embodiments of a delayed play apparatus of a video of the present disclosure;

fig. 6 shows a block diagram of further embodiments of the video time-lapse playing device of the present disclosure.

Detailed Description

Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.

In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.

As previously mentioned, storing a large amount of raw bare frame data results in a large amount of memory consumed by the server. The longer the time, the more memory is consumed. Particularly, in high-definition video processing, the data amount of a video frame is very large. Therefore, the time of the supported delay is often small (for example, only 15 seconds can be supported at most), which results in poor effect of the delayed playing.

In order to solve the problem, the delay processing is carried out through an encapsulation layer after encoding. That is, when the video frame has been encoded, i.e., is to be encapsulated and output, the delayed video is inserted. Therefore, a large amount of naked frame data does not need to be stored, and delayed playing can be realized only by caching the coded video frames. Therefore, the memory consumption is reduced, the long-time delay playing can be supported, and the delay playing effect is improved. For example, the technical solution of the present disclosure can be realized by the following embodiments.

Fig. 1 illustrates a flow diagram of some embodiments of a method of delayed play of a video of the present disclosure.

As shown in fig. 1, the delayed playing method includes: step 110, acquiring a current timestamp of a coded video frame; step 120, caching the encoded video frame; and step 130, outputting the coded video frame in a delayed mode.

In step 110, in response to a video frame to be delayed in a video being encoded as an encoded video frame, a current timestamp of the encoded video frame is obtained.

In step 120, the encoded video frame is buffered if the current timestamp of the encoded video frame satisfies the delay condition.

In some embodiments, the encoded video frame is output if the current timestamp of the encoded video frame does not satisfy the delay condition.

In some embodiments, the encoded video frame is buffered if the current timestamp of the encoded video frame matches the latency timestamp. For example, the delay time stamp may be calculated by the embodiment in fig. 2.

Fig. 2 shows a flow diagram of further embodiments of the disclosed video delay play method.

As shown in fig. 2, step 120 may include: step 210, extracting a delay parameter; and step 220, calculating a delay time stamp.

In step 210, in response to a user initiating a delay request, a delay parameter in the delay request is extracted. The delay parameter is used to determine a delay condition.

In step 220, a delay time stamp is calculated according to the acquired delay parameter and the acquired current time stamp of the video frame to be delayed.

In some embodiments, the encoded video frame with the first current timestamp greater than or equal to the latency timestamp in the video may be determined as the encoded video frame (key frame) that needs to be buffered.

After the corresponding encoded video frame is cached according to the calculated delay time stamp, the delayed play can be performed according to the remaining steps in fig. 1.

In step 130, a delayed video is inserted before the encoded video frame, and the encoded video frame is output after the delayed video is output. For example, the duration of the delayed video is set according to the delay condition.

Fig. 3 shows a flow chart of further embodiments of the video delay play method of the present disclosure.

As shown in fig. 3, the cloud director process for live video may include: a left data processing flow; and the delay processing flow on the right side.

For the cloud broadcasting process without delayed broadcasting, coded food can be output only through a data processing flow. For example, the encoded video may be output after a decapsulation process, a decoding process (acquiring an original video frame), a special effect composition process, an encoding process (acquiring an encoded video frame), and an encapsulation process for an input video stream.

For the cloud director process that needs to perform delayed playing, a delay processing step may be inserted in the corresponding step of the data processing flow to implement delayed playing.

In step 310, when the cloud server receives a delay request sent by the client, the delay parameter in the delay request is extracted. For example, the delay parameters may include delay duration, delay requirement, and the like.

In step 320, a timestamp (delay timestamp) that needs to be inserted into the delayed video is determined according to the current timestamp and the delay time.

In some embodiments, a timestamp of a video frame to be currently encoded after the special effect synthesis process may be recorded as the marking timestamp. And determining a delay time stamp according to the marking time stamp and the delay time length.

In step 330, it is detected whether the marking timestamp of the encoded video is greater than or equal to the delay timestamp. In the case of greater than or equal to, perform step 340; in the case of less than, step 360 is performed.

In some embodiments, a first video frame of the video with a timestamp greater than or equal to the delay timestamp may be used as a key frame, so that the delayed video is inserted before the key frame to realize delayed playing.

In some embodiments, the encapsulation layer timestamp of the encoded video is read when the encapsulation process is performed after the encoding process is completed. And judging whether the packaging layer timestamp is greater than or equal to the delay timestamp.

In step 340, the current encoded video frame is buffered and the encoded delayed video is inserted.

In step 350, the delayed video is played until the desired delay period is completed.

In step 360, the encoded video is output.

In the above embodiment, the data amount required to be cached is greatly reduced, so that long-time delayed playing is realized. The cloud server can flexibly respond to the delay request of the user, and flexible control of delay time from zero to zero and from few to many is realized.

Fig. 4 illustrates a block diagram of some embodiments of a delayed play apparatus of a video of the present disclosure.

As shown in fig. 4, the delayed playing apparatus 4 for video includes an obtaining unit 41, a buffering unit 42, and an output unit 43.

The obtaining unit 41 obtains a current timestamp of the encoded video frame in response to the video frame to be delayed in the video being encoded as an encoded video frame.

The buffering unit 42 buffers the encoded video frame in case that the current timestamp of the encoded video frame satisfies the delay condition.

In some embodiments, the buffering unit 42 buffers the encoded video frame if the current timestamp of the encoded video frame matches the latency timestamp. And calculating the delay time stamp according to the acquired delay parameters and the acquired current time stamp of the video frame to be delayed.

The output unit 43 inserts the delayed video before encoding the video frame, and outputs the encoded video frame after the delayed video is output.

In some embodiments, the output unit 43 outputs the encoded video frame if the current timestamp of the encoded video frame does not satisfy the delay condition.

In some embodiments, the buffering unit 42 determines the first encoded video frame in the video whose current timestamp is greater than or equal to the delay timestamp as the encoded video frame that needs to be buffered.

In some embodiments, the delayed playing apparatus 4 further includes: and the extracting unit 44 is configured to, in response to a user initiating a delay request, extract a delay parameter in the delay request. The delay parameter is used to determine a delay condition.

Fig. 5 shows a block diagram of further embodiments of the video time-lapse playing apparatus of the present disclosure.

As shown in fig. 5, the delayed playing apparatus 5 for video of this embodiment includes: a memory 51 and a processor 52 coupled to the memory 51, wherein the processor 52 is configured to execute a time-lapse playing method of a video in any one of the embodiments of the present disclosure based on instructions stored in the memory 51.

The memory 51 may include, for example, a system memory, a fixed nonvolatile storage medium, and the like. The system memory stores, for example, an operating system, an application program, a Boot Loader, a database, and other programs.

As shown in fig. 6, the delayed playback device 6 of the video according to this embodiment includes: a memory 610 and a processor 620 coupled to the memory 610, wherein the processor 620 is configured to execute the video delayed play method in any of the foregoing embodiments based on instructions stored in the memory 610.

The memory 610 may include, for example, system memory, fixed non-volatile storage media, and the like. The system memory stores, for example, an operating system, an application program, a Boot Loader, and other programs.

The delayed playing device 6 for video may further include an input/output interface 630, a network interface 640, a storage interface 650, and the like. These

interfaces

630, 640, 650 and the connections between the memory 610 and the processor 620 may be through a bus 660, for example. The input/output interface 630 provides a connection interface for input/output devices such as a display, a mouse, a keyboard, a touch screen, a microphone, and a sound box. The network interface 640 provides a connection interface for various networking devices. The storage interface 650 provides a connection interface for external storage devices such as an SD card and a usb disk.

As will be appreciated by one skilled in the art, embodiments of the present disclosure may be provided as a method, system, or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable non-transitory storage media having computer-usable program code embodied therein, including but not limited to disk storage, CD-ROM, optical storage, and the like.

So far, the time-lapse playing method of a video, the time-lapse playing apparatus of a video, and the non-volatile computer-readable storage medium according to the present disclosure have been described in detail. Some details that are well known in the art have not been described in order to avoid obscuring the concepts of the present disclosure. It will be fully apparent to those skilled in the art from the foregoing description how to practice the presently disclosed embodiments.

The method and system of the present disclosure may be implemented in a number of ways. For example, the methods and systems of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order for the steps of the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above unless specifically stated otherwise. Further, in some embodiments, the present disclosure may also be embodied as programs recorded in a recording medium, the programs including machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.

Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the foregoing examples are for purposes of illustration only and are not intended to limit the scope of the present disclosure. It will be appreciated by those skilled in the art that modifications may be made to the above embodiments without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A delayed playing method of a video comprises the following steps:

responding to a video frame to be delayed in a video to be coded into a coded video frame, and acquiring a current timestamp of the coded video frame;

under the condition that the current timestamp of the coded video frame meets a delay condition, caching the coded video frame;

and inserting a delay video before the coded video frame, and outputting the coded video frame after the delay video is output.

2. The delayed playback method of claim 1, wherein the buffering the encoded video frame if the current timestamp of the encoded video frame satisfies a delay condition comprises:

and under the condition that the current timestamp of the coded video frame is matched with the delay timestamp, caching the coded video frame, wherein the delay timestamp is calculated according to the acquired delay parameter and the acquired current timestamp of the video frame to be delayed.

3. The delayed playback method of claim 2, wherein said buffering the encoded video frame if the current timestamp of the encoded video frame matches the delayed timestamp comprises:

and determining the first coded video frame with the current timestamp greater than or equal to the delay timestamp in the video as the coded video frame needing to be cached.

4. The delayed play method of claim 1, further comprising:

and responding to a delay request initiated by a user, and extracting a delay parameter in the delay request, wherein the delay parameter is used for determining the delay condition.

5. The delayed play method according to any one of claims 1-4, further comprising:

and outputting the coded video frame under the condition that the current timestamp of the coded video frame does not meet the delay condition.

6. The delayed play method according to any one of claims 1-4,

and after each video frame in the video is subjected to decapsulation, decoding and special effect synthesis processing, encoding processing is carried out.

7. The delayed play method according to any one of claims 1-4,

and the time length of the delayed video is set according to the delay condition.

8. A delayed playing device of a video comprises:

the device comprises an acquisition unit, a delay unit and a processing unit, wherein the acquisition unit is used for responding to the condition that a video frame to be delayed in a video is coded into a coded video frame and acquiring the current timestamp of the coded video frame;

the buffer unit is used for buffering the coded video frame under the condition that the current timestamp of the coded video frame meets a delay condition;

and the output unit is used for inserting the delayed video before the coded video frame and outputting the coded video frame after the delayed video is output.

9. The time-lapse playing device of claim 8,

and the cache unit caches the coded video frame under the condition that the current time stamp of the coded video frame is matched with the delay time stamp, wherein the delay time stamp is calculated according to the acquired delay parameters and the acquired current time stamp of the video frame to be delayed.

10. The time-lapse playing device of claim 9,

and the cache unit determines the first coded video frame with the current timestamp greater than or equal to the delay timestamp in the video as the coded video frame needing to be cached.

11. The delayed playback device of claim 8, further comprising:

and the extracting unit is used for responding to a delay request initiated by a user and extracting a delay parameter in the delay request, wherein the delay parameter is used for determining the delay condition.

12. The delayed play device according to any one of claims 8-11,

the output unit outputs the encoded video frame if the current timestamp of the encoded video frame does not satisfy the delay condition.

13. The delayed play device according to any one of claims 8-11,

14. The delayed play device according to any one of claims 8-11,

15. A delayed playing device of a video comprises:

a memory; and

a processor coupled to the memory, the processor configured to execute the method for delayed playback of video of any of claims 1-7 based on instructions stored in the memory.

16. A non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the delayed play method of a video according to any one of claims 1 to 7.