CN111212315A - Data drift resistance low-delay video caching method and system, playing method and terminal - Google Patents
Data drift resistance low-delay video caching method and system, playing method and terminal Download PDFInfo
- Publication number
- CN111212315A CN111212315A CN201811399667.8A CN201811399667A CN111212315A CN 111212315 A CN111212315 A CN 111212315A CN 201811399667 A CN201811399667 A CN 201811399667A CN 111212315 A CN111212315 A CN 111212315A
- Authority
- CN
- China
- Prior art keywords
- video
- data
- time
- image data
- drift
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
Abstract
The invention discloses a data drift resistance low-delay video caching method, a data drift resistance low-delay video caching system, a data drift resistance low-delay video playing method and a data drift resistance low-delay video playing terminal, wherein image data of a video to be displayed are obtained; processing the image data; calculating data drift time, wherein the data drift time is the difference between the maximum time for processing one frame of image data and the time for playing one frame of image; and caching the image data of the video to be displayed, wherein the cached image data amount is equal to or larger than the image data amount required to be played in the data drift time. According to the method and the device, the image data of the video to be displayed is acquired, the image data is processed, the data drift time is calculated, the image data of the video to be displayed in the data drift time or more is cached, and a certain amount of video data is cached, so that the problem of screen display caused by data drift is solved, the delay time of playing is reduced, and the user experience is more comfortable.
Description
Technical Field
The invention relates to the technical field of communication, in particular to a data drift resistant low-delay video caching method, a data drift resistant low-delay video caching system, a data drift resistant low-delay video playing method and a data drift resistant low-delay video playing terminal.
Background
In the period of datamation, video related applications are more and more extensive, a video system generally comprises modules of front-end image acquisition, video encoding, video transmission, video decoding, video display and the like, generally, the front-end image acquisition and the video display adopt mutually independent time sequence driving, the starting time of the two time sequence driving and the beat of the time sequence driving are possibly different, in the processes of the video encoding, the video transmission and the video decoding, it is impossible to process each frame of image according to a fixed beat, for example, 30 frames per second of video, some frames need 35.33ms of time in the modules, some frames need 31.33ms of time, data drift exists, but the video display module requires to display images according to the fixed beat, and for example, 30 frames per second of video, the video display module requires to play one frame of image every 33.33 ms.
In some video application scenarios, there are strict requirements on the latency of the whole video processing system, such as: remote medical image transmission, unmanned aerial vehicle image shooting and control, long-range video communication etc., in whole video system, video display also can lead to certain delay, consequently, in whole video processing system, reduce video display's delay and can show the delay that reduces whole video processing system, if not buffer memory, because the existence of front end data drift, can lead to showing the flower screen, as shown in fig. 1, the video broadcast effect is poor, consequently adopt the mode of buffering a complete image frame to eliminate front end data drift and begin to show again usually, as shown in fig. 2, although this kind of mode can normally show, but can lead to the delay of a frame image time, the delay is longer, user experience is not good.
Disclosure of Invention
The invention aims to solve the technical problems of screen display waste, long delay time and poor user experience caused by data drift in the prior art, and provides a data drift resistant low-delay video caching method, a data drift resistant low-delay video caching system, a data drift resistant low-delay video playing method and a data drift resistant low-delay video playing terminal.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows: a low-delay video caching method for resisting data drift comprises the following steps:
acquiring image data of a video to be displayed;
processing the image data;
calculating data drift time, wherein the data drift time is as follows: processing the difference between the maximum time of one frame of image data and the time of playing one frame of image;
and caching the image data of the video to be displayed, wherein the cached image data amount is equal to or larger than the image data amount required to be played in the data drift time.
Further, the time for playing one frame of image is 1 second/frame rate.
Further, the frame rate includes any one of 25fps, 30fps, 35fps, 50fps, 60fps and 120 fps.
A data drift resistant low-delay video playing method uses the data drift resistant low-delay video caching method, and the method comprises the following steps:
receiving image data of a video to be displayed;
after waiting for the data drift time;
and playing the video.
A low-latency video cache system resistant to data drift comprises
The data acquisition module is used for acquiring image data of a video to be displayed;
a processing module for processing the image data;
a calculating module, configured to calculate a data drift time, where the data drift time is: processing the difference between the maximum time of one frame of image and the time of playing one frame of image;
the buffer module is used for buffering the image data of the video to be displayed, and the amount of the buffered image data is more than or equal to the amount of the image data needing to be played in the data drift time.
Further, the processing module comprises a video encoding unit, a video transmission unit and a video decoding unit.
A video playing terminal comprises the data drift resistant low-delay video cache system and a video display module, wherein the video display module is connected with the data drift resistant low-delay video cache system and used for displaying images.
Further, the video display module displays images according to a fixed beat.
Further, the video playing terminal comprises one or more of a mobile phone, a computer and a tablet.
As can be seen from the above description of the present invention, compared with the prior art, the data-drift-resistant low-latency video caching method, system, playing method, and terminal provided by the present invention solve the problem of screen display caused by data drift, reduce the delay time of playing, and make the user experience more comfortable by acquiring the image data of the video to be displayed, processing the image data, calculating the data drift time, caching the image data of the video to be displayed within the data drift time or more, and caching certain video data.
Drawings
FIG. 1 is a schematic diagram of a display screen caused by data drift in the background art of the present invention;
FIG. 2 is a diagram illustrating a method for buffering a complete image frame according to the background art of the present invention;
FIG. 3 is a flow chart of the data drift resistant low-latency video caching method of the present invention;
FIG. 4 is a block diagram of a low latency video cache system with data drift resistance according to the present invention;
FIG. 5 is a flow chart of the present invention for data drift resistant low latency video playback;
FIG. 6 is a schematic diagram of the data-drift resistant low-latency video playback of the present invention;
fig. 7 is a block diagram of a video display terminal according to the present invention.
Detailed Description
The technical solutions in the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments.
As shown in fig. 3, a low-latency video buffering method for resisting data drift includes the following steps:
s101: image data of a video to be displayed is acquired,
s102: the image data is processed in such a way that,
s103: calculating data drift time, wherein the data drift time is as follows: the difference between the maximum time of processing a frame of image data and the time of playing a frame of image data,
s104: and caching the image data of the video to be displayed, wherein the cached image data amount is equal to or larger than the image data amount required to be played in the data drift time.
The video is played and displayed by continuous frames, each frame is a static image, and the processing of the image data comprises encoding, transmitting and decoding the image data;
generally, in the process of video encoding, video transmission and video decoding, it is impossible to process each frame of image according to a fixed beat, the video display terminal needs to display the image according to the fixed beat, the frame rate refers to the number of frames of the transmitted picture in 1 second, usually expressed by fps (frames Per second), each frame is a static image, the frame is displayed rapidly and continuously, so as to form the motion artifact, the current frame rate is 25fps, 30fps, 35fps, 50fps, 60fps, 120fps, etc., the video display terminal plays one frame of image for 1 second/frame rate, taking 30 frames Per second as an example, the time for processing one frame of image on average is 33.33ms, assuming that the processing time of some frames is 35.33ms, the processing time of some frames is 31.33ms, the processing time of some frames is 35ms, the maximum time for processing one frame of image data is 35.33ms, the video display terminal needs to display the image according to the fixed beat, that is, the image playing time of one frame of the video display terminal is 33.33ms, the data drift time is the difference between the maximum time for processing one frame of image data and the time for playing one frame of image, that is, the data drift time is 2 ms;
for example, the amount of image data to be played within 2ms is cached, so that the delay of the video display terminal can be reduced to the greatest extent, the delay time of the video display terminal is only 2ms, in order to reduce the influence caused by other factors, the amount of data to be played in more than 2ms can be cached, the phenomenon of screen splash is avoided, and the delay time is low.
As shown in fig. 4, a low-latency video buffering system for resisting data drift comprises a data acquisition module 1, a processing module 2, a calculation module 3, and a buffering module 4,
the data acquisition module 1 acquires image data of a video to be displayed; the processing module 2 processes image data, the video is played and displayed in continuous frames, each frame is a still image, the processing module comprises a video encoding unit 21, a video transmission unit 22, a video decoding unit 23, and the calculating module 3 calculates data drift time, the data drift time is: the difference between the maximum time for processing a frame of image and the time for playing a frame of image is usually, during the process of video encoding, video transmission, and video decoding, it is impossible to process each frame of image according to a fixed beat, the video display terminal needs to display the image according to the fixed beat, the frame rate refers to the number of frames of the transmitted image in 1 second, usually expressed by fps (frames Per second), each frame is a static image, the motion artifacts are formed by displaying the frames in rapid succession, the current frame rate is 25fps, 30fps, 35fps, 50fps, 60fps, 120fps, etc., the video display terminal plays a frame of image for 1 second/frame rate, for example, 30 frames Per second, the time for processing a frame of image is 33.33ms on average, assuming that the processing time for some frames is 35.33ms, the processing time for some frames is 31.33ms, and the processing time for some frames is 35ms, then, the maximum time for processing one frame of image data is 35.33ms, the video display terminal needs to display images according to a fixed beat, that is, the image playing time of one frame of the video display terminal is 33.33ms, and the data drift time is the difference between the maximum time for processing one frame of image data and the time for playing one frame of image, that is, the data drift time is 2 ms; the buffer module 4 buffers image data of a video to be displayed, the amount of buffered image data is greater than or equal to the amount of image data to be played in data drift time, for example, the amount of image data to be played in 2ms is buffered, delay of the video display terminal can be reduced to the maximum extent, the delay time of the video display terminal is only 2ms, in order to reduce influence caused by other factors, the amount of data to be played in more than 2ms can be buffered, it is ensured that a screen-blooming phenomenon does not occur, and the delay time is low.
As shown in fig. 5, a method for playing a low-latency video with data drift resistance, which uses the above-mentioned method for buffering the low-latency video with data drift resistance, includes the following steps:
s201: receiving image data of a video to be displayed;
s202: after waiting for the data drift time;
s203: and playing the video.
As shown in fig. 6, since the amount of image data to be played within the data drift time or more is buffered, the video can be normally displayed, and the delay time is reduced.
As shown in fig. 7, a video playing terminal includes the above-mentioned data drift resistant low-latency video cache system 100 and a video display module 200, where the video display module 200 is connected to the data drift resistant low-latency video cache system 100 and is configured to display an image, and the video display module 200 displays the image according to a fixed beat, where the image includes one or more of a mobile phone, a computer, and a tablet.
As can be seen from the above description of the present invention, compared with the prior art, the data-drift-resistant low-latency video caching method, system, playing method, and terminal provided by the present invention solve the problem of screen display caused by data drift by acquiring image data of a video to be displayed, processing the image data, calculating data drift time, caching the image data of the video to be displayed within the data drift time or more, and by caching certain video data, reduce delay time of playing, enable remote medical image transmission, unmanned aerial vehicle image shooting and control, and remote video communication to be applied, so that user experience is more comfortable.
The above description is only a few specific embodiments of the present invention, but the design concept of the present invention is not limited thereto, and any insubstantial modifications made by the design concept should fall within the scope of the present invention.
Claims (9)
1. A low-delay video caching method for resisting data drift is characterized by comprising the following steps:
acquiring image data of a video to be displayed;
processing the image data;
calculating data drift time, wherein the data drift time is as follows: processing the difference between the maximum time of one frame of image data and the time of playing one frame of image;
and caching the image data of the video to be displayed, wherein the cached image data amount is equal to or larger than the image data amount required to be played in the data drift time.
2. The data drift resistant low-latency video buffering method according to claim 1, wherein: the time for playing one frame of image is 1 second/frame rate.
3. The data drift resistant low-latency video buffering method according to claim 2, wherein: the frame rate includes any one of 25fps, 30fps, 35fps, 50fps, 60fps and 120 fps.
4. A low-latency video playing method for resisting data drift, which is characterized by using the low-latency video buffering method for resisting data drift of any one of claims 1 to 3, and comprises the following steps:
receiving image data of a video to be displayed;
after waiting for the data drift time;
and playing the video.
5. A data drift resistant low-latency video buffering system is characterized in that: comprises that
The data acquisition module is used for acquiring image data of a video to be displayed;
a processing module for processing the image data;
a calculating module, configured to calculate a data drift time, where the data drift time is: processing the difference between the maximum time of one frame of image and the time of playing one frame of image;
the buffer module is used for buffering the image data of the video to be displayed, and the amount of the buffered image data is more than or equal to the amount of the image data needing to be played in the data drift time.
6. A data drift resistant low-latency video buffering system is characterized in that: the processing module comprises a video coding unit, a video transmission unit and a video decoding unit.
7. A video playback terminal, characterized in that: the data drift resistant low-latency video buffer system comprising the data drift resistant low-latency video buffer system of claims 5-6, further comprising a video display module coupled to the data drift resistant low-latency video buffer system for displaying images.
8. The video display terminal according to claim 7, wherein: and the video display module displays images according to a fixed beat.
9. The video display terminal according to claim 7, wherein: the video playing terminal comprises one or more of a mobile phone, a computer and a tablet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811399667.8A CN111212315A (en) | 2018-11-22 | 2018-11-22 | Data drift resistance low-delay video caching method and system, playing method and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811399667.8A CN111212315A (en) | 2018-11-22 | 2018-11-22 | Data drift resistance low-delay video caching method and system, playing method and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111212315A true CN111212315A (en) | 2020-05-29 |
Family
ID=70785953
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811399667.8A Pending CN111212315A (en) | 2018-11-22 | 2018-11-22 | Data drift resistance low-delay video caching method and system, playing method and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111212315A (en) |
-
2018
- 2018-11-22 CN CN201811399667.8A patent/CN111212315A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11356652B2 (en) | Stereoscopic image generating apparatus, stereoscopic image reconstructing apparatus and stereoscopic image playing system including same | |
| US11307655B2 (en) | Multi-stream foveal display transport | |
| CN107707860B (en) | Video data processing method, processing device and computer readable storage medium | |
| WO2004077809A2 (en) | Method and system for reduced bandwidth | |
| CN202799004U (en) | Video playback terminal and video playback system | |
| JP2005503732A (en) | Video data format conversion method and apparatus | |
| US20060038888A1 (en) | Image transmission apparatus | |
| WO2019080846A1 (en) | Video data processing method and video data processing device | |
| US20180102082A1 (en) | Apparatus, system, and method for video creation, transmission and display to reduce latency and enhance video quality | |
| EP2563038A1 (en) | Method for transmitting video signals from an application on a server over an IP network to a client device | |
| US8639029B2 (en) | Image processor and image processing method | |
| CN101658039B (en) | Dynamic image decoding method, dynamic image decoding device, and electronic apparatus | |
| US20230099405A1 (en) | Image data transfer apparatus, image display system, and image data transfer method | |
| CN111212315A (en) | Data drift resistance low-delay video caching method and system, playing method and terminal | |
| US20060045367A1 (en) | Video image capturing and displaying method and system applying same | |
| CN108874945B (en) | Data processing method and electronic equipment | |
| CN113596450B (en) | Video image compression method, decompression method, processing method, device and equipment | |
| CN114938461A (en) | Video processing method, device and equipment and readable storage medium | |
| TW200939785A (en) | Method and system for motion compensated picture rate up-conversion using information extracted from a compressed video stream | |
| CN113891057A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN103124348A (en) | Predictive frame dropping method used in wireless video/audio data transmission | |
| CN112995681A (en) | Image data transmission method, electronic device, and computer-readable medium | |
| US8270773B2 (en) | Image processing apparatus and image processing method | |
| CN101534427A (en) | Screen real-time migration method | |
| WO2021193362A1 (en) | Image processing device and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200529 |
|
| RJ01 | Rejection of invention patent application after publication |