CN112154665A - Video display method, receiving end, system and storage medium - Google Patents
Video display method, receiving end, system and storage medium Download PDFInfo
- Publication number
- CN112154665A CN112154665A CN201980032902.4A CN201980032902A CN112154665A CN 112154665 A CN112154665 A CN 112154665A CN 201980032902 A CN201980032902 A CN 201980032902A CN 112154665 A CN112154665 A CN 112154665A
- Authority
- CN
- China
- Prior art keywords
- video data
- display
- preset
- transmission
- current frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 230000005540 biological transmission Effects 0.000 claims abstract description 133
- 238000004590 computer program Methods 0.000 claims description 14
- 230000001965 increasing effect Effects 0.000 claims description 7
- 238000012544 monitoring process Methods 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 4
- 238000009877 rendering Methods 0.000 claims 1
- 238000012545 processing Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 8
- 230000006837 decompression Effects 0.000 description 6
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000003139 buffering effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
A video display method, a receiving end, a picture transmission system and a storage medium are provided, the method comprises: receiving the encoded video data, and decoding the video data by a decoder (S201); determining whether a portion of data output by a current frame among video data decoded by a decoder satisfies a preset condition (S202); if yes, generating a timing signal and sending the timing signal to the display controller so that the display controller controls the display screen to display the current frame (S203).
Description
Technical Field
The present application relates to the field of display technologies, and in particular, to a video display method, a receiving end, a picture transmission system, and a storage medium.
Background
At present, in a graph transmission system, in order to reduce the delay of graph transmission, a pipeline mode processing at a subframe level is generally adopted, and relevant steps of video stream processing are arranged in a time sequence in a pipeline mode, wherein the time sequence comprises corresponding steps of a video acquisition part, an image processing part, a video compression part, a video transmission part, a video decompression part and a video display part (such as an LCD display), and the time sequence of each step can be matched with each other to realize the processing. However, in a conventional image transmission system, the timing sequence between some steps may not be matched, for example, the timing of the video frame received at the receiving end and the video frame displayed on the LCD may be asynchronous, and at the time of the new LCD refresh, the position of the new video frame is uncertain, so that the previous frame may be displayed, and the next frame may be displayed. Therefore, end-to-end delay jitter is caused, and frame buffering is adopted for overcoming the delay jitter, namely a timing screen refreshing display mode is adopted after one frame data or multiple frames of data are buffered, but frame-level delay is introduced, and long-time timing drift also causes the problems of repeated display or frame loss display.
Disclosure of Invention
Based on this, the application provides a video display method, a receiving end, a picture transmission system and a storage medium, so as to reduce display delay and solve the problems of repeated display and frame loss display.
In a first aspect, the present application provides a video display method, including:
receiving the encoded video data, and decoding the video data through a decoder;
determining whether a part of data output by a current frame in the video data decoded by the decoder meets a preset condition, wherein the preset condition is used for triggering generation of a timing signal;
and if the output partial data meets the preset condition, generating a timing signal and sending the timing signal to a display controller so that the display controller controls a display screen to display the current frame.
In a second aspect, the present application further provides a receiving end, where the receiving end includes a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
receiving the encoded video data, and decoding the video data through a decoder;
determining whether a part of data output by a current frame in the video data decoded by the decoder meets a preset condition, wherein the preset condition is used for triggering generation of a timing signal;
and if the output partial data meets the preset condition, generating a timing signal and sending the timing signal to a display controller so that the display controller controls a display screen to display the current frame.
In a third aspect, the present application further provides a graph transmission system, where the system includes a sending end and a receiving end, and the sending end and the receiving end are in communication connection;
the sending end acquires video data and encodes the video data;
the sending end sends the coded video data to the receiving end;
the receiving end receives the coded video data and decodes the video data through a decoder;
the receiving end determines whether partial data output by a current frame in the video data decoded by the decoder meets a preset condition, wherein the preset condition is used for triggering generation of a timing signal;
and if the receiving end determines that the output partial data meets the preset condition, generating a timing signal and sending the timing signal to a display controller, so that the display controller controls a display screen to display the current frame.
In a fourth aspect, the present application further provides a computer-readable storage medium storing a computer program, which when executed by a processor causes the processor to implement the above-mentioned video display method.
The embodiment of the application provides a video display method, a receiving end, a picture transmission system and a storage medium, wherein after coded video data are received, the video data are decoded through a decoder; determining whether a part of data output by a current frame in the video data decoded by the decoder meets a preset condition; and when the preset condition is met, generating a timing signal and sending the timing signal to a display controller, so that the display controller controls a display screen to display the current frame according to the timing signal. The display method reduces the display delay, is different from a display mode of fixed frequency refreshing or frame buffering, and solves the problem that repeated display or frame loss display can be caused by long-time timing drift.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic block diagram of a graph transmission system provided in an embodiment of the present application;
FIG. 2 is a flow chart illustrating steps of a video display method according to an embodiment of the present application;
fig. 3 is a schematic diagram of a display process of a video display method provided by an embodiment of the present application;
FIG. 4 is a flowchart illustrating steps of a video display method according to another embodiment of the present application;
fig. 5 is a schematic block diagram of a transmitting end provided in an embodiment of the present application;
fig. 6 is a schematic block diagram of a receiving end according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a schematic block diagram of a graph transmission system provided in the present application. The graph system in the embodiment of the present application will be described below with reference to fig. 1.
As shown in fig. 1, the image transmission system 10 includes a transmitting end 11 and a receiving end 12, where the transmitting end 11 is mounted with a shooting device 110, and the shooting device 110 can capture a video and then transmit the captured video to the receiving end 12 by a wireless image transmission technology. Of course, the video captured by the camera 110 may also be transmitted to the receiving end 12 by wired transmission, which is not limited herein.
The transmitting end 11 includes a movable device, which may be, for example, an unmanned aerial vehicle, an unmanned vehicle, a handheld pan/tilt head, a robot, or the like, and the movable device is equipped with a shooting device 110 for capturing a video. For example, the unmanned aerial vehicle in fig. 1 is equipped with a camera.
In some embodiments, the camera 110 may be, for example, a mobile phone or a camera, but also other camera devices, such as a camera module.
It is understood that the handheld pan/tilt head includes a pan/tilt head system or an integrated pan/tilt head camera on which the photographing device 110 is mounted. The holder system of the camera 110 is a handheld holder for mounting a mobile phone or a handheld holder for mounting a camera.
The receiving end 12 may include a processor, a display, and a display controller. The display controller is electrically connected with the processor and the display for controlling the display to display corresponding content, such as displaying video pictures.
The Processor may be a Central Processing Unit (CPU), or may be other general-purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, a discrete hardware component, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The processor may be in communication with the display controller, such as to generate timing signals for triggering the display controller to control the display to display the relevant content.
It will be appreciated that the display controller may be part of the display or may be separate from the display. Including but not limited to LCD displays, LED displays, and OLED displays.
It is understood that the display may be a part of the receiving end 12, for example, the receiving end 12 is a mobile phone, and the display is a display screen of the mobile phone; of course, the display may be an external display of the receiving end 12. Accordingly, the display controller may also be part of the receiving end 12, or a separate part from the receiving end 12.
In some embodiments, the receiving end 12 specifically includes, but is not limited to, a remote controller, a mobile phone, or a tablet computer. Of course, electronic devices such as VR glasses or other wearable devices may also be used.
In fig. 1, the transmitting end 11 is an unmanned aerial vehicle, and the receiving end 12 is a mobile phone, but the transmitting end 11 and the receiving end 12 are limited.
In the image transmission system, in order to achieve end-to-end low delay, a sub-frame level pipeline processing is adopted, namely, each step corresponding to video processing and transmission is arranged in a pipeline timing mode and comprises a video acquisition part, an image processing part, a video compression part, a video transmission part, a video decompression part and a video display part. This requires that the timing of each step can be matched to each other.
However, in a conventional image transmission system, the timing sequence between some steps may not be matched, for example, the video frame received at the receiving end 12 may be asynchronous with the frame timing displayed by the display, and at the moment of refreshing the display, the in-place of a new video frame is uncertain, so that the previous frame may be displayed, the next frame may be displayed, and the next frame may be displayed by skipping the frame. Thereby causing jitter in the end-to-end delay and increased delay due to buffering added to overcome the delay jitter.
In the image-based system, a sending end 11 is configured to collect video data, perform compression coding on the collected video data, and send the compression-coded video data to a receiving end 12, where the receiving end 12 decodes and displays the coded video data. The fluency and the transmission speed of video transmission are improved by encoding the video.
For example, as in fig. 1, the unmanned aerial vehicle captures video data through the capturing device 110, compresses and encodes the captured video data, and transmits the compressed and encoded video data to a mobile phone located at the ground end, and the user decodes and displays the video 20 captured by the unmanned aerial vehicle through the mobile phone to view the video in real time.
The video data may be encoded by inter-frame coding or intra-frame coding, or by other coding methods, such as a mixed coding method of inter-frame coding and intra-frame coding. Accordingly, the encoded video data is decoded in a decoding manner corresponding to the encoding manner.
When encoding video data, it is necessary to perform macroblock division on a video image in the video data, that is, each macroblock includes a plurality of pixels, for example, 16 × 16 pixels is a macroblock.
A frame of video image may be encoded into one or more slices, each slice comprising an integer number of macroblocks. Wherein each slice comprises at least one macroblock, at most, macroblocks of the entire picture.
The slice group is a subset of macroblocks in a coded picture, and comprises one or several slices.
The sending end 11 and the receiving end 12 encode and decode video data, and the encoding and decoding are performed by an encoder and a decoder in the sending end 11 and the receiving end 12, respectively.
It is to be understood that the image system in fig. 1 and the above-mentioned naming of the components of the image system are for identification purposes only and do not limit the embodiments of the present application accordingly.
The video display method provided by the embodiment of the present application will be described in detail below based on the graph transmission system in fig. 1.
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating steps of a video display method according to an embodiment of the present application. The video display method can be applied to a receiving end of an image system to reduce the display delay of the video, and further solve the problem of repeated display or frame loss display caused by long-time timing drift.
As shown in fig. 2, the video display method includes steps S201 to S203.
S201, receiving encoded video data, and decoding the video data through a decoder;
s202, determining whether partial data output by a current frame in the video data decoded by the decoder meets a preset condition;
and S203, if the output partial data meets the preset condition, generating a timing signal and sending the timing signal to a display controller so that the display controller controls a display screen to display the current frame.
After the sending end collects the video data, the collected video data can be compressed and coded, specifically, the video data is coded by adopting a corresponding coding mode through a coder, and the coded video data is sent to the receiving end.
The corresponding encoding method is, for example, an intra-frame encoding method or an inter-frame encoding method. Other encoding schemes are certainly included, such as encoding video data by both inter-frame encoding and intra-frame encoding.
And after receiving the coded video data, the receiving end decodes the video data through a decoder. The decoder decodes the encoded video data in a decoding manner corresponding to the encoding manner.
In some embodiments, to improve decoding efficiency and reduce video display delay, decoding video data specifically is: decoding, by a decoder, video data at less than a time corresponding to a frame of video data.
The video data comprises a plurality of frames of video images, each frame of video image corresponding to a respective time. For example, if 100 frames of video images are displayed in one millisecond, the time corresponding to each frame of video data is 0.1 second. The video data is decoded by a decoder in less than 0.01 milliseconds.
It should be noted that decoding video data by a decoder includes two processes of demodulation and decoding and decompression, and decompression is to decompress data output by demodulation and decoding.
The preset condition is used for triggering generation of a timing signal, and the timing signal is used for triggering a display controller to control a display screen to display the current frame.
And when the receiving end determines that the output partial data meets the preset condition, generating a timing signal and sending the timing signal to a display controller, so that the display controller controls a display screen to display the current frame.
Therefore, the display delay is reduced by controlling the generation of the timing signal and the sending of the timing signal to the display controller so that the display controller controls the display screen to display the current frame.
In some embodiments, the preset conditions include: detecting whether partial data output by a current frame in the video data decoded by the decoder is greater than a preset quantity threshold value; and/or determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time.
The preset quantity threshold is used for determining the size of the decoded output data, and because the macro block division is carried out on each frame of video image in the video data during encoding, the video image can be divided into a plurality of slices through the macro block, each slice comprises an integer number of macro blocks, and the slice group comprises one or a plurality of slices. The preset number threshold may thus be represented by macroblocks, slices or slice groups.
The predetermined time is used to determine that the remaining data of the current frame can arrive at the display on time so that the current frame can be fully displayed. The predetermined time may be determined based on empirical values or based on a display parameter of the display, such as a refresh rate.
Illustratively, the preset number threshold includes a preset number of macroblocks, for example, the preset number of macroblocks is specifically M macroblocks, and M is a positive integer.
Correspondingly, detecting whether a part of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold specifically includes: and counting the number of the macro blocks output by the decoder when the current frame is decoded, and determining whether the number of the output macro blocks is greater than the preset number of the macro blocks.
For example, when the number of macroblocks output by the decoder for decoding the current frame is counted to be greater than M, it is determined that the output partial data meets the preset condition, so as to trigger generation of the timing signal.
Illustratively, if the encoded video data is encoded into a plurality of slices or slice groups, the preset number threshold includes a preset number of slices or a preset number of slice groups.
Correspondingly, detecting whether a part of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold specifically includes: and counting the number of slices or slice groups output by the decoder when the decoder decodes the current frame, and determining whether the output number of slices is greater than the preset number of slices or whether the output number of slice groups is greater than the preset number of slice groups.
For example, when the number of slices output by the decoder for decoding the current frame is counted to be greater than the preset number of slices, it is determined that the output partial data meets the preset condition, so as to trigger generation of the timing signal.
For another example, when the number of slice groups output by the decoder for decoding the current frame is counted to be greater than the preset number of slice groups, it is determined that the output part of data meets the preset condition, so as to trigger generation of the timing signal.
In some embodiments, determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time; and if the residual data of the current frame can be transmitted to the display within the preset time, determining that the output partial data meets the preset condition so as to trigger the generation of a timing signal.
And determining whether the residual data of the current frame can be transmitted to the display within a preset time by adopting a determination mode that whether the residual data can be transmitted to the display within the preset time is determined according to the time required for the residual data of the current frame to reach the display.
In some embodiments, to quickly determine whether transmission to the display is possible within a predetermined time. The determining method specifically comprises the following steps:
determining an arrival required time for transmitting the remaining data of the current frame to the display, and determining whether the arrival required time is less than or equal to a predetermined time; and if the required time of arrival is less than or equal to the preset time, determining that the rest data of the current frame can be transmitted to the display within the preset time.
For example, if the predetermined time is 0.01 msec and the required arrival time of the remaining data of the current frame to be transmitted to the display is determined to be 0.005 msec, it may be determined that the remaining data of the current frame can be transmitted to the display within the predetermined time.
In some embodiments, determining the required time for transmitting the remaining data of the current frame to the display includes: acquiring the number of macro blocks contained in the residual data of the current frame; determining an output time and a delay time of the macroblock; and determining the arrival demand time according to the number of the macro blocks, the output time and the delay time.
And determining and acquiring the number of macro blocks included in the residual data, and determining the output time and the delay time of the macro blocks, so that the required arrival time can be calculated according to the number of the macro blocks and the output time and the delay time corresponding to the macro blocks.
For example, if the number of macroblocks is 10, the output time of the macroblock is 0.0001 ms, and the delay time is 0.0004 ms, the calculated required arrival time is 0.005 ms.
It will be appreciated that the arrival demand time may also be calculated using the number of slices or groups of slices, and the corresponding output times and delay times.
In some embodiments, if the predetermined condition is: detecting whether a part of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold, and determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time.
Correspondingly, the determining whether the decoded output part of data meets the preset condition specifically includes: and if the output partial data is larger than the preset number threshold value and the residual data can be transmitted to a display within preset time, determining that the output partial data meets the preset condition. The preset condition can effectively avoid the delay of the frame level, and simultaneously solve the problems of repeated display and frame loss display.
Illustratively, as shown in fig. 3, the receiving end receives encoded compressed video data, which includes a plurality of frames of video images, for example, a current frame is a video image i. Decoding the video data by a decoder; determining whether a part of data output by a current frame in the video data decoded by the decoder meets a preset condition, wherein the preset condition is used for triggering generation of a timing signal; if the output partial data meets the preset condition, for example, M macro blocks are output when the current frame I is decoded in fig. 3, that is, the output partial data meets the preset condition, a timing signal is generated and sent to a display controller, so that the display controller controls a display screen to display the current frame, where the current frame is the decoded video image I.
It should be noted that, the decoding of the video data by the decoder includes two processes of demodulation, decoding and decompression, as shown in fig. 3, firstly, the data is output by demodulating and decoding the video image i after encoding and compressing, and then the decoded video data is obtained by decompressing the output data.
Therefore, the video display method realizes that the frame timing of the screen refreshing of the display is adjusted according to the output timing of the decoder, so that the screen refreshing is started immediately when the output data of the current frame meets the requirement, the display delay of the video on the display is reduced, and the delay of the whole image transmission system is reduced. And the displayed starting time is adjusted according to the time of data decoding output, so that the problems of frame loss, frame skipping and the like of the display caused by clock asynchronization are avoided. Thereby enhancing the viewing experience for the user.
In some embodiments, to better solve the display delay problem, the method further includes a process of dynamically adjusting the preset number threshold, where the adjusting process specifically includes: and adjusting the size of a preset quantity threshold according to the transmission stable state of the video data.
Specifically, determining whether transmission of the video data is stable; when the transmission of the video data is stable, increasing the size of a preset quantity threshold; and reducing the size of a preset number threshold when the transmission of the video data is unstable. Therefore, the preset quantity is adjusted in real time according to the stable state of video transmission, and the fact that the timing signal is triggered to be generated when necessary to finish display according to the timing signal is guaranteed, so that display delay is reduced.
In some embodiments, in particular, it is determined whether the transmission of the video data is stable; when the transmission of the video data is stable, determining a first preset number as a preset number threshold; and when the transmission of the video data is unstable, determining a second preset number as a preset number threshold. Wherein the second preset number is greater than the first preset number.
For example, when the transmission of the video data is stable, a first preset number is determined as preset macro block data; when the transmission of the video data is unstable, determining a second preset number as preset macro block data; wherein the second preset number is greater than the first preset number.
In case the data transmission of the graph system is stable enough, the delay is fixed for each part of data in each frame, so that a smaller first predetermined number can be determined as the predetermined number of macroblocks, for example, M macroblock rows correspond to 1/16 frame size.
In an image system, if the transmission is not stable enough, a certain buffer needs to be added to resist the jitter of the transmission delay, and a larger second preset number can be determined as the preset number of macroblocks, for example, M macroblock rows correspond to 3/4 frame size. Through the first preset number, the second preset number and the size relationship thereof, the jitter of transmission delay can be effectively resisted, and the display delay is further effectively reduced.
Wherein, determining whether the transmission of the video data is stable may specifically adopt: monitoring whether the delay time of the video data transmission is changed; if the delay time of the video data transmission is fixed and unchanged, determining that the video data transmission is stable; and if the delay time of the video data transmission is changed, determining that the video data transmission is unstable.
For example, if the monitored delay time is always 0.0004 msec, it may be determined that the transmission of the video data is stable; if the monitored delay time varies continuously, such as 0.0004 ms when the delay time is 0.0006 ms when, the transmission of the video data is determined to be unstable.
In some embodiments, the video display method further includes a step of determining a predetermined time, which specifically includes: and acquiring the refresh rate configured by the display, and determining the preset time according to the refresh rate. And determining the refresh time of the display according to the refresh frequency, and taking the refresh time as the preset time.
For example, different displays have different refresh rates, and the higher the refresh rate, the better the corresponding display image (picture) stability. The refresh rate for one display is 60Hz and the corresponding refresh time for the display is about 0.01543 milliseconds. The 0.01543 milliseconds are taken as the predetermined time.
It is understood that a certain time greater than the refresh time may be the predetermined time, of course. For example, the refresh time corresponding to the display is about 0.01543 ms, and 0.016 ms can be selected as the predetermined time.
And determining the preset time according to the refresh rate, wherein different refresh rates can be set for different types of displays or the same type of display users, and the preset time is adjusted timely. It can thus be determined that the display is capable of displaying in accordance with the timing signal, thereby further reducing display latency.
Referring to fig. 4, fig. 4 is a flowchart illustrating steps of a video display method according to another embodiment of the present application. The video display method can be applied to a picture transmission system, reduces the delay of video display, and solves the problem that repeated display or frame loss display is caused by long-time timing drift.
As shown in fig. 4, the video display method includes steps S401 to S405.
S401, the sending end obtains video data and codes the video data;
s402, the sending end sends the coded video data to the receiving end;
s403, the receiving end receives the coded video data and decodes the video data through a decoder;
s404, the receiving end determines whether partial data output by the current frame in the video data decoded by the decoder meets a preset condition;
s405, if the receiving end determines that the output partial data meets the preset condition, a timing signal is generated and sent to a display controller, so that the display controller controls a display screen to display the current frame.
The preset condition is used for triggering generation of a timing signal, and the timing signal is used for triggering a display controller to control a display screen to display the current frame.
The method comprises the steps that after a sending end collects video data through a shooting device, the video data are obtained and encoded.
Specifically, video data is acquired in a time less than a time corresponding to one frame of video data, and the video data is encoded in a time less than a time corresponding to one frame of video data;
the sending end sends the coded video data to the receiving end, and specifically sends the coded video data to the receiving end within a time shorter than a frame of video data.
The receiving end decodes the video data, specifically: decoding, by a decoder, video data at less than a time corresponding to a frame of video data.
Therefore, the control of the sub-frame level of the video acquisition part, the image processing part, the video compression part, the video transmission part, the video decompression part and the video display part is realized, and meanwhile, the control generates a timing signal and sends the timing signal to the display controller, so that the display controller controls the display screen to display the current frame. Thereby further reducing display latency.
Referring to fig. 5, fig. 5 is a schematic block diagram of a transmitting end according to an embodiment of the present application. The transmitting end 11 includes a camera 110, a processor 111, and a memory 112, and the processor 111, the memory 112, and the camera 110 are connected by a bus, such as an I2C (Inter-integrated Circuit) bus.
Specifically, the Processor 111 may be a Micro-controller Unit (MCU), a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or the like.
Specifically, the Memory 112 may be a Flash chip, a Read-Only Memory (ROM) magnetic disk, an optical disk, a usb disk, or a removable hard disk.
Wherein the processor 111 is configured to run a computer program stored in the memory and to implement the following steps when executing the computer program:
controlling a shooting device to collect video data; acquiring collected video data and encoding the video data; and sending the coded video data to the receiving end.
In some embodiments, when the processor 111 implements the obtaining of the video data by the sending end and the encoding of the video data, the following is specifically implemented:
the method includes acquiring video data in less than one frame of time corresponding to the video data, and encoding the video data in less than one frame of time corresponding to the video data.
In some embodiments, when the processor 111 implements that the sending end sends the encoded video data to the receiving end, specifically implementing:
and sending the coded video data to the receiving end in a time corresponding to less than one frame of video data.
Referring to fig. 6, fig. 6 is a schematic block diagram of a receiving end according to an embodiment of the present application. The receiving end 12 includes a processor 121, a memory 122, a display controller 123 and a display 124, wherein the processor 121, the memory 122 and the display controller 123 are connected via a bus, such as an I2C (Inter-integrated Circuit) bus, and the display controller 123 and the display 124 are configured to control the display 124 to display related content.
Specifically, the Processor 121 may be a Micro-controller Unit (MCU), a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or the like.
Specifically, the Memory 122 may be a Flash chip, a Read-Only Memory (ROM) magnetic disk, an optical disk, a usb disk, or a removable hard disk.
Wherein the processor 121 is configured to run a computer program stored in the memory, and when executing the computer program, implement the following steps:
receiving the encoded video data, and decoding the video data through a decoder; determining whether a part of data output by a current frame in the video data decoded by the decoder meets a preset condition, wherein the preset condition is used for triggering generation of a timing signal; and if the output partial data meets the preset condition, generating a timing signal and sending the timing signal to a display controller so that the display controller controls a display screen to display the current frame.
In some embodiments, the preset conditions include: detecting whether partial data output by a current frame in the video data decoded by the decoder is greater than a preset quantity threshold value; and/or determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time.
In some embodiments, the preset conditions include: detecting whether a part of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold, and determining whether the residual data of the current frame can be transmitted to the display within a preset time;
the determining whether a part of data output by a current frame of the video data decoded by the decoder satisfies a preset condition includes: and if the output partial data is larger than the preset number threshold value and the residual data can be transmitted to a display within preset time, determining that the output partial data meets the preset condition.
In some embodiments, the preset quantity threshold comprises a preset number of macroblocks; the processor 121, when implementing the detecting whether a portion of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold, implements:
and counting the number of the macro blocks output by the decoder when the current frame is decoded, and determining whether the number of the output macro blocks is greater than the preset number of the macro blocks.
In some embodiments, the encoded video data is encoded into a plurality of slices or slice groups, the preset number threshold comprises a preset number of slices or a preset number of slice groups; the processor 121, in implementing the detecting whether a part of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold, implements:
and counting the number of slices or slice groups output by the decoder when the decoder decodes the current frame, and determining whether the output number of slices is greater than the preset number of slices or whether the output number of slice groups is greater than the preset number of slice groups.
In some embodiments, the processor 121 further implements:
and adjusting the size of a preset quantity threshold according to the transmission stable state of the video data.
In some embodiments, the processor 121, when implementing the adjusting of the size of the preset number threshold according to the transmission steady state of the video data, implements:
determining whether transmission of the video data is stable; if the transmission of the video data is stable, increasing the size of a preset quantity threshold; and if the transmission of the video data is unstable, reducing the size of a preset quantity threshold value.
In some embodiments, the processor 121, when implementing the adjusting of the size of the preset number threshold according to the transmission steady state of the video data, implements:
determining whether transmission of the video data is stable; if the transmission of the video data is stable, determining a first preset number as a preset number threshold; and if the transmission of the video data is unstable, determining a second preset number as a preset number threshold, wherein the second preset number is larger than the first preset number.
In some embodiments, the processor 121, in carrying out the determining whether the transmission of the video data is stable, carries out:
monitoring whether the delay time of the video data transmission is changed; if the delay time of the video data transmission is fixed and unchanged, determining that the video data transmission is stable; and if the delay time of the video data transmission is changed, determining that the video data transmission is unstable.
In some embodiments, the processor 121, in performing the determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time, performs:
determining an arrival required time for transmitting the remaining data of the current frame to the display, and determining whether the arrival required time is less than or equal to a predetermined time; and if the required time of arrival is less than or equal to the preset time, determining that the rest data of the current frame can be transmitted to the display within the preset time.
In some embodiments, the processor 121, in implementing the determining the required time to arrival of the remaining data of the current frame for transmission to the display, implements:
acquiring the number of macro blocks contained in the residual data of the current frame; determining an output time and a delay time of the macroblock; and determining the arrival demand time according to the number of the macro blocks, the output time and the delay time.
In some embodiments, the processor further implements:
and acquiring the refresh rate configured by the display, and determining the preset time according to the refresh rate.
In some embodiments, the processor 121, in implementing the determining the predetermined time from the refresh rate, implements:
and determining the refresh time of the display according to the refresh frequency, and taking the refresh time as the preset time.
In some embodiments, the processor 121, in enabling the decoding of the video data by a decoder, enables:
decoding, by a decoder, video data at less than a time corresponding to a frame of video data.
In an embodiment of the present application, a graph transmission system is further provided, as shown in fig. 1, where the graph transmission system includes a sending end and a receiving end, and the sending end and the receiving end are in communication connection, for example, in a wired or wireless manner; wherein,
the sending end acquires video data and encodes the video data;
the sending end sends the coded video data to the receiving end;
the receiving end receives the coded video data and decodes the video data through a decoder;
the receiving end determines whether partial data output by a current frame in the video data decoded by the decoder meets a preset condition, wherein the preset condition is used for triggering generation of a timing signal;
and if the receiving end determines that the output partial data meets the preset condition, generating a timing signal and sending the timing signal to a display controller, so that the display controller controls a display screen to display the current frame.
In some embodiments, the acquiring and encoding of video data by the transmitting end includes:
acquiring video data in a time corresponding to less than one frame of video data, and encoding the video data in a time corresponding to less than one frame of video data;
the sending end sends the encoded video data to the receiving end, and the method comprises the following steps: and sending the coded video data to the receiving end in a time corresponding to less than one frame of video data.
In some embodiments, the preset conditions include: detecting whether partial data output by a current frame in the video data decoded by the decoder is greater than a preset quantity threshold value; and/or determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time.
In some embodiments, the preset conditions include: detecting whether a part of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold, and determining whether the residual data of the current frame can be transmitted to the display within a preset time;
the determining whether a part of data output by a current frame of the video data decoded by the decoder satisfies a preset condition includes: and if the output partial data is larger than the preset number threshold value and the residual data can be transmitted to a display within preset time, determining that the output partial data meets the preset condition.
In some embodiments, the preset quantity threshold comprises a preset number of macroblocks;
the detecting whether a portion of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold includes:
and counting the number of the macro blocks output by the decoder when the current frame is decoded, and determining whether the number of the output macro blocks is greater than the preset number of the macro blocks.
In some embodiments, the encoded video data is encoded into a plurality of slices or slice groups, the preset number threshold comprises a preset number of slices or a preset number of slice groups;
the detecting whether a portion of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold includes:
and counting the number of slices or slice groups output by the decoder when the decoder decodes the current frame, and determining whether the output number of slices is greater than the preset number of slices or whether the output number of slice groups is greater than the preset number of slice groups.
In some embodiments, the receiving end further adjusts the size of the preset number threshold according to the transmission stable state of the video data.
In some embodiments, the adjusting the size of the preset number threshold according to the transmission steady state of the video data includes:
determining whether transmission of the video data is stable; if the transmission of the video data is stable, increasing the size of a preset quantity threshold; and if the transmission of the video data is unstable, reducing the size of a preset quantity threshold value.
In some embodiments, the adjusting the size of the preset number threshold according to the transmission steady state of the video data includes:
determining whether transmission of the video data is stable; if the transmission of the video data is stable, determining a first preset number as a preset number threshold; and if the transmission of the video data is unstable, determining a second preset number as a preset number threshold, wherein the second preset number is larger than the first preset number.
In some embodiments, the determining whether the transmission of the video data is stable includes:
monitoring whether the delay time of the video data transmission is changed; if the delay time of the video data transmission is fixed and unchanged, determining that the video data transmission is stable; and if the delay time of the video data transmission is changed, determining that the video data transmission is unstable.
In some embodiments, the determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time includes:
determining an arrival required time for transmitting the remaining data of the current frame to the display, and determining whether the arrival required time is less than or equal to a predetermined time;
and if the required time of arrival is less than or equal to the preset time, determining that the rest data of the current frame can be transmitted to the display within the preset time.
In some embodiments, the determining the required time of arrival for the transmission of the remaining data of the current frame to the display comprises:
acquiring the number of macro blocks contained in the residual data of the current frame; determining an output time and a delay time of the macroblock; and determining the arrival demand time according to the number of the macro blocks, the output time and the delay time.
In some embodiments, the receiving end further obtains a refresh rate of the display configuration, and determines the predetermined time according to the refresh rate.
In some embodiments, said determining a predetermined time from said refresh rate comprises:
and determining the refresh time of the display according to the refresh frequency, and taking the refresh time as the preset time.
In some embodiments, said decoding said video data by a decoder comprises:
decoding, by a decoder, video data at less than a time corresponding to a frame of video data.
In some embodiments, the transmitting end includes, but is not limited to, a removable device.
In some embodiments, the removable device includes, but is not limited to: unmanned aerial vehicle, handheld cloud platform, unmanned car or robot.
In some embodiments, the receiving end includes, but is not limited to, a remote controller, a mobile phone, or a tablet computer.
In some embodiments, the receiving end includes, but is not limited to, a display and a display controller electrically connected to the processor for controlling the display of the display.
In an embodiment of the present application, a computer-readable storage medium is further provided, where a computer program is stored in the computer-readable storage medium, where the computer program includes program instructions, and the processor executes the program instructions to implement the steps of the video display method provided in the foregoing embodiment.
The computer-readable storage medium may be an internal storage unit of the handheld cloud deck according to any of the foregoing embodiments, for example, a hard disk or a memory of the handheld cloud deck. The computer readable storage medium may also be an external storage device of the handheld cloud deck, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are equipped on the handheld cloud deck.
While the invention has been described with reference to specific embodiments, the scope of the invention is not limited thereto, and those skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (50)
1. A video display method, comprising:
receiving the encoded video data, and decoding the video data through a decoder;
determining whether a part of data output by a current frame in the video data decoded by the decoder meets a preset condition, wherein the preset condition is used for triggering generation of a timing signal;
and if the output partial data meets the preset condition, generating a timing signal and sending the timing signal to a display controller so that the display controller controls a display screen to display the current frame.
2. The video display method according to claim 1, wherein the preset condition includes:
detecting whether partial data output by a current frame in the video data decoded by the decoder is greater than a preset quantity threshold value; and/or determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time.
3. The video display method according to claim 2, wherein the preset condition includes: detecting whether a part of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold, and determining whether the residual data of the current frame can be transmitted to the display within a preset time;
the determining whether a part of data output by a current frame of the video data decoded by the decoder satisfies a preset condition includes:
and if the output partial data is larger than the preset number threshold value and the residual data can be transmitted to a display within preset time, determining that the output partial data meets the preset condition.
4. The video display method of claim 2, wherein the predetermined number threshold comprises a predetermined number of macroblocks;
the detecting whether a portion of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold includes:
and counting the number of the macro blocks output by the decoder when the current frame is decoded, and determining whether the number of the output macro blocks is greater than the preset number of the macro blocks.
5. The video display method according to claim 2, wherein the encoded video data is encoded into a plurality of slices or slice groups, and the preset number threshold comprises a preset number of slices or a preset number of slice groups;
the detecting whether a portion of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold includes:
and counting the number of slices or slice groups output by the decoder when the decoder decodes the current frame, and determining whether the output number of slices is greater than the preset number of slices or whether the output number of slice groups is greater than the preset number of slice groups.
6. The video display method according to claim 2, further comprising:
and adjusting the size of a preset quantity threshold according to the transmission stable state of the video data.
7. The method according to claim 6, wherein said adjusting the size of the threshold value of the preset number according to the transmission steady state of the video data comprises:
determining whether transmission of the video data is stable;
if the transmission of the video data is stable, increasing the size of a preset quantity threshold;
and if the transmission of the video data is unstable, reducing the size of a preset quantity threshold value.
8. The method according to claim 6, wherein said adjusting the size of the threshold value of the preset number according to the transmission steady state of the video data comprises:
determining whether transmission of the video data is stable;
if the transmission of the video data is stable, determining a first preset number as a preset number threshold;
and if the transmission of the video data is unstable, determining a second preset number as a preset number threshold, wherein the second preset number is larger than the first preset number.
9. The video display method according to claim 7 or 8, wherein the determining whether the transmission of the video data is stable comprises:
monitoring whether the delay time of the video data transmission is changed;
if the delay time of the video data transmission is fixed and unchanged, determining that the video data transmission is stable;
and if the delay time of the video data transmission is changed, determining that the video data transmission is unstable.
10. The video display method of claim 2, wherein said determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time comprises:
determining an arrival required time for transmitting the remaining data of the current frame to the display, and determining whether the arrival required time is less than or equal to a predetermined time;
and if the required time of arrival is less than or equal to the preset time, determining that the rest data of the current frame can be transmitted to the display within the preset time.
11. The method of claim 10, wherein said determining the required time to transmit the remaining data of the current frame to the display comprises:
acquiring the number of macro blocks contained in the residual data of the current frame;
determining an output time and a delay time of the macroblock; and
and determining the arrival demand time according to the number of the macro blocks, the output time and the delay time.
12. The video display method according to claim 3, 10 or 11, characterized in that the video display method further comprises:
and acquiring the refresh rate configured by the display, and determining the preset time according to the refresh rate.
13. The video display method of claim 12, wherein said determining a predetermined time based on said refresh rate comprises:
and determining the refresh time of the display according to the refresh frequency, and taking the refresh time as the preset time.
14. The video display method according to claim 1, wherein said decoding the video data by a decoder comprises:
decoding, by a decoder, video data at less than a time corresponding to a frame of video data.
15. A receiving end, wherein the receiving end comprises a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
receiving the encoded video data, and decoding the video data through a decoder;
determining whether a part of data output by a current frame in the video data decoded by the decoder meets a preset condition, wherein the preset condition is used for triggering generation of a timing signal;
and if the output partial data meets the preset condition, generating a timing signal and sending the timing signal to a display controller so that the display controller controls a display screen to display the current frame.
16. The receiving end according to claim 15, wherein the preset condition comprises:
detecting whether partial data output by a current frame in the video data decoded by the decoder is greater than a preset quantity threshold value; and/or determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time.
17. The receiving end according to claim 16, wherein the preset condition comprises: detecting whether a part of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold, and determining whether the residual data of the current frame can be transmitted to the display within a preset time;
the processor, when implementing the determining whether a part of data output by a current frame in the video data decoded by the decoder satisfies a preset condition, implements:
and if the output partial data is larger than the preset number threshold value and the residual data can be transmitted to a display within preset time, determining that the output partial data meets the preset condition.
18. The receiving end of claim 16, wherein the preset number threshold comprises a preset number of macroblocks;
the processor, when implementing the detecting whether a portion of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold, implements:
and counting the number of the macro blocks output by the decoder when the current frame is decoded, and determining whether the number of the output macro blocks is greater than the preset number of the macro blocks.
19. The receiving end of claim 16, wherein the encoded video data is encoded into a plurality of slices or slice groups, and the preset number threshold comprises a preset number of slices or a preset number of slice groups;
the processor, when implementing the detecting whether a portion of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold, implements:
and counting the number of slices or slice groups output by the decoder when the decoder decodes the current frame, and determining whether the output number of slices is greater than the preset number of slices or whether the output number of slice groups is greater than the preset number of slice groups.
20. The receiving end of claim 16, wherein the processor further implements:
and adjusting the size of a preset quantity threshold according to the transmission stable state of the video data.
21. The receiving end of claim 20, wherein the processor, when implementing the adjusting of the size of the preset number threshold according to the transmission steady state of the video data, implements:
determining whether transmission of the video data is stable;
if the transmission of the video data is stable, increasing the size of a preset quantity threshold;
and if the transmission of the video data is unstable, reducing the size of a preset quantity threshold value.
22. The receiving end of claim 20, wherein the processor, when implementing the adjusting of the size of the preset number threshold according to the transmission steady state of the video data, implements:
determining whether transmission of the video data is stable;
if the transmission of the video data is stable, determining a first preset number as a preset number threshold;
and if the transmission of the video data is unstable, determining a second preset number as a preset number threshold, wherein the second preset number is larger than the first preset number.
23. The receiving end of claim 21 or 22, wherein the processor, in implementing the determining whether the transmission of the video data is stable, implements:
monitoring whether the delay time of the video data transmission is changed;
if the delay time of the video data transmission is fixed and unchanged, determining that the video data transmission is stable;
and if the delay time of the video data transmission is changed, determining that the video data transmission is unstable.
24. The receiving end of claim 16, wherein the processor, in implementing the determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time, implements:
determining an arrival required time for transmitting the remaining data of the current frame to the display, and determining whether the arrival required time is less than or equal to a predetermined time;
and if the required time of arrival is less than or equal to the preset time, determining that the rest data of the current frame can be transmitted to the display within the preset time.
25. The receiving end of claim 24, wherein the processor, in implementing the determining of the required time for the transmission of the remaining data of the current frame to the display, implements:
acquiring the number of macro blocks contained in the residual data of the current frame;
determining an output time and a delay time of the macroblock; and
and determining the arrival demand time according to the number of the macro blocks, the output time and the delay time.
26. A receiving end according to claim 17, 24 or 25, wherein the processor in implementing further implements:
and acquiring the refresh rate configured by the display, and determining the preset time according to the refresh rate.
27. The receiving end of claim 26, wherein the processor, when implementing the determining the predetermined time according to the refresh rate, implements:
and determining the refresh time of the display according to the refresh frequency, and taking the refresh time as the preset time.
28. The receiving end of claim 15, wherein the processor, in implementing the decoding of the video data by the decoder, implements:
decoding, by a decoder, video data at less than a time corresponding to a frame of video data.
29. The receiving end of claim 15, wherein the receiving end comprises a display and a display controller, and the display controller is electrically connected to the processor for controlling the display of the display.
30. The receiving end of claim 15, wherein the receiving end comprises a remote controller, a mobile phone or a tablet computer.
31. A kind of picture transmission system, characterized by, including sending end and receiving end, said sending end and receiving end communication connection;
the sending end acquires video data and encodes the video data;
the sending end sends the coded video data to the receiving end;
the receiving end receives the coded video data and decodes the video data through a decoder;
the receiving end determines whether partial data output by a current frame in the video data decoded by the decoder meets a preset condition, wherein the preset condition is used for triggering generation of a timing signal;
and if the receiving end determines that the output partial data meets the preset condition, generating a timing signal and sending the timing signal to a display controller, so that the display controller controls a display screen to display the current frame.
32. The image-transmission system of claim 31, wherein the sending end acquires video data and encodes the video data, comprising:
acquiring video data in a time corresponding to less than one frame of video data, and encoding the video data in a time corresponding to less than one frame of video data;
the sending end sends the encoded video data to the receiving end, and the method comprises the following steps: and sending the coded video data to the receiving end in a time corresponding to less than one frame of video data.
33. The graph-transmission system according to claim 31, wherein the preset conditions comprise:
detecting whether partial data output by a current frame in the video data decoded by the decoder is greater than a preset quantity threshold value; and/or determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time.
34. The graph-transmission system according to claim 33, wherein the preset conditions comprise: detecting whether a part of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold, and determining whether the residual data of the current frame can be transmitted to the display within a preset time;
the determining whether a part of data output by a current frame of the video data decoded by the decoder satisfies a preset condition includes:
and if the output partial data is larger than the preset number threshold value and the residual data can be transmitted to a display within preset time, determining that the output partial data meets the preset condition.
35. The image-rendering system of claim 33, wherein the predetermined quantity threshold comprises a predetermined number of macroblocks;
the detecting whether a portion of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold includes:
and counting the number of the macro blocks output by the decoder when the current frame is decoded, and determining whether the number of the output macro blocks is greater than the preset number of the macro blocks.
36. The picture transmission system according to claim 33, wherein the encoded video data is encoded into a plurality of slices or slice groups, and the preset number threshold comprises a preset number of slices or a preset number of slice groups;
the detecting whether a portion of data output by a current frame in the video data decoded by the decoder is greater than a preset number threshold includes:
and counting the number of slices or slice groups output by the decoder when the decoder decodes the current frame, and determining whether the output number of slices is greater than the preset number of slices or whether the output number of slice groups is greater than the preset number of slice groups.
37. The image-transmission system of claim 33, wherein the receiving end further adjusts the size of the threshold according to the transmission steady state of the video data.
38. The graph-based system according to claim 37, wherein the adjusting the threshold value of the preset number according to the transmission steady state of the video data comprises:
determining whether transmission of the video data is stable;
if the transmission of the video data is stable, increasing the size of a preset quantity threshold;
and if the transmission of the video data is unstable, reducing the size of a preset quantity threshold value.
39. The graph-based system according to claim 37, wherein the adjusting the threshold value of the preset number according to the transmission steady state of the video data comprises:
determining whether transmission of the video data is stable;
if the transmission of the video data is stable, determining a first preset number as a preset number threshold;
and if the transmission of the video data is unstable, determining a second preset number as a preset number threshold, wherein the second preset number is larger than the first preset number.
40. The graph transmission system according to claim 38 or 39, wherein the determining whether the transmission of the video data is stable comprises:
monitoring whether the delay time of the video data transmission is changed;
if the delay time of the video data transmission is fixed and unchanged, determining that the video data transmission is stable;
and if the delay time of the video data transmission is changed, determining that the video data transmission is unstable.
41. The system of claim 33, wherein the determining whether the remaining data of the current frame can be transmitted to the display within a predetermined time comprises:
determining an arrival required time for transmitting the remaining data of the current frame to the display, and determining whether the arrival required time is less than or equal to a predetermined time;
and if the required time of arrival is less than or equal to the preset time, determining that the rest data of the current frame can be transmitted to the display within the preset time.
42. The graph transmission system according to claim 41, wherein the determining the required time of arrival for the transmission of the remaining data of the current frame to the display comprises:
acquiring the number of macro blocks contained in the residual data of the current frame;
determining an output time and a delay time of the macroblock; and
and determining the arrival demand time according to the number of the macro blocks, the output time and the delay time.
43. The system according to claim 34, 41 or 42, wherein said receiving end further obtains a refresh rate of said display configuration, and determines said predetermined time based on said refresh rate.
44. The graph transmission system according to claim 43, wherein said determining a predetermined time according to the refresh rate comprises:
and determining the refresh time of the display according to the refresh frequency, and taking the refresh time as the preset time.
45. The picture-through system of claim 31, wherein the decoding the video data by a decoder comprises:
decoding, by a decoder, video data at less than a time corresponding to a frame of video data.
46. The image-transmission system of claim 31, wherein the transmitting end comprises a mobile device.
47. The graph-transfer system of claim 46, wherein the removable device comprises: unmanned aerial vehicle, handheld cloud platform or robot.
48. The image-transmission system of claim 31, wherein the receiving end comprises a remote controller, a mobile phone or a tablet computer.
49. The illustration system of claim 31, wherein said receiving end comprises a display and a display controller, said display controller being electrically connected to said processor for controlling said display.
50. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when executed by a processor, causes the processor to implement the video display method according to any one of claims 1 to 14.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2019/104597 WO2021042341A1 (en) | 2019-09-05 | 2019-09-05 | Video display method, receiving end, system and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112154665A true CN112154665A (en) | 2020-12-29 |
Family
ID=73891968
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201980032902.4A Pending CN112154665A (en) | 2019-09-05 | 2019-09-05 | Video display method, receiving end, system and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112154665A (en) |
| WO (1) | WO2021042341A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113473229A (en) * | 2021-06-25 | 2021-10-01 | 荣耀终端有限公司 | Method for dynamically adjusting frame loss threshold and related equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005322995A (en) * | 2004-05-06 | 2005-11-17 | Nippon Telegr & Teleph Corp <Ntt> | Buffer control method in real-time video image transfer, transmitting terminal, receiving terminal, video image distributing system and program |
| CN101287122A (en) * | 2008-05-23 | 2008-10-15 | 清华大学 | Video decoding method with active buffer management and complexity control function |
| CN101557512A (en) * | 2009-05-19 | 2009-10-14 | 武汉长江通信产业集团股份有限公司 | Method for processing time delay when video terminal receives video data |
| CN102497578A (en) * | 2011-11-25 | 2012-06-13 | 武汉大学 | Mobile audio and video real-time communication method in 3G network environment |
| CN105763919A (en) * | 2016-04-14 | 2016-07-13 | 福州瑞芯微电子股份有限公司 | Method and device for display and video synchronization |
| CN105933800A (en) * | 2016-04-29 | 2016-09-07 | 联发科技（新加坡）私人有限公司 | Video play method and control terminal |
| CN109144445A (en) * | 2018-07-24 | 2019-01-04 | 深圳市创易联合科技有限公司 | Wireless screen transmission method and device |
-
2019
- 2019-09-05 CN CN201980032902.4A patent/CN112154665A/en active Pending
- 2019-09-05 WO PCT/CN2019/104597 patent/WO2021042341A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005322995A (en) * | 2004-05-06 | 2005-11-17 | Nippon Telegr & Teleph Corp <Ntt> | Buffer control method in real-time video image transfer, transmitting terminal, receiving terminal, video image distributing system and program |
| CN101287122A (en) * | 2008-05-23 | 2008-10-15 | 清华大学 | Video decoding method with active buffer management and complexity control function |
| CN101557512A (en) * | 2009-05-19 | 2009-10-14 | 武汉长江通信产业集团股份有限公司 | Method for processing time delay when video terminal receives video data |
| CN102497578A (en) * | 2011-11-25 | 2012-06-13 | 武汉大学 | Mobile audio and video real-time communication method in 3G network environment |
| CN105763919A (en) * | 2016-04-14 | 2016-07-13 | 福州瑞芯微电子股份有限公司 | Method and device for display and video synchronization |
| CN105933800A (en) * | 2016-04-29 | 2016-09-07 | 联发科技（新加坡）私人有限公司 | Video play method and control terminal |
| CN109144445A (en) * | 2018-07-24 | 2019-01-04 | 深圳市创易联合科技有限公司 | Wireless screen transmission method and device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113473229A (en) * | 2021-06-25 | 2021-10-01 | 荣耀终端有限公司 | Method for dynamically adjusting frame loss threshold and related equipment |
| CN113473229B (en) * | 2021-06-25 | 2022-04-12 | 荣耀终端有限公司 | Method for dynamically adjusting frame loss threshold and related equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021042341A1 (en) | 2021-03-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180220170A1 (en) | Method and apparatus for transmitting data of mobile terminal | |
| RU2479937C2 (en) | Information processing apparatus and method | |
| CN106375841B (en) | Wireless screen projection data processing method, wireless screen projection data processing device, wireless screen projection video data display method, wireless screen projection video data display device and electronic equipment | |
| KR101809306B1 (en) | Low latency rate control system and method | |
| US8184636B2 (en) | Information processing device and method, and computer readable medium for packetizing and depacketizing data | |
| US20130273945A1 (en) | Electronic devices for sending a message and buffering a bitstream | |
| US9716865B2 (en) | Apparatus and method for shooting moving picture in camera device | |
| EP2868107A2 (en) | System and method for encoding video content using virtual intra-frames | |
| CN106162199B (en) | Method and system for video processing with back channel message management | |
| US20130003846A1 (en) | Frame encoding selection based on frame similarities and visual quality and interests | |
| CN111641804A (en) | Video data processing method and device, terminal, camera and video conference system | |
| US20110299605A1 (en) | Method and apparatus for video resolution adaptation | |
| CN105681792A (en) | Method and device for real-time encoding | |
| CN112154665A (en) | Video display method, receiving end, system and storage medium | |
| WO2024078066A1 (en) | Video decoding method and apparatus, video encoding method and apparatus, storage medium, and device | |
| CN102843566A (en) | Communication method and equipment for three-dimensional (3D) video data | |
| CN106131565B (en) | Video decoding and rendering using joint jitter-frame buffer | |
| CN116962613A (en) | Data transmission method and device, computer equipment and storage medium | |
| CN111225238A (en) | Information processing method and related equipment | |
| US9456220B2 (en) | Image coding method, image coding device, image processing apparatus, and image transmitting/receiving system | |
| CN115550688A (en) | Video code stream processing method, medium, program product and electronic device | |
| KR101251879B1 (en) | Apparatus and method for displaying advertisement images in accordance with screen changing in multimedia cloud system | |
| CN110785994A (en) | Image processing method, apparatus and storage medium | |
| CN110012307A (en) | Video transmission method, device and main terminal equipment | |
| KR101947513B1 (en) | Encoding and Decoding Method for Video Coding Using Error Concealment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20201229 |
|
| WD01 | Invention patent application deemed withdrawn after publication |