WO2020024103A1 - 视频显示控制方法、设备、计算机可读存储介质 - Google Patents

视频显示控制方法、设备、计算机可读存储介质 Download PDF

Info

Publication number
WO2020024103A1
WO2020024103A1 PCT/CN2018/097767 CN2018097767W WO2020024103A1 WO 2020024103 A1 WO2020024103 A1 WO 2020024103A1 CN 2018097767 W CN2018097767 W CN 2018097767W WO 2020024103 A1 WO2020024103 A1 WO 2020024103A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
video frame
display control
display
control signal
Prior art date
Application number
PCT/CN2018/097767
Other languages
English (en)
French (fr)
Inventor
张良平
熊亮
杨小虎
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201880039230.5A priority Critical patent/CN110771173A/zh
Priority to PCT/CN2018/097767 priority patent/WO2020024103A1/zh
Publication of WO2020024103A1 publication Critical patent/WO2020024103A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs

Definitions

  • the present invention relates to the field of video technology, and in particular, to a video display control method, device, and computer-readable storage medium.
  • Video When the video is displayed on the device, the video can be transmitted from other devices through the network.
  • Video has a wide range of applications.
  • a monitoring device can capture a video stream and transmit the video stream to a remote display device for display in order to achieve real-time monitoring.
  • a drone can obtain video through a camera during flight. Stream, and then stream the video to a handheld device for playback and display.
  • the real-time requirements of the video are high, but when the local display frame rate is too fast, and the frame transmission rate of the received video stream is too slow, the video may still freeze in real-time playback.
  • the frame transmission rate of the video stream is 30fps
  • the local display frame rate is 60fps.
  • the video consumption is much faster than the video reception. If the video consumption is too fast, it will cause more jitter in the real-time display process, resulting in video. Caton. There is currently no solution to the above technical problems.
  • the invention provides a video display control method, a device, and a computer-readable storage medium, which can prevent the problem that more jitters are generated in the real-time display process due to excessive video consumption.
  • a video display control method applied to a video processing device includes:
  • the frequency of the display control signal is the same as the display frequency of the video frame
  • the displayed video frame is replaced with the video frame in the video stream by the selected display control signal.
  • a video processing device including: a memory and a processor;
  • the memory is used to store program code
  • the processor is configured to call the program code, and when the program code is executed, is configured to perform the following operations:
  • the frequency of the display control signal is the same as the display frequency of the video frame
  • the displayed video frame is replaced with the video frame in the video stream by the selected display control signal.
  • a computer-readable storage medium stores computer instructions.
  • the computer instructions When the computer instructions are executed, the video according to the first aspect of the embodiments of the present invention is implemented.
  • the control method is displayed.
  • the frequency of the received display control signal is the same as the video frame display frequency, and the video frame display frequency does not match the video frame transmission rate. According to the video frame display frequency and The relationship between the video frame transmission rate in the received video stream determines whether the received display and control signal is selected. When the display and control signal is selected, the displayed video frame can be replaced with the video frame in the video stream. The old video frame is kept displayed when it is selected.
  • the selected process is a process of filtering the display and control signals according to the above relationship
  • the selected display and control signal is used to implement the replacement of the video frame, so that the rate of video frame replacement can be compared with the video frame
  • the transmission rate matching can prevent the problem of more jitter in the real-time display process due to excessive video consumption, and reduce the possibility of stuttering during video display.
  • FIG. 1 is a schematic flowchart of a video display control method according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of the selection of the display control signal when the display frequency of the video frame supported by the device is in a multiple relationship with the video frame transmission rate in the video stream;
  • FIG. 3 is a schematic diagram of a display control signal selection situation when a video frame display frequency and a video frame transmission rate in a video stream are not multiplied by each other;
  • FIG. 4 is a structural block diagram of a video processing device according to an embodiment of the present invention.
  • first, second, third, etc. may be used in the present invention to describe various kinds of information, the information should not be limited to these terms. These terms are used to distinguish the same type of information from each other.
  • first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information.
  • word "if” can be interpreted as “at”, or “at ", or "in response to a determination”.
  • the video display control method of the embodiment of the present invention can be applied to a video processing device.
  • the video processing device includes, but is not limited to, a mobile terminal, a remote controller, and a computer.
  • the video processing device can receive the video stream from the video source device for display.
  • the video source device can be, for example, a drone, a monitoring device (such as an NVR), and other imaging devices. Of course, it can also be an imaging device such as a camera or a camera. No limit.
  • an intermediate device can also be connected between the video processing device and the video source device.
  • the video source device as a drone as an example
  • the drone remote control when the drone remote control has a display device, the drone transmits the video stream to the drone remote control and can display it directly on the remote control; or, Does the remote control of the drone have a display device?
  • the drone can also transmit the video stream to the remote control, and then transmit the video stream to the mobile terminal (such as a mobile phone, a tablet computer, etc.) through the remote control to display on the mobile terminal.
  • the mobile terminal such as a mobile phone, a tablet computer, etc.
  • the video display control method of the embodiment of the present invention is particularly applicable to a case where a video frame display frequency supported by a video processing device is faster than a video frame transmission rate in a received video stream.
  • a video display control method is applied to a video processing device.
  • the method includes the following steps:
  • S100 Determine the relationship between the video frame display frequency supported by the device and the video frame transmission rate in the received video stream;
  • S200 Select at least one display control signal received according to the relationship; the frequency of the display control signal is the same as the display frequency of the video frame;
  • the execution subject of the video display control method may be a video processing device, and further may be a processor of the video processing device, wherein the processor may be one or more, and the processor may be a general-purpose processor or Dedicated processor.
  • Video processing equipment can of course also be integrated with other hardware modules, such as a wireless communication module (such as a 4G module) that can be used for data communication to receive video streams, a display device for displaying video frames, and a clock signal Clock modules, etc. are not limited.
  • step S100 the processor determines the relationship between the video frame display frequency supported by the device and the video frame transmission rate in the received video stream.
  • the video stream received by this device may be a video captured in real time from a video source device (such as an imaging device such as a camera), or it may be a stored video from a video source device, which is not limited in particular.
  • a video source device such as an imaging device such as a camera
  • a stored video from a video source device which is not limited in particular.
  • the video frame display frequency supported by this device refers to the frequency at which the display device of this device refreshes the displayed video frames, and the unit can be frames per second.
  • the video frame transmission rate in the video stream received by this device refers to the frame rate of the video stream sent by the video source device, that is, the number of video frames sent by the video source device to this device per second, and the unit can be frames per second.
  • the relationship between the video frame display frequency supported by the device and the video frame transmission rate in the received video stream can be determined through comparison, for example, dividing the video frame display frequency supported by the device and the video frame transmission rate in the received video stream. Determine the relationship between the two.
  • the relationship here refers to the size relationship.
  • the relationship can be represented by a numerical value.
  • the processor can determine how quickly the video frame display frequency supported by the device is faster than the video frame transmission rate in the received video stream, and the subsequent display and control processing can be performed based on this relationship.
  • step S200 the processor selects at least one received display control signal according to the relationship.
  • the received display and control signals may be generated by the device itself or input from an external display and control device, which is not limited in detail.
  • the display and control signals also come in the form of signal flow, so the received display and control signals are at least one, usually multiple, and are periodic.
  • the processor determines whether the selected display control signal is selected according to the determined above-mentioned relationship, that is, the signal flow of the display control signal is filtered, so the selected display control signal will not be more than the received display control signal.
  • the processor changes the frequency of the display control signal based on the selected display control signal according to the above relationship. If the selected display control signal is still periodic, the change is a frequency reduction.
  • the non-periodic between the control signals also reduces the speed of sending the display. For example, if one display control signal is selected every other display control signal, the frequency of the selected display control signal is half of the frequency of the received display control signal.
  • step S300 the processor replaces the displayed video frame with the video frame in the video stream through the selected display control signal.
  • the video frame replacement is controlled by the selected display and control signal according to the relationship, so that the video frame replacement rate matches the video frame transmission rate.
  • the displayed video frame may be the previous frame of the video frame in the video stream.
  • the selected display and control signal can be used to control the sending and display of video frames. Then, only when the display and control signal is selected, the displayed old video frame will be replaced with the new video frame in the video stream, that is, displayed on the display device. Video frames will be replaced from old video frames to new video frames, and when the display control signal is not selected, the old video frames that are displayed will not be replaced, that is, the video frames displayed on the display device will still maintain the old video frames. .
  • other screen contents such as the title bar, time, application theme, etc., are not limited.
  • the refresh frequency is the video frame display frequency supported by the device. Because the sending and displaying of video frames are controlled by the selected display and control signal, each time the displayed video frame is refreshed, only the selected display and control signal will replace the displayed old video frame with the new video frame, otherwise the old video will be maintained Frame, but does not affect the replacement of other screen contents when refreshing the display. In other words, under the control of the selected display control signal, the replacement rate of the video frames displayed by the device is no longer the same as the video frame display frequency, that is, the replacement and refresh of the video frames are no longer synchronized.
  • the frequency of the received display control signal is the same as the video frame display frequency, and the video frame display frequency does not match the video frame transmission rate.
  • the relationship between the video frame transmission rate determines whether the received display and control signal is selected.
  • the displayed video frame can be replaced with the video frame in the video stream, and the display is maintained when the display and control video is not selected.
  • the selected process is a screening process of the display and control signals according to the above relationship, the selected display and control signal is used to replace the video frame, so that the rate of video frame replacement can match the video frame transmission rate. Prevents excessive jitter during real-time display due to excessive video consumption, and reduces the possibility of freezes during video display.
  • matching the video frame replacement rate with the video frame transmission rate means that the video frame replacement process and the video frame reception process are frame synchronized.
  • matching the video frame replacement rate with the video frame transmission rate means that the video frame replacement process and the video frame reception process are based on the same number of frames each. Groups and groups are synchronized.
  • step S100 determining a relationship between a display frequency of a video frame supported by the device and a video frame transmission rate in a received video stream includes:
  • a ratio between a video frame display frequency supported by the device and a video frame transmission rate in the video stream is L, where L is a positive integer.
  • the above relationship can be realized by a division operation.
  • the ratio between the video frame display frequency and the video frame transmission rate is L, that is, the video frame display frequency is L times the video frame transmission rate.
  • the selecting and receiving at least one display control signal according to the relationship includes:
  • the display control is selected in the manner of selecting one display control signal every L-1 display control signals. After the signal, the frequency of the display control signal in the signal stream formed by the selected display control signal is consistent with the video frame transmission rate. Then, the selected display control signal is used to replace the displayed video frame with the video frame in the video stream. The frequency of replacing video frames is the same as the video frame transmission rate.
  • the consumption of video frames is synchronized with the reception, which prevents the problem of more jitter during real-time display due to excessive video consumption.
  • the selection process of the display control signal is shown when the ratio between the video frame display frequency and the video frame transmission rate is 2.
  • the video frame display frequency is 60 fps and the video frame transmission rate is 30fps.
  • the upper waveform is the pulse signal flow of the received control signal. Only the display control signals V1-V9 are shown. The arrows on the display control signal indicate selection; and the waveform below is the selected control signal. Since the display frequency of the video signal frame is twice the transmission rate of the video frame, one display control signal is selected every other display control signal.
  • the selected display control signals are V1, V3, V5, V7, and V9.
  • the determining a relationship between a display frequency of a video frame supported by the device and a video frame transmission rate in a received video stream includes:
  • the ratio between the video frame display frequency supported by the device and the video frame transmission rate in the video stream is M: N; both M and N are positive integers, and M cannot be divisible by N.
  • the above relationship can be realized by a division operation.
  • the ratio between the video frame display frequency and the video frame transmission rate is M: N, that is, the video frame display frequency is not an integer multiple of the video frame transmission rate.
  • the at least one display control signal selected and received according to the relationship includes:
  • the display control signals are selected in the manner of selecting N display control signals from every M display control signals.
  • the M and N are coprime.
  • M: N is preferably 6: 5, that is, 5 display control signals are selected from every 6 display control signals.
  • the video stream is synchronized once.
  • M: N can also be 12:10, that is, 10 display control signals are selected from every 12 display control signals.
  • the ratio of the display frequency of the video frame to the transmission rate of the video frame is M: N, so the display control signal is selected in the manner of selecting N display control signals from every M display control signals After receiving N video frames, N video frames will be replaced (of course, the N frame replacement may have less jitter, but overall, the jitter is smaller), making the frequency of replacing video frames and video
  • the frame transmission rate is matched as a whole, and the consumption of video frames is matched with the overall reception rate to prevent the problem of more jitter in the real-time display process due to excessive video consumption.
  • a process of selecting a display control signal in a case where a ratio between a video frame display frequency and a video frame transmission rate is 4: 3 is shown.
  • a video frame display frequency is 40 fps, and a video frame transmission is performed.
  • the rate is 30fps.
  • the upper waveform is the pulse signal flow of the received control signal. Only the display control signals V1'-V9 'are shown. The arrows on the display control signal indicate the selection.
  • the lower waveform is the selected display signal.
  • the pulse signal flow of the control signal because the ratio of the video frame display frequency to the video frame transmission rate is 4: 3, so 3 display control signals are selected for every 4 display control signals, and the selected display control signals are V1'-V3 ' , V5'-V7 ', and V9'.
  • the ratio is M: N, and further includes:
  • the ratio between the display frequency of the video frame supported by the device and the video frame transmission rate in the video stream is adjusted from M: N to a specified multiple.
  • the specified multiple can be a multiple determined according to M and N. Of course, you can also adjust by adjusting the video frame transmission rate in the video stream.
  • adjusting the relationship between the video frame display frequency supported by the device and the video frame transmission rate in the video stream from M: N to a specified multiple includes:
  • the specified multiple is determined as the video frame display frequency and video frame transmission rate
  • the ratio M: N is a value obtained by rounding down, so that the ratio of the video frame display frequency and the video frame transmission rate can be adjusted to an integer multiple while reducing the adjustment range as much as possible to reduce the refresh of other screen content. Display impact.
  • step S300 the replacing a displayed video frame with a video frame in the video stream through the selected display control signal includes:
  • the displayed video frame is replaced by the selected display control signal with a video frame buffered as a frame to be replaced in the video stream when the previous display control signal is selected.
  • the display device of this device for displaying video frames of a video stream may have a display buffer area.
  • the display buffer area can buffer the video frames that have been buffered as the frames to be replaced under the control of the last selected display and control signal.
  • the display control signal is selected this time, the video frames of the frame to be replaced can be sent for display.
  • the next video frame in the video stream will be sent to the display buffer area and cached as the frame to be replaced (for example, it is sent from the video stream buffer area to the display buffer area), waiting for the next time the display control signal is selected Send the frame to be replaced for display.
  • the video frames in the video stream can also be sent to the display without replacing the display buffer, and the displayed video frames can be replaced.
  • the method before determining the relationship between the video frame display frequency supported by the device and the video frame transmission rate in the received video stream, the method further includes the following steps:
  • S500 Buffer the video frames in the decoded video stream.
  • the video frames in the video stream can be buffered in the video stream buffer area of the device. As the video stream is received and sent, the video frames buffered in the video stream buffer area will change dynamically. Under the control of the selected display control signal, the decoded video frames can be obtained from the video stream buffer area for display or sent to the display buffer area for buffering.
  • the main cause of video freeze is the jitter of the video transmission network. Due to environmental interference and other issues, wireless transmission cannot guarantee smooth operation at all times, causing transmission to be slow and fast, making video data transmission unstable, and it is difficult to form a very uniform video stream. Although the wireless network does not lose data, Unable to guarantee uniform data transmission, resulting in video not smooth.
  • the video stream is buffered first, and then the buffered video frame is decoded and sent to the display device.
  • the problems caused by the foregoing existing solutions are that the decoding time is uncertain, which results in uncertain display and display, and brings about a video display stutter problem caused by uncertain decoding time.
  • the order of buffering and decoding is adjusted.
  • the video stream is decoded first, and then the decoded video stream is stored in the video stream buffer. In this way, only the corresponding video frames need to be sent to the display. It only needs to be sent to the display device, and there is no need to decode it when sending it, so it can overcome the blocking problem caused by jitter in decoding time.
  • the display control signal is a signal that controls a display device for displaying the video frame to perform display refresh.
  • the display control signal is a signal that controls the display refresh, so a part of the signals from the control refresh signal is selected to control the display.
  • the video flow control is more accurate and it is not easily affected by system scheduling.
  • the display control signal is a signal generated by the device and arrives in an interrupted form.
  • the display and control signal was originally only used to control the display device that displays the video frame for display refresh. However, in the embodiment of the present invention, it will be used to control the sending of the display at the same time.
  • the display and control signal will be used as the interrupt signal to respond to the Arrival, reduce the delay or be affected by system scheduling.
  • an embodiment of the present invention further provides a video processing device, which is characterized in that it includes a memory and a processor (such as one or more processors).
  • Video processing equipment can of course also be integrated with other hardware modules, such as a wireless communication module (such as a 4G module) that can be used for data communication to receive video streams, a display device for displaying video frames, and a clock signal Clock modules, etc. are not limited.
  • the memory is used to store program code; the processor is used to call the program code, and when the program code is executed, used to perform the following operations:
  • the frequency of the display control signal is the same as the display frequency of the video frame
  • the displayed video frame is replaced with the video frame in the video stream by the selected display control signal.
  • the determining a relationship between a display frequency of a video frame supported by the device and a video frame transmission rate in a received video stream includes:
  • a ratio between a video frame display frequency supported by the device and a video frame transmission rate in the video stream is L, where L is a positive integer.
  • the selecting and receiving at least one display control signal according to the relationship includes:
  • the display control signal is selected in such a manner that one display control signal is selected every L-1 display control signals.
  • the determining a relationship between a display frequency of a video frame supported by the device and a video frame transmission rate in a received video stream includes:
  • the ratio between the video frame display frequency supported by the device and the video frame transmission rate in the video stream is M: N; both M and N are positive integers, and M cannot be divisible by N.
  • the at least one display control signal selected and received according to the relationship includes:
  • the display control signals are selected in the manner of selecting N display control signals from every M display control signals.
  • the M and N are coprime.
  • the method further includes:
  • the ratio between the display frequency of the video frame supported by the device and the video frame transmission rate in the video stream is adjusted from M: N to a specified multiple.
  • adjusting the relationship between the video frame display frequency supported by the device and the video frame transmission rate in the video stream from M: N to a specified multiple includes:
  • the replacing a displayed video frame with a video frame in the video stream by the selected display control signal includes:
  • the displayed video frame is replaced by the selected display control signal with a video frame buffered as a frame to be replaced in the video stream when the previous display control signal is selected.
  • the method before determining the relationship between the video frame display frequency supported by the device and the video frame transmission rate in the received video stream, the method further includes:
  • the display control signal is a signal for controlling a display device for displaying the video frame to perform display refresh.
  • the display control signal is a signal generated by the device and arrives in an interrupted form.
  • an embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium stores computer instructions, and when the computer instructions are executed, the foregoing embodiments are implemented.
  • the system, device, module, or unit described in the foregoing embodiments may be implemented by a computer chip or entity, or by a product having a certain function.
  • a typical implementation device is a computer, and the specific form of the computer may be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email sending and receiving device, and a game control Desk, tablet computer, wearable device, or a combination of any of these devices.
  • the embodiments of the present invention may be provided as a method, a system, or a computer program product. Therefore, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • these computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device,
  • the instruction device implements the functions specified in a flowchart or a plurality of processes and / or a block or a block of the block diagram.
  • These computer program instructions can also be loaded into a computer or other programmable data processing device, so that a series of operating steps are performed on the computer or other programmable device to produce a computer-implemented process, and the instructions executed on the computer or other programmable device Provides steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.

Abstract

本发明实施例一种视频显示控制方法,应用于视频处理设备,包括:确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系;依据所述关系选中接收的至少一个显控信号;所述显控信号的频率与所述视频帧显示频率相同;通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧。可防止因视频消耗过快而导致实时显示过程中产生较多抖动的问题。

Description

视频显示控制方法、设备、计算机可读存储介质 技术领域
本发明涉及视频技术领域,尤其是涉及一种视频显示控制方法、设备、计算机可读存储介质。
背景技术
在设备上进行视频显示时,视频可以是通过网络从其他设备传输过来的。视频应用范围较广,例如,监控设备可以采集得到视频流,将视频流传输给远程的显示设备进行显示,以实现实时的监控;又如,无人机在飞行过程中可通过摄像头拍摄得到视频流,而后将视频流传输到手持设备上进行播放显示等。
很多视频应用场景中,对视频的实时性要求较高,但是在本地显示帧率过快,而接收的视频流的帧传输速率过慢时,实时播放视频仍可能会出现视频卡顿现象。例如,视频流的帧传输速率是30fps,而本地显示帧率是60fps,会存在视频的消耗比视频的接收快很多的问题,视频消耗过快导致实时显示过程中会产生较多抖动,导致视频卡顿。而目前还未有针对上述技术问题的解决方案。
发明内容
本发明提供一种视频显示控制方法、设备、计算机可读存储介质,可防止因视频消耗过快而导致实时显示过程中产生较多抖动的问题。
本发明实施例第一方面,提供一种视频显示控制方法,应用于视频处理设备,包括:
确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系;
依据所述关系选中接收的至少一个显控信号;所述显控信号的频率与所述视频帧显示频率相同;
通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧。
本发明实施例第二方面,提供一种视频处理设备,包括:存储器和处理器;
所述存储器,用于存储程序代码;
所述处理器,用于调用所述程序代码,当程序代码被执行时,用于执行以下操作:
确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系;
依据所述关系选中接收的至少一个显控信号;所述显控信号的频率与所述视频帧显示频率相同;
通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧。
本发明实施例第三方面,提供一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机指令,所述计算机指令被执行时,实现本发明实施例第一方面所述的视频显示控制方法。
基于上述技术方案,本发明实施例中,接收的显控信号的频率与视频帧显示频率相同,而视频帧显示频率与视频帧传输速率之间不匹配,依据本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系确定是否选中接收的显控信号,在显控信号被选中时可用视频流中的视频帧更换已显示的旧视频帧,而在显控视频未被选中时维持显示该旧视频帧,由于选中的过程是依据上述关系对显控信号的筛选过程,被选中的显控信号用来实现视频帧的更换,使得视频帧更换的速率可与视频帧传输速率匹配,可防止因视频消耗过快而导致实时显示过程中产生较多抖动的问题,降低了视频显 示时发生卡顿的可能。
附图说明
为了更加清楚地说明本发明实施例中的技术方案,下面将对本发明实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明中记载的一些实施例,对于本领域普通技术人员来讲,还可以根据本发明实施例的这些附图获得其它的附图。
图1是本发明一实施例的视频显示控制方法的流程示意图;
图2是本设备支持的视频帧显示频率和视频流中视频帧传输速率之间成倍数关系时的显控信号选中情况的示意图;
图3是本设备支持的视频帧显示频率和视频流中视频帧传输速率之间不成倍数关系时的显控信号选中情况的示意图;
图4是本发明一实施例的视频处理设备的结构框图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。另外,在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。
本发明使用的术语仅仅是出于描述特定实施例的目的,而非限制本发明。本发明和权利要求书所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其它含义。应当理解的是,本文中使用的术语“和/或”是指包含一个或多个相关联的列出项目的任何或所有可能组合。
尽管在本发明可能采用术语第一、第二、第三等来描述各种信息,但这 些信息不应限于这些术语。这些术语用来将同一类型的信息彼此区分开。例如,在不脱离本发明范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。取决于语境,此外,所使用的词语“如果”可以被解释成为“在……时”,或者,“当……时”,或者,“响应于确定”。
本发明实施例的视频显示控制方法,可应用于视频处理设备。视频处理设备包括但不限于移动终端、遥控器、计算机。视频处理设备可接收来自视频源设备的视频流送去显示,视频源设备例如可以是无人机、监控设备(例如NVR)等具有成像功能的设备,当然也可以摄像头、相机等成像设备,具体不限。
可以理解,视频处理设备与视频源设备之间当然还可以连接有中间设备。以视频源设备为无人机为例,在无人机遥控器带有显示装置的情况下,无人机将视频流传输至无人机遥控器后可直接在遥控器上显示;或者,无论无人机遥控器是否带有显示装置,无人机也可以将视频流传输至遥控器后再通过遥控器传输给移动终端(例如手机、平板电脑等),在移动终端上显示。
本发明实施例的视频显示控制方法,尤其适用于视频处理设备支持的视频帧显示频率比接收的视频流中视频帧传输速率更快的情况。
下面对本发明实施例的视频显示控制方法进行更具体的描述,但不应以此为限。
在一个实施例中,参看图1,一种视频显示控制方法,应用于视频处理设备,该方法包括以下步骤:
S100:确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系;
S200:依据所述关系选中接收的至少一个显控信号;所述显控信号的频率与所述视频帧显示频率相同;
S300:通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧。
具体地,视频显示控制方法的执行主体可以为视频处理设备,进一步地可以为视频处理设备的处理器,其中,所述处理器可以为一个或多个,所述处理器可以为通用处理器或者专用处理器。
视频处理设备当然还可以集成有其他硬件模块,例如可以集成有可用于数据通信以接收视频流的无线通信模块(例如4G模块)、用于进行视频帧显示的显示装置、用于提供时钟信号的时钟模块等等,具体不限。
在步骤S100中,处理器确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系。
本设备接收的视频流可以是来自于视频源设备(例如摄像头等成像设备)的实时采集的视频,当然也可以是来自于视频源设备的所存储的视频,具体不限。
本设备支持的视频帧显示频率是指本设备的显示装置刷新显示的视频帧的频率,单位可为帧每秒。本设备接收的视频流中视频帧传输速率是指视频源设备发送该视频流的帧速率,即视频源设备每秒向本设备发送的视频帧数,单位可为帧每秒。
本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系可以通过比较确定,例如将本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率进行除法运算确定两者之间的关系。此处的关系是指大小关系,在确定关系的方式是除法运算时,该关系可以用一个数值表示。
通过执行步骤S100,处理器可以确定本设备支持的视频帧显示频率比接收的视频流中视频帧传输速率快多少,据此关系可进行后续的显控处理。
在步骤S200中,处理器依据关系选中接收的至少一个显控信号。接收的显控信号可以是本设备自己生成的,也可以是外部显控装置输入的,具体不限。
显控信号也是以信号流形式到来,因而接收的显控信号为至少一个,通常是多个,且呈周期性。处理器依据所确定的上述关系来确定是否选中到来的显控信号,即对显控信号的信号流进行筛选,因而最终选中的显控信号不 会多于接收的显控信号。
处理器对接收的显控信号依据上述关系进行选中的过程改变了显控信号频率,若被选中的显控信号之间仍呈周期性,则该改变即为降频,而若被选中的显控信号之间不呈周期性,则同样也降低了送显的速度。例如,每隔一个显控信号选中一个显控信号,则被选中的显控信号的频率是接收的显控信号的频率的一半。
在步骤S300中,处理器通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧。通过依据关系被选中的显控信号控制视频帧的更换,使得视频帧更换的速率与视频帧传输速率匹配。当然,已显示的视频帧可以是所述视频流中的视频帧的上一帧。
可以利用被选中的显控信号控制视频帧的送显,那么,仅在显控信号被选中时,已显示的旧视频帧会被更换为视频流中的新视频帧,也即显示装置上显示的视频帧会从旧视频帧更换为新视频帧,而在显控信号未被选中时,已显示的旧视频帧则不会被更换,即显示装置上显示的视频帧还是维持该旧视频帧。当然,显示装置上显示该视频帧之外,当然还可以显示其他画面内容,例如标题栏、时间、应用主题等等不限。
本设备的显示装置在每次刷新显示的视频帧时,同时还会刷新显示的其他画面内容,刷新的频率即本设备支持的视频帧显示频率。由于视频帧的送显是由被选中的显控信号控制的,因而在每次刷新显示的视频帧时,只有选中显控信号才会用新视频帧更换显示的旧视频帧,否则维持旧视频帧,但并不影响其他画面内容在刷新显示时的更换。换言之,在被选中的显控信号的控制下,本设备显示的视频帧的更换速率不再与视频帧显示频率相同,即视频帧的更换与刷新不再同步。
本发明实施例中,接收的显控信号的频率与视频帧显示频率相同,而视频帧显示频率与视频帧传输速率之间不匹配,依据本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系确定是否选中接收的显控信号,在显控信号被选中时可用视频流中的视频帧更换已显示的旧视频帧, 而在显控视频未被选中时维持显示该旧视频帧,由于选中的过程是依据上述关系对显控信号的筛选过程,被选中的显控信号用来实现视频帧的更换,使得视频帧更换的速率可与视频帧传输速率匹配,可防止因视频消耗过快而导致实时显示过程中产生较多抖动的问题,降低了视频显示时发生卡顿的可能。
本发明实施例中,被选中的显控信号构成的信号流呈周期性时,视频帧更换的速率与视频帧传输速率匹配是指,视频帧更换过程与视频帧接收过程是帧同步的。而被选中的显控信号构成的信号流不呈周期性时,视频帧更换的速率与视频帧传输速率匹配是指,视频帧更换过程与视频帧接收过程是,各自以相同数量的帧作为一组且组同步。
在一个实施例中,步骤S100中,确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系,包括:
确定本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为L,所述L为正整数。
上述关系可以利用除法运算实现,视频帧显示频率和视频帧传输速率之间的比值为L,即视频帧显示频率是视频帧传输速率的L倍。
优选的,所述依据所述关系选中接收的至少一个显控信号,包括:
按照每隔L-1个显控信号中选中1个显控信号的方式选中显控信号。
由于视频帧显示频率与显控信号的频率相同,视频帧显示频率又是视频帧传输速率的L倍,因而按照每隔L-1个显控信号中选中1个显控信号的方式选中显控信号后,被选中的显控信号构成的信号流中显控信号的频率与视频帧传输速率一致,那么通过被选中的显控信号控制将已显示的视频帧更换为视频流中的视频帧,更换视频帧的频率与视频帧传输速率一致,视频帧的消耗与接收同步,防止因视频消耗过快而导致实时显示过程中产生较多抖动的问题。
具体的,参看图2,示出的是视频帧显示频率和视频帧传输速率之间的比值为2的情况下显控信号的选中过程,例如,视频帧显示频率为60fps,视频帧传输速率为30fps。图2中,上面的波形图是接收的显控信号的脉冲信号流, 仅示出了显控信号V1-V9,显控信号上的箭头表示选中;而下面的波形是被选中的显控信号的脉冲信号流,由于视频帧显示频率是视频帧传输速率的2倍,因而每隔1个显控信号选中一个显控信号,被选中的显控信号为V1、V3、V5、V7和V9。
在一个实施例中,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系,包括:
确定所述本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为M:N;所述M和N均为正整数,且M不能被N整除。
上述关系可以利用除法运算实现,视频帧显示频率和视频帧传输速率之间的比值为M:N,即视频帧显示频率不是视频帧传输速率的整数倍。
优选的,所述依据所述关系选中接收的至少一个显控信号包括:
按照每M个显控信号中选中N个显控信号的方式选中显控信号。
优选的,所述M与N互质。例如,视频帧显示频率为60fps,视频帧传输速率为50fps,则M:N优选为6:5,即每6个显控信号中选5个显控信号,可以每6个显控信号与接收的视频流同步一次。当然,M:N还可以为12:10,即每12个显控信号中选10个显控信号。
由于视频帧显示频率与显控信号的频率相同,视频帧显示频率与视频帧传输速率的比值为M:N,因而按照每M个显控信号中选中N个显控信号的方式选中显控信号后,每接收N个视频帧就会更换N个视频帧(当然这N帧更换可能会有较小的抖动,但从整体来说,抖动是较小的),使得更换视频帧的频率与视频帧传输速率整体上匹配,视频帧的消耗与接收整体速率匹配,防止因视频消耗过快而导致实时显示过程中产生较多抖动的问题。
具体的,参看图3,示出的是视频帧显示频率和视频帧传输速率之间的比值为4:3的情况下显控信号的选中过程,例如,视频帧显示频率为40fps,视频帧传输速率为30fps。图3中,上面的波形图是接收的显控信号的脉冲信号流,仅示出了显控信号V1’-V9’,显控信号上的箭头表示选中;而下面的波形是被选中的显控信号的脉冲信号流,由于视频帧显示频率与视频帧传输速 率的比值为4:3,因而每4个显控信号选中3个显控信号,被选中的显控信号为V1’-V3’、V5’-V7’和V9’。
在一个实施例中,确定所述本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为M:N之后,还包括:
将本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值从M:N调整为指定倍数。
可以调整本设备支持的视频帧显示频率,以调整视频帧显示频率和视频帧传输速率之间的比值,指定倍数可以是依据M和N确定的倍数。当然,也可通过调整视频流中视频帧传输速率实现调整。
优选的,所述将本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的关系从M:N调整为指定倍数,包括:
对本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之比M:N进行向下取整得到所述指定倍数;
依据所述指定倍数和所述视频帧传输速率确定所述视频帧显示频率的目标值;
将所述视频帧显示频率调整至所述目标值。
由于调整本设备支持的视频帧显示频率,也会影响其他画面内容的刷新显示,例如标题栏、时间、应用主题等等不限,因而,将指定倍数确定为视频帧显示频率和视频帧传输速率之比M:N进行向下取整得到的数值,使得视频帧显示频率和视频帧传输速率之比可调整至整数倍的同时尽可能地减小调整幅度,以减小对其他画面内容的刷新显示的影响。
在一个实施例中,步骤S300中,所述通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧,包括:
通过被选中的所述显控信号将已显示的视频帧更换为在上一个显控信号被选中时所述视频流中被缓存为待更换帧的视频帧。
为了减小信号延迟导致的显示抖动,本设备的用于显示视频流的视频帧的显示装置中,可以具有显示缓存区。显示缓存区可以缓存有上一次被选中 的显控信号控制下被缓存为待更换帧的视频帧,而本次显控信号被选中时,该待更换帧的视频帧可以被送去显示,同时视频流中的下一视频帧会被送入到该显示缓存区中被缓存为待更换帧(例如是从视频流缓存区送入到显示缓存区中),等待下一次显控信号被选中时将该待更换帧送去显示。
当然,每次显控信号被选中时,视频流中的视频帧也可以不进行显示缓存,而是直接进行送显,更换已显示的视频帧。
在一个实施例中,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系之前,还包括以下步骤:
S400:将所接收的所述视频流进行解码;
S500:将解码后的所述视频流中的视频帧进行缓存。
视频流中的视频帧可以缓存在本设备的视频流缓存区,随着视频流的接收及送显,视频流缓存区缓存的视频帧会动态变化。在被选中的显控信号控制下,可以从视频流缓存区获取解码后的视频帧送去显示、或者送去显示缓存区缓存。
视频卡顿很重要的原因是视频传输网络的抖动。由于环境干扰因素等问题,无线传输不能保证时刻都能顺畅,导致传输忽快忽慢,使得视频数据传输不稳定,很难形成非常匀速的视频流,尽管无线网络没有丢数据,但由于无线网络不能保证匀速数据传输,导致视频不流畅。
因此,需要增设视频流缓存区来对接收的视频流进行缓存,以克服网络抖动带来的卡顿。然而现有的解决方案中,先对视频流进行缓存,而后再将缓存的视频帧进行解码后送去显示装置。上述现有的解决方案带来的问题是,解码时间不确定,导致送显示不确定,带来了解码时间不定导致的视频显示卡顿问题。
而本发明实施例中,对缓存和解码的先后进行了调整,先对视频流进行解码,而后将解码后的视频流存入在视频流缓存中,这样送显的时候只要将相应的视频帧送去显示装置即可,送显时无需再进行解码,因而可克服解码时间抖动带来的卡顿问题。
在一个实施例中,所述显控信号是控制用于显示所述视频帧的显示装置进行显示刷新的信号。
显控信号是控制进行显示刷新的信号,则从用于控制刷新的信号中选中部分信号控制送显,视频流控更时钟准确,也不容易受系统调度影响。
优选的,所述显控信号是本设备生成的信号并且以中断的形式到来。
显控信号原本只会用于控制显示视频帧的显示装置进行显示刷新,但本发明实施例中将同时用来控制送显,将显控信号作为中断信号,可及时地相应该显控信号的到来,减小时延或受系统调度的影响。
基于与上述方法同样的构思,参见图4所示,本发明实施例中还提供一种视频处理设备,其特征在于,包括:存储器和处理器(如一个或多个处理器)。
视频处理设备当然还可以集成有其他硬件模块,例如可以集成有可用于数据通信以接收视频流的无线通信模块(例如4G模块)、用于进行视频帧显示的显示装置、用于提供时钟信号的时钟模块等等,具体不限。
所述存储器,用于存储程序代码;所述处理器,用于调用所述程序代码,当程序代码被执行时,用于执行以下操作:
确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系;
依据所述关系选中接收的至少一个显控信号;所述显控信号的频率与所述视频帧显示频率相同;
通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧。
优选的,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系,包括:
确定本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为L,所述L为正整数。
优选的,所述依据所述关系选中接收的至少一个显控信号,包括:
按照每隔L-1个显控信号中选中1个显控信号的方式选中显控信号。
优选的,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系,包括:
确定所述本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为M:N;所述M和N均为正整数,且M不能被N整除。
优选的,所述依据所述关系选中接收的至少一个显控信号包括:
按照每M个显控信号中选中N个显控信号的方式选中显控信号。
优选的,所述M与N互质。
优选的,确定所述本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为M:N之后,还包括:
将本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值从M:N调整为指定倍数。
优选的,所述将本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的关系从M:N调整为指定倍数,包括:
对本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之比M:N进行向下取整得到所述指定倍数;
依据所述指定倍数和所述视频帧传输速率确定所述视频帧显示频率的目标值;
将所述视频帧显示频率调整至所述目标值。
优选的,所述通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧,包括:
通过被选中的所述显控信号将已显示的视频帧更换为在上一个显控信号被选中时所述视频流中被缓存为待更换帧的视频帧。
优选的,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系之前,还包括:
将所接收的所述视频流进行解码;
将解码后的所述视频流中的视频帧进行缓存。
优选的,所述显控信号是控制用于显示所述视频帧的显示装置进行显示刷新的信号。
优选的,所述显控信号是本设备生成的信号并且以中断的形式到来。
基于与上述方法同样的发明构思,本发明实施例中还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机指令,所述计算机指令被执行时,实现前述实施例所述的视频显示控制方法。
上述实施例阐明的系统、装置、模块或单元,可以由计算机芯片或实体实现,或者由具有某种功能的产品来实现。一种典型的实现设备为计算机,计算机的具体形式可以是个人计算机、膝上型计算机、蜂窝电话、相机电话、智能电话、个人数字助理、媒体播放器、导航设备、电子邮件收发设备、游戏控制台、平板计算机、可穿戴设备或者这些设备中的任意几种设备的组合。
为了描述的方便,描述以上装置时以功能分为各种单元分别描述。当然,在实施本发明时可以把各单元的功能在同一个或多个软件和/或硬件中实现。
本领域内的技术人员应明白,本发明实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明实施例可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可以由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其它可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其它可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
而且,这些计算机程序指令也可以存储在能引导计算机或其它可编程数 据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或者多个流程和/或方框图一个方框或者多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其它可编程数据处理设备,使得在计算机或者其它可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其它可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
以上所述仅为本发明实施例而已,并不用于限制本发明。对于本领域技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原理之内所作的任何修改、等同替换、改进,均应包含在本发明的权利要求范围之内。

Claims (25)

  1. 一种视频显示控制方法,其特征在于,应用于视频处理设备,包括:
    确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系;
    依据所述关系选中接收的至少一个显控信号;所述显控信号的频率与所述视频帧显示频率相同;
    通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧。
  2. 如权利要求1所述的视频显示控制方法,其特征在于,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系,包括:
    确定本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为L,所述L为正整数。
  3. 如权利要求2所述的视频显示控制方法,其特征在于,所述依据所述关系选中接收的至少一个显控信号,包括:
    按照每隔L-1个显控信号中选中1个显控信号的方式选中显控信号。
  4. 如权利要求1所述的视频显示控制方法,其特征在于,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系,包括:
    确定所述本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为M:N;所述M和N均为正整数,且M不能被N整除。
  5. 如权利要求4所述的视频显示控制方法,其特征在于,所述依据所述关系选中接收的至少一个显控信号包括:
    按照每M个显控信号中选中N个显控信号的方式选中显控信号。
  6. 如权利要求5所述的视频显示控制方法,其特征在于,所述M与N互质。
  7. 如权利要求4所述的视频显示控制方法,其特征在于,确定所述本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为M:N之后,还包括:
    将本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值从M:N调整为指定倍数。
  8. 如权利要求7所述的视频显示控制方法,其特征在于,所述将本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的关系从M:N调整为指定倍数,包括:
    对本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之比M:N进行向下取整得到所述指定倍数;
    依据所述指定倍数和所述视频帧传输速率确定所述视频帧显示频率的目标值;
    将所述视频帧显示频率调整至所述目标值。
  9. 如权利要求1所述的视频显示控制方法,其特征在于,所述通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧,包括:
    通过被选中的所述显控信号将已显示的视频帧更换为在上一个显控信号被选中时所述视频流中被缓存为待更换帧的视频帧。
  10. 如权利要求1所述的视频显示控制方法,其特征在于,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系之前,还包括:
    将所接收的所述视频流进行解码;
    将解码后的所述视频流中的视频帧进行缓存。
  11. 如权利要求1所述的视频显示控制方法,其特征在于,所述显控信号是控制用于显示所述视频帧的显示装置进行显示刷新的信号。
  12. 如权利要求11所述的视频显示控制方法,其特征在于,所述显控信号是本设备生成的信号并且以中断的形式到来。
  13. 一种视频处理设备,其特征在于,包括:存储器和处理器;
    所述存储器,用于存储程序代码;
    所述处理器,用于调用所述程序代码,当程序代码被执行时,用于执行以下操作:
    确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系;
    依据所述关系选中接收的至少一个显控信号;所述显控信号的频率与所述视频帧显示频率相同;
    通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧。
  14. 如权利要求13所述的视频处理设备,其特征在于,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系,包括:
    确定本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为L,所述L为正整数。
  15. 如权利要求14所述的视频处理设备,其特征在于,所述依据所述关系选中接收的至少一个显控信号,包括:
    按照每隔L-1个显控信号中选中1个显控信号的方式选中显控信号。
  16. 如权利要求13所述的视频处理设备,其特征在于,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系,包括:
    确定所述本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为M:N;所述M和N均为正整数,且M不能被N整除。
  17. 如权利要求16所述的视频处理设备,其特征在于,所述依据所述关系选中接收的至少一个显控信号包括:
    按照每M个显控信号中选中N个显控信号的方式选中显控信号。
  18. 如权利要求17所述的视频处理设备,其特征在于,所述M与N互质。
  19. 如权利要求16所述的视频处理设备,其特征在于,确定所述本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值为M:N之后,还包括:
    将本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之间的比值从M:N调整为指定倍数。
  20. 如权利要求19所述的视频处理设备,其特征在于,所述将本设备支持 的视频帧显示频率和所述视频流中视频帧传输速率之间的关系从M:N调整为指定倍数,包括:
    对本设备支持的视频帧显示频率和所述视频流中视频帧传输速率之比M:N进行向下取整得到所述指定倍数;
    依据所述指定倍数和所述视频帧传输速率确定所述视频帧显示频率的目标值;
    将所述视频帧显示频率调整至所述目标值。
  21. 如权利要求13所述的视频处理设备,其特征在于,所述通过被选中的显控信号将已显示的视频帧更换为所述视频流中的视频帧,包括:
    通过被选中的所述显控信号将已显示的视频帧更换为在上一个显控信号被选中时所述视频流中被缓存为待更换帧的视频帧。
  22. 如权利要求13所述的视频处理设备,其特征在于,所述确定本设备支持的视频帧显示频率和接收的视频流中视频帧传输速率之间的关系之前,还包括:
    将所接收的所述视频流进行解码;
    将解码后的所述视频流中的视频帧进行缓存。
  23. 如权利要求13所述的视频处理设备,其特征在于,所述显控信号是控制用于显示所述视频帧的显示装置进行显示刷新的信号。
  24. 如权利要求13所述的视频处理设备,其特征在于,所述显控信号是本设备生成的信号并且以中断的形式到来。
  25. 一种计算机可读存储介质,其特征在于,
    所述计算机可读存储介质上存储有计算机指令,所述计算机指令被执行时,实现权利要求1-12任一项所述的视频显示控制方法。
PCT/CN2018/097767 2018-07-31 2018-07-31 视频显示控制方法、设备、计算机可读存储介质 WO2020024103A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880039230.5A CN110771173A (zh) 2018-07-31 2018-07-31 视频显示控制方法、设备、计算机可读存储介质
PCT/CN2018/097767 WO2020024103A1 (zh) 2018-07-31 2018-07-31 视频显示控制方法、设备、计算机可读存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/097767 WO2020024103A1 (zh) 2018-07-31 2018-07-31 视频显示控制方法、设备、计算机可读存储介质

Publications (1)

Publication Number Publication Date
WO2020024103A1 true WO2020024103A1 (zh) 2020-02-06

Family

ID=69232149

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/097767 WO2020024103A1 (zh) 2018-07-31 2018-07-31 视频显示控制方法、设备、计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN110771173A (zh)
WO (1) WO2020024103A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7559077B1 (en) * 2001-11-16 2009-07-07 Sprint Communications Company L.P. Video system for use where the network transfer rate is slower than the video display rate
CN105409229A (zh) * 2014-05-28 2016-03-16 索尼公司 信息处理装置、信息处理方法与程序
CN107786828A (zh) * 2016-08-30 2018-03-09 中国人民解放军信息工程大学 一种隐式信息传输方法、装置及系统

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013081600A1 (en) * 2011-11-30 2013-06-06 Intel Corporation Reducing power for 3d workloads
CN102543023B (zh) * 2012-01-10 2014-04-02 硅谷数模半导体(北京)有限公司 接收设备、视频刷新频率的控制方法、装置及系统
CN105100876B (zh) * 2015-08-28 2019-04-12 北京奇艺世纪科技有限公司 一种流媒体的播放方法及装置
CN106526685B (zh) * 2015-09-09 2019-03-19 同方威视技术股份有限公司 一种行李物品的安检方法和系统
CN111182268B (zh) * 2016-01-29 2021-08-17 深圳市大疆创新科技有限公司 视频数据传输方法、系统、设备和拍摄装置
CN105763919A (zh) * 2016-04-14 2016-07-13 福州瑞芯微电子股份有限公司 显示与视频同步的方法及装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7559077B1 (en) * 2001-11-16 2009-07-07 Sprint Communications Company L.P. Video system for use where the network transfer rate is slower than the video display rate
CN105409229A (zh) * 2014-05-28 2016-03-16 索尼公司 信息处理装置、信息处理方法与程序
CN107786828A (zh) * 2016-08-30 2018-03-09 中国人民解放军信息工程大学 一种隐式信息传输方法、装置及系统

Also Published As

Publication number Publication date
CN110771173A (zh) 2020-02-07

Similar Documents

Publication Publication Date Title
JP6732893B2 (ja) 仮想現実コンテンツのビデオレンダリング速度の調整および立体画像の処理
US8713472B2 (en) Display apparatus, a method for a display control, and program
US11694316B2 (en) Method and apparatus for determining experience quality of VR multimedia
JP6477495B2 (ja) 情報処理装置、および情報処理方法、並びにプログラム
US10484690B2 (en) Adaptive batch encoding for slow motion video recording
US9832521B2 (en) Latency and efficiency for remote display of non-media content
US20150350544A1 (en) Systems And Methods For Exposure Metering For Timelapse Video
US20140344882A1 (en) System and Method of Video Quality Adaptation
KR20130111072A (ko) 디스플레이 시스템 및 그것의 디스플레이 장치
US9549006B2 (en) Self-adaptive sample period for content sharing in communication sessions
WO2020024103A1 (zh) 视频显示控制方法、设备、计算机可读存储介质
CN110166733B (zh) 预监方法及装置、输出盒、服务器、拼接系统
US20160057382A1 (en) Dynamic Adjustment Of Video Frame Sampling Rate
CN115151886A (zh) 基于帧更新延迟dsi时钟改变以提供更平滑的用户界面体验
WO2022021058A1 (zh) 图像接收设备、图像处理设备及方法、图传系统
CN112449239A (zh) 视频播放方法、装置及电子设备
US10025550B2 (en) Fast keyboard for screen mirroring
US20240048727A1 (en) Method and system of low latency video coding with interactive applications
CN113839908B (zh) 视频传输方法、装置、系统及计算机可读存储介质
US20240073415A1 (en) Encoding Method, Electronic Device, Communication System, Storage Medium, and Program Product
CN114758606B (zh) 一种场同步信号的发送方法、控制器及显示控制系统
CN116112627B (zh) 一种视频帧率自适应变换的方法和电路
CN113988569A (zh) 坐席管理系统、图像显示方法、图像显示装置及输出设备
WO2022230727A1 (ja) 動画像受信装置、制御方法及びプログラム
TW201911283A (zh) 顯示控制裝置以及顯示控制方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18928377

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18928377

Country of ref document: EP

Kind code of ref document: A1