CN111083547B - Method, apparatus, and medium for balancing video frame rate error based on trigger mode - Google Patents

Method, apparatus, and medium for balancing video frame rate error based on trigger mode Download PDF

Info

Publication number
CN111083547B
CN111083547B CN201911293352.XA CN201911293352A CN111083547B CN 111083547 B CN111083547 B CN 111083547B CN 201911293352 A CN201911293352 A CN 201911293352A CN 111083547 B CN111083547 B CN 111083547B
Authority
CN
China
Prior art keywords
video
frame rate
frame
line
video display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911293352.XA
Other languages
Chinese (zh)
Other versions
CN111083547A (en
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhuhai Eeasy Electronic Tech Co ltd
Original Assignee
Zhuhai Eeasy Electronic Tech Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhuhai Eeasy Electronic Tech Co ltd filed Critical Zhuhai Eeasy Electronic Tech Co ltd
Priority to CN201911293352.XA priority Critical patent/CN111083547B/en
Publication of CN111083547A publication Critical patent/CN111083547A/en
Application granted granted Critical
Publication of CN111083547B publication Critical patent/CN111083547B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Systems (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The invention discloses a method, equipment and a medium for balancing video frame rate errors based on a trigger mode, wherein the method comprises the steps of setting clock frequencies of a video acquisition end and a video display end so as to meet the requirements of video frame rate consistency and display resolution; setting a time sequence parameter of a video display end to be n lines of blanking areas less than a standard time sequence parameter; n is a positive integer; generating a frame trigger control signal according to the frame rate of the video acquisition end so as to start the video display end to display each frame of video in real time; the missing n line blanking regions of the video display terminal compensate for the deviation by waiting for the time interval for the next frame to trigger the control signal. The method successfully solves the problem that the frame rates of the video acquisition end and the video display end are inconsistent through a mode of waiting for compensation based on frame rate triggering of the video acquisition end and frame rate triggering of the video display end, ensures that the display frame rate is consistent with the video source frame rate, simultaneously realizes the display delay of the most line level, and meets the requirement of low-delay application of the video.

Description

Method, apparatus, and medium for balancing video frame rate error based on trigger mode
Technical Field
The present invention relates to video processing technologies, and in particular, to a method, an apparatus, and a medium for balancing video frame rate errors based on a trigger mode.
Background
The real-time nature of video display is increasingly important. For example, the camera is used for replacing an external rearview mirror to observe the scene of the road condition outside the automobile, so that a high requirement is put forward on the real-time performance of video display. According to the method, the problem of frame rate error is solved by a frame loss or frame folding mode, on one hand, a large buffer space is needed, on the other hand, display is delayed greatly, and the requirement of low-delay application cannot be met. Obviously, the video is directly transmitted from the video acquisition terminal to the video display terminal, so that the display delay can be reduced, however, in the process of acquiring and displaying the video, because the clock source frequencies of the video acquisition terminal and the video display terminal have errors, the video frame rates at the two terminals have errors, if the frame rate errors are not eliminated, the video acquisition and display cannot be balanced due to the cumulative effect, and therefore a new mode must be found to solve the problem of the video frame rate errors at the two terminals.
Disclosure of Invention
In order to solve the problem of frame rate errors of videos at two ends, embodiments of the present invention provide a method, an apparatus, and a medium for balancing a video frame rate error based on a trigger mode, so as to implement low-latency video transmission and ensure that a display frame rate is consistent with a video source frame rate.
In order to realize the purpose, the technical scheme of the invention is as follows:
in a first aspect, an embodiment of the present invention provides a method for balancing a video frame rate error based on a trigger mode, where the method includes:
setting clock frequencies of a video acquisition end and a video display end to meet the requirements of video frame rate consistency and display resolution;
setting a time sequence parameter of a video display end to be n lines of blanking areas less than a standard time sequence parameter; n is a positive integer;
generating a frame trigger control signal according to the frame rate of the video acquisition end so as to start the video display end to display each frame of video in real time;
the missing n line blanking regions of the video display terminal compensate for the deviation by waiting for the time interval for the next frame to trigger the control signal.
Furthermore, the timing parameter of the video display end is less than the standard timing parameter by one line of blanking area in the VFP interval.
Further, the blanking area of the line which is lacked at the video display end compensates the deviation by waiting for the time interval triggered by the next frame:
when the frame rate of the video acquisition end is slightly larger than that of the video display end, the length of the missing blanking area of the line is slightly smaller than the length of the standard time sequence;
when the frame rate of the video acquisition end is slightly less than that of the video display end, the length of the missing line blanking area is slightly greater than the standard time sequence length.
Further, the line blanking region waiting for compensation retains the line synchronization signal and is adjusted only by the blanking region space following the line synchronization signal.
Further, the n line blanking areas missing from the video display end compensate the deviation by waiting for the time interval of the next frame trigger control signal:
when the frame rate of the video acquisition end is slightly larger than that of the video display end, the length of the missing n-line blanking area is slightly smaller than the length of the standard time sequence;
when the frame rate of the video acquisition end is slightly less than that of the video display end, the length of the missing n-line blanking area is slightly greater than the length of the standard time sequence.
Further, the method for balancing the video frame rate error based on the trigger mode further includes:
according to the delay condition of the video transmission path, a buffer unit with a proper space is arranged to adjust the trigger point position of the balance frame, so that the display delay of the maximum line level is realized.
In a second aspect, an embodiment of the present invention provides an apparatus for balancing video frame rate errors based on a trigger mode, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the above-mentioned method steps when executing the computer program.
In a third aspect, the embodiments of the present invention provide a computer-readable storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the method steps as described above
Compared with the prior art, the invention has the beneficial effects that:
the method successfully solves the problem that the frame rates of the video acquisition end and the video display end are inconsistent through a mode of waiting for compensation based on frame rate triggering of the video acquisition end and frame rate triggering of the video display end, ensures that the display frame rate is consistent with the video source frame rate, simultaneously realizes display delay of the most line levels, and meets the requirement of low-delay application of the video.
Drawings
FIG. 1 is a schematic diagram of a video stream direct transmission structure;
fig. 2 is a flowchart of a method for balancing video frame rate errors based on a trigger mode according to embodiment 1 of the present invention;
FIG. 3 is a diagram of a standard timing format;
fig. 4 is a practical timing chart of the method provided by embodiment 1 of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and detailed description.
The timing format of video includes an Active area (Active area) for transmitting Active video data and a Blanking area (Blanking area) for transmitting a synchronization signal, and video timing content contains the synchronization signal and the video signal.
Example 1:
as shown in fig. 1, the schematic diagram of the entire video direct transmission path includes video acquisition, video pre-processing, video caching, video post-processing, time sequence establishment, and video display; the invention mainly aims at the frame rate deviation, and utilizes the tiny deviation to compensate the frame rate deviation in the virtual frame time sequence establishing part.
The method for balancing video frame rate errors based on the trigger mode provided by the embodiment can be applicable to an end-to-end direct transmission scene from Camera to display equipment of all videos.
Specifically, as shown in fig. 2, the method for balancing video frame rate errors based on a trigger manner provided in this embodiment includes the following steps:
21. setting the clock frequencies of a video acquisition end and a video display end according to the video frame rate consistency and the display resolution requirement; if the frequency of two ends is 148.5MHz when the frequency is transmitted from 1080p/60Hz to 1080p/60Hz, and if the frequency is from 1080p/60Hz to 720p/60Hz, the clock frequency of a video acquisition end is 148.5MHz, and the clock frequency of a video display end is 74.5 MHz.
22. Based on the consistency of the video frame rate and the display resolution, the time sequence parameter of the video display end is set to be a plurality of line blanking areas less than the standard time sequence parameter, so that the video display end finishes the transmission of the previous frame data at the time point triggered by each frame, and meanwhile, the length of the line can be adjusted according to the frame rate of the video acquisition end to compensate the frame rate deviation.
23. Designing a frame trigger control signal based on a video acquisition end frame rate; specifically, the frame trigger control signal is a fixed point selected from the video capture end for triggering, and may be selected at any position of the video format, such as a vsync trigger edge of each frame, for example, a position of the first valid data, for example, a position of the nth valid data, and so on. I.e. the displayed frame rate is eventually equivalent to the acquired frame rate, thus eliminating the offset.
24. Starting a video display end to display each frame of video in real time based on the frame trigger control signal;
25. Based on the consistent video frame rate, the video display terminal compensates the deviation by waiting for the time interval triggered by the next frame.
Therefore, the method successfully solves the problem that the frame rates of the video acquisition end and the video display end are inconsistent through a mode of waiting for compensation based on frame rate triggering of the video acquisition end and frame-to-frame triggering of the video display end, ensures that the display frame rate is consistent with the video source frame rate, simultaneously realizes the display delay of the maximum row level and meets the requirement of low-delay application of the video.
Preferably, for the convenience of implementation, the timing parameter at the video display end is one line less than the standard timing parameter in the VFP interval, certainly not necessarily one line less in the VFP interval, and may be several lines less in other blanking areas (such as vbp/vsync), and it is easier to implement only one line less in the VFP interval.
Specifically, the line of blanking areas missing from the video display end is compensated by means of waiting for video interframe trigger, and the length of the line of blanking areas waiting may not be consistent with the standard timing length based on the frame rate errors of the video acquisition end and the video display end. When the frame rate of the video acquisition end is slightly larger than that of the video display end, the length of the blanking area of the line is slightly smaller than the length of the standard time sequence; when the frame rate of the video acquisition end is slightly less than that of the video display end, the length of the line blanking area is slightly greater than the length of the standard time sequence. Based on the length balance of the blanking area of the line, the video display end can maintain the frame rate to be consistent with that of the video acquisition end, and normal real-time display is ensured.
When the timing parameter of the video display end lacks n (a positive integer with n being greater than 1) line blanking areas compared with the standard timing parameter, because the trigger signal is provided by the video acquisition end, the timing of the video acquisition end is complete, the timing of each frame is consistent, for example, the first point trigger is set, each frame initiates one trigger at the position of the point, the lack of the n line blanking areas is specific to the video display end, the lack of the n line blanking areas is utilized, each trigger of the video acquisition end can be ensured, the display end finishes sending the previous frame, the state of the triggered next frame is waited, a new trigger cannot occur temporarily, the display of the previous frame is not finished, and the length of the lack of the n line can be slightly longer or slightly shorter than the actual length in consideration of the deviation of the two, so that the deviation of the two is counteracted.
In addition, in order to further ensure the consistency of the timing formats, a blank area of a waiting line can retain the line synchronization signal, and only the blank area space behind the line synchronization signal is used for adjustment, namely, the deviation is balanced by setting the length of the line, but the hsync area of the line is retained and only the length of a part of the hblanking area behind the hsync area of the line is adjusted for balance, so that the whole timing sequence is basically consistent, and the condition that one hsync is less does not occur.
In addition, based on the delay condition of the video transmission path, a buffer unit with a proper space is arranged, the trigger point position of the balance frame is adjusted, and the display delay of the maximum line level is realized. Specifically, the buffer unit may be a simple FIFO, data provided by the video capture end is buffered in advance, a frame trigger signal is generated after a certain amount of data is buffered, the frame trigger signal may select a fixed point of each frame of video at the video capture end to perform frame triggering, and in practice, the fixed point may be found by the buffer unit, for example, in practical application, the first data may be selected as a trigger point, and the trigger point may be started by buffering the first data of one frame of video at each time in the buffer unit, and so on, but this is only an implementation scheme of triggering, and the setting of the trigger point and the setting of the buffer unit may be adjusted according to specific application.
FIG. 3 is a schematic diagram of a standard timing format, the first is a row timing diagram including hfp/hsync/hbp/active region, the second is a column timing diagram including vfp/vsync/vbp/active region;
FIG. 4 is a diagram of an actual timing diagram after the method of the present embodiment is applied, comparing to see that the row timing diagram is consistent, except for the last row, which may be slightly larger or smaller than the standard row timing, and this comparison is not shown; the column timing diagram is just one row less at vfp, compensated by waiting;
Comparing fig. 3 and 4, it can be seen that the timing formats actually displayed are substantially consistent.
In summary, the method for balancing the video frame rate error based on the trigger method provided by the embodiment has the following technical advantages compared with the prior art:
1. in the prior art, a frame loss or frame overlapping method is adopted to eliminate frame rate errors, so that the actual video display frame rate is inconsistent with the video source frame rate.
2. The traditional technology frame dropping or frame overlapping mode needs a frame buffer storage unit when realizing low-delay video transmission, the cost is too high, when DDR storage is adopted, due to the problems of bandwidth, delay, response speed and the like, the real-time performance of video transmission can be reduced, and the application requirement can not be met for scenes with high real-time performance requirement. The method only needs a proper line cache storage unit, greatly reduces the cache cost, can display the video from the acquisition, only has line-level delay, and really achieves low delay.
Example 2:
the present embodiment provides an apparatus for balancing video frame rate errors based on a trigger mode, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the method steps described in embodiment 1 when executing the computer program.
Example 3:
the present embodiment provides a computer-readable storage medium, which stores a computer program that, when executed by a processor, implements the method steps described in embodiment 1.
The above-described embodiments of the system and apparatus are only schematic, wherein the modules described as separate parts may or may not be physically separate, and the parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above detailed description of the embodiments, those skilled in the art will clearly understand that the embodiments may be implemented by software plus a necessary general hardware platform, and may also be implemented by hardware. Based on such understanding, the above technical solutions may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, where the storage medium includes a Read-Only Memory (ROM), a Random Access Memory (RAM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), a One-time Programmable Read-Only Memory (OTPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc-Read-Only Memory (CD-ROM), or other disk memories, CD-ROMs, or other magnetic disks, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The above embodiments are only for illustrating the technical concept and features of the present invention, and the purpose thereof is to enable those skilled in the art to understand the contents of the present invention and implement the present invention accordingly, and not to limit the protection scope of the present invention accordingly. All equivalent changes or modifications made in accordance with the spirit of the present disclosure are intended to be covered by the scope of the present disclosure.

Claims (5)

1. A method for balancing video frame rate error based on a trigger mode is applied to direct transmission of a video from an acquisition end to a display end, and is characterized by comprising the following steps:
setting clock frequencies of a video acquisition end and a video display end to meet the requirements of video frame rate consistency and display resolution;
setting a blanking area with n lines of time sequence parameters of a video display end less than standard time sequence parameters, wherein the blanking area with one line of time sequence parameters of the video display end less than the standard time sequence parameters in a VFP interval; n is a positive integer;
generating a frame trigger control signal according to the frame rate of the video acquisition end so as to start the video display end to display each frame of video in real time;
the blanking area of n lines which is lacked at the video display end compensates deviation by waiting for the time interval of the next frame triggering control signal;
the blanking area of the line which is lacked at the video display end compensates the deviation by waiting for the time interval triggered by the next frame:
When the frame rate of the video acquisition end is slightly greater than that of the video display end, the length of the missing line blanking area is slightly less than the length of the standard time sequence;
when the frame rate of the video acquisition end is slightly less than that of the video display end, the length of the missing blanking area of the line is slightly greater than the length of the standard time sequence;
the line blanking area waiting for compensation is reserved for the line synchronization signal and is adjusted only by the blanking area space following the line synchronization signal.
2. The method for balancing video frame rate error based on trigger mode as claimed in claim 1, wherein the n line blanking areas missing from the video display end compensate for the deviation by waiting for the time interval of the next frame trigger control signal:
when the frame rate of the video acquisition end is slightly larger than that of the video display end, the length of the missing n-line blanking area is slightly smaller than the length of the standard time sequence;
when the frame rate of the video acquisition end is slightly less than that of the video display end, the length of the missing n-line blanking area is slightly greater than the length of the standard time sequence.
3. The method for balancing video frame rate error based on trigger mode as claimed in claim 1, further comprising:
according to the delay condition of the video transmission path, a buffer unit with a proper space is arranged to adjust the trigger point position of the balance frame, so that the display delay of the maximum line level is realized.
4. An apparatus for trigger-based video frame rate error balancing, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method steps of any of claims 1-3 when executing the computer program.
5. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 3.
CN201911293352.XA 2019-12-16 2019-12-16 Method, apparatus, and medium for balancing video frame rate error based on trigger mode Active CN111083547B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911293352.XA CN111083547B (en) 2019-12-16 2019-12-16 Method, apparatus, and medium for balancing video frame rate error based on trigger mode

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911293352.XA CN111083547B (en) 2019-12-16 2019-12-16 Method, apparatus, and medium for balancing video frame rate error based on trigger mode

Publications (2)

Publication Number Publication Date
CN111083547A CN111083547A (en) 2020-04-28
CN111083547B true CN111083547B (en) 2022-07-29

Family

ID=70314729

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911293352.XA Active CN111083547B (en) 2019-12-16 2019-12-16 Method, apparatus, and medium for balancing video frame rate error based on trigger mode

Country Status (1)

Country Link
CN (1) CN111083547B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022155889A1 (en) * 2021-01-22 2022-07-28 京东方科技集团股份有限公司 Method and apparatus for signal processing, and display apparatus
CN113542840B (en) * 2021-06-11 2023-04-07 浙江大华技术股份有限公司 Method for adjusting display delay, electronic device and storage medium
CN115171598B (en) * 2022-07-27 2023-04-18 富满微电子集团股份有限公司 Blanking circuit and chip

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6522363B1 (en) * 1999-07-30 2003-02-18 Thomson Licensing S.A. Display frame rate adaptation
CN100379285C (en) * 2003-06-13 2008-04-02 苹果电脑公司 Synthesis of vertical blanking signal
US8204104B2 (en) * 2006-03-09 2012-06-19 Sony Corporation Frame rate conversion system, method of converting frame rate, transmitter, and receiver
CN101686399B (en) * 2008-09-28 2012-09-05 中兴通讯股份有限公司 Device and method for transmitting video stream between chips of video conferphone system
CN104717442B (en) * 2013-12-12 2018-02-09 中国航空工业集团公司第六三一研究所 Automatic switching method of more video formats to VESA agreement 1600X1200 resolution ratio 60Hz frame-rate videos
US9332216B2 (en) * 2014-03-12 2016-05-03 Sony Computer Entertainment America, LLC Video frame rate compensation through adjustment of vertical blanking
CN106205460B (en) * 2016-09-29 2018-11-23 京东方科技集团股份有限公司 Driving method, sequence controller and the display device of display device

Also Published As

Publication number Publication date
CN111083547A (en) 2020-04-28

Similar Documents

Publication Publication Date Title
CN111083547B (en) Method, apparatus, and medium for balancing video frame rate error based on trigger mode
US5977989A (en) Method and apparatus for synchronizing video and graphics data in a multimedia display system including a shared frame buffer
KR100751861B1 (en) Synchronization of image frame update
US9607542B2 (en) Display panel driving method, driving device and display device
JP2736641B2 (en) A device that freezes television images
CN111510773A (en) Resolution adjustment method, display screen, computer storage medium and equipment
US11646001B2 (en) Display device, data processor, data processing method, driving method, storage medium, and electronic device
US6160590A (en) Video signal processing circuit inhibiting display of distorted images
WO2023179348A1 (en) Data transmission method, cloud desktop virtual machine, cloud terminal, and readable storage medium
CN114025107B (en) Image ghost shooting method, device, storage medium and fusion processor
TWI765293B (en) Receiving device, video recording system and method for reducing video latency in video recording system
JP3384659B2 (en) Reduced video signal processing circuit
CN111510772B (en) Method, device, equipment and storage medium for balancing video frame rate error
CN113438502B (en) Video frame image transmission method, sending card and video frame image display system
CN114866829A (en) Synchronous playing control method and device
US7289170B2 (en) Method and apparatus for compensating for interlaced-scan type video signal
CN111104350A (en) Online low-delay regulation and control method, terminal equipment and storage medium
CN108243293B (en) Image display method and system based on virtual reality equipment
WO2022179681A1 (en) Method for operating a display device of a vehicle for displaying video frames of a video stream at a predefined frame rate and corresponding display device and vehicle
US6407778B1 (en) Video signal processing
WO2020258031A1 (en) Control method, image transmission system, display device, and unmanned aerial vehicle system
US20220375046A1 (en) Image distortion correction system and method
CN110636348B (en) Video playing method, device and system
US20220066721A1 (en) System and method for reducing render latency in a display-server computing system
US20240070824A1 (en) Image processing circuit and method having output timing adjustment mechanism

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant