CN107277295A - Audio video synchronization processing unit and method - Google Patents
Audio video synchronization processing unit and method Download PDFInfo
- Publication number
- CN107277295A CN107277295A CN201710483258.5A CN201710483258A CN107277295A CN 107277295 A CN107277295 A CN 107277295A CN 201710483258 A CN201710483258 A CN 201710483258A CN 107277295 A CN107277295 A CN 107277295A
- Authority
- CN
- China
- Prior art keywords
- video
- decoding
- header signal
- signal
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
- H04N5/08—Separation of synchronising signals from picture signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides a kind of audio video synchronization processing unit and method, the device includes：First extraction module, the decoding header signal for extracting decoding video, and by the video data in decoding video and the decoding header signal synchronized transmission to clock synchronization process module；Clock frequency recovery module, for obtaining reference clock frequency from reference video；Clock synchronization process module, the video data consistent with reference clock frequency for synchronism output and decoding header signal are to synchronous output module；Second extraction module, the reference header signal for extracting reference video；Synchronous output module, the starting output time for the video data for determining to receive for the decoding header signal according to reception and with reference to header signal, and the video data is exported according to starting output time.The video data of so each road decoding video double synchronous on clock zone and data field, can keep the television image broadcasted stable, improve the viewing effect of people.
Description
Technical field
The present invention relates to broadcasting television technology field, more particularly, to a kind of audio video synchronization processing unit and method.
Background technology
In the broadcast system of radio and television, what the multi-channel video that system front end is inputted had comes from satellite-signal, and what is had comes
From reradiated signal, what is had comes from recorded broadcast signal etc., after these videos are decoded respectively through decoding device, passes through SDI interfaces
(Serial Digital Interface, digital component serial line interface) is exported.In order to (decoded to regard in multipath decoding video
Frequency is referred to as decoding video) between switch over, the output ends of SDI interfaces is connected with SDI switch, the control decoding of SDI switch
The output of video.
Each road decoding video there may be asynchronous problem on clock zone or data field, when SDI switch is in difference
When being switched between the decoding video of Bu Ge roads, can cause broadcast television image it is unstable, for example occur jump, flicker or
Roll etc., so as to influence the viewing effect of people.
The content of the invention
In view of this, it is an object of the invention to provide a kind of audio video synchronization processing unit and method, so that each road is decoded
The video data of video double synchronous on clock zone and data field, so as to keep the television image broadcasted stable, improves people
Viewing effect.
In a first aspect, the embodiments of the invention provide a kind of audio video synchronization processing unit, described device includes first and extracted
Module, clock frequency recovery module, clock synchronization process module, the second extraction module and synchronous output module；
First extraction module is used to, when receiving the decoding video of video source offer, extract the decoding video
Decode header signal, and by the video data in the decoding video and the decoding header signal synchronized transmission to the clock
Synchronous processing module；Wherein, the decoding header signal is used for the frame header position for indicating each frame of video of the decoding video；
The clock frequency recovery module is used for when receiving the reference video of reference source offer, from the reference video
Middle acquisition reference clock frequency, and the reference clock frequency is sent to the clock synchronization process module, and will be described
Reference video is sent to second extraction module；
When the clock synchronization process module is used to receive the video data, the decoding header signal and the reference
Clock frequency, and the synchronism output video data consistent with the reference clock frequency and decoding header signal are to the synchronism output
Module；
Second extraction module is used for when receiving the reference video, extracts the reference frame head of the reference video
Signal, and the reference header signal is sent to the synchronous output module；Wherein, the reference header signal is used to indicate
The frame header position of each frame of video of the reference video；
The synchronous output module is used to receive the video data, the decoding header signal and reference frame head letter
Number, the starting output time of the video data, and root are determined according to the decoding header signal and the reference header signal
The video data is exported according to the starting output time.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the first of first aspect, wherein, institute
State the first extraction module specifically for：
The synchronizing signal of the decoding video is obtained, the synchronizing signal includes horizontal-drive signal, vertical synchronizing signal
And field sync signal；The decoding header signal of the decoding video is extracted according to the synchronizing signal.
With reference to the first possible embodiment of first aspect, the embodiments of the invention provide second of first aspect
Possible embodiment, wherein, first extraction module includes：
First extraction unit, for when the decoding video is interlaced scanning video, according to the field sync signal
Change location extracts the decoding header signal of the decoding video；
Second extraction unit, for when the decoding video is progressive scanned video, according to the vertical synchronizing signal
Change location and the horizontal-drive signal extract the decoding header signal of the decoding video.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the third of first aspect, wherein, institute
Clock synchronization process module is stated including writing unit, memory cell and output unit is read；
Said write unit is used to the video data of reception and the decoding header signal being synchronously written described deposit
Storage unit；
The memory cell is used to store the video data and the decoding header signal received；
The output unit that reads is used for the reference clock frequency according to reception, and the synchronous reading memory cell is deposited
The video data and the decoding header signal of storage, and the video data of reading and the decoding header signal is same
Step is sent to the synchronous output module.
With reference to the third possible embodiment of first aspect, the embodiments of the invention provide the 4th of first aspect kind
Possible embodiment, wherein, said write unit is additionally operable to when overflow occurs in the memory cell, by the video
The current video frame of data is repeatedly written the corresponding storage region of last frame of video before the memory cell overflow；
The reading output unit is additionally operable to when storage underflow occurs in the memory cell, and it is single that the storage is read in repetition
Last frame of video stored before first underflow.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the 5th of first aspect kind, wherein, institute
State synchronous output module specifically for：
It is synchronous to read the video data, the decoding header signal and the reference header signal received；Work as reading
During to the decoding header signal, the decoding video is read in stopping, continuing to read the reference header signal, and will read afterwards
The time for getting the reference header signal is defined as the starting output time；According to the starting output time output
Video data.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the 6th of first aspect kind, wherein, institute
Stating device also includes delay adjustment module；
The delay adjustment module is used to adjust relative between the decoding header signal and the reference header signal
Delay, and the relative time delay is sent to the synchronous output module；
The synchronous output module is specifically additionally operable to receive the relative time delay, is risen according to being determined the relative time delay
Beginning output time, and the video data is exported according to the starting output time.
Second aspect, the embodiment of the present invention also provides a kind of audio video synchronization processing method, and methods described is applied such as first
In audio video synchronization processing unit described in aspect；Methods described includes：
When first extraction module receives the decoding video of video source offer, the decoding of the decoding video is extracted
Header signal, and the video data in the decoding video and the decoding header signal synchronized transmission is synchronous to the clock
Processing module；Wherein, the decoding header signal is used for the frame header position for indicating each frame of video of the decoding video；
When the clock frequency recovery module receives the reference video of reference source offer, obtained from the reference video
Reference clock frequency is taken, and the reference clock frequency is sent to the clock synchronization process module, and by the reference
Video is sent to second extraction module；
The clock synchronization process module receives the video data, the decoding header signal and reference clock frequency
Rate, and the synchronism output video data consistent with the reference clock frequency and decoding header signal are to the synchronism output mould
Block；
When second extraction module receives the reference video, the reference frame head letter of the reference video is extracted
Number, and the reference header signal is sent to the synchronous output module；Wherein, the reference header signal is used to indicate institute
State the frame header position of each frame of video of reference video；
The synchronous output module receives the video data, the decoding header signal and the reference header signal,
The starting output time of the video data is determined according to the decoding header signal and the reference header signal, and according to institute
State starting output time and export the video data.
With reference to second aspect, the embodiments of the invention provide the possible embodiment of the first of second aspect, wherein, institute
State when first extraction module receives the decoding video of video source offer, extract the decoding frame head letter of the decoding video
Number, including：
When first extraction module receives the decoding video of video source offer, the synchronization of the decoding video is obtained
Signal, the synchronizing signal includes horizontal-drive signal, vertical synchronizing signal and field sync signal；
The decoding header signal of the decoding video is extracted according to the synchronizing signal.
With reference to second aspect, the embodiments of the invention provide the possible embodiment of second of second aspect, wherein, institute
The starting output time that the video data is determined according to the decoding header signal and the reference header signal is stated, including：
It is synchronous to read the video data, the decoding header signal and the reference header signal received；Work as reading
During to the decoding header signal, the decoding video is read in stopping, continuing to read the reference header signal, and will read afterwards
The time for getting the reference header signal is defined as the starting output time.
The embodiment of the present invention brings following beneficial effect：
In the embodiment of the present invention, audio video synchronization processing unit includes the first extraction module, clock frequency recovery module, clock
Synchronous processing module, the second extraction module and synchronous output module；First extraction module, which is used to work as, receives video source offer
During decoding video, the decoding header signal of the decoding video is extracted, and by the video data in the decoding video and the decoding frame
Head signal synchronized transmission is to clock synchronization process module；Wherein, decoding header signal is used for each video for indicating decoding video
The frame header position of frame；Clock frequency recovery module is used for when receiving the reference video of reference source offer, from the reference video
Middle acquisition reference clock frequency, and the reference clock frequency is sent to clock synchronization process module, and by the reference video
Send to the second extraction module；Clock synchronization process module is used to receive video data, decoding header signal and reference clock frequency
Rate, and the synchronism output video data consistent with the reference clock frequency and decoding header signal are to synchronous output module；Second
Extraction module is used for when receiving reference video, extracts the reference header signal of the reference video, and this is believed with reference to frame head
Number send to synchronous output module；Wherein, the frame header position of each frame of video for indicating reference video is used for reference to header signal；
Synchronous output module is used to receive video data, decode header signal and refer to header signal, according to the decoding header signal and
This determines the starting output time of the video data with reference to header signal, and exports the video counts according to the starting output time
According to.Clock synchronization process module according to reference clock frequency can by decoding video and reference video on clock zone it is synchronous, enter
And synchronous output module can be by decoding video and reference video in data field according to decoding header signal and reference header signal
Upper synchronization, it is achieved thereby that decoding video and double synchronous of the reference video on clock zone and data field.Due to the decoding of each road
Video is synchronous with reference video, therefore applies audio video synchronization processing unit provided in an embodiment of the present invention and method, output
Each road video data double synchronous on clock zone and data field, the television image for so maintaining broadcast is stable, improves
The viewing effect of people.
Other features and advantages of the present invention will be illustrated in the following description, also, partly be become from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages are in specification, claims
And specifically noted structure is realized and obtained in accompanying drawing.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description of the drawings
, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical scheme of the prior art
The accompanying drawing used required in embodiment or description of the prior art is briefly described, it should be apparent that, in describing below
Accompanying drawing is some embodiments of the present invention, for those of ordinary skill in the art, before creative work is not paid
Put, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is the first structural representation of audio video synchronization processing unit provided in an embodiment of the present invention；
Fig. 2 is that the unit composition of clock synchronization process module in audio video synchronization processing unit provided in an embodiment of the present invention shows
It is intended to；
Fig. 3 is the handling process schematic diagram of audio video synchronization processing unit provided in an embodiment of the present invention；
Fig. 4 is second of structural representation of audio video synchronization processing unit provided in an embodiment of the present invention；
Fig. 5 is the schematic flow sheet of audio video synchronization processing method provided in an embodiment of the present invention.
Icon：
The extraction modules of 10- first；20- clock frequency recovery modules；30- clock synchronization process modules；31- writing units；
32- memory cell；33- reads output unit；The extraction modules of 40- second；50- synchronous output modules；60- delay adjustment modules.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with accompanying drawing to the present invention
Technical scheme be clearly and completely described, it is clear that described embodiment is a part of embodiment of the invention, rather than
Whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creative work premise
Lower obtained every other embodiment, belongs to the scope of protection of the invention.
In view of the electricity that when SDI switch is switched between nonsynchronous each road decoding video, can cause to broadcast
It is unstable depending on picture, the viewing effect of influence people, a kind of audio video synchronization processing unit and method provided in an embodiment of the present invention,
Each road video data of output double synchronous on clock zone and data field can be made, keep the television image broadcasted stable, carry
The viewing effect of high people.
For ease of understanding the present embodiment, a kind of audio video synchronization disclosed in the embodiment of the present invention is handled filled first
Put and describe in detail.
Embodiment one：
Fig. 1 is the first structural representation of audio video synchronization processing unit provided in an embodiment of the present invention, as shown in figure 1,
The device includes the first extraction module 10, clock frequency recovery module 20, clock synchronization process module 30, the second extraction module 40
With synchronous output module 50.
First extraction module 10 is used to, when receiving the decoding video of video source offer, extract the decoding of the decoding video
Header signal, and by the video data in the decoding video and the decoding header signal synchronized transmission to clock synchronization process module
30；Wherein, decoding header signal is used for the frame header position for indicating each frame of video of decoding video.
Clock frequency recovery module 20 is used to, when receiving the reference video of reference source offer, obtain from the reference video
Reference clock frequency is taken, and the reference clock frequency is sent to clock synchronization process module 30, and the reference video is sent out
Deliver to the second extraction module 40.
Clock synchronization process module 30 is used to receive video data, decoding header signal and reference clock frequency, and synchronously
The output video data consistent with the reference clock frequency and header signal is decoded to synchronous output module 50.
Second extraction module 40 is used for when receiving reference video, extracts the reference header signal of the reference video, and
This is sent to synchronous output module 50 with reference to header signal；Wherein, with reference to header signal be used for indicate reference video each
The frame header position of frame of video.
Synchronous output module 50 is used to receive video data, decode header signal and refer to header signal, according to the decoding
Header signal determines the starting output time of the video data with this with reference to header signal, and is exported according to the starting output time
The video data.
In the embodiment of the present invention, audio video synchronization processing unit includes the first extraction module, clock frequency recovery module, clock
Synchronous processing module, the second extraction module and synchronous output module, clock synchronization process module can be with according to reference clock frequency
By decoding video and reference video on clock zone it is synchronous, and then synchronous output module is according to decoding header signal and refers to frame head
Signal can by decoding video and reference video on data field it is synchronous, it is achieved thereby that decoding video with reference video in clock
Double synchronous on domain and data field.Because each road decoding video is synchronous with reference video, therefore apply the embodiment of the present invention
The audio video synchronization processing unit of offer, each road video data of output double synchronous on clock zone and data field, is so protected
Hold the television image broadcasted stable, improve the viewing effect of people.
Above-mentioned audio video synchronization processing unit can rely on FPGA, and (Field Programmable Gate Array, scene can
Program gate array) chip realization.For the device, input source is divided into two parts, and one is video source, and one is reference source.Its
In, video source can be, but not limited to be decoding chip output video data, head end video input source by decoding chip output
Decoded decoding video, decoding video is digital video；Reference source is external analog video source, exports reference video, reference
Video is analog video, and the reference video is used to simultaneously provide object of reference for each decoding video.The device is defeated to both
It is synchronization process to enter source, and the device is specifically described below to decoding video and the processing procedure of reference video.
The decoding header signal that (1) first extraction module 10 extracts decoding video includes：When the first extraction module 10 is received
During to decoding video, the synchronizing signal of the decoding video is obtained, the synchronizing signal includes horizontal-drive signal, vertical synchronizing signal
And field sync signal, the decoding header signal of the decoding video, i.e. TOF (Top Of Frame, frame are extracted according to the synchronizing signal
Head) signal.
Specifically, for a complete decoding video, can obtain it Hsync signals (horizontal-drive signal),
Vsync signals (vertical synchronizing signal) and Fsync signals (field sync signal), Hsync signals are used to indicate decoding video
Each row in the terminal or starting point of each row data in each frame of video, each frame of video of Vsync signals for indicating decoding video
Data are in field blanking interval or trace is interval (valid data row), and Fsync signals are used for each video for indicating decoding video
Each row data are in odd field or even field in frame.It can be carried according to the Hsync signals, Vsync signals and Fsync signals of decoding video
Take the TOF signals of the decoding video.
Scan mode in view of video is divided into interlacing scan and progressive scan, and the first extraction module 10 includes：First carries
Unit is taken, for when decoding video is interlaced scanning video, decoding video to be extracted according to the change location of field sync signal
Decode header signal；Second extraction unit, for when decoding video is progressive scanned video, according to the change of vertical synchronizing signal
Change position and horizontal-drive signal extracts the decoding header signal of decoding video.
Specifically, for interlaced scanning video, because each frame of video includes two-odd field and even field, Fsync signals exist
Odd field and even field are respectively low level and high level (or opposite), therefore can be changed according to the level of Fsync signals come really
Frame header position is determined, so as to extract TOF signals.If for example, each frame of video of decoding video first scans odd field, then scanning idol
, Fsync signals are low level under odd field, and even Fsync signals off field are high level, then when Fsync signals are changed into from high level
Illustrate that the even field scan of current video frame terminates during low level, start to scan the odd field of next frame of video, you can to determine now
The frame header position of correspondence frame of video, so as to extract TOF signals.
For progressive scanned video, Fsync signals are constant, now can not be according to Fsync signal extraction TOF signals.Consider
Each frame of video to progressive scanned video includes interval field blanking, trace interval and interval three parts of field blanking, same to regard
The line number in the field blanking interval after trace is interval under frequency standard is fixed, and Vsync signals blanking interval on the scene and trace interval point
Not Wei high level and low level (or opposite), therefore the interval knot of trace can be determined by the level change of Vsync signals
Beam position, line number is determined further according to Hsync signals, can find the frame header position of next frame of video, so as to extract TOF signals.
For example, if each frame of video of decoding video includes 750 rows, the blanking of 1-25 behavior fields is interval, and 26-745 behaviors trace is interval,
The blanking of 746-750 behavior fields is interval, and Vsync signals blanking interval on the scene is high level, is low level in trace interval, then when
When detecting Vsync signals and being changed into high level from low level, it may be determined that now just interval to field blanking by the scanning of trace interval
(such as 745-746 rows), determines the frame header position that the position after 5 rows is next frame of video, so as to extract further according to Hsync signals
TOF signals.
(2) processing of the clock frequency recovery module 20 to reference video includes：When clock frequency retrieval module 20 is received
During the reference video that reference source is provided, recover the analog video source clock of the reference video, and using analog video source clock as
The processing clock of decoding video, that is, obtain the reference clock frequency of the reference video, and regard the reference clock frequency as decoding
Clock frequency after audio video synchronization, and then realize that decoding video is synchronous on clock zone with reference video.
(3) clock synchronization process module 30 is used to make decoding video and reference video synchronous on clock zone.Fig. 2 is this hair
The unit composition schematic diagram of clock synchronization process module in the audio video synchronization processing unit that bright embodiment is provided, as shown in Fig. 2 when
Clock synchronous processing module 30 includes writing unit 31, memory cell 32 and reads output unit 33.Writing unit 31 is used to connect
The video data and decoding header signal of receipts are synchronously written memory cell 32；Memory cell 32 is used to store the video data received
With decoding header signal；Reading output unit 33 is used for the reference clock frequency according to reception, and the synchronous memory cell 32 that reads is deposited
The video data and decoding header signal of storage, and by the video data of reading and header signal synchronized transmission is decoded to synchronism output
Module 50.
In view of the clock frequency of decoding video in itself and reference clock frequency it is inconsistent when, writing unit 31 write-in speed
Rate and the output speed of reading output unit 33 are inconsistent, therefore utilize the caching of the progress video data of memory cell 32.Clock
Synchronous processing module 30 can be, but not limited to carry out the caching of data using DDR.DDR full name is DDR SDRAM (Double
Data Rate SDRAM, Double Data Rate SDRAM), wherein SDRAM is Synchronous Dynamic Random Access
Memory, synchronous DRAM.
Further, it is contemplated that when writing rate is more than output speed, DDR overflows can be caused, writing unit 31 is also
For when overflow occurs in memory cell 32, the current video frame of video data to be repeatedly written before the overflow of memory cell 32
The corresponding storage region of last frame of video.When being less than output speed in view of writing rate, it can cause under DDR storages
Overflow, read output unit 33 and be additionally operable to, when storage underflow occurs in memory cell 32, repeat to deposit before reading the underflow of memory cell 32
Last frame of video of storage.This way it is ensured that the video data from DDR outputs is a complete frame, while TOF signals
Synchronous output module 50 is output to the video data after clock synchronization.
(4) second extraction modules 40 are used for the reference header signal for extracting reference video, i.e. TOF signals.Specifically, refer to
Video also carries synchronizing signal in itself：Hsync signals, Vsync signals and Fsync signals, due to the synchronizing signal of reference video
For analog video synchronizing signal, it is necessary to using modulus conversion chip by the Hsync signals, Vsync signals and Fsync of reference video
Signal is transformed into numeric field, so that the second extraction module 40 is used.Second extraction module 40 extracts the TOF signals of reference video
Process is identical with the process for the TOF signals that the first extraction module 10 extracts decoding video, repeats no more here.
(5) synchronous output module 50 specifically for：It is synchronous to read the video data received, decoding header signal and reference frame
Head signal；When reading decoding header signal, stop reading decoding video, continue reading and refer to header signal, and by after
The time read with reference to header signal is defined as originating output time；The video data is exported according to the starting output time.
The output interface of synchronous output module 50 can be SDI interfaces.So, just accomplished decoding video with reference video in data field
On it is consistent.
Fig. 3 is the handling process schematic diagram of audio video synchronization processing unit provided in an embodiment of the present invention, as shown in figure 3, should
The handling process of device includes following steps：
Step S301, the first extraction module extracts the TOF signals of decoding video.
Step S302, clock frequency recovery module obtains reference clock frequency from reference video.
Step S303, the second extraction module extracts the TOF signals of reference video.
It should be noted that step S301 and step S302 or step S303 can synchronously perform, to step S302 and step
Rapid S303 execution sequence is not construed as limiting, to first carry out step S302 in Fig. 3, then is performed and illustrated exemplified by step S303.
Step S304, clock synchronization process module is synchronous by the decoding video of reception and reference video progress clock zone, and
Export to synchronous output module.
Step S305, synchronous output module is synchronous by decoding video and reference video progress data field, and output is regarded with reference
The synchronous video data of frequency.
The specific implementation procedure of each above-mentioned step may be referred to foregoing teachings, repeat no more here.
Other processing are done in extended meeting after the video data exported in view of above-mentioned audio video synchronization processing unit, and are existed outside
The influence of environment, can cause actual video data and reference video to reach Complete Synchronization on data field, such as Fig. 4 institutes
Show, the device also includes delay adjustment module 60 on the basis of Fig. 1, delay adjustment module 60 is used to adjust decoding header signal
And with reference to the relative time delay between header signal, and the relative time delay is sent to synchronous output module 50.Synchronous output module
50 are specifically additionally operable to receive the relative time delay, and starting output time is determined according to the relative time delay, and when being exported according to the starting
Between export the video data.
Specifically, user can adjust above-mentioned relative time delay by delay adjustment module 60, and the base unit of regulation is one
Individual reference clock cycle, is also equal to the regulation of a frame of video, and precision is very high, wherein, reference clock cycle and reference clock
Frequency correspondence.So further ensure video data synchronous on data field with reference video.
In view of when reference source occurs exception or changed, above-mentioned relative time delay is not fixed, when multiple inspection
When measuring relative time delay change, the real time synchronization of decoding video and reference video can be kept by the way of re-synchronizing.
In summary, audio video synchronization processing unit provided in an embodiment of the present invention can make the video data of decoding video with
Reference video double synchronous on clock zone and data field, while ensureing that synchronous precision and real-time sexual satisfaction are required.
Embodiment two：
Originally implement there is provided a kind of audio video synchronization processing method, this method is applied at such as audio video synchronization of embodiment one
Manage on device.Fig. 5 is the schematic flow sheet of audio video synchronization processing method provided in an embodiment of the present invention, as shown in figure 5, this method
Including following steps：
Step S501, when the first extraction module receives the decoding video of video source offer, extracts the decoding video
Decode header signal, and by the video data in the decoding video and the decoding header signal synchronized transmission to clock synchronization process
Module；Wherein, decoding header signal is used for the frame header position for indicating each frame of video of decoding video.
Step S502, when clock frequency retrieval module receives the reference video of reference source offer, from the reference video
Middle acquisition reference clock frequency, and the reference clock frequency is sent to clock synchronization process module, and by the reference video
Send to the second extraction module.
Step S503, clock synchronization process module receives video data, decoding header signal and reference clock frequency, and together
The output video data consistent with reference clock frequency and decoding header signal are walked to synchronous output module.
Step S504, when the second extraction module receives reference video, extracts the reference header signal of the reference video,
And send this to synchronous output module with reference to header signal；Wherein, with reference to header signal be used for indicate reference video each
The frame header position of frame of video.
Step S505, synchronous output module receives video data, decodes header signal and refer to header signal, according to the solution
Code header signal determines the starting output time of the video data with this with reference to header signal, and defeated according to the starting output time
Go out the video data.
The process of decoding header signal that first extraction module extracts decoding video is specially：When the first extraction module is received
During the decoding video provided to video source, the synchronizing signal of the decoding video is obtained, synchronizing signal includes horizontal-drive signal, hung down
Straight synchronizing signal and field sync signal；The decoding header signal of the decoding video is extracted according to the synchronizing signal.
Determine that the process of the starting output time of video data is specially according to decoding header signal and with reference to header signal：
It is synchronous to read the video data received, decode header signal and refer to header signal；When reading decoding header signal, stop
Decoding video is read, continues reading and refers to header signal, and the time read afterwards with reference to header signal is defined as starting
Output time.
In the embodiment of the present invention, when the first extraction module receives the decoding video of video source offer, the decoding is extracted
The decoding header signal of video, and the video data in the decoding video and the decoding header signal synchronized transmission is same to clock
Walk processing module；Wherein, decoding header signal is used for the frame header position for indicating each frame of video of decoding video.Work as clock frequency
When recovery module receives the reference video of reference source offer, reference clock frequency is obtained from the reference video, and this is joined
Examine clock frequency to send to clock synchronization process module, and the reference video is sent to the second extraction module.Clock is synchronous
Processing module receives video data, decoding header signal and reference clock frequency, and synchronism output is consistent with reference clock frequency
Video data and decoding header signal to synchronous output module.When the second extraction module receives reference video, extracting should
The reference header signal of reference video, and this is sent to synchronous output module with reference to header signal；Wherein, with reference to header signal
For the frame header position for each frame of video for indicating reference video.Synchronous output module receives video data, decoding header signal
With refer to header signal, according to the decoding header signal and this with reference to header signal determine the video data starting export when
Between, and the video data is exported according to the starting output time.Clock synchronization process module can be by according to reference clock frequency
Decoding video and reference video are synchronous on clock zone, and then synchronous output module is believed according to decoding header signal and with reference to frame head
Number can by decoding video and reference video on data field it is synchronous, it is achieved thereby that decoding video with reference video in clock zone
With the double synchronous on data field.Carried because each road decoding video is synchronous with reference video, therefore using the embodiment of the present invention
The audio video synchronization processing method of confession, each road video data of output double synchronous on clock zone and data field, so keeps
The television image broadcasted is stable, improves the viewing effect of people.
It is apparent to those skilled in the art that, for convenience and simplicity of description, the method for foregoing description
Specific work process, may be referred to the corresponding process in aforementioned means embodiment, will not be repeated here.
Audio video synchronization processing method provided in an embodiment of the present invention, the audio video synchronization processing unit provided with above-described embodiment
With identical technical characteristic, so can also solve identical technical problem, identical technique effect is reached.
Flow chart and block diagram in accompanying drawing show system, method and the computer journey of multiple embodiments according to the present invention
Architectural framework in the cards, function and the operation of sequence product.At this point, each square frame in flow chart or block diagram can generation
The part of one module of table, program segment or code a, part for the module, program segment or code is used comprising one or more
In the executable instruction for realizing defined logic function.It should also be noted that in some realizations as replacement, being marked in square frame
The function of note can also be with different from the order marked in accompanying drawing generation.For example, two continuous square frames can essentially base
Originally it is performed in parallel, they can also be performed in the opposite order sometimes, this is depending on involved function.It is also noted that
It is, the combination of each square frame in block diagram and/or flow chart and the square frame in block diagram and/or flow chart that can use and perform rule
Fixed function or the special hardware based system of action realize, or can use the group of specialized hardware and computer instruction
Close to realize.
In the description of the invention, it is necessary to which explanation, term " first ", " second ", " the 3rd " are only used for describing purpose,
And it is not intended that indicating or implying relative importance.
The computer program product for the carry out audio video synchronization processing method that the embodiment of the present invention is provided, including store place
The computer-readable recording medium of the executable non-volatile program code of device is managed, the instruction that described program code includes can be used for
The method described in previous methods embodiment is performed, implements and can be found in embodiment of the method, will not be repeated here.
, can be with several embodiments provided herein, it should be understood that disclosed systems, devices and methods
Realize by another way.Device embodiment described above is only schematical, for example, the division of the unit,
It is only a kind of division of logic function, there can be other dividing mode when actually realizing, in another example, multiple units or component can
To combine or be desirably integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or beg for
The coupling each other of opinion or direct-coupling or communication connection can be by some communication interfaces, device or unit it is indirect
Coupling is communicated to connect, and can be electrical, machinery or other forms.
The unit illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.
If the function is realized using in the form of SFU software functional unit and is used as independent production marketing or in use, can be with
It is stored in the executable non-volatile computer read/write memory medium of a processor.Understood based on such, the present invention
The part that is substantially contributed in other words to prior art of technical scheme or the part of the technical scheme can be with software
The form of product is embodied, and the computer software product is stored in a storage medium, including some instructions are to cause
One computer equipment (can be personal computer, server, or network equipment etc.) performs each embodiment institute of the invention
State all or part of step of method.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-
Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with
The medium of store program codes.
Finally it should be noted that：Embodiment described above, is only the embodiment of the present invention, to illustrate the present invention
Technical scheme, rather than its limitations, protection scope of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, it will be understood by those within the art that：Any one skilled in the art
The invention discloses technical scope in, it can still modify to the technical scheme described in previous embodiment or can be light
Change is readily conceivable that, or equivalent substitution is carried out to which part technical characteristic；And these modifications, change or replacement, do not make
The essence of appropriate technical solution departs from the spirit and scope of technical scheme of the embodiment of the present invention, should all cover the protection in the present invention
Within the scope of.Therefore, protection scope of the present invention described should be defined by scope of the claims.
Claims (10)
1. a kind of audio video synchronization processing unit, it is characterised in that described device includes the first extraction module, clock frequency and recovers mould
Block, clock synchronization process module, the second extraction module and synchronous output module；
First extraction module is used to, when receiving the decoding video of video source offer, extract the decoding of the decoding video
Header signal, and the video data in the decoding video and the decoding header signal synchronized transmission is synchronous to the clock
Processing module；Wherein, the decoding header signal is used for the frame header position for indicating each frame of video of the decoding video；
The clock frequency recovery module is used to, when receiving the reference video of reference source offer, obtain from the reference video
Reference clock frequency is taken, and the reference clock frequency is sent to the clock synchronization process module, and by the reference
Video is sent to second extraction module；
The clock synchronization process module is used to receive the video data, the decoding header signal and reference clock frequency
Rate, and the synchronism output video data consistent with the reference clock frequency and decoding header signal are to the synchronism output mould
Block；
Second extraction module is used for when receiving the reference video, extracts the reference frame head letter of the reference video
Number, and the reference header signal is sent to the synchronous output module；Wherein, the reference header signal is used to indicate institute
State the frame header position of each frame of video of reference video；
The synchronous output module is used to receive the video data, the decoding header signal and the reference header signal,
The starting output time of the video data is determined according to the decoding header signal and the reference header signal, and according to institute
State starting output time and export the video data.
2. device according to claim 1, it is characterised in that first extraction module specifically for：
The synchronizing signal of the decoding video is obtained, the synchronizing signal includes horizontal-drive signal, vertical synchronizing signal and field
Synchronizing signal；The decoding header signal of the decoding video is extracted according to the synchronizing signal.
3. device according to claim 2, it is characterised in that first extraction module includes：
First extraction unit, for when the decoding video is interlaced scanning video, according to the change of the field sync signal
Extract the decoding header signal of the decoding video in position；
Second extraction unit, for when the decoding video is progressive scanned video, according to the change of the vertical synchronizing signal
Change position and the horizontal-drive signal extracts the decoding header signal of the decoding video.
4. device according to claim 1, it is characterised in that the clock synchronization process module includes writing unit, deposited
Storage unit and reading output unit；
Said write unit is used to the video data of reception and the decoding header signal being synchronously written the storage list
Member；
The memory cell is used to store the video data and the decoding header signal received；
The output unit that reads is used for the reference clock frequency according to reception, synchronous to read what the memory cell was stored
The video data and the decoding header signal, and the video data of reading and the decoding header signal are synchronously sent out
Deliver to the synchronous output module.
5. device according to claim 4, it is characterised in that said write unit is additionally operable to when the memory cell occurs
During overflow, the current video frame of the video data is repeatedly written last video before the memory cell overflow
The corresponding storage region of frame；
The reading output unit is additionally operable to when storage underflow occurs in the memory cell, and repetition is read under the memory cell
Last frame of video of storage before overflowing.
6. device according to claim 1, it is characterised in that the synchronous output module specifically for：
It is synchronous to read the video data, the decoding header signal and the reference header signal received；When reading
When stating decoding header signal, the decoding video is read in stopping, continuing to read the reference header signal, and will read afterwards
The time of the reference header signal is defined as the starting output time；The video is exported according to the starting output time
Data.
7. device according to claim 1, it is characterised in that described device also includes delay adjustment module；
The delay adjustment module is used to adjust the relative time delay between the decoding header signal and the reference header signal,
And send the relative time delay to the synchronous output module；
The synchronous output module is specifically additionally operable to receive the relative time delay, determines that the starting is defeated according to the relative time delay
Go out the time, and the video data is exported according to the starting output time.
8. a kind of audio video synchronization processing method, it is characterised in that methods described is applied in such as any one of claim 1 to 7 institute
In the audio video synchronization processing unit stated；Methods described includes：
When first extraction module receives the decoding video of video source offer, the decoding frame head of the decoding video is extracted
Signal, and by the video data in the decoding video and the decoding header signal synchronized transmission to the clock synchronization process
Module；Wherein, the decoding header signal is used for the frame header position for indicating each frame of video of the decoding video；
When the clock frequency recovery module receives the reference video of reference source offer, ginseng is obtained from the reference video
Clock frequency is examined, and the reference clock frequency is sent to the clock synchronization process module, and by the reference video
Send to second extraction module；
The clock synchronization process module receives the video data, the decoding header signal and the reference clock frequency,
And the synchronism output video data consistent with the reference clock frequency and decoding header signal are to the synchronous output module；
When second extraction module receives the reference video, the reference header signal of the reference video is extracted, and
The reference header signal is sent to the synchronous output module；Wherein, the reference header signal is used to indicate the ginseng
Examine the frame header position of each frame of video of video；
The synchronous output module receives the video data, the decoding header signal and the reference header signal, according to
The decoding header signal and the reference header signal determine the starting output time of the video data, and according to described
Beginning output time exports the video data.
9. method according to claim 8, it is characterised in that described to be carried when first extraction module receives video source
During the decoding video of confession, the decoding header signal of the decoding video is extracted, including：
When first extraction module receives the decoding video of video source offer, the synchronous letter of the decoding video is obtained
Number, the synchronizing signal includes horizontal-drive signal, vertical synchronizing signal and field sync signal；
The decoding header signal of the decoding video is extracted according to the synchronizing signal.
10. method according to claim 8, it is characterised in that described according to the decoding header signal and the reference
Header signal determines the starting output time of the video data, including：
It is synchronous to read the video data, the decoding header signal and the reference header signal received；When reading
When stating decoding header signal, the decoding video is read in stopping, continuing to read the reference header signal, and will read afterwards
The time of the reference header signal is defined as the starting output time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710483258.5A CN107277295B (en) | 2017-06-22 | 2017-06-22 | Audio video synchronization processing unit and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710483258.5A CN107277295B (en) | 2017-06-22 | 2017-06-22 | Audio video synchronization processing unit and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107277295A true CN107277295A (en) | 2017-10-20 |
| CN107277295B CN107277295B (en) | 2019-10-18 |
Family
ID=60068125
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710483258.5A Active CN107277295B (en) | 2017-06-22 | 2017-06-22 | Audio video synchronization processing unit and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107277295B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108089834A (en) * | 2017-11-07 | 2018-05-29 | 潍坊歌尔电子有限公司 | A kind of broadcasting synchronous method, device and USB sound cards |
| CN109644290A (en) * | 2018-11-02 | 2019-04-16 | 上海极清慧视科技有限公司 | Data switching device, data acquisition device and system, method |
| CN110636219A (en) * | 2019-09-03 | 2019-12-31 | 北京三快在线科技有限公司 | Video data stream transmission method and device |
| WO2020087590A1 (en) * | 2018-11-02 | 2020-05-07 | 上海极清慧视科技有限公司 | Data transfer device, data acquisition device, system, and method |
| CN114500986A (en) * | 2021-12-20 | 2022-05-13 | 北京镁伽科技有限公司 | Time sequence synchronization method and device based on FPGA and PG equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1543193A (en) * | 2003-03-31 | 2004-11-03 | 索尼英国有限公司 | Video synchronization |
| CN1588988A (en) * | 2004-07-29 | 2005-03-02 | 联合信源数字音视频技术（北京）有限公司 | Synchronous control device and control method for video elecoding and display |
| CN1859567A (en) * | 2006-03-07 | 2006-11-08 | 华为技术有限公司 | Digital TV decoding method and system |
| JP2008022436A (en) * | 2006-07-14 | 2008-01-31 | Sony Corp | Video signal processing apparatus, and video signal processing method |
| JP2008148239A (en) * | 2006-12-13 | 2008-06-26 | Sony Corp | Video equipment and jitter/wander measurement method |
| CN101924884A (en) * | 2010-06-26 | 2010-12-22 | 大连捷成实业发展有限公司 | Digital video signal switching circuit and method |
| CN103686315A (en) * | 2012-09-13 | 2014-03-26 | 深圳市快播科技有限公司 | Synchronous audio and video playing method and device |
-
2017
- 2017-06-22 CN CN201710483258.5A patent/CN107277295B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1543193A (en) * | 2003-03-31 | 2004-11-03 | 索尼英国有限公司 | Video synchronization |
| CN1588988A (en) * | 2004-07-29 | 2005-03-02 | 联合信源数字音视频技术（北京）有限公司 | Synchronous control device and control method for video elecoding and display |
| CN1859567A (en) * | 2006-03-07 | 2006-11-08 | 华为技术有限公司 | Digital TV decoding method and system |
| JP2008022436A (en) * | 2006-07-14 | 2008-01-31 | Sony Corp | Video signal processing apparatus, and video signal processing method |
| JP2008148239A (en) * | 2006-12-13 | 2008-06-26 | Sony Corp | Video equipment and jitter/wander measurement method |
| CN101924884A (en) * | 2010-06-26 | 2010-12-22 | 大连捷成实业发展有限公司 | Digital video signal switching circuit and method |
| CN103686315A (en) * | 2012-09-13 | 2014-03-26 | 深圳市快播科技有限公司 | Synchronous audio and video playing method and device |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108089834A (en) * | 2017-11-07 | 2018-05-29 | 潍坊歌尔电子有限公司 | A kind of broadcasting synchronous method, device and USB sound cards |
| US10963213B2 (en) | 2017-11-07 | 2021-03-30 | Goertek Technology Co., Ltd. | Playback synchronization method and device and USB sound card |
| CN109644290A (en) * | 2018-11-02 | 2019-04-16 | 上海极清慧视科技有限公司 | Data switching device, data acquisition device and system, method |
| WO2020087590A1 (en) * | 2018-11-02 | 2020-05-07 | 上海极清慧视科技有限公司 | Data transfer device, data acquisition device, system, and method |
| CN109644290B (en) * | 2018-11-02 | 2022-03-08 | 上海极清慧视科技有限公司 | Data switching device, data acquisition device, system and method |
| CN110636219A (en) * | 2019-09-03 | 2019-12-31 | 北京三快在线科技有限公司 | Video data stream transmission method and device |
| CN114500986A (en) * | 2021-12-20 | 2022-05-13 | 北京镁伽科技有限公司 | Time sequence synchronization method and device based on FPGA and PG equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107277295B (en) | 2019-10-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107277295A (en) | Audio video synchronization processing unit and method | |
| EP2398227B1 (en) | Image pick-up device and synchronization-signal-generating device | |
| CN105828183A (en) | Video frame processing method, video processing chip and motion estimate and motion compensation MEMC chip | |
| CN105763919A (en) | Method and device for display and video synchronization | |
| CN112217960A (en) | Method for synchronously displaying multi-screen playing pictures | |
| CN102655585B (en) | Video conference system and time delay testing method, device and system thereof | |
| JP2016502126A (en) | Video image processing method and apparatus | |
| CN104168487A (en) | Video signal frame synchronization method and device | |
| JP2015001549A (en) | Signal output apparatus, signal output method, and image display apparatus | |
| CN103595924A (en) | Image fusion system based on Cameralink and image fusion method based on Cameralink | |
| US20220174186A1 (en) | Synchronizing media in multiple devices | |
| CN102426514A (en) | Synchronous displaying method and device for large-screen spliced wall | |
| CN105681720A (en) | Video playing processing method and device | |
| CN105472203A (en) | Genlock system and method | |
| CN102625086B (en) | DDR2 (Double Data Rate 2) storage method and system for high-definition digital matrix | |
| CN102663988A (en) | Method, device and system for broadcasting subtitles | |
| US10148934B2 (en) | Image process apparatus and image process method | |
| CN109410894B (en) | Method and module for generating differential output signal and display device | |
| CN104902192B (en) | The transmission method and equipment of multiple signals | |
| CN114153408B (en) | Image display control method and related equipment | |
| CN107135407B (en) | Synchronous method and system in a kind of piano video teaching | |
| CN105491288A (en) | Image adjusting method, device and system | |
| CN105430237A (en) | Frame missing image processing method and system | |
| CN102497514B (en) | Three-channel video forwarding equipment and forwarding method | |
| CN102215415B (en) | Video signal processing apparatus, display device and display packing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |