CN107277295B - Audio video synchronization processing unit and method - Google Patents
Audio video synchronization processing unit and method Download PDFInfo
- Publication number
- CN107277295B CN107277295B CN201710483258.5A CN201710483258A CN107277295B CN 107277295 B CN107277295 B CN 107277295B CN 201710483258 A CN201710483258 A CN 201710483258A CN 107277295 B CN107277295 B CN 107277295B
- Authority
- CN
- China
- Prior art keywords
- video
- decoding
- header signal
- signal
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
- H04N5/08—Separation of synchronising signals from picture signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The present invention provides a kind of audio video synchronization processing unit and methods, the device includes: the first extraction module, for extracting the decoding header signal of decoding video, and by video data and decoding header signal in decoding video synchronize be sent to clock synchronization process module；Clock frequency recovery module, for obtaining reference clock frequency from reference video；Clock synchronization process module for synchronism output and the consistent video data of reference clock frequency and decodes header signal to synchronous output module；Second extraction module, for extracting the reference header signal of reference video；Synchronous output module for decoding header signal based on the received and determining that the starting of received video data exports the time with reference to header signal, and exports the video data according to the starting output time.The video data of road decoding video each in this way double synchronous on clock domain and data field can keep the television image broadcasted to stablize, improve the viewing effect of people.
Description
Technical field
The present invention relates to broadcasting television technology fields, more particularly, to a kind of audio video synchronization processing unit and method.
Background technique
In the broadcast system of radio and television, the multi-channel video some of system front end input comes from satellite-signal, and some is come
From reradiated signal, for some from recorded broadcast signal etc., these videos after decoding device decodes, pass through SDI interface respectively
(Serial Digital Interface, digital component serial line interface) output.In order in multipath decoding video (decoded view
Frequency is known as decoding video) between switch over, the output end of SDI interface is connected with SDI switch, the control decoding of SDI switch
The output of video.
There may be asynchronous problems on clock domain or data field for each road decoding video, when SDI switch is in difference
When switching between the decoding video of the road Bu Ge, the television image that will lead to broadcast is unstable, for example, occur jump, flashing or
Roll etc., to influence the viewing effect of people.
Summary of the invention
In view of this, the purpose of the present invention is to provide a kind of audio video synchronization processing unit and method, so that each road decodes
The video data of video double synchronous on clock domain and data field improves people so that the television image broadcasted be kept to stablize
Viewing effect.
In a first aspect, described device includes the first extraction the embodiment of the invention provides a kind of audio video synchronization processing unit
Module, clock frequency recovery module, clock synchronization process module, the second extraction module and synchronous output module；
First extraction module is used to extract the decoding video when receiving the decoding video of video source offer
Decode header signal, and by video data and the decoding header signal in the decoding video synchronize be sent to the clock
Synchronous processing module；Wherein, the decoding header signal is used to indicate the frame header position of each video frame of the decoding video；
The clock frequency recovery module is used for when receiving the reference video of reference source offer, from the reference video
Middle acquisition reference clock frequency, and the reference clock frequency is sent to the clock synchronization process module, and will be described
Reference video is sent to second extraction module；
The clock synchronization process module is for when receiving the video data, the decoding header signal and the reference
Clock frequency, and synchronism output and the consistent video data of the reference clock frequency and header signal is decoded to the synchronism output
Module；
Second extraction module is used for when receiving the reference video, extracts the reference frame head of the reference video
Signal, and the synchronous output module is sent to reference to header signal by described；Wherein, described to be used to indicate with reference to header signal
The frame header position of each video frame of the reference video；
The synchronous output module is believed for receiving the video data, the decoding header signal and the reference frame head
Number, header signal and the starting output time that the video data is determined with reference to header signal, and root are decoded according to described
The video data is exported according to the starting output time.
With reference to first aspect, the embodiment of the invention provides the first possible embodiments of first aspect, wherein institute
The first extraction module is stated to be specifically used for:
The synchronization signal of the decoding video is obtained, the synchronization signal includes horizontal synchronizing signal, vertical synchronizing signal
And field sync signal；The decoding header signal of the decoding video is extracted according to the synchronization signal.
The possible embodiment of with reference to first aspect the first, the embodiment of the invention provides second of first aspect
Possible embodiment, wherein first extraction module includes:
First extraction unit is used for when the decoding video is interlaced scanning video, according to the field sync signal
Change location extracts the decoding header signal of the decoding video；
Second extraction unit is used for when the decoding video is progressive scanned video, according to the vertical synchronizing signal
Change location and the horizontal synchronizing signal extract the decoding header signal of the decoding video.
With reference to first aspect, the embodiment of the invention provides the third possible embodiments of first aspect, wherein institute
Stating clock synchronization process module includes writing unit, storage unit and reading output unit；
Said write unit is used to for the received video data and the decoding header signal to be synchronously written described deposit
Storage unit；
The storage unit is for storing the received video data and the decoding header signal；
The reading output unit is deposited for the reference clock frequency based on the received, the synchronous reading storage unit
The video data and the decoding header signal of storage, and the video data of reading and the decoding header signal is same
Step is sent to the synchronous output module.
The third possible embodiment with reference to first aspect, the embodiment of the invention provides the 4th kind of first aspect
Possible embodiment, wherein said write unit is also used to when overflow occurs in the storage unit, by the video
The current video frame of data is repeatedly written the corresponding storage region of the last one video frame before the storage unit overflow；
The reading output unit is also used to when storage underflow occurs in the storage unit, and it is single that the storage is read in repetition
The last one video frame stored before first underflow.
With reference to first aspect, the embodiment of the invention provides the 5th kind of possible embodiments of first aspect, wherein institute
Synchronous output module is stated to be specifically used for:
It is synchronous to read the received video data, the decoding header signal and described with reference to header signal；Work as reading
When to the decoding header signal, stop reading the decoding video, continue to read it is described with reference to header signal, and will after read
Getting the time with reference to header signal is determined as the starting output time；According to starting output time output
Video data.
With reference to first aspect, the embodiment of the invention provides the 6th kind of possible embodiments of first aspect, wherein institute
Stating device further includes delay adjustment module；
The delay adjustment module is for adjusting the decoding header signal and described with reference to opposite between header signal
Delay, and the relative time delay is sent to the synchronous output module；
The synchronous output module is specifically also used to receive the relative time delay, determines described rise according to the relative time delay
Begin the output time, and the time output video data is exported according to the starting.
Second aspect, the embodiment of the present invention also provide a kind of audio video synchronization processing method, and the method is applied such as first
In audio video synchronization processing unit described in aspect；The described method includes:
When first extraction module receives the decoding video of video source offer, the decoding of the decoding video is extracted
Header signal, and synchronize to be sent to the clock synchronous by video data and the decoding header signal in the decoding video
Processing module；Wherein, the decoding header signal is used to indicate the frame header position of each video frame of the decoding video；
When the clock frequency recovery module receives the reference video of reference source offer, obtained from the reference video
It takes reference clock frequency, and the reference clock frequency is sent to the clock synchronization process module, and by the reference
Video is sent to second extraction module；
The clock synchronization process module receives the video data, the decoding header signal and reference clock frequency
Rate, and synchronism output and the consistent video data of the reference clock frequency and header signal is decoded to the synchronism output mould
Block；
When second extraction module receives the reference video, the reference frame head letter of the reference video is extracted
Number, and the synchronous output module is sent to reference to header signal by described；Wherein, described to be used to indicate institute with reference to header signal
State the frame header position of each video frame of reference video；
The synchronous output module receives the video data, the decoding header signal and described with reference to header signal,
According to the decoding header signal and the starting output time for determining the video data with reference to header signal, and according to institute
State the starting output time output video data.
In conjunction with second aspect, the embodiment of the invention provides the first possible embodiments of second aspect, wherein institute
State the decoding frame head letter that the decoding video is extracted when first extraction module receives the decoding video of video source offer
Number, comprising:
When first extraction module receives the decoding video of video source offer, the synchronization of the decoding video is obtained
Signal, the synchronization signal include horizontal synchronizing signal, vertical synchronizing signal and field sync signal；
The decoding header signal of the decoding video is extracted according to the synchronization signal.
In conjunction with second aspect, the embodiment of the invention provides second of possible embodiments of second aspect, wherein institute
It states according to the decoding header signal and the starting output time for determining the video data with reference to header signal, comprising:
It is synchronous to read the received video data, the decoding header signal and described with reference to header signal；Work as reading
When to the decoding header signal, stop reading the decoding video, continue to read it is described with reference to header signal, and will after read
Getting the time with reference to header signal is determined as the starting output time.
The embodiment of the present invention bring it is following the utility model has the advantages that
In the embodiment of the present invention, audio video synchronization processing unit includes the first extraction module, clock frequency recovery module, clock
Synchronous processing module, the second extraction module and synchronous output module；First extraction module, which is used to work as, receives video source offer
When decoding video, the decoding header signal of the decoding video is extracted, and by the video data and the decoding frame in the decoding video
Head signal, which synchronizes, is sent to clock synchronization process module；Wherein, decoding header signal is used to indicate each video of decoding video
The frame header position of frame；Clock frequency recovery module is used for when receiving the reference video of reference source offer, from the reference video
Middle acquisition reference clock frequency, and the reference clock frequency is sent to clock synchronization process module, and by the reference video
It is sent to the second extraction module；Clock synchronization process module is for receiving video data, decoding header signal and reference clock frequency
Rate, and synchronism output and the consistent video data of the reference clock frequency and header signal is decoded to synchronous output module；Second
Extraction module is used for when receiving reference video, extracts the reference header signal of the reference video, and this is believed with reference to frame head
Number it is sent to synchronous output module；Wherein, the frame header position of each video frame of reference video is used to indicate with reference to header signal；
Synchronous output module for receiving video data, decoding header signal and with reference to header signal, according to the decoding header signal and
This determines the starting output time of the video data with reference to header signal, and exports the video counts according to the starting output time
According to.Clock synchronization process module can be synchronous on clock domain with reference video by decoding video according to reference clock frequency, into
And synchronous output module can be by decoding video and reference video in data field according to decoding header signal and reference header signal
Upper synchronization, to realize the double synchronous of decoding video and reference video on clock domain and data field.Since each road decodes
Video is synchronous with reference video, therefore applies audio video synchronization processing unit provided in an embodiment of the present invention and method, output
Each road video data double synchronous on clock domain and data field, the television image for maintaining broadcast in this way are stablized, are improved
The viewing effect of people.
Other features and advantages of the present invention will illustrate in the following description, also, partly become from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention are in specification, claims
And specifically noted structure is achieved and obtained in attached drawing.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate
Appended attached drawing, is described in detail below.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art be briefly described, it should be apparent that, it is described below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, is also possible to obtain other drawings based on these drawings.
Fig. 1 is the first structural schematic diagram of audio video synchronization processing unit provided in an embodiment of the present invention；
Fig. 2 is that the unit composition of clock synchronization process module in audio video synchronization processing unit provided in an embodiment of the present invention shows
It is intended to；
Fig. 3 is the processing flow schematic diagram of audio video synchronization processing unit provided in an embodiment of the present invention；
Fig. 4 is second of structural schematic diagram of audio video synchronization processing unit provided in an embodiment of the present invention；
Fig. 5 is the flow diagram of audio video synchronization processing method provided in an embodiment of the present invention.
Icon:
The first extraction module of 10-；20- clock frequency recovery module；30- clock synchronization process module；31- writing unit；
32- storage unit；33- reads output unit；The second extraction module of 40-；50- synchronous output module；60- delay adjustment module.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with attached drawing to the present invention
Technical solution be clearly and completely described, it is clear that described embodiments are some of the embodiments of the present invention, rather than
Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Under every other embodiment obtained, shall fall within the protection scope of the present invention.
In view of will lead to the electricity of broadcast when SDI switch switches between nonsynchronous each road decoding video
It is unstable depending on picture, influence the viewing effect of people, a kind of audio video synchronization processing unit and method provided in an embodiment of the present invention,
It can make each road video data of output double synchronous on clock domain and data field, keep the television image broadcasted to stablize, mention
The viewing effect of high people.
To be filled to a kind of processing of audio video synchronization disclosed in the embodiment of the present invention first convenient for understanding the present embodiment
It sets and describes in detail.
Embodiment one:
Fig. 1 is the first structural schematic diagram of audio video synchronization processing unit provided in an embodiment of the present invention, as shown in Figure 1,
The device includes the first extraction module 10, clock frequency recovery module 20, clock synchronization process module 30, the second extraction module 40
With synchronous output module 50.
First extraction module 10 is used to extract the decoding of the decoding video when receiving the decoding video of video source offer
Header signal, and by video data and decoding header signal in the decoding video synchronize be sent to clock synchronization process module
30；Wherein, decoding header signal is used to indicate the frame header position of each video frame of decoding video.
Clock frequency recovery module 20 is used to obtain from the reference video when receiving the reference video of reference source offer
Reference clock frequency is taken, and the reference clock frequency is sent to clock synchronization process module 30, and the reference video is sent out
It send to the second extraction module 40.
Clock synchronization process module 30 is synchronized for receiving video data, decoding header signal and reference clock frequency
Output and the consistent video data of the reference clock frequency and header signal is decoded to synchronous output module 50.
Second extraction module 40 is used for when receiving reference video, extracts the reference header signal of the reference video, and
This is sent to synchronous output module 50 with reference to header signal；Wherein, each of reference video is used to indicate with reference to header signal
The frame header position of video frame.
Synchronous output module 50 is for receiving video data, decoding header signal and with reference to header signal, according to the decoding
Header signal determines the starting output time of the video data with this with reference to header signal, and exports time output according to the starting
The video data.
In the embodiment of the present invention, audio video synchronization processing unit includes the first extraction module, clock frequency recovery module, clock
Synchronous processing module, the second extraction module and synchronous output module, clock synchronization process module can be with according to reference clock frequency
Decoding video is synchronous on clock domain with reference video, and then synchronous output module according to decoding header signal and refers to frame head
Signal can be synchronous on data field with reference video by decoding video, to realize decoding video and reference video in clock
Double synchronous on domain and data field.Since each road decoding video is synchronous with reference video, the embodiment of the present invention is applied
The audio video synchronization processing unit of offer, each road video data of output double synchronous on clock domain and data field are protected in this way
It has held the television image broadcasted to stablize, has improved the viewing effect of people.
Above-mentioned audio video synchronization processing unit can rely on FPGA, and (Field Programmable Gate Array, scene can
Program gate array) chip realization.For the device, input source is divided into two parts, and one is video source, and one is reference source.Its
In, video source can be, but not limited to be decoding chip output video data, head end video input source by decoding chip output
Decoded decoding video, decoding video are digital video；Reference source is external analog video source, exports reference video, reference
Video is analog video, which is used to simultaneously provide object of reference for each decoding video.The device is defeated to both
Entering source is synchronization process, and the device is specifically described below to the treatment process of decoding video and reference video.
The decoding header signal that (1) first extraction module 10 extracts decoding video includes: when the first extraction module 10 receives
When to decoding video, the synchronization signal of the decoding video is obtained, which includes horizontal synchronizing signal, vertical synchronizing signal
And field sync signal, the decoding header signal of the decoding video, i.e. TOF (Top Of Frame, frame are extracted according to the synchronization signal
Head) signal.
Specifically, decoding video complete for one, it is available it Hsync signal (horizontal synchronizing signal),
Vsync signal (vertical synchronizing signal) and Fsync signal (field sync signal), Hsync signal are used to indicate decoding video
The terminal or starting point of each row data in each video frame, Vsync signal are used to indicate each row in each video frame of decoding video
Data are in field blanking section or trace section (valid data row), Fsync signal are used to indicate each video of decoding video
Each row data are in odd field or even field in frame.It can be mentioned according to the Hsync signal, Vsync signal and Fsync signal of decoding video
Take the TOF signal of the decoding video.
In view of the scanning mode of video is divided into interlacing scan and progressive scan, the first extraction module 10 includes: first to mention
Unit is taken, for extracting decoding video according to the change location of field sync signal when decoding video is interlaced scanning video
Decode header signal；Second extraction unit is used for when decoding video is progressive scanned video, according to the change of vertical synchronizing signal
Change position and horizontal synchronizing signal extracts the decoding header signal of decoding video.
Specifically, for interlaced scanning video, since each video frame includes two-odd field and even field, Fsync signal exists
Odd field and even field are respectively low level and high level (or opposite), therefore can be come according to the level change of Fsync signal true
Frame header position is determined, to extract TOF signal.For example, if each video frame of decoding video first scans odd field, then scan idol
, Fsync signal is low level under odd field, and even Fsync signal off field is high level, then when Fsync signal becomes from high level
Illustrate that the even field scan of current video frame terminates when low level, start the odd field for scanning next video frame, it can determines at this time
The frame header position of corresponding video frame, to extract TOF signal.
For progressive scanned video, Fsync signal is constant, at this time can not be according to Fsync signal extraction TOF signal.Consider
Each video frame to progressive scanned video includes field blanking section, trace section and field blanking section three parts, same view
The line number in the field blanking section under frequency standard behind trace section is fixed, and Vsync signal blanking section on the scene and trace section point
Not Wei high level and low level (or opposite), therefore can determine by the level change of Vsync signal the knot in trace section
Beam position determines line number further according to Hsync signal, can find the frame header position of next video frame, to extract TOF signal.
For example, if each video frame of decoding video include 750 rows, 1-25 behavior field blanking section, 26-745 behavior trace section,
746-750 behavior field blanking section, Vsync signal blanking section on the scene be high level, trace section be low level, then when
When detecting that Vsync signal becomes high level from low level, it can determine and just scanned at this time by trace section to field blanking section
(such as 745-746 row), the position after 5 rows are determined further according to Hsync signal is the frame header position of next video frame, to extract
TOF signal.
(2) clock frequency recovery module 20 includes: when clock frequency retrieval module 20 receives to the processing of reference video
When the reference video that reference source provides, restore the analog video source clock of the reference video, and using analog video source clock as
The processing clock of decoding video obtains the reference clock frequency of the reference video, and using the reference clock frequency as decoding
Clock frequency after audio video synchronization, and then realize that decoding video is synchronous on clock domain with reference video.
(3) clock synchronization process module 30 is for keeping decoding video synchronous on clock domain with reference video.Fig. 2 is this hair
The unit composition schematic diagram of clock synchronization process module in the audio video synchronization processing unit that bright embodiment provides, as shown in Fig. 2, when
Clock synchronous processing module 30 includes writing unit 31, storage unit 32 and reading output unit 33.Writing unit 31 will be for that will connect
The video data and decoding header signal of receipts are synchronously written storage unit 32；Storage unit 32 is for storing received video data
With decoding header signal；Output unit 33 is read for reference clock frequency based on the received, the synchronous storage unit 32 that reads is deposited
The video data of storage and decoding header signal, and by the video data of reading and decode header signal synchronize be sent to synchronism output
Module 50.
When inconsistent in view of the clock frequency and reference clock frequency of decoding video itself, the write-in speed of writing unit 31
Rate and the output speed for reading output unit 33 are inconsistent, therefore the caching of video data is carried out using storage unit 32.Clock
Synchronous processing module 30 can be, but not limited to the caching that data are carried out using DDR.The full name of DDR is DDR SDRAM (Double
Data Rate SDRAM, Double Data Rate SDRAM), wherein SDRAM is Synchronous Dynamic Random Access
Memory, synchronous DRAM.
Further, it is contemplated that when writing rate is greater than output speed, will cause DDR overflow, writing unit 31 is also
For when overflow occurs in storage unit 32, before the current video frame of video data is repeatedly written 32 overflow of storage unit
The corresponding storage region of the last one video frame.When being less than output speed in view of writing rate, it will cause under DDR storage
It overflows, reads output unit 33 and be also used to repeat to deposit before reading 32 underflow of storage unit when storage underflow occurs in storage unit 32
The last one video frame of storage.This way it is ensured that from the video data that DDR is exported be a complete frame, while TOF signal
Video data after synchronizing with clock is output to synchronous output module 50.
(4) second extraction modules 40 are used to extract the reference header signal of reference video, i.e. TOF signal.Specifically, it refers to
Video itself also carries synchronization signal: Hsync signal, Vsync signal and Fsync signal, due to the synchronization signal of reference video
For analog video synchronization signal, need to utilize modulus conversion chip by the Hsync signal, Vsync signal and Fsync of reference video
Signal is transformed into numeric field, for the use of the second extraction module 40.Second extraction module 40 extracts the TOF signal of reference video
Process is identical as the first extraction module 10 extraction process of TOF signal of decoding video, and which is not described herein again.
(5) synchronous output module 50 is specifically used for: synchronous to read received video data, decoding header signal and reference frame
Head signal；When reading decoding header signal, stop reading decoding video, continue to read with reference to header signal, and will after
The time read with reference to header signal is determined as the starting output time；The video data is exported according to the starting output time.
The output interface of synchronous output module 50 can be SDI interface.In this way, just having accomplished decoding video and reference video in data field
On it is consistent.
Fig. 3 is the processing flow schematic diagram of audio video synchronization processing unit provided in an embodiment of the present invention, as shown in figure 3, should
The process flow of device including the following steps:
Step S301, the first extraction module extract the TOF signal of decoding video.
Step S302, clock frequency recovery module obtain reference clock frequency from reference video.
Step S303, the second extraction module extract the TOF signal of reference video.
It should be noted that step S301 synchronous can be executed with step S302 or step S303, to step S302 and step
The execution sequence of rapid S303 is not construed as limiting, and to first carry out step S302 in Fig. 3, then is executed and is illustrated for step S303.
Step S304, clock synchronization process module is synchronous with reference video progress clock domain by received decoding video, and
It exports to synchronous output module.
Step S305, synchronous output module is synchronous with reference video progress data field by decoding video, and output is regarded with reference
The synchronous video data of frequency.
The specific implementation procedure of above-mentioned each step can refer to foregoing teachings, and which is not described herein again.
In view of other processing are done in extended meeting after the video data of above-mentioned audio video synchronization processing unit output, and exist external
The influence of environment, will lead to actual video data and reference video cannot reach fully synchronized on data field, such as Fig. 4 institute
Show, the device further includes delay adjustment module 60 on the basis of Fig. 1, and delay adjustment module 60 is for adjusting decoding header signal
Relative time delay between reference header signal, and the relative time delay is sent to synchronous output module 50.Synchronous output module
50 are specifically also used to receive the relative time delay, when determining the starting output time according to the relative time delay, and being exported according to the starting
Between export the video data.
Specifically, user can adjust above-mentioned relative time delay by delay adjustment module 60, and the basic unit of adjusting is one
A reference clock cycle, is also equal to the adjusting of a video frame, and precision is very high, wherein reference clock cycle and reference clock
Frequency is corresponding.It is synchronous on data field with reference video that video data is further ensured in this way.
In view of when reference source is abnormal or is changed, above-mentioned relative time delay be not it is fixed, when multiple inspection
When measuring relative time delay variation, the real time synchronization of decoding video and reference video can be kept by the way of re-synchronizing.
In summary, audio video synchronization processing unit provided in an embodiment of the present invention can make the video data of decoding video with
Reference video double synchronous on clock domain and data field, while guaranteeing that synchronous precision and real-time are met the requirements.
Embodiment two:
Originally it implements and provides a kind of audio video synchronization processing method, this method is applied at such as audio video synchronization of embodiment one
It manages on device.Fig. 5 is the flow diagram of audio video synchronization processing method provided in an embodiment of the present invention, as shown in figure 5, this method
Including the following steps:
Step S501 extracts the decoding video when the first extraction module receives the decoding video of video source offer
Decode header signal, and by video data and decoding header signal in the decoding video synchronize be sent to clock synchronization process
Module；Wherein, decoding header signal is used to indicate the frame header position of each video frame of decoding video.
Step S502, when clock frequency retrieval module receives the reference video of reference source offer, from the reference video
Middle acquisition reference clock frequency, and the reference clock frequency is sent to clock synchronization process module, and by the reference video
It is sent to the second extraction module.
Step S503, clock synchronization process module receive video data, decoding header signal and reference clock frequency, and same
Output and the consistent video data of reference clock frequency and decoding header signal are walked to synchronous output module.
Step S504 extracts the reference header signal of the reference video when the second extraction module receives reference video,
And this is sent to synchronous output module with reference to header signal；Wherein, each of reference video is used to indicate with reference to header signal
The frame header position of video frame.
Step S505, synchronous output module receives video data, decoding header signal and refers to header signal, according to the solution
Code header signal determines the starting output time of the video data with this with reference to header signal, and defeated according to the starting output time
The video data out.
First extraction module extracts the process of the decoding header signal of decoding video specifically: when the first extraction module receives
When the decoding video provided to video source, the synchronization signal of the decoding video is obtained, synchronization signal includes horizontal synchronizing signal, hangs down
Straight synchronization signal and field sync signal；The decoding header signal of the decoding video is extracted according to the synchronization signal.
The process of the starting output time of video data is determined according to decoding header signal and with reference to header signal specifically:
It is synchronous to read received video data, decoding header signal and refer to header signal；When reading decoding header signal, stop
Decoding video is read, continues to read with reference to header signal, and the time for reading later with reference to header signal is determined as originating
Export the time.
In the embodiment of the present invention, when the first extraction module receives the decoding video of video source offer, the decoding is extracted
The decoding header signal of video, and synchronize to be sent to clock same by video data and decoding header signal in the decoding video
Walk processing module；Wherein, decoding header signal is used to indicate the frame header position of each video frame of decoding video.Work as clock frequency
When recovery module receives the reference video of reference source offer, reference clock frequency is obtained from the reference video, and by the ginseng
It examines clock frequency and is sent to clock synchronization process module, and the reference video is sent to the second extraction module.Clock is synchronous
Processing module receives video data, decoding header signal and reference clock frequency, and synchronism output is consistent with reference clock frequency
Video data and decoding header signal to synchronous output module.When the second extraction module receives reference video, extracting should
The reference header signal of reference video, and this is sent to synchronous output module with reference to header signal；Wherein, with reference to header signal
It is used to indicate the frame header position of each video frame of reference video.Synchronous output module receives video data, decoding header signal
With reference header signal, according to the decoding header signal and this with reference to header signal determine the video data starting export when
Between, and the video data is exported according to the starting output time.Clock synchronization process module can be incited somebody to action according to reference clock frequency
Decoding video is synchronous on clock domain with reference video, and then synchronous output module is believed according to decoding header signal and with reference to frame head
Number can be synchronous on data field with reference video by decoding video, to realize decoding video and reference video in clock domain
With the double synchronous on data field.Since each road decoding video is synchronous with reference video, mentioned using the embodiment of the present invention
The audio video synchronization processing method of confession, each road video data of output double synchronous on clock domain and data field are kept in this way
The television image broadcasted is stablized, and improves the viewing effect of people.
It is apparent to those skilled in the art that for convenience and simplicity of description, the method for foregoing description
Specific work process, can be with reference to the corresponding process in aforementioned device embodiment, details are not described herein.
Audio video synchronization processing method provided in an embodiment of the present invention, with audio video synchronization processing unit provided by the above embodiment
Technical characteristic having the same reaches identical technical effect so also can solve identical technical problem.
The flow chart and block diagram in the drawings show the system of multiple embodiments according to the present invention, method and computer journeys
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, section or code of table, a part of the module, section or code include one or more use
The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box
The function of note can also occur in a different order than that indicated in the drawings.For example, two continuous boxes can actually base
Originally it is performed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.It is also noted that
It is the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, can uses and execute rule
The dedicated hardware based system of fixed function or movement is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
In the description of the present invention, it should be noted that term " first ", " second ", " third " are used for description purposes only,
It is not understood to indicate or imply relative importance.
The computer program product of audio video synchronization processing method is carried out provided by the embodiment of the present invention, including stores place
The computer readable storage medium of the executable non-volatile program code of device is managed, the instruction that said program code includes can be used for
Previous methods method as described in the examples is executed, specific implementation can be found in embodiment of the method, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with
It realizes by another way.The apparatus embodiments described above are merely exemplary, for example, the division of the unit,
Only a kind of logical function partition, there may be another division manner in actual implementation, in another example, multiple units or components can
To combine or be desirably integrated into another system, or some features can be ignored or not executed.Another point, it is shown or beg for
The mutual coupling, direct-coupling or communication connection of opinion can be through some communication interfaces, device or unit it is indirect
Coupling or communication connection can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in the executable non-volatile computer-readable storage medium of a processor.Based on this understanding, of the invention
Technical solution substantially the part of the part that contributes to existing technology or the technical solution can be with software in other words
The form of product embodies, which is stored in a storage medium, including some instructions use so that
One computer equipment (can be personal computer, server or the network equipment etc.) executes each embodiment institute of the present invention
State all or part of the steps of method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-
Only Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can be with
Store the medium of program code.
Finally, it should be noted that embodiment described above, only a specific embodiment of the invention, to illustrate the present invention
Technical solution, rather than its limitations, scope of protection of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, those skilled in the art should understand that: anyone skilled in the art
In the technical scope disclosed by the present invention, it can still modify to technical solution documented by previous embodiment or can be light
It is readily conceivable that variation or equivalent replacement of some of the technical features；And these modifications, variation or replacement, do not make
The essence of corresponding technical solution is detached from the spirit and scope of technical solution of the embodiment of the present invention, should all cover in protection of the invention
Within the scope of.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. a kind of audio video synchronization processing unit, which is characterized in that described device includes the first extraction module, clock frequency recovery mould
Block, clock synchronization process module, the second extraction module and synchronous output module；
First extraction module is used to extract the decoding of the decoding video when receiving the decoding video of video source offer
Header signal, and synchronize to be sent to the clock synchronous by video data and the decoding header signal in the decoding video
Processing module；Wherein, the decoding header signal is used to indicate the frame header position of each video frame of the decoding video；
The clock frequency recovery module is used to obtain from the reference video when receiving the reference video of reference source offer
It takes reference clock frequency, and the reference clock frequency is sent to the clock synchronization process module, and by the reference
Video is sent to second extraction module；
The clock synchronization process module is for receiving the video data, the decoding header signal and reference clock frequency
Rate, and synchronism output and the consistent video data of the reference clock frequency and header signal is decoded to the synchronism output mould
Block；
Second extraction module is used for when receiving the reference video, extracts the reference frame head letter of the reference video
Number, and the synchronous output module is sent to reference to header signal by described；Wherein, described to be used to indicate institute with reference to header signal
State the frame header position of each video frame of reference video；
The synchronous output module for receive the video data, the decoding header signal and it is described refer to header signal,
According to the decoding header signal and the starting output time for determining the video data with reference to header signal, and according to institute
State the starting output time output video data.
2. the apparatus according to claim 1, which is characterized in that first extraction module is specifically used for:
The synchronization signal of the decoding video is obtained, the synchronization signal includes horizontal synchronizing signal, vertical synchronizing signal and field
Synchronization signal；The decoding header signal of the decoding video is extracted according to the synchronization signal.
3. the apparatus of claim 2, which is characterized in that first extraction module includes:
First extraction unit is used for when the decoding video is interlaced scanning video, according to the variation of the field sync signal
Extract the decoding header signal of the decoding video in position；
Second extraction unit is used for when the decoding video is progressive scanned video, according to the change of the vertical synchronizing signal
Change position and the horizontal synchronizing signal extracts the decoding header signal of the decoding video.
4. the apparatus according to claim 1, which is characterized in that the clock synchronization process module includes writing unit, deposits
Storage unit and reading output unit；
Said write unit is used to for the received video data and the decoding header signal to be synchronously written the storage single
Member；
The storage unit is for storing the received video data and the decoding header signal；
The reading output unit is synchronous to read what the storage unit stored for the reference clock frequency based on the received
The video data and the decoding header signal, and by the video data of reading it is synchronous with the decoding header signal hair
It send to the synchronous output module.
5. device according to claim 4, which is characterized in that said write unit is also used to occur when the storage unit
The last one video when overflow, before the current video frame of the video data to be repeatedly written to the storage unit overflow
The corresponding storage region of frame；
The reading output unit is also used to when storage underflow occurs in the storage unit, and repetition is read under the storage unit
The last one video frame stored before overflowing.
6. the apparatus according to claim 1, which is characterized in that the synchronous output module is specifically used for:
It is synchronous to read the received video data, the decoding header signal and described with reference to header signal；When reading
When stating decoding header signal, stop reading the decoding video, continue to read it is described with reference to header signal, and will after read
The time with reference to header signal is determined as the starting output time；The time output video is exported according to the starting
Data.
7. the apparatus according to claim 1, which is characterized in that described device further includes delay adjustment module；
The delay adjustment module is used to adjust the decoding header signal and the relative time delay with reference between header signal,
And the relative time delay is sent to the synchronous output module；
The synchronous output module is specifically also used to receive the relative time delay, determines that the starting is defeated according to the relative time delay
Time out, and the time output video data is exported according to the starting.
8. a kind of audio video synchronization processing method, which is characterized in that the method is applied in such as any one of claims 1 to 7 institute
In the audio video synchronization processing unit stated；The described method includes:
When first extraction module receives the decoding video of video source offer, the decoding frame head of the decoding video is extracted
Signal, and by video data and the decoding header signal in the decoding video synchronize be sent to the clock synchronization process
Module；Wherein, the decoding header signal is used to indicate the frame header position of each video frame of the decoding video；
When the clock frequency recovery module receives the reference video of reference source offer, ginseng is obtained from the reference video
It examines clock frequency, and the reference clock frequency is sent to the clock synchronization process module, and by the reference video
It is sent to second extraction module；
The clock synchronization process module receives the video data, the decoding header signal and the reference clock frequency,
And synchronism output and the consistent video data of the reference clock frequency and header signal is decoded to the synchronous output module；
When second extraction module receives the reference video, the reference header signal of the reference video is extracted, and
The synchronous output module is sent to reference to header signal by described；Wherein, described to be used to indicate the ginseng with reference to header signal
Examine the frame header position of each video frame of video；
The synchronous output module receives the video data, the decoding header signal and described with reference to header signal, according to
The decoding header signal and the starting output time that the video data is determined with reference to header signal, and according to described
Begin the output time output video data.
9. according to the method described in claim 8, it is characterized in that, described mention when first extraction module receives video source
When the decoding video of confession, the decoding header signal of the decoding video is extracted, comprising:
When first extraction module receives the decoding video of video source offer, the synchronous letter of the decoding video is obtained
Number, the synchronization signal includes horizontal synchronizing signal, vertical synchronizing signal and field sync signal；
The decoding header signal of the decoding video is extracted according to the synchronization signal.
10. according to the method described in claim 8, it is characterized in that, described according to the decoding header signal and the reference
Header signal determines the starting output time of the video data, comprising:
It is synchronous to read the received video data, the decoding header signal and described with reference to header signal；When reading
When stating decoding header signal, stop reading the decoding video, continue to read it is described with reference to header signal, and will after read
The time with reference to header signal is determined as the starting output time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710483258.5A CN107277295B (en) | 2017-06-22 | 2017-06-22 | Audio video synchronization processing unit and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710483258.5A CN107277295B (en) | 2017-06-22 | 2017-06-22 | Audio video synchronization processing unit and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107277295A CN107277295A (en) | 2017-10-20 |
| CN107277295B true CN107277295B (en) | 2019-10-18 |
Family
ID=60068125
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710483258.5A Active CN107277295B (en) | 2017-06-22 | 2017-06-22 | Audio video synchronization processing unit and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107277295B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108089834B (en) * | 2017-11-07 | 2021-04-30 | 潍坊歌尔电子有限公司 | Playing synchronization method and device and USB sound card |
| CN109644290B (en) * | 2018-11-02 | 2022-03-08 | 上海极清慧视科技有限公司 | Data switching device, data acquisition device, system and method |
| WO2020087590A1 (en) * | 2018-11-02 | 2020-05-07 | 上海极清慧视科技有限公司 | Data transfer device, data acquisition device, system, and method |
| CN110636219B (en) * | 2019-09-03 | 2020-12-01 | 北京三快在线科技有限公司 | Video data stream transmission method and device |
| CN114500986A (en) * | 2021-12-20 | 2022-05-13 | 北京镁伽科技有限公司 | Time sequence synchronization method and device based on FPGA and PG equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1543193A (en) * | 2003-03-31 | 2004-11-03 | 索尼英国有限公司 | Video synchronization |
| CN1588988A (en) * | 2004-07-29 | 2005-03-02 | 联合信源数字音视频技术（北京）有限公司 | Synchronous control device and control method for video elecoding and display |
| CN1859567A (en) * | 2006-03-07 | 2006-11-08 | 华为技术有限公司 | Digital TV decoding method and system |
| JP2008022436A (en) * | 2006-07-14 | 2008-01-31 | Sony Corp | Video signal processing apparatus, and video signal processing method |
| JP2008148239A (en) * | 2006-12-13 | 2008-06-26 | Sony Corp | Video equipment and jitter/wander measurement method |
| CN101924884A (en) * | 2010-06-26 | 2010-12-22 | 大连捷成实业发展有限公司 | Digital video signal switching circuit and method |
| CN103686315A (en) * | 2012-09-13 | 2014-03-26 | 深圳市快播科技有限公司 | Synchronous audio and video playing method and device |
-
2017
- 2017-06-22 CN CN201710483258.5A patent/CN107277295B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1543193A (en) * | 2003-03-31 | 2004-11-03 | 索尼英国有限公司 | Video synchronization |
| CN1588988A (en) * | 2004-07-29 | 2005-03-02 | 联合信源数字音视频技术（北京）有限公司 | Synchronous control device and control method for video elecoding and display |
| CN1859567A (en) * | 2006-03-07 | 2006-11-08 | 华为技术有限公司 | Digital TV decoding method and system |
| JP2008022436A (en) * | 2006-07-14 | 2008-01-31 | Sony Corp | Video signal processing apparatus, and video signal processing method |
| JP2008148239A (en) * | 2006-12-13 | 2008-06-26 | Sony Corp | Video equipment and jitter/wander measurement method |
| CN101924884A (en) * | 2010-06-26 | 2010-12-22 | 大连捷成实业发展有限公司 | Digital video signal switching circuit and method |
| CN103686315A (en) * | 2012-09-13 | 2014-03-26 | 深圳市快播科技有限公司 | Synchronous audio and video playing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107277295A (en) | 2017-10-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107277295B (en) | Audio video synchronization processing unit and method | |
| KR101659346B1 (en) | Method and device for processing video image | |
| WO2015070694A1 (en) | Screen splicing system and video data stream processing method | |
| EP3151540A1 (en) | Image pick-up device and synchronization-signal-generating device | |
| WO2013018262A1 (en) | Imaging device, information processing device, information processing method, and method for synchronizing frame data output | |
| CN104168487A (en) | Video signal frame synchronization method and device | |
| US20220174186A1 (en) | Synchronizing media in multiple devices | |
| CN106341575B (en) | A kind of real-time output processing system of vision signal | |
| CN113055675A (en) | Image transmission method and device and video processing equipment | |
| CN105472203A (en) | Genlock system and method | |
| CN104602095A (en) | Acquiring and synchronous display method and system for combined desktop | |
| CN102625086B (en) | DDR2 (Double Data Rate 2) storage method and system for high-definition digital matrix | |
| US10148934B2 (en) | Image process apparatus and image process method | |
| CN103108148A (en) | Frame inserting method of video frames and information processing equipment | |
| JP5664356B2 (en) | Generation apparatus and generation method | |
| CN102881273B (en) | Embedded type image processing method aiming at asynchronous video | |
| JP2012138655A (en) | Image processing device and image processing method | |
| CN105227946B (en) | 3D video decomposers | |
| CN102843565B (en) | A kind of 2D image turns the method for 3D rendering | |
| US11189254B2 (en) | Video processing device, display device, video processing method, and recording medium | |
| JP6127311B2 (en) | 3D playback device, television receiver, 3D playback method, program, and storage medium storing program | |
| CN104717443B (en) | Automatic switching method from many video formats to SMPTE274 agreement 1080i resolution videos | |
| JP2006191538A (en) | Compressed stream decoding instrument and compressed stream decoding method | |
| TW202002604A (en) | Image processing method and electronic device | |
| US10284840B2 (en) | Apparatus and method for reproducing 3D image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |