CN114339345B - Source end synchronization device and synchronization method applied to audio and video signals - Google Patents
Source end synchronization device and synchronization method applied to audio and video signals Download PDFInfo
- Publication number
- CN114339345B CN114339345B CN202011050229.8A CN202011050229A CN114339345B CN 114339345 B CN114339345 B CN 114339345B CN 202011050229 A CN202011050229 A CN 202011050229A CN 114339345 B CN114339345 B CN 114339345B
- Authority
- CN
- China
- Prior art keywords
- audio
- signal
- video
- processing unit
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 239000000872 buffer Substances 0.000 claims abstract description 83
- 230000005236 sound signal Effects 0.000 claims abstract description 78
- 230000001360 synchronised effect Effects 0.000 claims abstract description 33
- 230000003139 buffering effect Effects 0.000 claims abstract description 17
- 239000013078 crystal Substances 0.000 claims description 34
- 230000003111 delayed effect Effects 0.000 claims description 21
- 230000001934 delay Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 description 9
- 230000008569 process Effects 0.000 description 7
- 238000005070 sampling Methods 0.000 description 6
- 230000009471 action Effects 0.000 description 4
- 230000003247 decreasing effect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 2
- 241000238876 Acari Species 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Receiver Circuits (AREA)
Abstract
The application discloses a source end synchronization device and a synchronization method applied to audio and video signals, and an audio and video display device. The source end synchronization device provided by the application comprises: the audio/video receiving unit is used for receiving externally input audio/video signals, analyzing the audio/video signals, outputting video signals, audio signals and synchronous signals, transmitting the video signals to the video processing unit, and transmitting the audio signals and the synchronous signals to the audio processing unit; the video processing unit is used for carrying out frame buffering on the video signal and generating a video output signal to be transmitted to an external display terminal; and the audio processing unit is used for generating an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit and outputting an audio signal according to the audio enabling signal. The embodiment of the application generates the audio enabling signal according to the frame buffer memory of the video signal and the synchronizing signal, thereby realizing the synchronization of the video signal and the audio signal at the source end and having wide reference prospect.
Description
Technical Field
The present invention relates to the field of display technologies, and in particular, to a source synchronization device and synchronization method for audio and video signals, and an audio and video display device.
Background
In a typical audio video processing system, the sound signal is typically nested in the data stream when transmitted, and the clock signal is not transmitted alone. For the source, the clock system of the sound data cannot be strictly synchronized.
In the prior art, a typical processing circuit directly uses a local clock for audio processing, which inevitably results in loss or repetition of sound data. In application fields with high requirements for sound quality, such as the field of professional monitors, etc., the loss or repetition of sound data caused by such a sound processing manner will result in an inadmissible sound abnormality such as periodic ticks or background noise.
Disclosure of Invention
In order to solve at least one of the above problems, a first embodiment of the present application provides a source synchronization device applied to an audio/video signal, including an audio/video receiving unit, a video processing unit, and an audio processing unit, wherein:
The audio/video receiving unit is used for receiving externally input audio/video signals, analyzing the audio/video signals, outputting video signals, audio signals and synchronous signals, transmitting the video signals to the video processing unit, and transmitting the audio signals and the synchronous signals to the audio processing unit;
The video processing unit is used for carrying out frame buffering on the video signal and generating a video output signal to be transmitted to an external display terminal;
and the audio processing unit is used for generating an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit and outputting an audio signal according to the audio enabling signal.
In some alternative embodiments, the audio processing unit comprises a time delay unit and a time enable unit, wherein the time delay unit comprises a delay time acquisition unit and a delay unit, wherein,
A delay time acquisition unit for acquiring the delay time of the video signal according to the buffer number of the frame buffer of the video processing unit and the preset video frame rate,
A delay unit for delaying according to the synchronous signal and the delay time and outputting a delayed output signal to the time enabling unit after the delay;
The time enabling unit comprises a crystal oscillator for generating an audio enabling signal according to the delayed output signal and the output signal of the crystal oscillator.
In some alternative embodiments, the frequency of the crystal oscillator is the same as the frequency of the crystal oscillator used to generate the audio-visual signal.
In some alternative embodiments, the audio processing unit further comprises a buffer queue for storing the audio signal, and the time enabling unit is configured to dynamically adjust an output period of the output audio signal according to a current storage proportion of the buffer queue and a preset proportion threshold value to adjust an audio output rate in response to the delayed output signal, and generate the audio enabling signal according to the output period and the output signal of the crystal oscillator.
In some alternative embodiments, the audio output rate is directly proportional to the storage ratio of the buffer queue.
The second aspect of the present application provides an audio/video display apparatus, which includes the source synchronization apparatus according to the first aspect of the present application.
A third aspect of the present application provides a source synchronization method of the source synchronization device according to the first aspect of the present application, including:
The audio and video receiving unit receives an externally input audio and video signal, analyzes the audio and video signal, outputs a video signal, an audio signal and a synchronous signal, transmits the video signal to the video processing unit, and transmits the audio signal and the synchronous signal to the audio processing unit;
The video processing unit performs frame buffering on the video signal and generates a video output signal to be transmitted to an external display terminal;
the audio processing unit generates an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit, and outputs an audio signal according to the audio enabling signal.
In some alternative embodiments, the audio processing unit includes a time delay unit and a time enable unit, the time delay unit includes a delay time acquisition unit and a delay unit, the time enable unit includes a crystal oscillator, the audio processing unit generates an audio enable signal according to the synchronization signal and buffering information of a frame buffer of the video processing unit, and outputting the audio signal according to the audio enable signal further includes:
the delay time acquisition unit acquires the delay time of the video signal according to the buffer number of the frame buffer of the video processing unit and a preset video frame rate;
the delay unit delays according to the synchronous signal and the delay time and outputs a delayed output signal to the time enabling unit after delay;
And a time enabling unit for generating an audio enabling signal according to the delayed output signal and the output signal of the crystal oscillator.
In some alternative embodiments, the frequency of the crystal oscillator is the same as the frequency of the crystal oscillator used to generate the audio-visual signal.
In some alternative embodiments, the audio processing unit further includes a buffer queue storing audio signals, the audio processing unit generating an audio enable signal according to the synchronization signal and buffer information of the frame buffer of the video processing unit, outputting the audio signal according to the audio enable signal further includes:
The time enabling unit is used for responding to the delayed output signal, dynamically adjusting the output period of the output audio signal according to the current storage proportion of the buffer queue and a preset proportion threshold value to adjust the audio output rate, and generating an audio enabling signal according to the output period and the output signal of the crystal oscillator.
In some alternative embodiments, the audio output rate is directly proportional to the storage ratio of the buffer queue.
The beneficial effects of the invention are as follows:
Aiming at the existing problems at present, the invention establishes a source end synchronization device and a synchronization method applied to audio and video signals and an audio and video display device, and generates an audio enabling signal according to the cache information of video signal frame cache and the synchronization signal to realize synchronization of the source end video signals and the audio signals; in addition, the output period of the output audio signal is dynamically adjusted to adjust the audio output rate through the storage proportion of the buffer queue based on the audio signal, so that the real-time synchronization of the output audio signal and the video signal is further ensured, the problems in the prior art are overcome, the synchronous transmission performance of the audio and video signal is effectively improved, the user experience can be improved, and the method has a wide application prospect.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is an exemplary block diagram of a source-side synchronization apparatus applied to an audio and video signal according to an embodiment of the present application.
Fig. 2 is an exemplary flowchart of a source synchronization process of a source synchronization apparatus applied to an audio and video signal according to an embodiment of the present application.
Fig. 3 is an exemplary block diagram of a source-side synchronization apparatus applied to an audio and video signal according to another embodiment of the present application.
Fig. 4 is a schematic block diagram of a synchronization method applied to a source synchronization device of an audio/video signal according to an embodiment of the present invention.
Detailed Description
In order to more clearly illustrate the present invention, the present invention will be further described with reference to preferred embodiments and the accompanying drawings. Like parts in the drawings are denoted by the same reference numerals. It is to be understood by persons skilled in the art that the following detailed description is illustrative and not restrictive, and that this invention is not limited to the details given herein.
It is noted that in the description of the present application, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.
As shown in fig. 1, an embodiment of the present invention provides a source synchronization device applied to an audio/video signal, including an audio/video receiving unit, a video processing unit, and an audio processing unit, where:
The audio/video receiving unit is used for receiving externally input audio/video signals, analyzing the audio/video signals, outputting video signals, audio signals and synchronous signals, transmitting the video signals to the video processing unit, and transmitting the audio signals and the synchronous signals to the audio processing unit;
The video processing unit is used for carrying out frame buffering on the video signal and generating a video output signal to be transmitted to an external display terminal;
and the audio processing unit is used for generating an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit and outputting an audio signal according to the audio enabling signal.
In this embodiment, a source synchronization device applied to an audio/video signal is formulated, and an audio enabling signal is generated according to cache information and a synchronization signal of a video signal frame cache, so that synchronization of the source video signal and the audio signal is realized, the problems existing in the prior art are solved, the synchronous transmission performance of the audio/video signal is effectively improved, the user experience can be improved, and the source synchronization device has a wide application prospect.
In a specific example, as shown in fig. 1, a source synchronization device applied to an audio/video signal according to an embodiment of the present application includes an audio/video receiving unit 10, a video processing unit 20, and an audio processing unit 30. The audio/video receiving unit 10 receives an audio/video signal input from the outside, and the audio/video signal may be a signal based on HDMI transmission protocol, a signal based on DP transmission protocol, a signal based on SDI protocol, or the like, which is not limited herein. The audio-video receiving unit 10 parses the audio-video signal according to the received signal protocol, and outputs the video signal to the video processing unit 20, and outputs the audio signal and the synchronization signal to the audio processing unit 30. The video processing unit 20 performs frame buffering of the video signal and generates a video output signal for transmission to an external display terminal, and in the video processing unit 20, the video signal may be frame buffered by a buffer commonly used in the art, such as DDR (double rate synchronous dynamic random access memory), but is not limited thereto. The audio processing unit 30 receives the audio signal and the synchronization signal received and analyzed by the audio-video receiving unit 10, generates an audio enable signal according to the synchronization signal and the buffer information of the frame buffer of the video processing unit, and finally outputs the audio signal to the outside based on the audio enable signal. It will be appreciated by those skilled in the art that, for a particular frame buffer, the buffer information is generally known, and may include the number of buffers of the frame buffer, but is not limited thereto, and may be other information for determining the number of buffers. During frame buffering, the video signal generates an internal delay, and the audio enable signal is controlled to be output at the same time according to the buffering information of the video signal in the video processing unit 20, so that the output audio signal can be synchronized with the video signal at the source side.
Specifically, the audio processing unit 30 includes a time delay unit 301 and a time enable unit 303. The time delay unit 301 includes a delay time acquisition unit for calculating a delay time of the video signal and a delay unit for delaying and outputting the synchronization signal according to the calculated delay time. Specifically, the delay time acquisition unit acquires the delay time of the video signal according to the buffer number of the frame buffer of the video processing unit and a preset video frame rate. Specifically, the delay time may be expressed as:
Δt＝n*t0 (1)
Wherein the delay time represents the time difference between the input and output of the video signal to the video processing unit 20, n is a positive integer, represents the delay frame number of the video signal in the frame buffer, t 0 represents the period of each frame, and t 0＝1/f0,f0 is the video frame rate of the video signal, which is preset according to the video frame rate to be output from the source.
The delay unit delays the synchronization signal according to the synchronization signal and the delay time and outputs a delayed output signal to the time enable unit 303 after the delay. Specifically, the length of time for which the delay unit delays the synchronization signal is the calculated delay time.
The time enabling unit 303 includes a crystal oscillator 303-1. The crystal oscillator 303-1 generates a local clock having a clock period identical to that of the crystal oscillator used for generating the externally input audio-video signal, i.e., the frequency of the crystal oscillator 303-1 is identical to that of the crystal oscillator used for generating the audio-video signal. In order to synchronize the audio signal with the video signal at the source side, in the present application, the audio enable signal is generated by the time enable unit from the delayed output signal outputted by the delay unit and based on the local clock outputted by the crystal oscillator 303-1, that is, the synchronization signal parsed by the audio-video receiving unit 10 is delayed according to the internal delay of the video signal in the frame buffer, and the audio enable signal is generated to enable the output of the audio signal based on the same frequency as the frequency of the crystal oscillator used for the audio signal. As shown in fig. 1, the audio enable signal is output to the buffer queue 305 of the audio processing unit 30 to output an audio signal based on the enabling action of the signal. By the above mode, the adjustment of the output time of the audio signal is realized. Those skilled in the art will appreciate that the buffer queue 305 is an audio buffer for handling asynchronous problems of sound, and will not be described in detail herein.
For further understanding of the source synchronization device according to the embodiment of the present application, fig. 2 is a flowchart of a synchronization process of the source synchronization device. After the source synchronization device is powered on and initialized, as shown in fig. 2, the audio/video receiving unit 10 parses the received audio/video signal into a video signal, an audio signal and a synchronization signal, where the video signal enters a frame buffer in the video processing unit 20, for example, DDR in this example, and the audio signal enters an audio buffer in the audio processing unit 30, here, FIFO (first in first out queue). The video processor processes the video image, the processed video image is output from the DDR and the video image is output via an output interface, as shown in fig. 1, the video image is output to a display panel 50 of an external display terminal via an interface 40-1, and the interface 40-1 may be a VBO (V-BY-ONE) transmission interface. The audio data entering the buffer FIFO of the audio signal is output at a timing based on the delay of the synchronization signal by the time delay unit 301, and the delayed output signal generates an audio enable signal via the time enable unit 303. The buffer FIFO outputs an audio signal based on the audio enable signal, specifically, the audio signal is decoded via the interface 40-2 to the external decoding chip 60-1 and is output acoustically via the speaker 60-2. Those skilled in the art will appreciate that the decoding and sound output processes are typically performed at the external receiving end.
In the above manner, by providing the audio processing unit including the time delay unit and the time enable unit, it is possible to delay the synchronization signal by the same time according to the internal delay time of the video signal, and generate the clock enable signal based on the delayed output signal to enable the output of the audio signal, so that synchronization of the audio signal and the video signal is achieved at the source side.
In an alternative embodiment, as shown in fig. 3, the audio enable signal output by the sound enable unit 303 may also dynamically adjust the sound output rate according to the storage proportion of the buffer queue 305. Specifically, according to the above embodiment of the present application, when generating the audio enable signal based on only the buffering information, only the buffering delay of the frame buffering in the video processing unit is considered, and the buffering delay that may exist in the buffering queue 305 of the audio signal is not considered. In this embodiment, the time enabling unit 301 dynamically adjusts the output period of the output audio signal according to the current storage ratio of the buffer queue 305 and a preset ratio threshold value in response to the delayed output signal to adjust the audio output rate, and generates the audio enabling signal according to the output period and the output signal of the crystal oscillator 303-1.
Further specifically, referring to fig. 3, the time enabling unit 303 is further capable of acquiring the storage ratio information of the cache queue 305, for example, when the cache queue 305 is a FIFO, the storage ratio information may be an rd_cnt signal of the FIFO, and the storage ratio of the cache queue 305 is acquired through the rd_cnt signal. This signal represents the amount of data that can be read in the FIFO, and based on the memory capacity of the FIFO, the time enabling unit 303 can calculate the current memory ratio of the fetch buffer queue 303. In addition, the current storage ratio of the buffer queue 305 may also be calculated based on the equivalent read-write rate, for example, the storage ratio information is set to the equivalent read-write rate. Those skilled in the art will appreciate that the above is exemplary only, and the application is not intended to be so limited, as other ways of obtaining the current storage ratio of the cache queue 305 are possible.
In an embodiment of the present application, the time enabling unit 303 generates the audio enabling signal such that the storage proportion of the cache queue 305 is dynamically maintained in a predetermined proportion state, that is, dynamically maintained in a preset proportion threshold. Optionally, in the embodiment of the present application, the predetermined proportion state is set to be a half-full state, that is, the preset proportion threshold of the cache queue 305 is 1/2. Those skilled in the art will appreciate that the present application is intended to control the output timing of the audio signal by keeping the buffer queue 305 in equilibrium at all times, and is not intended to specifically limit the ratio. The ratio of the sound signal blank may be set so that the data stored in the buffer queue 305 is not excessively overflowed and lost due to the nature of the buffer, or so that the data amount is too small.
Specifically, the present embodiment is described below taking a predetermined ratio of 1/2 as an example, while taking the clock of the crystal oscillator 303-1 as 256 times the sampling clock as an example.
In the embodiment of the present application, after the sound enabling unit 303 obtains the delayed output signal, it obtains the current storage ratio from the buffer queue 305, and when the obtained current read ratio is greater than 1/2, that is, when the buffer queue 305 is currently greater than half full state, it needs to speed up the output rate of the current audio signal, that is, when the enabling signal generating unit 303-2 of the time enabling unit 303 generates the audio enabling signal, its clock is reduced by n clock cycles on the basis of the preset clock cycle. That is, assuming that the period of the sampling clock is represented by clk, the preset clock period is 256clk, and when the acquired current read ratio is greater than 1/2, the period in which the enable signal generation unit in the time enable unit 303 generates the audio enable signal is (256-n) clk, where n is a positive integer. While the specific value of n is not limited in the present application, it may be a fixed value, for example, a fixed step, such as 2, but is certainly not limited to 2, and may be a gradually decreasing value, and the specific decreasing manner is not limited.
In the embodiment of the present application, when the sound enabling unit 303 obtains the current storage proportion of the buffer queue 305 and the obtained current read proportion is less than 1/2, that is, when the buffer queue 305 is in a state of being less than half full, the output rate of the current audio signal needs to be slowed down, that is, when the enabling signal generating unit 303-2 of the time enabling unit 303 generates the audio enabling signal, the clock thereof is increased by n clock cycles on the basis of the preset clock cycle. That is, assuming that the period of the sampling clock is represented by clk, the preset clock period is 256clk, and when the acquired current read ratio is less than 1/2, the period in which the enable signal generation unit in the time enable unit 303 generates the audio enable signal is (256+n) clk, where n is a positive integer. In the present application, the specific value of n is not limited, and may be a fixed value or a gradually decreasing value, and the specific decreasing manner is not limited.
In the embodiment of the present application, the sound enabling unit 303 obtains the current storage ratio of the buffer queue 305, and when the obtained current read ratio is equal to 1/2, that is, when the buffer queue 305 is currently equal to a half-full state, that is, the output rate of the current audio signal is normal, that is, when the enabling signal generating unit 303-2 of the time enabling unit 303 generates the audio enabling signal, the clock thereof is unchanged on the basis of a preset clock period. That is, assuming that the period of the sampling clock is represented by clk, the preset clock period is 256clk, and when the acquired current read ratio is equal to 1/2, the period in which the enable signal generation unit in the time enable unit 303 generates the audio enable signal is 256clk.
Based on the above mode, through the output period of the output audio signal based on the storage proportion dynamic adjustment of the cache queue of the cache audio signal to adjust the audio output rate, the dynamic adjustment of the effective output sampling frequency of sound can be realized, thereby further ensuring the real-time synchronization of the output audio signal and video signal, effectively avoiding the loss or repetition of sound data, making up the problems in the prior art, effectively improving the synchronous transmission performance of the audio and video signal, improving the user experience and having wide application prospect.
An embodiment of the present application further provides a source synchronization method using the source synchronization device of the embodiment of the present application, including:
The audio and video receiving unit receives an externally input audio and video signal, analyzes the audio and video signal, outputs a video signal, an audio signal and a synchronous signal, transmits the video signal to the video processing unit, and transmits the audio signal and the synchronous signal to the audio processing unit;
The video processing unit performs frame buffering on the video signal and generates a video output signal to be transmitted to an external display terminal;
the audio processing unit generates an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit, and outputs an audio signal according to the audio enabling signal.
In this embodiment, aiming at the existing problem, the audio enabling signal is generated according to the buffer information of the video signal frame buffer and the synchronization signal, so that synchronization of the source video signal and the audio signal is realized, the problem existing in the prior art is overcome, the synchronous transmission performance of the audio and video signal is effectively improved, the user experience can be improved, and the method has a wide application prospect. The specific implementation manner of this embodiment is the same as that of the foregoing embodiment, and will not be described herein.
In an alternative embodiment, the audio processing unit includes a time delay unit and a time enable unit, the time delay unit includes a delay time acquisition unit and a delay unit, the time enable unit includes a crystal oscillator, the audio processing unit generates an audio enable signal according to the synchronization signal and buffering information of a frame buffer of the video processing unit, and outputting the audio signal according to the audio enable signal further includes:
the delay time acquisition unit acquires the delay time of the video signal according to the buffer number of the frame buffer of the video processing unit and the preset video frame rate;
the delay unit delays according to the synchronous signal and the delay time and outputs a delayed output signal to the time enabling unit after delay;
And a time enabling unit for generating an audio enabling signal according to the delayed output signal and the output signal of the crystal oscillator.
In this embodiment, the synchronization of the video signal and the audio signal is achieved at the source end by delaying the synchronization signal and determining the period of the audio enable signal by the clock signal provided by the local clock.
In an alternative embodiment, the frequency of the crystal oscillator is the same as the frequency of the crystal oscillator used to generate the audio-visual signal.
In an alternative embodiment, the audio processing unit further includes a buffer queue for storing audio signals, the audio processing unit generates an audio enable signal according to the synchronization signal and buffer information of the frame buffer of the video processing unit, and outputting the audio signal according to the audio enable signal further includes:
The time enabling unit is used for responding to the delayed output signal, dynamically adjusting the output period of the output audio signal according to the current storage proportion of the buffer queue and a preset proportion threshold value so as to adjust the audio output rate, and generating an audio enabling signal according to the output period and the output signal of the crystal oscillator.
Optionally, the audio output rate is directly proportional to the storage ratio of the first-in-first-out queue.
Based on the above mode, the output period of the output audio signal is dynamically adjusted based on the storage proportion of the cache queue of the cache audio signal to adjust the audio output rate, so that the dynamic adjustment of the effective output sampling frequency of sound is realized, the real-time synchronization of the output audio signal and the video signal is further ensured, and the loss or repetition of sound data is effectively avoided.
Based on the signal processing device, an embodiment of the application further provides an audio/video display device, which comprises the source synchronization device according to the embodiment of the application.
In this embodiment, the audio/video display device may be any product or component with a display function, such as a mobile phone, a tablet computer, a television, a display, a notebook computer, a digital photo frame, or a navigator.
Aiming at the existing problems at present, the invention establishes a source end synchronization device and a synchronization method applied to audio and video signals and an audio and video display device, and generates an audio enabling signal according to the cache information of video signal frame cache and the synchronization signal to realize synchronization of the source end video signals and the audio signals; in addition, the output period of the output audio signal is dynamically adjusted to adjust the audio output rate through the storage proportion of the buffer queue based on the audio signal, so that the real-time synchronization of the output audio signal and the video signal is further ensured, the problems in the prior art are overcome, the synchronous transmission performance of the audio and video signal is effectively improved, the user experience can be improved, and the method has a wide application prospect.
It should be understood that the foregoing examples of the present invention are provided merely for clearly illustrating the present invention and are not intended to limit the embodiments of the present invention, and that various other changes and modifications may be made therein by one skilled in the art without departing from the spirit and scope of the present invention as defined by the appended claims.
Claims (9)
1. The source end synchronization device applied to the audio and video signals is characterized by comprising an audio and video receiving unit, a video processing unit and an audio processing unit, wherein:
The audio and video receiving unit is used for receiving an externally input audio and video signal, analyzing the audio and video signal, outputting a video signal, an audio signal and a synchronous signal, transmitting the video signal to the video processing unit, and transmitting the audio signal and the synchronous signal to the audio processing unit;
The video processing unit is used for carrying out frame buffering on the video signal and generating a video output signal to be transmitted to an external display terminal;
the audio processing unit is used for generating an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit, and outputting the audio signal according to the audio enabling signal;
the audio processing unit comprises a time delay unit and a time enabling unit, wherein
The time delay unit comprises a delay time acquisition unit and a delay unit, wherein,
The delay time acquisition unit is used for acquiring the delay time of the video signal according to the buffer number of the frame buffer of the video processing unit and the preset video frame rate,
The delay unit is used for delaying the synchronous signal according to the synchronous signal and delay time and outputting a delayed output signal after delay to be sent to the time enabling unit;
the time enabling unit comprises a crystal oscillator and is used for generating an audio enabling signal according to the delay output signal and the output signal of the crystal oscillator.
2. The source synchronization device according to claim 1, wherein the frequency of the crystal oscillator is the same as the frequency of the crystal oscillator used to generate the audio-visual signal.
3. The source synchronization device according to claim 1, wherein the audio processing unit further comprises a buffer queue storing the audio signals;
the time enabling unit is used for responding to the delayed output signal, dynamically adjusting and outputting the output period of the audio signal according to the current storage proportion of the buffer queue and a preset proportion threshold value so as to adjust the audio output rate, and generating an audio enabling signal according to the output period and the output signal of the crystal oscillator.
4. The source synchronization device of claim 3, wherein the audio output rate is in direct proportional relationship with the storage ratio of the buffer queue.
5. An audio-visual display apparatus comprising a source-side synchronization apparatus as claimed in any one of claims 1-4.
6. A source synchronization method using the source synchronization device according to any one of claims 1 to 4, comprising:
the audio and video receiving unit receives an externally input audio and video signal, analyzes the audio and video signal, outputs a video signal, an audio signal and a synchronizing signal, transmits the video signal to the video processing unit, and transmits the audio signal and the synchronizing signal to the audio processing unit;
The video processing unit performs frame buffering on the video signal and generates a video output signal to be transmitted to an external display terminal;
The audio processing unit generates an audio enabling signal according to the synchronizing signal and the buffer information of the frame buffer of the video processing unit, outputs the audio signal according to the audio enabling signal, the audio processing unit comprises a time delay unit and a time enabling unit, the time delay unit comprises a delay time acquisition unit and a delay unit, the time enabling unit comprises a crystal oscillator, and the audio processing unit further comprises:
The delay time acquisition unit acquires the delay time of the video signal according to the buffer number of the frame buffer of the video processing unit and a preset video frame rate;
the delay unit delays the synchronous signal according to the synchronous signal and delay time and outputs a delayed output signal to the time enabling unit after delay;
the time enabling unit generates an audio enabling signal according to the delayed output signal and the output signal of the crystal oscillator thereof.
7. The source synchronization method according to claim 6, wherein a frequency of the crystal oscillator is the same as a frequency of a crystal oscillator used for generating the audio-video signal.
8. The source synchronization method according to claim 6, wherein the audio processing unit further includes a buffer queue storing the audio signal, the audio processing unit generates an audio enable signal according to the synchronization signal and buffer information of a frame buffer of the video processing unit, and outputting the audio signal according to the audio enable signal further includes:
The time enabling unit is used for responding to the delayed output signal, dynamically adjusting and outputting the output period of the audio signal according to the current storage proportion of the buffer queue and a preset proportion threshold value so as to adjust the audio output rate, and generating an audio enabling signal according to the output period and the output signal of the crystal oscillator.
9. The source synchronization method of claim 8, wherein the audio output rate is in direct proportional relationship with the storage ratio of the buffer queue.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011050229.8A CN114339345B (en) | 2020-09-29 | 2020-09-29 | Source end synchronization device and synchronization method applied to audio and video signals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011050229.8A CN114339345B (en) | 2020-09-29 | 2020-09-29 | Source end synchronization device and synchronization method applied to audio and video signals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114339345A CN114339345A (en) | 2022-04-12 |
| CN114339345B true CN114339345B (en) | 2024-05-31 |
Family
ID=81011034
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011050229.8A Active CN114339345B (en) | 2020-09-29 | 2020-09-29 | Source end synchronization device and synchronization method applied to audio and video signals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114339345B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114845004B (en) * | 2022-07-04 | 2022-10-25 | 杭州兆华电子股份有限公司 | Audio and video synchronization implementation method and acoustic imaging method |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009657A (en) * | 2007-02-02 | 2007-08-01 | 华为技术有限公司 | Measurement of the output speed of the buffer queue, allocation method and device of Iub bandwidth |
| CN101448315A (en) * | 2008-12-31 | 2009-06-03 | 华为技术有限公司 | Frame clock synchronization method and frame clock synchronization apparatus |
| CN101465686A (en) * | 2007-12-19 | 2009-06-24 | 中兴通讯股份有限公司 | Method and apparatus for implementing TD-SCDMA base station synchronization |
| CN101527606A (en) * | 2009-03-26 | 2009-09-09 | 上海交通大学 | Railway TV monochromatic network signal overlapping area tester |
| CN101778204A (en) * | 2010-02-06 | 2010-07-14 | 大连科迪视频技术有限公司 | 3G-SDI high-definition digital audio/video delay system |
| CN101867839A (en) * | 2010-05-31 | 2010-10-20 | 深圳创维－Rgb电子有限公司 | Program signal output method, system, television and glasses |
| CN101931482A (en) * | 2010-09-08 | 2010-12-29 | 武汉虹信通信技术有限责任公司 | Clock synchronization method and system of convergent type video optical transmitter and receiver |
| CN106792070A (en) * | 2016-12-19 | 2017-05-31 | 广东威创视讯科技股份有限公司 | A kind of audio, video data DMA transfer method and device |
| CN111479154A (en) * | 2020-04-03 | 2020-07-31 | 海信视像科技股份有限公司 | Equipment and method for realizing sound and picture synchronization and computer readable storage medium |
-
2020
- 2020-09-29 CN CN202011050229.8A patent/CN114339345B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009657A (en) * | 2007-02-02 | 2007-08-01 | 华为技术有限公司 | Measurement of the output speed of the buffer queue, allocation method and device of Iub bandwidth |
| CN101465686A (en) * | 2007-12-19 | 2009-06-24 | 中兴通讯股份有限公司 | Method and apparatus for implementing TD-SCDMA base station synchronization |
| CN101448315A (en) * | 2008-12-31 | 2009-06-03 | 华为技术有限公司 | Frame clock synchronization method and frame clock synchronization apparatus |
| CN101527606A (en) * | 2009-03-26 | 2009-09-09 | 上海交通大学 | Railway TV monochromatic network signal overlapping area tester |
| CN101778204A (en) * | 2010-02-06 | 2010-07-14 | 大连科迪视频技术有限公司 | 3G-SDI high-definition digital audio/video delay system |
| CN101867839A (en) * | 2010-05-31 | 2010-10-20 | 深圳创维－Rgb电子有限公司 | Program signal output method, system, television and glasses |
| CN101931482A (en) * | 2010-09-08 | 2010-12-29 | 武汉虹信通信技术有限责任公司 | Clock synchronization method and system of convergent type video optical transmitter and receiver |
| CN106792070A (en) * | 2016-12-19 | 2017-05-31 | 广东威创视讯科技股份有限公司 | A kind of audio, video data DMA transfer method and device |
| CN111479154A (en) * | 2020-04-03 | 2020-07-31 | 海信视像科技股份有限公司 | Equipment and method for realizing sound and picture synchronization and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114339345A (en) | 2022-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105812902B (en) | Method, equipment and the system of data playback | |
| US20200321014A1 (en) | Jitter Buffer Control, Audio Decoder, Method and Computer Program | |
| US5875354A (en) | System for synchronization by modifying the rate of conversion by difference of rate between first clock and audio clock during a second time period | |
| US20190173663A1 (en) | Audio and video playback system and method for playing audio data applied thereto | |
| WO2021143612A1 (en) | Video signal transmission method and apparatus, and display device | |
| US20060184261A1 (en) | Method and system for reducing audio latency | |
| EP2538689A1 (en) | Adaptive media delay matching | |
| US20080186972A1 (en) | Data Stream Synchronization | |
| US9854295B2 (en) | Content output device and program | |
| US20240292044A1 (en) | Method, apparatus, electronic device and storage medium for audio and video synchronization monitoring | |
| CN114339345B (en) | Source end synchronization device and synchronization method applied to audio and video signals | |
| US7627071B2 (en) | Timing synchronization module and method for synchronously playing a media signal | |
| CN111327789B (en) | Display signal synchronous conversion device | |
| US20130108083A1 (en) | Audio processing system and adjusting method for audio signal buffer | |
| KR20140018235A (en) | Mechanism for clock recovery for streaming content being communicated over a packetized communication network | |
| US20030208359A1 (en) | Method and apparatus for controlling buffering of audio stream | |
| JP5440839B2 (en) | Information processing apparatus and method, and program | |
| US20070203597A1 (en) | Audio data processing apparatus | |
| WO2021120124A1 (en) | Method and apparatus for video display, and computer storage medium | |
| CN115426438B (en) | DP video signal time sequence recovery device and working method thereof | |
| US11374729B2 (en) | Audio synchronization processing circuit and method thereof | |
| JP2001168883A (en) | Method for adjusting time stamp offset and packet- transmitting device using the same | |
| JP2020145585A (en) | Synchronization device, synchronization method, and program | |
| JP5082969B2 (en) | Receiving device, receiving method, and program | |
| JP3764878B2 (en) | VIDEO / AUDIO PLAYER, VIDEO / AUDIO PLAYBACK METHOD, PROGRAM, AND MEDIUM |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |