CN114339345A - Source end synchronization device and synchronization method applied to audio and video signals - Google Patents
Source end synchronization device and synchronization method applied to audio and video signals Download PDFInfo
- Publication number
- CN114339345A CN114339345A CN202011050229.8A CN202011050229A CN114339345A CN 114339345 A CN114339345 A CN 114339345A CN 202011050229 A CN202011050229 A CN 202011050229A CN 114339345 A CN114339345 A CN 114339345A
- Authority
- CN
- China
- Prior art keywords
- audio
- signal
- video
- processing unit
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The application discloses a source end synchronization device and a synchronization method applied to audio and video signals and an audio and video display device. The application provides a source end synchronizer includes: the audio and video receiving unit is used for receiving an externally input audio and video signal, analyzing the audio and video signal, outputting a video signal, an audio signal and a synchronous signal, transmitting the video signal to the video processing unit, and transmitting the audio signal and the synchronous signal to the audio processing unit; the video processing unit is used for carrying out frame buffering on the video signal and generating a video output signal to be transmitted to an external display terminal; and the audio processing unit is used for generating an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit and outputting the audio signal according to the audio enabling signal. The embodiment of the application generates the audio enabling signal according to the frame buffer of the video signal and the synchronization signal, thereby realizing the synchronization of the video signal and the audio signal at the source end, and having a wide reference prospect.
Description
Technical Field
The present invention relates to the field of display technologies, and in particular, to a source synchronization device and a synchronization method applied to an audio/video signal, and an audio/video display device.
Background
In a typical audio-video processing system, the audio signal is usually nested in the data stream when transmitted, and the clock signal is not transmitted separately. For the source, the clock system of the sound data cannot be strictly synchronized.
In the prior art, a common processing circuit directly uses a local clock for audio processing, which inevitably causes loss or repetition of sound data. In an application field with a high requirement on sound quality, such as a professional monitor field, the loss or repetition of sound data caused by such a sound processing method will cause an unallowable sound anomaly, such as a periodic click or a background noise.
Disclosure of Invention
In order to solve at least one of the above problems, a first embodiment of the present application provides a source synchronization device applied to an audio/video signal, including an audio/video receiving unit, a video processing unit, and an audio processing unit, where:
the audio and video receiving unit is used for receiving an externally input audio and video signal, analyzing the audio and video signal, outputting a video signal, an audio signal and a synchronous signal, transmitting the video signal to the video processing unit, and transmitting the audio signal and the synchronous signal to the audio processing unit;
the video processing unit is used for carrying out frame buffering on the video signal and generating a video output signal to be transmitted to an external display terminal;
and the audio processing unit is used for generating an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit and outputting the audio signal according to the audio enabling signal.
In some optional embodiments, the audio processing unit comprises a time delay unit and a time enable unit, wherein the time delay unit comprises a delay time acquisition unit and a delay unit, wherein,
a delay time obtaining unit for obtaining the delay time of the video signal according to the buffer amount of the frame buffer of the video processing unit and the preset video frame rate,
the delay unit is used for delaying according to the synchronous signal and the delay time and outputting a delayed output signal to the time enabling unit after delay;
and a time enable unit including a crystal oscillator for generating an audio enable signal according to the delayed output signal and an output signal of the crystal oscillator.
In some alternative embodiments, the frequency of the crystal oscillator is the same as the frequency of the crystal oscillator used to generate the audio-visual signal.
In some optional embodiments, the audio processing unit further includes a buffer queue for storing the audio signal, and the time enable unit is configured to dynamically adjust an output period of the output audio signal according to a current storage ratio of the buffer queue and a preset ratio threshold to adjust an audio output rate in response to the delayed output signal, and generate the audio enable signal according to the output period and the output signal of the crystal oscillator.
In some alternative embodiments, the audio output rate is proportional to the storage ratio of the buffer queue.
A second aspect of the present application provides an audio/video display device, including the source end synchronization device according to the first aspect of the present application.
A third aspect of the present application provides a source synchronization method for a source synchronization apparatus in the first aspect of the present application, including:
the audio and video receiving unit receives an externally input audio and video signal, analyzes the audio and video signal, outputs a video signal, an audio signal and a synchronous signal, transmits the video signal to the video processing unit, and transmits the audio signal and the synchronous signal to the audio processing unit;
the video processing unit carries out frame buffer on the video signal and generates a video output signal to be transmitted to an external display terminal;
the audio processing unit generates an audio enable signal according to the synchronization signal and the buffer information of the frame buffer of the video processing unit, and outputs the audio signal according to the audio enable signal.
In some optional embodiments, the audio processing unit includes a time delay unit and a time enable unit, the time delay unit includes a delay time obtaining unit and a delay unit, the time enable unit includes a crystal oscillator, the audio processing unit generates the audio enable signal according to the synchronization signal and buffering information of the frame buffer of the video processing unit, and outputting the audio signal according to the audio enable signal further includes:
the delay time acquisition unit acquires the delay time of the video signal according to the frame buffer amount of the video processing unit and a preset video frame rate;
the delay unit delays according to the synchronous signal and the delay time and outputs a delayed output signal to the time enabling unit after delaying;
and the time enabling unit generates an audio enabling signal according to the delay output signal and the output signal of the crystal oscillator.
In some alternative embodiments, the frequency of the crystal oscillator is the same as the frequency of the crystal oscillator used to generate the audio-visual signal.
In some optional embodiments, the audio processing unit further includes a buffer queue storing the audio signal, the audio processing unit generates the audio enable signal according to the synchronization signal and buffer information of the frame buffer of the video processing unit, and outputting the audio signal according to the audio enable signal further includes:
the time enabling unit responds to the delay output signal, dynamically adjusts the output period of the output audio signal according to the current storage proportion of the buffer queue and a preset proportion threshold value to adjust the audio output rate, and generates an audio enabling signal according to the output period and the output signal of the crystal oscillator.
In some alternative embodiments, the audio output rate is proportional to the storage ratio of the buffer queue.
The invention has the following beneficial effects:
aiming at the existing problems, the invention sets a source end synchronization device and a synchronization method applied to audio and video signals and an audio and video display device, and realizes the synchronization of the source end video signals and the audio signals by generating audio enabling signals according to the cache information and the synchronization signals cached by video signal frames; in addition, the output period of the output audio signal is dynamically adjusted to adjust the audio output rate based on the storage proportion of the buffer queue of the audio signal, so that the real-time synchronization of the output audio signal and the output video signal is further ensured, the problems in the prior art are solved, the synchronous transmission performance of the audio and video signal is effectively improved, the user experience can be improved, and the application prospect is wide.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a block diagram illustrating an exemplary structure of a source synchronization apparatus applied to an audio/video signal according to an embodiment of the present application.
Fig. 2 is an exemplary flowchart of a source synchronization process applied to a source synchronization device of an audio/video signal according to an embodiment of the present application.
Fig. 3 is a block diagram illustrating an exemplary structure of a source synchronization device applied to an audio/video signal according to another embodiment of the present application.
Fig. 4 shows a schematic block diagram of a synchronization method applied to a source synchronization device of an audio-video signal according to an embodiment of the present invention.
Detailed Description
In order to more clearly illustrate the invention, the invention is further described below with reference to preferred embodiments and the accompanying drawings. Similar parts in the figures are denoted by the same reference numerals. It is to be understood by persons skilled in the art that the following detailed description is illustrative and not restrictive, and is not to be taken as limiting the scope of the invention.
It is noted that, in the description of the present application, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
As shown in fig. 1, an embodiment of the present invention provides a source synchronization device applied to an audio/video signal, including an audio/video receiving unit, a video processing unit, and an audio processing unit, where:
the audio and video receiving unit is used for receiving an externally input audio and video signal, analyzing the audio and video signal, outputting a video signal, an audio signal and a synchronous signal, transmitting the video signal to the video processing unit, and transmitting the audio signal and the synchronous signal to the audio processing unit;
the video processing unit is used for carrying out frame buffering on the video signal and generating a video output signal to be transmitted to an external display terminal;
and the audio processing unit is used for generating an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit and outputting the audio signal according to the audio enabling signal.
In the embodiment, a source synchronization device applied to audio and video signals is formulated, and an audio enable signal is generated according to cache information and a synchronization signal cached in a video signal frame, so that synchronization of the source video signal and the audio signal is realized, the problems in the prior art are solved, the synchronous transmission performance of the audio and video signals is effectively improved, the user experience can be improved, and the device has a wide application prospect.
In a specific example, as shown in fig. 1, a source synchronization device applied to an audio/video signal according to an embodiment of the present application includes an audio/video receiving unit 10, a video processing unit 20, and an audio processing unit 30. The audio/video receiving unit 10 receives an externally input audio/video signal, which may be a signal based on an HDMI transmission protocol, a signal based on a DP transmission protocol, a signal based on an SDI protocol, or the like, and is not limited herein. The audio/video receiving unit 10 parses the audio/video signal according to the received signal protocol, and outputs the video signal to the video processing unit 20 and the audio signal and the synchronization signal to the audio processing unit 30. The video processing unit 20 performs frame buffering on the video signal and generates a video output signal for transmission to an external display terminal, and in the video processing unit 20, the video signal may be frame buffered by a buffer commonly used in the art, such as a DDR (double data rate synchronous dynamic random access memory), but is not limited thereto. The audio processing unit 30 receives the audio signal and the synchronization signal received and analyzed by the audio/video receiving unit 10, generates an audio enable signal according to the synchronization signal and the buffer information of the frame buffer of the video processing unit, and finally outputs the audio signal to the outside based on the audio enable signal. It will be understood by those skilled in the art that the buffering information is generally known for a particular frame buffer, and the buffering information may include, but is not limited to, the buffering amount of the frame buffer, and may be other information for determining the buffering amount. The video signal is internally delayed during the frame buffering process, and the audio enable signal is controlled to be output at the same time delay according to the buffering information of the video signal in the video processing unit 20, so that the output audio signal can be synchronized with the video signal at the source end.
Specifically, the audio processing unit 30 includes a time delay unit 301 and a time enable unit 303. The time delay unit 301 includes a delay time acquisition unit for calculating a delay time of the video signal and a delay unit for delaying and outputting the synchronization signal according to the calculated delay time. Specifically, the delay time acquiring unit acquires the delay time of the video signal according to the buffer amount of the frame buffer of the video processing unit and a preset video frame rate. Specifically, the delay time may be expressed as:
Δt＝n*t0 (1)
wherein the delay time represents a time difference between the input and output of the video signal to and from the video processing unit 20, n is a positive integer representing the number of delayed frames of the video signal in the frame buffer, t0Denotes the period of each frame, t0＝1/f0，f0The video frame rate of the video signal is preset according to the video frame rate to be output by the source end.
The delay unit delays the synchronization signal according to the synchronization signal and the delay time and outputs a delayed output signal to the time enable unit 303 after the delay. Specifically, the delay unit delays the synchronization signal by the calculated delay time.
The time enabling unit 303 includes a crystal oscillator 303-1. The crystal oscillator 303-1 generates a local clock having a clock period identical to that of the crystal oscillator used to generate the externally input audio-video signal, i.e., the frequency of the crystal oscillator 303-1 is the same as that of the crystal oscillator used to generate the audio-video signal. In order to synchronize the audio signal and the video signal at the source end, in the present application, the audio enable signal is generated by the time enable unit according to the delayed output signal output by the delay unit and based on the local clock output by the crystal oscillator 303-1, that is, the synchronization signal analyzed by the audio/video receiving unit 10 is delayed according to the internal delay of the video signal in the frame buffer, and the audio enable signal is generated to enable the output of the audio signal based on the same frequency as the frequency of the crystal oscillator used for the audio signal. As shown in fig. 1, the audio enable signal is output to the buffer queue 305 of the audio processing unit 30 to output an audio signal based on the enable action of the signal. Through the mode, the adjustment of the output time of the audio signal is realized. It will be understood by those skilled in the art that the buffer queue 305 is an audio buffer for handling the asynchronous problem of sound, and will not be described herein.
For further understanding of the source synchronization device of the embodiment of the present application, fig. 2 shows a flowchart of a synchronization process of the source synchronization device. After the power-on initialization of the source end synchronizer, as shown in fig. 2, the audio/video receiving unit 10 parses the received audio/video signal into a video signal, an audio signal and a synchronization signal, the video signal enters a frame buffer, such as a DDR in this example, in the video processing unit 20, and the audio signal enters an audio buffer, here a FIFO (first in first out queue), in the audio processing unit 30. The video processor processes the video image, the processed video image is output from the DDR, and the video image is output via the output interface, as shown in fig. 1, the video image is output to the display panel 50 of the external display terminal via the interface 40-1, and the interface 40-1 may be a VBO (V-BY-ONE) transmission interface. The output timing of the audio data entering the buffer FIFO of the audio signal is based on the delay of the synchronization signal by the time delay unit 301, and the delayed output signal is output after the delay to generate the audio enable signal by the time enable unit 303. The buffer FIFO outputs an audio signal based on the audio enable signal, specifically, to the external decoding chip 60-1 via the interface 40-2 to decode the audio signal and to output sound via the speaker 60-2. Those skilled in the art will appreciate that the decoding and sound output processes are typically performed at the external receiving end.
In this way, by providing the audio processing unit including the time delay unit and the time enable unit, the synchronization signal can be delayed by the same time according to the internal delay time of the video signal, and the clock enable signal is generated based on the delayed output signal to enable the output of the audio signal, so that the synchronization of the audio signal and the video signal is realized at the source end.
In an alternative embodiment, as shown in fig. 3, the audio enable signal output by the sound enable unit 303 may also dynamically adjust the sound output rate according to the storage ratio of the buffer queue 305. In particular, according to the above embodiment of the present application, when generating an audio enable signal based on only buffering information, only buffering delay of frame buffering in a video processing unit is considered, and buffering delay of an audio signal that may exist in the buffer queue 305 is not considered. In the present embodiment, the time enable unit 301 dynamically adjusts the output period of the output audio signal according to the current storage ratio of the buffer queue 305 and a preset ratio threshold value in response to the delayed output signal to adjust the audio output rate, and generates the audio enable signal according to the output period and the output signal of the crystal oscillator 303-1.
Further specifically, referring to fig. 3, the time enable unit 303 can also obtain the storage ratio information of the buffer queue 305, for example, when the buffer queue 305 is a FIFO, the storage ratio information may be an rd _ cnt signal of the FIFO, and the storage ratio of the buffer queue 305 is obtained through the rd _ cnt signal. The signal indicates the amount of data that can be read in the FIFO, and based on the memory capacity of the FIFO, the time enable unit 303 can calculate the current storage proportion of the fetch buffer queue 303. In addition, the current storage proportion of the buffer queue 305 may also be calculated based on the equivalent read-write rate, for example, the storage proportion information is set to the equivalent read-write rate. Those skilled in the art will appreciate that the above is merely exemplary, and the present application is not intended to be limited thereto, and other ways of obtaining the current storage fraction of the buffer queue 305 are possible.
In the embodiment of the present application, the time enabling unit 303 generates the audio enabling signal so as to dynamically maintain the storage ratio of the buffer queue 305 at the predetermined ratio state, i.e. at the preset ratio threshold. Optionally, in this embodiment of the present application, the predetermined ratio state is set to be a half-full state, that is, the preset ratio threshold of the buffer queue 305 is 1/2. It will be appreciated by those skilled in the art that the present application is intended to control the output timing of the audio signal with the buffer queue 305 always in equilibrium, and is not intended to specifically limit the ratio. It is sufficient that the data stored in the buffer queue 305 is not overflowed and lost due to the nature of the buffer, or the data amount is too small, and a ratio of the audio signal blank occurs.
Specifically, the present embodiment will be described below by taking 1/2 as an example of the predetermined ratio state and 256 times the sampling clock as an example of the clock of the crystal oscillator 303-1.
In the embodiment of the present application, after obtaining the delayed output signal, the sound enabling unit 303 obtains the current storage ratio from the buffer queue 305, and when the obtained current reading ratio is greater than 1/2, that is, when the buffer queue 305 is currently greater than half full, it needs to increase the output rate of the current audio signal, that is, when the enabling signal generating unit 303-2 of the time enabling unit 303 generates the audio enabling signal, its clock is decreased by n clock cycles based on the preset clock cycle. That is, assuming that clk represents the period of the sampling clock, the preset clock period is 256clk, and when the acquired current reading ratio is greater than 1/2, the period in which the enable signal generation unit in the time enable unit 303 generates the audio enable signal is (256-n) clk, where n is a positive integer. When the specific value of n is not limited in the present application, it may be a fixed value, for example, a fixed step, such as 2, but is not limited to 2, and may also be a gradually decreasing value, and the specific decreasing manner is not limited.
In the embodiment of the present application, the sound enabling unit 303 obtains the current storage ratio of the buffer queue 305, and when the obtained current reading ratio is less than 1/2, that is, when the buffer queue 305 is currently less than half full, it is necessary to slow down the output rate of the current audio signal, that is, when the enable signal generating unit 303-2 of the time enabling unit 303 generates the audio enable signal, its clock is increased by n clock cycles based on the preset clock cycle. That is, assuming that clk represents the period of the sampling clock, the preset clock period is 256clk, and when the acquired current reading ratio is less than 1/2, the period in which the enable signal generation unit in the time enable unit 303 generates the audio enable signal is (256+ n) clk, where n is a positive integer. When the specific value of n is not limited in the present application, the specific value may be a fixed value or a gradually decreasing value, and the specific decreasing manner is not limited.
In the embodiment of the present application, the sound enabling unit 303 obtains the current storage ratio of the buffer queue 305, and when the obtained current reading ratio is equal to 1/2, that is, when the buffer queue 305 is currently equal to a half-full state, that is, the output rate of the current audio signal is normal, that is, when the enabling signal generating unit 303-2 of the time enabling unit 303 generates the audio enabling signal, its clock is not changed on the basis of the preset clock period. That is, assuming that clk represents the period of the sampling clock, the preset clock period is 256clk, and when the acquired current reading ratio is equal to 1/2, the period in which the enable signal generation unit in the time enable unit 303 generates the audio enable signal is 256 clk.
Based on the above manner, the output period of the output audio signal is dynamically adjusted to adjust the audio output rate through the storage proportion of the cache queue based on the cache audio signal, so that the dynamic adjustment of the effective output sampling frequency of the sound can be realized, the real-time synchronization of the output audio signal and the video signal is further ensured, the loss or the repetition of sound data is effectively avoided, the problems in the prior art are solved, the synchronous transmission performance of the audio and video signal is effectively improved, the user experience can be improved, and the method has a wide application prospect.
An embodiment of the present application further provides a source synchronization method using a source synchronization apparatus in an embodiment of the present application, including:
the audio and video receiving unit receives an externally input audio and video signal, analyzes the audio and video signal, outputs a video signal, an audio signal and a synchronous signal, transmits the video signal to the video processing unit, and transmits the audio signal and the synchronous signal to the audio processing unit;
the video processing unit carries out frame buffer on the video signal and generates a video output signal to be transmitted to an external display terminal;
the audio processing unit generates an audio enable signal according to the synchronization signal and the buffer information of the frame buffer of the video processing unit, and outputs the audio signal according to the audio enable signal.
In this embodiment, for the existing problem, an audio enable signal is generated according to the buffer information and the synchronization signal buffered in the video signal frame, so that synchronization between the source-end video signal and the audio signal is realized, the problems in the prior art are solved, the synchronous transmission performance of the audio and video signal is effectively improved, the user experience can be improved, and the application prospect is wide. The specific implementation manner of this embodiment is the same as that of the previous embodiment, and is not described herein again.
In an alternative embodiment, the audio processing unit includes a time delay unit and a time enable unit, the time delay unit includes a delay time obtaining unit and a delay unit, the time enable unit includes a crystal oscillator, the audio processing unit generates the audio enable signal according to the synchronization signal and buffering information of the frame buffer of the video processing unit, and outputting the audio signal according to the audio enable signal further includes:
the delay time acquisition unit acquires the delay time of the video signal according to the frame buffer amount of the video processing unit and a preset video frame rate;
the delay unit delays according to the synchronous signal and the delay time and outputs a delayed output signal to the time enabling unit after delaying;
and the time enabling unit generates an audio enabling signal according to the delay output signal and the output signal of the crystal oscillator.
In this embodiment, the video signal and the audio signal are synchronized at the source end by delaying the synchronization signal and determining the period of the audio enable signal by the clock signal provided by the local clock.
In an alternative embodiment, the frequency of the crystal oscillator is the same as the frequency of the crystal oscillator used to generate the audio-visual signal.
In an optional embodiment, the audio processing unit further includes a buffer queue for storing the audio signal, the audio processing unit generates an audio enable signal according to the synchronization signal and buffer information of the frame buffer of the video processing unit, and outputting the audio signal according to the audio enable signal further includes:
and the time enabling unit responds to the delayed output signal, dynamically adjusts the output period of the output audio signal according to the current storage proportion of the cache queue and a preset proportion threshold value so as to adjust the audio output rate, and generates an audio enabling signal according to the output period and the output signal of the crystal oscillator.
Optionally, the audio output rate is proportional to a storage ratio of the first-in-first-out queue.
Based on the mode, the output period of the output audio signal is dynamically adjusted based on the storage proportion of the cache queue for caching the audio signal so as to adjust the audio output rate, so that the dynamic adjustment of the effective output sampling frequency of the sound is realized, the real-time synchronization of the output audio signal and the video signal is further ensured, and the loss or the repetition of the sound data is effectively avoided.
Based on the signal processing device, an embodiment of the present application further provides an audio/video display device, including the source end synchronization device according to the embodiment of the present application.
In this embodiment, the audio/video display device may be any product or component with a display function, such as a mobile phone, a tablet computer, a television, a display, a notebook computer, a digital photo frame, or a navigator.
Aiming at the existing problems, the invention sets a source end synchronization device and a synchronization method applied to audio and video signals and an audio and video display device, and realizes the synchronization of the source end video signals and the audio signals by generating audio enabling signals according to the cache information and the synchronization signals cached by video signal frames; in addition, the output period of the output audio signal is dynamically adjusted to adjust the audio output rate based on the storage proportion of the buffer queue of the audio signal, so that the real-time synchronization of the output audio signal and the output video signal is further ensured, the problems in the prior art are solved, the synchronous transmission performance of the audio and video signal is effectively improved, the user experience can be improved, and the application prospect is wide.
It should be understood that the above-mentioned embodiments of the present invention are only examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention, and it will be obvious to those skilled in the art that other variations or modifications may be made on the basis of the above description, and all embodiments may not be exhaustive, and all obvious variations or modifications may be included within the scope of the present invention.
Claims (11)
1. A source end synchronizer applied to audio and video signals is characterized by comprising an audio and video receiving unit, a video processing unit and an audio processing unit, wherein:
the audio and video receiving unit is used for receiving an externally input audio and video signal, analyzing the audio and video signal, outputting a video signal, an audio signal and a synchronous signal, transmitting the video signal to the video processing unit, and transmitting the audio signal and the synchronous signal to the audio processing unit;
the video processing unit is used for carrying out frame buffering on the video signal and generating a video output signal to be transmitted to an external display terminal;
the audio processing unit is used for generating an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit, and outputting the audio signal according to the audio enabling signal.
2. The source synchronization device of claim 1, wherein the audio processing unit comprises a time delay unit and a time enable unit, wherein
The time delay unit comprises a delay time acquisition unit and a delay unit, wherein,
the delay time acquiring unit is used for acquiring the delay time of the video signal according to the buffer amount of the frame buffer of the video processing unit and a preset video frame rate,
the delay unit is used for delaying according to the synchronous signal and the delay time, outputting a delay output signal after delay and sending the delay output signal to the time enabling unit;
the time enabling unit comprises a crystal oscillator and is used for generating an audio enabling signal according to the delay output signal and an output signal of the crystal oscillator.
3. A source synchronization device as claimed in claim 2, wherein the frequency of the crystal oscillator is the same as the frequency of the crystal oscillator used to generate the audio-video signal.
4. The source synchronization device of claim 2, wherein the audio processing unit further comprises a buffer queue for storing the audio signal;
and the time enabling unit is used for responding to the delayed output signal, dynamically adjusting the output period of the output audio signal according to the current storage proportion of the buffer queue and a preset proportion threshold value so as to adjust the audio output rate, and generating an audio enabling signal according to the output period and the output signal of the crystal oscillator.
5. The source synchronization device of claim 4, wherein the audio output rate is proportional to a storage ratio of the buffer queue.
6. An audiovisual display device, characterized in that it comprises a source synchronization device as claimed in any of claims 1-5.
7. A source synchronization method using a source synchronization device according to any one of claims 1 to 5, comprising:
the audio and video receiving unit receives an externally input audio and video signal, analyzes the audio and video signal, outputs a video signal, an audio signal and a synchronous signal, transmits the video signal to the video processing unit, and transmits the audio signal and the synchronous signal to the audio processing unit;
the video processing unit carries out frame buffering on the video signal and generates a video output signal to be transmitted to an external display terminal;
and the audio processing unit generates an audio enabling signal according to the synchronous signal and the buffer information of the frame buffer of the video processing unit, and outputs the audio signal according to the audio enabling signal.
8. The source synchronization method of claim 7, wherein the audio processing unit includes a time delay unit and a time enable unit, the time delay unit includes a delay time obtaining unit and a delay unit, the time enable unit includes a crystal oscillator, the audio processing unit generates an audio enable signal according to the synchronization signal and buffering information of a frame buffer of the video processing unit, and outputs the audio signal according to the audio enable signal further includes:
the delay time acquisition unit acquires the delay time of the video signal according to the frame buffer amount of the video processing unit and a preset video frame rate;
the delay unit delays according to the synchronous signal and the delay time and outputs a delayed output signal after delay to be sent to the time enabling unit;
the time enabling unit generates an audio enabling signal according to the delay output signal and the output signal of the crystal oscillator.
9. The source synchronization method of claim 8, wherein the frequency of the crystal oscillator is the same as the frequency of the crystal oscillator used to generate the audio-video signal.
10. The source synchronization method of claim 8, wherein the audio processing unit further includes a buffer queue for storing the audio signal, the audio processing unit generates an audio enable signal according to the synchronization signal and buffer information of a frame buffer of the video processing unit, and the outputting the audio signal according to the audio enable signal further includes:
and the time enabling unit responds to the delayed output signal, dynamically adjusts the output period of outputting the audio signal according to the current storage proportion of the cache queue and a preset proportion threshold value so as to adjust the audio output rate, and generates an audio enabling signal according to the output period and the output signal of the crystal oscillator.
11. The source synchronization method of claim 10, wherein the audio output rate is proportional to a storage ratio of the buffer queue.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011050229.8A CN114339345A (en) | 2020-09-29 | 2020-09-29 | Source end synchronization device and synchronization method applied to audio and video signals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011050229.8A CN114339345A (en) | 2020-09-29 | 2020-09-29 | Source end synchronization device and synchronization method applied to audio and video signals |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114339345A true CN114339345A (en) | 2022-04-12 |
Family
ID=81011034
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011050229.8A Pending CN114339345A (en) | 2020-09-29 | 2020-09-29 | Source end synchronization device and synchronization method applied to audio and video signals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114339345A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114845004A (en) * | 2022-07-04 | 2022-08-02 | 杭州兆华电子股份有限公司 | Audio and video synchronization implementation method and acoustic imaging method |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009657A (en) * | 2007-02-02 | 2007-08-01 | 华为技术有限公司 | Measurement of the output speed of the buffer queue, allocation method and device of Iub bandwidth |
| CN101448315A (en) * | 2008-12-31 | 2009-06-03 | 华为技术有限公司 | Frame clock synchronization method and frame clock synchronization apparatus |
| CN101465686A (en) * | 2007-12-19 | 2009-06-24 | 中兴通讯股份有限公司 | Method and apparatus for implementing TD-SCDMA base station synchronization |
| CN101527606A (en) * | 2009-03-26 | 2009-09-09 | 上海交通大学 | Railway TV monochromatic network signal overlapping area tester |
| CN101778204A (en) * | 2010-02-06 | 2010-07-14 | 大连科迪视频技术有限公司 | 3G-SDI high-definition digital audio/video delay system |
| CN101867839A (en) * | 2010-05-31 | 2010-10-20 | 深圳创维－Rgb电子有限公司 | Program signal output method, system, television and glasses |
| CN101931482A (en) * | 2010-09-08 | 2010-12-29 | 武汉虹信通信技术有限责任公司 | Clock synchronization method and system of convergent type video optical transmitter and receiver |
| CN106792070A (en) * | 2016-12-19 | 2017-05-31 | 广东威创视讯科技股份有限公司 | A kind of audio, video data DMA transfer method and device |
| CN111479154A (en) * | 2020-04-03 | 2020-07-31 | 海信视像科技股份有限公司 | Equipment and method for realizing sound and picture synchronization and computer readable storage medium |
-
2020
- 2020-09-29 CN CN202011050229.8A patent/CN114339345A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009657A (en) * | 2007-02-02 | 2007-08-01 | 华为技术有限公司 | Measurement of the output speed of the buffer queue, allocation method and device of Iub bandwidth |
| CN101465686A (en) * | 2007-12-19 | 2009-06-24 | 中兴通讯股份有限公司 | Method and apparatus for implementing TD-SCDMA base station synchronization |
| CN101448315A (en) * | 2008-12-31 | 2009-06-03 | 华为技术有限公司 | Frame clock synchronization method and frame clock synchronization apparatus |
| CN101527606A (en) * | 2009-03-26 | 2009-09-09 | 上海交通大学 | Railway TV monochromatic network signal overlapping area tester |
| CN101778204A (en) * | 2010-02-06 | 2010-07-14 | 大连科迪视频技术有限公司 | 3G-SDI high-definition digital audio/video delay system |
| CN101867839A (en) * | 2010-05-31 | 2010-10-20 | 深圳创维－Rgb电子有限公司 | Program signal output method, system, television and glasses |
| CN101931482A (en) * | 2010-09-08 | 2010-12-29 | 武汉虹信通信技术有限责任公司 | Clock synchronization method and system of convergent type video optical transmitter and receiver |
| CN106792070A (en) * | 2016-12-19 | 2017-05-31 | 广东威创视讯科技股份有限公司 | A kind of audio, video data DMA transfer method and device |
| CN111479154A (en) * | 2020-04-03 | 2020-07-31 | 海信视像科技股份有限公司 | Equipment and method for realizing sound and picture synchronization and computer readable storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114845004A (en) * | 2022-07-04 | 2022-08-02 | 杭州兆华电子股份有限公司 | Audio and video synchronization implementation method and acoustic imaging method |
| CN114845004B (en) * | 2022-07-04 | 2022-10-25 | 杭州兆华电子股份有限公司 | Audio and video synchronization implementation method and acoustic imaging method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10147440B2 (en) | Method for playing data and apparatus and system thereof | |
| US5875354A (en) | System for synchronization by modifying the rate of conversion by difference of rate between first clock and audio clock during a second time period | |
| US10992451B2 (en) | Audio and video playback system and method for playing audio data applied thereto | |
| WO2021143612A1 (en) | Video signal transmission method and apparatus, and display device | |
| CN100411423C (en) | Data synchronousely regenerating device and terminal device | |
| JP5212473B2 (en) | VIDEO / AUDIO DATA OUTPUT DEVICE AND VIDEO / AUDIO DATA OUTPUT METHOD | |
| US10200741B2 (en) | Content output device and program | |
| US7627071B2 (en) | Timing synchronization module and method for synchronously playing a media signal | |
| CN111327789B (en) | Display signal synchronous conversion device | |
| US7240013B2 (en) | Method and apparatus for controlling buffering of audio stream | |
| CN114339345A (en) | Source end synchronization device and synchronization method applied to audio and video signals | |
| KR101787424B1 (en) | Mechanism for clock recovery for streaming content being communicated over a packetized communication network | |
| US20130108083A1 (en) | Audio processing system and adjusting method for audio signal buffer | |
| WO2010143550A1 (en) | Information processing device, method therefor, and program | |
| WO2021120124A1 (en) | Method and apparatus for video display, and computer storage medium | |
| CN115426438B (en) | DP video signal time sequence recovery device and working method thereof | |
| KR20210023853A (en) | Receiving device, and receiving method | |
| US8855212B2 (en) | System and method for AV synchronization of encoder data | |
| US20090021640A1 (en) | Signal processing apparatus for applying avc to delayed signals and a method thereof | |
| US20060017600A1 (en) | Image signal processing system | |
| JP3882688B2 (en) | Image and audio synchronization device | |
| JP2020145585A (en) | Synchronization device, synchronization method, and program | |
| TWI756871B (en) | Data conversion and high definition multimedia interface reciving device | |
| JP2005229168A (en) | Medium output system, synchronous error control system thereof and program | |
| CN116527613A (en) | Audio parameter adjustment method, device, apparatus and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |