CN112333512B - Audio and video system, audio delay detection method and audio and video watching scene synchronization method - Google Patents
Audio and video system, audio delay detection method and audio and video watching scene synchronization method Download PDFInfo
- Publication number
- CN112333512B CN112333512B CN202011296567.XA CN202011296567A CN112333512B CN 112333512 B CN112333512 B CN 112333512B CN 202011296567 A CN202011296567 A CN 202011296567A CN 112333512 B CN112333512 B CN 112333512B
- Authority
- CN
- China
- Prior art keywords
- audio
- sound signal
- transmits
- sound
- usb interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 42
- 238000000034 method Methods 0.000 title claims abstract description 16
- 230000005236 sound signal Effects 0.000 claims abstract description 296
- 230000005540 biological transmission Effects 0.000 claims abstract description 33
- 238000009826 distribution Methods 0.000 claims description 17
- 238000004891 communication Methods 0.000 claims description 13
- 238000005520 cutting process Methods 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 abstract description 5
- 102100037904 CD9 antigen Human genes 0.000 description 20
- 101000738354 Homo sapiens CD9 antigen Proteins 0.000 description 20
- 238000012360 testing method Methods 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000003321 amplification Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
Abstract
The invention relates to an audio-video system, a method for detecting audio delay and a method for synchronizing audio-video watching scenes, which comprises the following steps: novel OTT box, novel OTT box include host computer, USB detection device and MIC, and the host computer includes CPU, audio player and HDMI module, and USB detection device includes USB interface, sound card treater and wireless transmission module, the host computer is connected with MIC, and host computer and USB detection device pass through USB interface connection. The invention can detect the delay caused by the processing of the television audio signal and carry out compensation delay so as to realize synchronous sounding of video and audio scenes.
Description
Technical Field
The invention relates to the technical field of video and audio, in particular to a video and audio system, a method for detecting audio delay and a video and audio watching scene synchronization method.
Background
The novel OTT box application scene of TV that prior art provided is: the box is output to a television for playing through an HDMI interface, after HDMI audio enters the television, the audio is played through a television host through digital signal processing and D/A conversion, to a power amplifier, to a television loudspeaker for playing, and the audio is received and played, so that a large delay exists due to the requirement of signal processing, and different televisions can play audio signals from entering the television to the playing, wherein the delay is 40 ms-100 ms due to different processing schemes.
Novel OTT box is to external stereo set's application scene: in order to enhance the sound effect, a user can be externally connected with the sound box to play, and an audio 3.5mm earphone output port is arranged on a general box and connected with the sound box in a wired mode to play. The television and the external sound equipment play scenes simultaneously, the television has larger delay from the output of the box to the playing of the television loudspeaker due to the adoption of different technical solutions, the delay is also uncertain, and the delay is very small from the audio of the box entering the sound equipment to the playing, so that 2 playing devices of the television and the sound equipment are caused, the sound is asynchronous, the user experience is poor, and the wired connection sound equipment can be connected with complexity.
Disclosure of Invention
The invention provides an audio-video system, an audio delay detection method and an audio-video watching scene synchronization method, which can solve the problem of asynchronous multiple audio playing devices.
In order to achieve the above object, the present invention provides the following technical solutions:
an audio-visual system, comprising: the novel OTT box comprises a host 1, a USB detection device 2 and an MIC3, wherein the host 1 comprises a CPU, an audio player and an HDMI module, the USB detection device 2 comprises a USB interface, a sound card processor and a wireless transmitting module, the host 1 and the USB detection device 2 are connected through the USB interface, the host 1 is connected with the MIC3, and the HDMI interface is used for connecting the novel OTT box to a television;
the audio player is used for playing audio and transmitting the audio to the USB interface;
the USB interface is used for receiving the audio, transmitting the audio according to a standard USB protocol, generating a first sound signal and transmitting the first sound signal to the sound card processor;
a sound card processor for receiving the first sound signal, performing audio distribution transmission on the first sound signal by using an audio input/output channel of the sound card, generating a second sound signal and a sixth sound signal,
and transmitting the second sound signal to a USB interface, transmitting the sixth sound signal to the wireless transmitting module,
and the communication connection is used for transmission control through the USB port and the host CPU; the sound card processor is connected with the wireless transmitting module and controls the transmitting of the wireless transmitting module;
the wireless transmitting module is used for receiving a sixth sound signal, modulating and wirelessly transmitting the sixth sound signal, supporting one-to-many wireless transmission by adopting an own communication protocol, and generating a seventh sound signal which is transmitted to the wireless receiving module in the wireless sound equipment and is played;
the USB interface is used for receiving the second sound signal, transmitting the second sound signal according to a standard USB protocol, generating a third sound signal and transmitting the third sound signal to the HDMI module; the USB interface is also used for transmitting control between the host and the USB detection device;
the HDMI module is used for receiving the third sound signal, transmitting the third sound signal by using a standard HDMI protocol, generating a fourth sound signal, and transmitting the fourth sound signal to the HDMI interface;
the HDMI is used for receiving the fourth sound signal, transmitting the fourth sound signal by using a standard HDMI protocol to generate a fifth sound signal, transmitting the fifth sound signal to the HDMI of the television, and after the audio enters the television, processing the audio by the television to a television loudspeaker for playing;
MIC3, which is used to collect the fifth sound signal played by television and the seventh sound signal played by wireless sound.
Preferably, the HDMI module is connected with an HDMI interface, and the HDMI interface is used for connecting a television;
the HDMI module transmits the fourth sound signal to an HDMI interface, the HDMI interface receives the fourth sound signal, a standard HDMI protocol is used for transmitting the fourth sound signal to generate a fifth sound signal, the fifth sound signal is transmitted to an HDMI interface of a television, and after audio enters the television, the audio is processed by the television and played by a television loudspeaker.
Preferably, the wireless transmitting module receives a sixth sound signal, modulates and wirelessly transmits the sixth sound signal, supports one-to-many wireless transmission by adopting a self-contained communication protocol, generates a seventh sound signal for transmission to wireless audio playing, and the wireless receiving module of the wireless audio receives the seventh sound signal to audio playing.
Preferably, the USB detection device 2 is built in the novel OTT box or is external as a USB dongle device.
A method for detecting audio delay, which uses any one of the above video and audio systems, comprises the following specific steps:
s1, the host 1 cuts off an original audio channel;
s2, the CPU controls the audio playing device to play a preset detection audio and transmit the detection audio to the USB interface;
s3, the host 1 records the time t1 from playing to transmitting the detected audio to the USB interface;
s4, when the MIC3 collects the audio played by the television loudspeaker and completes the first audio line, the host 1 records the time t2 when the first audio line is completed, and the first audio line is: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a second sound signal, and transmits the second sound signal to the USB interface; the USB interface receives the second sound signal, transmits the second sound signal, generates a third sound signal and transmits the third sound signal to the HDMI module; the HDMI module receives a third sound signal, transmits the third sound signal, generates a fourth sound signal, and transmits the fourth sound signal to the HDMI interface; the HDMI receives the fourth sound signal, transmits the fourth sound signal, generates a fifth sound signal and transmits the fifth sound signal to a television loudspeaker for playing;
s5, the host computer 1 calculates the television time T1=t2-T1;
s6, when the MIC3 collects the audio played by the wireless audio loudspeaker after the second audio line is completed, the host computer 1 detects and records the audio time T2 of the second audio line, and the second audio line is: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a sixth sound signal, and transmits the sixth sound signal to the wireless transmitting module; the wireless receiving module receives a sixth sound signal, modulates and wirelessly transmits the sixth sound signal, generates a seventh sound signal and transmits the seventh sound signal to the wireless sound equipment for playing;
s7, the host 1 calculates a delay time t3=t1-T2.
A video and audio watching scene synchronization method uses any one of the video and audio systems, and comprises the following specific steps:
s1, the host 1 cuts off an original audio channel;
s2, the CPU controls the audio playing device to play a preset detection audio and transmit the detection audio to the USB interface;
s3, the host 1 records the time t1 from playing to transmitting the detected audio to the USB interface;
s4, when the MIC3 collects the audio played by the television loudspeaker and completes the first audio line, the host 1 records the time t2 when the first audio line is completed, and the first audio line is: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a second sound signal, and transmits the second sound signal to the USB interface; the USB interface receives the second sound signal, transmits the second sound signal, generates a third sound signal and transmits the third sound signal to the HDMI module; the HDMI module receives a third sound signal, transmits the third sound signal, generates a fourth sound signal, and transmits the fourth sound signal to the HDMI interface; the HDMI receives the fourth sound signal, transmits the fourth sound signal, generates a fifth sound signal and transmits the fifth sound signal to a television loudspeaker for playing;
s5, the host computer 1 calculates the television time T1=t2-T1;
s6, when the MIC3 collects the audio played by the wireless audio loudspeaker after the second audio line is completed, the host computer 1 detects and records the audio time T2 of the second audio line, and the second audio line is: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a sixth sound signal, and transmits the sixth sound signal to the wireless transmitting module; the wireless receiving module receives a sixth sound signal, modulates and wirelessly transmits the sixth sound signal, generates a seventh sound signal and transmits the seventh sound signal to the wireless sound equipment for playing;
s7, the host 1 calculates delay time T3=T1-T2;
and S8, when the video and audio are actually played, the host 1 controls the sound card processor of the USB detection device through the USB interface, and further controls the wireless transmitting module to transmit the seventh sound signal to the wireless sound equipment, and delay time T3 is added.
Through implementing above technical scheme, have following technical effect: the invention provides an audio-video system, an audio delay detection method and an audio-video watching scene synchronization method, which can test delay caused by processing of television audio signals, and compensate the delay when audio is transmitted to an external sound of a playing device with short delay, so that synchronous sounding of watching movies and listening to music scenes is realized. Secondly, through wireless transmitting module for the box has the function of wireless transmission multichannel audio frequency, through being connected with wireless stereo set, realizes that a plurality of loudspeaker watch the film, listens to the synchronous sound production of music scene, builds better home theater effect, improves user experience.
Drawings
Fig. 1 is a schematic system structure of an audio-visual system according to the present invention.
Detailed Description
For a better understanding of the technical solutions of the invention, embodiments provided by the invention are described in detail below with reference to the accompanying drawings.
Example 1
As shown in fig. 1, it can be understood that the audio-visual system provided in this embodiment includes: the novel OTT box comprises a host 1, a USB detection device 2 and an MIC3, wherein the host 1 comprises a CPU, an audio player and an HDMI module, the USB detection device 2 comprises a USB interface, a sound card processor and a wireless transmitting module, the host 1 and the USB detection device 2 are connected through the USB interface, the host 1 is connected with the MIC3, and the HDMI interface is used for connecting the novel OTT box to a television;
the audio player is used for playing audio and transmitting the audio to the USB interface;
the USB interface is used for receiving the audio, transmitting the audio according to a standard USB protocol, generating a first sound signal and transmitting the first sound signal to the sound card processor;
a sound card processor for receiving the first sound signal, performing audio distribution transmission on the first sound signal by using an audio input/output channel of the sound card, generating a second sound signal and a sixth sound signal,
and transmitting the second sound signal to a USB interface, transmitting the sixth sound signal to the wireless transmitting module,
and the communication connection is used for transmission control through the USB port and the host CPU; the sound card processor is connected with the wireless transmitting module and controls the transmitting of the wireless transmitting module;
the wireless transmitting module is used for receiving a sixth sound signal, modulating and wirelessly transmitting the sixth sound signal, supporting one-to-many wireless transmission by adopting an own communication protocol, and generating a seventh sound signal which is transmitted to the wireless receiving module in the wireless sound equipment and is played;
the USB interface is used for receiving the second sound signal, transmitting the second sound signal according to a standard USB protocol, generating a third sound signal and transmitting the third sound signal to the HDMI module; the USB interface is also used for communication control between the host and the USB detection device;
the HDMI module is used for receiving the third sound signal, transmitting the third sound signal by using a standard HDMI protocol, generating a fourth sound signal, and transmitting the fourth sound signal to the HDMI interface;
the HDMI is used for receiving the fourth sound signal, transmitting the fourth sound signal by using a standard HDMI protocol to generate a fifth sound signal, transmitting the fifth sound signal to the HDMI of the television, and after the audio enters the television, processing the audio by the television to a television loudspeaker for playing;
MIC3, which is used to collect the fifth sound signal played by television and the seventh sound signal played by wireless sound.
Further, the HDMI module is connected with an HDMI interface, and the HDMI interface is used for being connected with a television; the HDMI module transmits the fourth sound signal to an HDMI interface, the HDMI interface receives the fourth sound signal, a standard HDMI protocol is used for transmitting the fourth sound signal to generate a fifth sound signal, the fifth sound signal is transmitted to an HDMI interface of a television, and after audio enters the television, the audio is processed by the television and played by a television loudspeaker.
The wireless transmitting module receives a sixth sound signal, modulates and wirelessly transmits the sixth sound signal, supports one-to-many wireless transmission by adopting an own communication protocol, generates a seventh sound signal for transmission to wireless sound playing, and the wireless receiving module of the wireless sound receives the seventh sound signal to sound playing.
In this embodiment, the novel OTT box is a novel television OTT box with wireless transmission audio function and capable of compensating audio playing delay, and the USB detection device 2 in the novel OTT box is matched with the host 1 to test the audio delay of a specific television, and the wireless transmission module compensates the delay. Specifically, after the audio playing device starts playing audio, there are two audio lines:
1. the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a second sound signal, and transmits the second sound signal to the USB interface; the USB interface receives the second sound signal, transmits the second sound signal, generates a third sound signal and transmits the third sound signal to the HDMI module; the HDMI module receives a third sound signal, transmits the third sound signal, generates a fourth sound signal, and transmits the fourth sound signal to the HDMI interface; and the HDMI receives the fourth sound signal, transmits the fourth sound signal, generates a fifth sound signal and transmits the fifth sound signal to a television loudspeaker for playing.
2. The audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a sixth sound signal, and transmits the sixth sound signal to the wireless transmitting module; and the wireless transmitting module receives a sixth sound signal, modulates and wirelessly transmits the sixth sound signal, generates a seventh sound signal and transmits the seventh sound signal to the wireless sound equipment for playing.
The novel OTT box carries out the step of detecting time delay as follows: firstly, cutting off an original audio channel, and calculating time t1 from audio player to audio transmission to USB interface; collecting signals when the television loudspeaker plays audio when the first audio line is completed through the MIC3, and detecting and recording time t2 of the signals by the host 1; the normal television playing time is calculated as follows: t1=t2-T1; collecting signals when the wireless sound horn plays the audio when the second audio line is completed through the MIC3, and detecting and recording the time T2 of the signals by the host computer 1; the delay time t3=t1-T2 is calculated.
The time T2 of the wireless sound playing is a fixed value, and can be directly preset into a system without testing when in use, and the wireless sound playing is transmitted according to the two paths when in actual playing of the audio, and the first circuit is transmitted to the television, and is subjected to digital processing, digital-analog conversion and playing to a television loudspeaker after being amplified; the second path is transmitted to the wireless sound equipment for playing, and when the USB detection device 2 transmits to the wireless sound equipment, the delay time T3 obtained through calculation is added, so that synchronous sounding of a plurality of speakers for watching a film and listening to a music scene can be realized. In this embodiment, the communication protocol of the wireless transmitting module can realize one-to-many communication, and a plurality of wireless speakers can be externally connected. Further, in this embodiment, the USB detection device 2 may be built in the novel OTT box or may be external as a USB dongle device. The USB detection device 2 can be built in and can also be used as a small plug-in of USB to be connected with a novel OTT box.
Example two
As shown in fig. 1, the method for detecting audio delay provided in this embodiment uses any one of the audio-video systems described in the above embodiments, and specifically includes the following steps:
s1, the host 1 cuts off an original audio channel;
s2, the CPU controls the audio playing device to play a preset detection audio and transmit the detection audio to the USB interface;
s3, the host 1 records the time t1 from playing to transmitting the detected audio to the USB interface;
s4, when the MIC3 collects the audio played by the television loudspeaker and completes the first audio line, the host 1 records the time t2 when the first audio line is completed, and the first audio line is: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a second sound signal, and transmits the second sound signal to the USB interface; the USB interface receives the second sound signal, transmits the second sound signal, generates a third sound signal and transmits the third sound signal to the HDMI module; the HDMI module receives a third sound signal, transmits the third sound signal, generates a fourth sound signal, and transmits the fourth sound signal to the HDMI interface; the HDMI receives the fourth sound signal, transmits the fourth sound signal, generates a fifth sound signal and transmits the fifth sound signal to a television loudspeaker for playing;
s5, the host computer 1 calculates the television time T1=t2-T1;
s6, when the MIC3 collects the audio played by the wireless audio loudspeaker after the second audio line is completed, the host computer 1 detects and records the audio time T2 of the second audio line, and the second audio line is: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a sixth sound signal, and transmits the sixth sound signal to the wireless transmitting module; the wireless receiving module receives a sixth sound signal, modulates and wirelessly transmits the sixth sound signal, generates a seventh sound signal and transmits the seventh sound signal to the wireless sound equipment for playing;
s7, the host 1 calculates a delay time t3=t1-T2.
In this embodiment, the steps of detecting the delay of the novel OTT box are as follows: firstly, a host 1 cuts off an original audio channel, an audio player starts to play audio and transmits the audio to a USB interface, and the time t1 from the audio player playing the audio to the audio being transmitted to the USB interface is recorded; the MIC3 collects signals when the television loudspeaker plays audio when the first audio circuit is completed, and the host 1 detects and records the time t2; the host 1 calculates the normal television playing time as follows: t1=t2-T1; the MIC3 collects signals when the wireless sound horn plays the audio when the second audio circuit is completed, and the host computer detects and records the time T2; the host 1 calculates the delay time t3=t1-T2. Namely, the calculation of the delay is completed through the cooperation of the USB detection device 2 and the host 1.
Example III
As shown in the figure, the method for synchronizing video and audio viewing scenes provided by the embodiment uses any of the video and audio systems described in the above embodiments, and specifically comprises the following steps:
s1, the host 1 cuts off an original audio channel;
s2, the CPU controls the audio playing device to play a preset audio and transmit the audio to the USB interface;
s3, the host 1 records the time t1 from playing to transmitting the audio to the USB interface;
s4, when the MIC3 collects the audio played by the television loudspeaker and completes the first audio line, the host 1 records the time t2 when the first audio line is completed, and the first audio line is: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a second sound signal, and transmits the second sound signal to the USB interface; the USB interface receives the second sound signal, transmits the second sound signal, generates a third sound signal and transmits the third sound signal to the HDMI module; the HDMI module receives a third sound signal, transmits the third sound signal, generates a fourth sound signal, and transmits the fourth sound signal to the HDMI interface; the HDMI receives the fourth sound signal, transmits the fourth sound signal, generates a fifth sound signal and transmits the fifth sound signal to a television loudspeaker for playing;
s5, the host computer 1 calculates the television time T1=t2-T1;
s6, when the MIC3 collects the audio played by the wireless audio loudspeaker after the second audio line is completed, the host computer 1 detects and records the audio time T2 of the second audio line, and the second audio line is: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a sixth sound signal, and transmits the sixth sound signal to the wireless transmitting module; the wireless receiving module receives a sixth sound signal, modulates and wirelessly transmits the sixth sound signal, generates a seventh sound signal and transmits the seventh sound signal to the wireless sound equipment for playing;
s7, the host 1 calculates a delay time t3=t1-T2.
And S8, when the video and audio are actually played, the host 1 controls the sound card processor of the USB detection device through the USB interface, and further controls the wireless transmitting module to transmit the seventh sound signal to the wireless sound equipment, and delay time T3 is added.
In this embodiment, the steps of detecting the delay of the novel OTT box are as follows: firstly, a host 1 cuts off an original audio channel, an audio player starts to play audio and transmits the audio to a USB interface, and the time t1 from the audio player playing the audio to the audio being transmitted to the USB interface is recorded; the MIC3 collects signals when the television loudspeaker plays audio when the first audio circuit is completed, and the host 1 detects and records the time t2; the host 1 calculates the normal television playing time as follows: t1=t2-T1; the MIC3 collects signals when the wireless sound horn plays the audio when the second audio circuit is completed, and the host computer detects and records the time T2; the host 1 calculates the delay time t3=t1-T2. Namely, the calculation of the delay is completed through the cooperation of the USB detection device 2 and the host 1.
The time T2 of the wireless sound playing is a fixed value, and can be directly preset into a system without testing when in use, and the wireless sound playing is transmitted according to the two paths when in actual playing of the audio, wherein the first path is transmitted to the television, and is subjected to digital processing, digital-analog conversion and playing to a television loudspeaker after power amplification in the television; the second path is transmitted to the wireless sound equipment for playing, and when the USB detection device 2 transmits to the wireless sound equipment, the delay time T3 obtained through calculation is added, so that synchronous sounding of a plurality of speakers for watching a film and listening to a music scene can be realized. In this embodiment, the communication protocol of the wireless transmitting module can realize one-to-many communication, and a plurality of wireless speakers can be externally connected.
The audio and video system, the audio delay detection method and the audio and video viewing scene synchronization method provided by the embodiments of the present invention are described in detail above, and for those skilled in the art, according to the idea of the embodiments of the present invention, the specific implementation and application range of the embodiments of the present invention are changed, so that the content of the present invention should not be construed as limiting the invention.
Claims (4)
1. An audio-visual system, comprising: the novel OTT box comprises a host (1), a USB detection device (2) and an MIC (3), wherein the host (1) comprises a CPU, an audio player and an HDMI module, the USB detection device (2) comprises a USB interface, a sound card processor and a wireless transmitting module, the host (1) and the USB detection device (2) are connected through the USB interface, the host (1) is connected with the MIC (3), and the HDMI interface is used for connecting the novel OTT box to a television;
the audio player is used for playing audio and transmitting the audio to the USB interface;
the USB interface is used for receiving the audio, transmitting the audio according to a standard USB protocol, generating a first sound signal and transmitting the first sound signal to the sound card processor;
a sound card processor for receiving the first sound signal, performing audio distribution transmission on the first sound signal by using an audio input/output channel of the sound card, generating a second sound signal and a sixth sound signal,
and transmitting the second sound signal to a USB interface, transmitting the sixth sound signal to the wireless transmitting module,
and the communication connection is used for transmission control through the USB interface and the host CPU; the sound card processor is connected with the wireless transmitting module and controls the transmitting of the wireless transmitting module;
the wireless transmitting module is used for receiving a sixth sound signal, modulating and wirelessly transmitting the sixth sound signal, supporting one-to-many wireless transmission by adopting an own communication protocol, and generating a seventh sound signal which is transmitted to the wireless receiving module in the wireless sound equipment and is played;
the USB interface is used for receiving the second sound signal, transmitting the second sound signal according to a standard USB protocol, generating a third sound signal and transmitting the third sound signal to the HDMI module; the USB interface is also used to transfer control between the host and the USB detection device,
the HDMI module is used for receiving the third sound signal, transmitting the third sound signal by using a standard HDMI protocol, generating a fourth sound signal, and transmitting the fourth sound signal to the HDMI interface;
the HDMI is used for receiving the fourth sound signal, transmitting the fourth sound signal by using a standard HDMI protocol to generate a fifth sound signal, transmitting the fifth sound signal to the HDMI of the television, and after the audio enters the television, processing the audio by the television to a television loudspeaker for playing;
MIC (3) for collecting fifth sound signal played on television and seventh sound signal played on wireless sound;
the host (1) can cut off the original audio channel and record the transmission time of each sound signal.
2. The audio-visual system according to claim 1, wherein the USB detection device (2) is built in the novel OTT box or is external as a USB dongle device.
3. A method for detecting audio delay, characterized in that the audio delay method uses the audio-visual system according to any one of claims 1-2, comprising the following steps:
s1, cutting off an original audio channel by a host (1);
s2, the CPU controls the audio playing device to play a preset detection audio and transmit the detection audio to the USB interface;
s3, the host (1) records the time t1 from playing to transmitting the detected audio to the USB interface;
s4, when the MIC (3) collects the audio played by the television loudspeaker and finishes the first audio line, the host (1) records the time t2 for finishing the first audio line, and the first audio line is: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a second sound signal, and transmits the second sound signal to the USB interface; the USB interface receives the second sound signal, transmits the second sound signal, generates a third sound signal and transmits the third sound signal to the HDMI module; the HDMI module receives a third sound signal, transmits the third sound signal, generates a fourth sound signal, and transmits the fourth sound signal to the HDMI interface; the HDMI receives the fourth sound signal, transmits the fourth sound signal, generates a fifth sound signal and transmits the fifth sound signal to a television loudspeaker for playing;
s5, the host computer (1) calculates the television time T1=t2-T1;
s6, when the MIC (3) collects the second audio circuit to be finished, the wireless audio loudspeaker plays audio, and the host computer (1) detects and records the audio time T2 of finishing the second audio circuit, wherein the second audio circuit is as follows: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a sixth sound signal, and transmits the sixth sound signal to the wireless transmitting module; the wireless receiving module receives a sixth sound signal, modulates and wirelessly transmits the sixth sound signal, generates a seventh sound signal and transmits the seventh sound signal to the wireless sound equipment for playing;
s7, the host (1) calculates delay time T3=T1-T2.
4. A method for synchronizing video and audio viewing scenes, which is characterized by using the video and audio system according to any one of claims 1-2, and comprises the following specific steps:
s1, cutting off an original audio channel by a host (1);
s2, the CPU controls the audio playing device to play a preset detection audio and transmit the detection audio to the USB interface;
s3, the host (1) records the time t1 from playing to transmitting the detected audio to the USB interface;
s4, when the MIC (3) collects the audio played by the television loudspeaker and finishes the first audio line, the host (1) records the time t2 for finishing the first audio line, and the first audio line is: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a second sound signal, and transmits the second sound signal to the USB interface; the USB interface receives the second sound signal, transmits the second sound signal, generates a third sound signal and transmits the third sound signal to the HDMI module; the HDMI module receives a third sound signal, transmits the third sound signal, generates a fourth sound signal, and transmits the fourth sound signal to the HDMI interface; the HDMI receives the fourth sound signal, transmits the fourth sound signal, generates a fifth sound signal and transmits the fifth sound signal to a television loudspeaker for playing;
s5, the host computer (1) calculates the television time T1=t2-T1;
s6, when the MIC (3) collects the second audio circuit to be finished, the wireless audio loudspeaker plays audio, and the host computer (1) detects and records the audio time T2 of finishing the second audio circuit, wherein the second audio circuit is as follows: the audio player plays audio and transmits the audio to a USB interface, and the USB interface receives the audio, transmits the audio, generates a first sound signal and transmits the first sound signal to the sound card processor; the sound card processor receives the first sound signal, performs audio distribution and transmission on the first sound signal, generates a sixth sound signal, and transmits the sixth sound signal to the wireless transmitting module; the wireless receiving module receives a sixth sound signal, modulates and wirelessly transmits the sixth sound signal, generates a seventh sound signal and transmits the seventh sound signal to the wireless sound equipment for playing;
s7, the host (1) calculates delay time T3=T1-T2;
and S8, when the video and audio are actually played, the host (1) controls the sound card processor of the USB detection device through the USB interface, and further controls the wireless transmitting module to transmit the seventh sound signal to the wireless sound box, and delay time T3 is added.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011296567.XA CN112333512B (en) | 2020-11-18 | 2020-11-18 | Audio and video system, audio delay detection method and audio and video watching scene synchronization method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011296567.XA CN112333512B (en) | 2020-11-18 | 2020-11-18 | Audio and video system, audio delay detection method and audio and video watching scene synchronization method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112333512A CN112333512A (en) | 2021-02-05 |
| CN112333512B true CN112333512B (en) | 2024-04-12 |
Family
ID=74321282
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011296567.XA Active CN112333512B (en) | 2020-11-18 | 2020-11-18 | Audio and video system, audio delay detection method and audio and video watching scene synchronization method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112333512B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103916683A (en) * | 2014-04-21 | 2014-07-09 | 深圳市兰丁科技有限公司 | OTT device with karaoke function |
| CN204669601U (en) * | 2015-06-23 | 2015-09-23 | 上海艾斯玛特智能科技有限公司 | A kind of full Wireless high fidelity sound system |
| CN206181272U (en) * | 2016-10-14 | 2017-05-17 | 深圳市网今科技有限公司 | Circuit structure of intelligence box all -in -one |
| KR101976355B1 (en) * | 2018-06-15 | 2019-05-08 | 주식회사 오투오 | Set-top box external-connection type AI speaker device, and AI speaker system using the same |
| CN111757171A (en) * | 2020-07-03 | 2020-10-09 | 海信视像科技股份有限公司 | Display device and audio playing method |
| CN111836097A (en) * | 2020-07-24 | 2020-10-27 | 深圳市亿联智能有限公司 | Intelligent multimedia device for listening to television through Bluetooth and communication method |
| CN213693982U (en) * | 2020-11-18 | 2021-07-13 | 深圳巴金科技有限公司 | Audio-video system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8971546B2 (en) * | 2011-10-14 | 2015-03-03 | Sonos, Inc. | Systems, methods, apparatus, and articles of manufacture to control audio playback devices |
| US10931909B2 (en) * | 2018-09-18 | 2021-02-23 | Roku, Inc. | Wireless audio synchronization using a spread code |
| US11245985B2 (en) * | 2019-03-27 | 2022-02-08 | Microsoft Technology Licensing, Llc | Architecture for USB-synchronized array of speakers |
-
2020
- 2020-11-18 CN CN202011296567.XA patent/CN112333512B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103916683A (en) * | 2014-04-21 | 2014-07-09 | 深圳市兰丁科技有限公司 | OTT device with karaoke function |
| CN204669601U (en) * | 2015-06-23 | 2015-09-23 | 上海艾斯玛特智能科技有限公司 | A kind of full Wireless high fidelity sound system |
| CN206181272U (en) * | 2016-10-14 | 2017-05-17 | 深圳市网今科技有限公司 | Circuit structure of intelligence box all -in -one |
| KR101976355B1 (en) * | 2018-06-15 | 2019-05-08 | 주식회사 오투오 | Set-top box external-connection type AI speaker device, and AI speaker system using the same |
| CN111757171A (en) * | 2020-07-03 | 2020-10-09 | 海信视像科技股份有限公司 | Display device and audio playing method |
| CN111836097A (en) * | 2020-07-24 | 2020-10-27 | 深圳市亿联智能有限公司 | Intelligent multimedia device for listening to television through Bluetooth and communication method |
| CN213693982U (en) * | 2020-11-18 | 2021-07-13 | 深圳巴金科技有限公司 | Audio-video system |
Non-Patent Citations (3)
| Title |
|---|
| Software-Defined Multicast for Over-the-Top and Overlay-based Live Streaming in ISP Networks;Rückert J.等;《J Netw Syst Manage (2015)》;20150430;全文 * |
| 基于FPGA的频谱音乐播放显示系统;李乐吟等;《数码世界》;20180703(第5期);全文 * |
| 殷春燕.WiFi智能音响系统体验远超蓝牙.《集成电路应用》.2013,(第7期),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112333512A (en) | 2021-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8649538B2 (en) | Hearing aid having multiple sound inputs and methods therefor | |
| US10178345B2 (en) | Apparatus, systems and methods for synchronization of multiple headsets | |
| US7483538B2 (en) | Wireless and wired speaker hub for a home theater system | |
| US8477970B2 (en) | Systems, methods, and apparatus for controlling sounds in a three-dimensional listening environment | |
| US8565458B2 (en) | Media player and adapter for providing audio data to hearing aid | |
| US20090245548A1 (en) | Audio apparatus for wirelessly transmitting audio signal, audio system, and audio signal transmission method thereof | |
| KR20170009650A (en) | Method and apparatus for processing audio signal | |
| CN106465031A (en) | Sound apparatus, television receiver, speaker device, audio signal adjustment method, program, and recording medium | |
| WO2014040667A1 (en) | Audio system, method for sound reproduction, audio signal source device, and sound output device | |
| US9438963B2 (en) | Wireless audio transmission method and device | |
| KR20140146491A (en) | Audio System, Audio Device and Method for Channel Mapping Thereof | |
| CN213693982U (en) | Audio-video system | |
| CN112333512B (en) | Audio and video system, audio delay detection method and audio and video watching scene synchronization method | |
| US7339492B1 (en) | Multi-media wireless system | |
| US20080192952A1 (en) | Multichannel Wireless System | |
| US11589180B2 (en) | Electronic apparatus, control method thereof, and recording medium | |
| JP6112602B2 (en) | Television broadcasting system and terminal device | |
| KR101392933B1 (en) | System for supply 3-dimension sound | |
| US20080101632A1 (en) | Wireless multi-channel audio system | |
| CN204104122U (en) | Wireless sound system and sound module applicable to same | |
| CN111263272B (en) | Audio signal shunting and returning method and system | |
| KR20110120402A (en) | Apparatus and method for signal control of hometheater system | |
| CN100382453C (en) | Short distance wireless tranmission method and system for audio and video signal in audio and video system | |
| KR100923872B1 (en) | Audio signal output apparatus of home theater system and that of using signal output method | |
| KR101782980B1 (en) | Wireless transceiving system and method between mobile device and channel speaker |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |