CN115802087A - Sound and picture synchronous processing method and related equipment thereof - Google Patents
Sound and picture synchronous processing method and related equipment thereof Download PDFInfo
- Publication number
- CN115802087A CN115802087A CN202211368593.8A CN202211368593A CN115802087A CN 115802087 A CN115802087 A CN 115802087A CN 202211368593 A CN202211368593 A CN 202211368593A CN 115802087 A CN115802087 A CN 115802087A
- Authority
- CN
- China
- Prior art keywords
- audio
- playing
- sound
- signal
- time point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The embodiment of the application discloses a sound and picture synchronous processing method, which is applied to audio-video playing equipment with external audio playing equipment and comprises the following steps: sending a target sound signal playing instruction; playing a target sound signal through an internal audio playing structure and sending a first audio signal; playing the target sound signal through external audio playing equipment and sending out a second audio signal; receiving a first audio signal and recording the receiving time as a first time point; receiving a second audio signal, and recording the receiving time as a second time point; and performing sound and picture synchronization adjustment based on the difference between the first time point and the second time point. The sound and picture delay condition of the external audio playing device is adjusted by the above mode, the consistency of the audio signal and the video signal output by the external audio playing device and the audio and video playing device in the using process is ensured, and the audition experience of a user is improved.
Description
Technical Field
The application belongs to the field of data processing, and particularly relates to a sound and picture synchronous processing method and related equipment.
Background
Television (Television, TV) refers to a device that uses electronic technology to deliver moving image pictures and audio signals, i.e., a Television receiver, and is also an important broadcast and video communication tool. As a commonly used audio-visual device, a television is used, and the most common scenario is to output images and sounds so that a user can watch and listen to the images and sounds simultaneously. Therefore, the images and sounds need to be output synchronously to provide a better user experience.
When the television is used, the television can be matched with external audio playing equipment for use, such as HDMI audio output, optical fiber audio output, bluetooth audio output and the like, the audio of the television is output to the external audio equipment through different channels, and the external audio playing equipment plays corresponding audio.
However, after the processing of the external audio device, the time difference between the audio played by the external device and the image and audio played by the television itself becomes large. Taking the bluetooth audio output as an example, when the bluetooth audio is transmitted, the audio is encoded first, then transmitted to the bluetooth audio playing device through the bluetooth, and then decoded and played. Due to the influence of the factors, the audio playing process of the bluetooth device usually generates higher delay, which causes the problem of asynchronous sound and picture.
Disclosure of Invention
A first aspect of the embodiments of the present application provides a sound and picture synchronization processing method, where the method is applied to a video playback device with an external audio playback device, and includes:
sending a target sound signal playing instruction, wherein the target sound signal playing instruction is used for indicating an internal audio playing structure of the audio-video playing equipment and the external audio playing equipment to play a target sound signal simultaneously;
playing the target sound signal through the internal audio playing structure, and sending out a first audio signal;
playing the target sound signal through the external audio playing equipment and sending out a second audio signal;
receiving the first audio signal, and recording the receiving time as a first time point;
receiving the second audio signal, and recording the receiving time as a second time point;
and performing sound and picture synchronization adjustment based on the difference between the first time point and the second time point.
According to the sound and picture synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the audio-video playing device is a television device.
According to the sound-picture synchronization processing method provided by the first aspect of the embodiment of the present application, optionally, the receiving the first audio signal includes:
receiving the first audio signal by a microphone;
the receiving the second audio signal comprises:
receiving the second audio signal by the microphone.
According to the sound-picture synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the performing sound-picture synchronization adjustment based on the difference between the first time point and the second time point includes:
judging whether the difference value between the first time point and the second time point is larger than a preset value or not;
if the difference value is larger than a preset value, carrying out the sound and picture synchronous adjustment process;
and if the difference is less than or equal to the preset value, the process of synchronously adjusting the sound and the picture is not carried out.
According to the sound-picture synchronization processing method provided by the first aspect of the embodiment of the present application, optionally, the process of sound-picture synchronization adjustment includes:
and adding signal delay of difference duration to the local signal processing process of the audio-video playing equipment, wherein the difference duration is equal to the difference between the first time point and the second time point.
According to the sound-picture synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the sound-picture synchronization adjusting process includes:
and adjusting the audio decoding mode of the external audio playing equipment.
According to the sound-picture synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the microphone is disposed on a control device of the audio-video playing device.
A second aspect of the embodiments of the present application provides a sound and picture synchronization processing device, where the device is used in association with a video and audio playing device including an external audio playing device, and includes:
the transmitting unit is used for transmitting a target sound signal playing instruction, and the target sound signal playing instruction is used for indicating the internal audio playing structure of the audio-video playing equipment and the external audio playing equipment to play a target sound signal simultaneously;
the first audio playing unit is used for playing the target sound signal through the internal audio playing structure and sending out a first audio signal;
the second audio playing unit is used for playing the target sound signal through the external audio playing equipment and sending out a second audio signal;
the first receiving unit is used for receiving the first audio signal and recording the receiving time as a first time point;
the second receiving unit is used for receiving the second audio signal and recording the receiving time as a second time point;
and the adjusting unit is used for carrying out sound and picture synchronization adjustment on the basis of the difference value between the first time point and the second time point.
Based on the audio-visual synchronous processing device provided in the second aspect of the embodiment of the present application, optionally, the audio-visual playing device is a television device.
Based on the sound and picture synchronization processing apparatus provided in the second aspect of the embodiment of the present application, optionally, the first receiving unit is specifically configured to: receiving the first audio signal by a microphone;
the second receiving unit is specifically configured to: receiving the second audio signal by the microphone.
Based on the sound-picture synchronization processing apparatus provided in the second aspect of the embodiment of the present application, optionally, the adjusting unit is specifically configured to:
judging whether the difference value between the first time point and the second time point is larger than a preset value or not;
if the difference value is larger than a preset value, carrying out the sound and picture synchronous adjustment process;
and if the difference is less than or equal to the preset value, the process of synchronously adjusting the sound and the picture is not carried out.
Based on the sound-picture synchronization processing apparatus provided in the second aspect of the embodiment of the present application, optionally, the adjusting unit is specifically configured to:
and increasing the signal delay of the difference duration in the local signal processing process of the video and audio playing equipment, wherein the difference duration is equal to the difference between the first time point and the second time point.
Based on the sound and picture synchronization processing apparatus provided in the second aspect of the embodiment of the present application, optionally, the adjusting unit is specifically configured to:
and adjusting the audio decoding mode of the external audio playing equipment.
Based on the audio-visual synchronous processing device provided in the second aspect of the embodiment of the present application, optionally, the microphone is disposed on the control device of the audio-visual playing device.
A third aspect of the embodiments of the present application provides an audio/video playback device, including:
the system comprises a processor, a memory, an internal audio playing structure and external audio playing equipment;
the memory is a transient memory or a persistent memory;
the processor is configured to communicate with the memory, and control the internal audio playing structure and the external audio playing device on the audio-visual playing device to execute the instruction operations in the memory so as to execute the method according to any one of the first aspect of the embodiments of the present application.
A fourth aspect of embodiments of the present application provides a computer-readable storage medium, including instructions, which, when executed on a computer, cause the computer to perform the method according to any one of the first aspect of embodiments of the present application.
According to the technical scheme, the embodiment of the application has the following advantages: the embodiment of the application provides a sound and picture synchronous processing method, which is applied to a video and audio playing device with an external audio playing device, and comprises the following steps: sending a target sound signal playing instruction, wherein the target sound signal playing instruction is used for indicating an internal audio playing structure of the audio-video playing equipment and the external audio playing equipment to play a target sound signal simultaneously; playing the target sound signal through the internal audio playing structure, and sending out a first audio signal; playing the target sound signal through the external audio playing equipment and sending out a second audio signal; receiving the first audio signal, and recording the receiving time as a first time point; receiving the second audio signal, and recording the receiving time as a second time point; and performing sound and picture synchronization adjustment based on the difference between the first time point and the second time point. The sound and picture delay condition of the external audio playing device is adjusted by the above mode, the consistency of the audio signal and the video signal output by the external audio playing device and the audio and video playing device in the using process is ensured, and the audition experience of a user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only the embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts. It is to be understood that the drawings provided in this section are only for the purpose of better understanding the present solution and are not to be construed as limiting the present application.
Fig. 1 is a schematic flowchart of an embodiment of a sound-picture synchronization processing method provided in the present application;
FIG. 2 is another schematic flow chart of an embodiment of a method for processing audio and video synchronization provided in the present application;
fig. 3 is a schematic structural diagram of an embodiment of a sound-picture synchronization processing method provided in the present application;
fig. 4 is a schematic structural diagram of an embodiment of an audio-video playback device provided in the present application.
Detailed Description
In order to make the technical solutions in the embodiments of the present application better understood, the technical solutions in the embodiments of the present application are clearly and completely described below, and it is obvious that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort shall fall within the protection scope of the present application. Meanwhile, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness of description.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present application and in the drawings described above, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
As a commonly used audio-visual device, a television is used, and the most common scenario is to output images and sounds so that a user can watch and listen to the images and sounds simultaneously. Therefore, the images and the sounds need to be output synchronously so as to provide better use experience for users. When the television is used, the television can be matched with external audio playing equipment for use, such as HDMI audio output, optical fiber audio output, bluetooth audio output and the like, the audio of the television is output to the external audio equipment through different channels, and the external audio playing equipment plays corresponding audio.
However, after the processing of the external audio device, the time difference between the audio played by the external device and the image and audio played by the television itself becomes large. Taking the bluetooth audio output as an example, during bluetooth audio transmission, the audio can be encoded first, and then transmitted to the bluetooth audio playing device through bluetooth, and then decoded and played. Through the influence of these factors, a higher delay is generally generated, which is about 200 milliseconds, and this delay effect may cause the user to feel more obvious about the phenomenon of audio-video asynchronism, which affects the user experience, and to solve this problem, the first aspect of the embodiment of the present application provides a method for processing audio-video synchronization, please refer to fig. 1, which includes: step 101 to step 106.
101. And sending a target sound signal playing instruction.
Specifically, before explaining the method, it is necessary to introduce an implementation environment of the present solution, and the present solution may be applied to any device having an audio/video playing function in an actual implementation process, and the particular device may be a device such as a television, a personal computer, an IPAD, a projector, or even a smart phone, or an audio/video playing device composed of a television and a set top box, and only the device needs to be a device that can be externally connected to an audio playing device and has an audio/video playing function, and the specific location is not limited herein. The type of the external audio playing device connected to the audio and video playing device may also be determined according to actual situations, such as bluetooth sound or bluetooth headset, which is not limited herein.
In this step, the user can select to perform the sound and picture processing process through a specific application or an interface provided by the audio-video playing device, so as to activate the sending process of the target sound signal playing instruction to the internal audio playing structure and the external audio playing device. The target sound signal playing instruction sent in this step is used for indicating the internal audio playing structure of the audio-video playing device and the external audio playing device to simultaneously play the target sound signal, that is, the indicating device body and the external device play a certain specific sound at the same time, so as to simulate the audio-video playing process under the general condition, so as to support the judgment of whether the audio and video are not synchronous, and support the processing process of the audio and video not synchronous. The specific played target sound signal should be stored in association with the instruction, and the target sound signal should have a specific frequency and duration for the subsequent identification process, and the specific form may be determined according to the actual situation, and is not limited herein.
102. And playing the target sound signal through the internal audio playing structure to send out a first audio signal.
Specifically, the target sound signal is played through the internal audio playing structure to emit a first audio signal, the internal audio playing structure is a loudspeaker or a loudspeaker and other structures of the audio-video playing device, when the target sound signal is played through the internal audio playing structure, additional data processing is not needed, the playing process can be directly carried out, and therefore the time difference between the emitted first audio signal and the instruction is small. In addition, for the video and audio playing device itself, the audio playing time and the video playing time have higher consistency, and it can be considered that there is no time difference or the time difference is smaller. Taking a television device as an example, the delay standard of images and sounds is usually controlled within 50 milliseconds, so that the time of emitting the first audio signal can be considered as the time of playing the picture.
103. And playing the target sound signal through the external audio playing equipment and sending out a second audio signal.
Specifically, the target sound signal is played through the external audio playing device, and a second audio signal is emitted. The external audio playing device is a device which is in data connection with the audio-video playing device in advance and has a control relation, and when the audio-video playing device plays audio signals in media signals through the internal audio playing structure in a general working process, electronic data of the audio signals can be transmitted to the external audio playing device and is played synchronously by the external audio playing device. However, the external audio playing device needs to encode the audio first in the playing process, and then transmit the encoded audio to the external audio playing device for decoding, which may generate unnecessary delay, and easily cause a large difference between the audio signal played by the external audio playing device and the time point of the command, so that a time difference may exist between the second audio signal and the first audio signal.
104. Receiving a first audio signal and recording the receiving time as a first time point;
specifically, a first audio signal is received, and the receiving time is recorded as a first time point. In the actual implementation process, the audio receiving device can be used, specifically, the audio receiving device is used for receiving audio through a microphone of the audio-video playing device, and a first time point of receiving the first audio signal is recorded so as to compare a time difference with a time when the second audio signal is sent out.
105. Receiving the second audio signal, and recording the receiving time as a second time point;
specifically, the second audio signal is received, and the receiving time is recorded as a second time point, and the receiving process of the second audio signal is similar to the receiving process of the first audio signal, which is not described herein again specifically, it is worth noting that there may be a superposition of the first audio signal and the second audio signal when the second audio signal is received, and at this time, the audio recognition process should be correspondingly processed so as to accurately recognize the second audio signal.
106. And performing sound and picture synchronization adjustment based on the difference between the first time point and the second time point.
Specifically, the sound and picture synchronization adjustment is performed based on the difference between the first time point and the second time point, specifically, if the difference between the first time point and the second time point is too large, the sound and picture synchronization adjustment process may be performed, and if the difference is small, the process may be ended without performing corresponding adjustment.
For the condition that the adjustment is needed, the sound and picture synchronization adjustment can be performed in different modes, for example, a certain time delay can be set for the audio and video processing and playing process of the audio and video playing device, so that the audio and picture synchronization adjusting device can cooperate with the processing time of the external audio playing device to achieve the processing effect of consistent sound and picture. In addition, the delay may also be reduced by changing the audio decoding method of the external audio playing device, and the specific method may be determined according to the actual situation, which is not limited herein.
It can be understood that, after the sound and picture synchronization adjustment process is performed, the processes from the step 101 to the step 105 may be performed again, and the difference between the first time point and the second time point is obtained again, so as to determine whether the sound and picture synchronization adjustment process reaches the predetermined effect, and if not, the sound and picture synchronization adjustment process may be adjusted again, so as to ensure the processing effect.
According to the technical scheme, the embodiment of the application has the following advantages: the embodiment of the application provides a sound and picture synchronous processing method, which is applied to a video and audio playing device with an external audio playing device, and comprises the following steps: sending a target sound signal playing instruction, wherein the target sound signal playing instruction is used for indicating an internal audio playing structure of the audio-video playing equipment and the external audio playing equipment to play a target sound signal simultaneously; playing the target sound signal through the internal audio playing structure and sending out a first audio signal; playing the target sound signal through the external audio playing equipment and sending out a second audio signal; receiving the first audio signal, and recording the receiving time as a first time point; receiving the second audio signal, and recording the receiving time as a second time point; and performing sound and picture synchronization adjustment based on the difference between the first time point and the second time point. The sound and picture delay condition of the external audio playing device is adjusted by the above mode, the consistency of the audio signal and the video signal output by the external audio playing device and the audio and video playing device in the using process is ensured, and the audition experience of a user is improved.
To facilitate the use of the method in practical implementation, the present application also provides a more detailed embodiment of an alternative implementation, and referring to fig. 2, an embodiment of the present application includes: step 101-step 105.
201. And sending a target sound signal playing instruction.
Specifically, in this embodiment, the implementation subject is taken as an example of a television device, and a user can control a television to enter a sound and picture adjusting process through a television remote controller during using the television, so as to execute the method.
202. And playing the target sound signal through the internal audio playing structure to send out a first audio signal.
203. And playing the target sound signal through the external audio playing equipment, and sending out a second audio signal.
Specifically, the steps 202 to 203 are similar to the steps 102 to 103 in the embodiment of fig. 1, and reference may be made to the above-mentioned details, which are not repeated herein.
204. The first audio signal is received through a microphone, and the receiving time is recorded as a first time point.
205. And receiving the second audio signal through the microphone, and recording the receiving time as a second time point.
Specifically, the steps 204 to 205 may be completed by a microphone disposed on the television apparatus, wherein the microphone for receiving the sound may also be disposed on a remote controller corresponding to the television apparatus, or may be an independent apparatus having a data connection with the television apparatus, which may be determined according to actual circumstances and is not limited herein.
206. And judging whether the difference value between the first time point and the second time point is greater than a preset value or not.
Specifically, a difference between the first time point and the second time point is calculated, and a relationship between the difference and a preset value is compared, where the preset value is preset by a worker to indicate that the maximum duration of the acceptable sound-picture delay is long, and the smaller the preset value is, the better the sound-picture synchronization effect is, but the higher the precision requirement on the adjustment process is, generally speaking, the value may be set to 50ms, and the specific value setting may be determined according to actual conditions, and is not limited herein. If the difference between the first time point and the second time point is less than or equal to the preset value, it indicates that the delay is in a reasonable range, step 207 is executed, and the audio-video synchronization adjustment process is not performed. If the difference between the first time point and the second time point is greater than the predetermined value, step 208 is executed to perform a sound-picture synchronization adjustment process.
207. The sound and picture synchronization adjustment process is not performed.
Specifically, if the difference between the first time point and the second time point is less than or equal to the preset value, it indicates that the amplitude of the sound-picture asynchronism in the current environment is small, adjustment is not needed, the sound-picture synchronization adjustment process may not be performed, and the process may be ended.
208. And carrying out a sound and picture synchronous adjustment process.
Specifically, the actually implementable sound-picture synchronization adjustment process includes two ways, which are described below:
(1) And adding signal delay of difference duration to the local signal processing process of the audio-video playing equipment, wherein the difference duration is equal to the difference between the first time point and the second time point.
The audio and video signals are output after the difference duration in the processing process of the audio and video playing equipment, but the delay is not added to the external audio playing equipment, and then the audio and video output by the audio and video playing equipment are kept consistent with the audio output by the external audio playing equipment in terms of time by adding the processing delay to the local signal processing process.
(2) And adjusting the audio decoding mode of the external audio playing equipment.
Specifically, in the actual implementation process, the external audio device may use some coding modes that have better obtained audio effects but are more complex to process, and this mode, although having better obtained sound effects, may cause higher delay, and thus may be switched to a coding mode that has a common processing effect but is simpler and faster, for example. A common bluetooth Audio Coding format is SBC (Sub-band Coding)/AAC (Advanced Audio Coding), and the Low-delay bluetooth Audio Coding format is aptX LL (aptX Low Latency, low-delay lossless transmission technology)/LC 3 (Low-complexity communication Codec)/LHDC (Low-Latency Hi-Definition Audio Coding), which can be converted from a conventional Coding method into a Low-delay Coding method in an actual implementation process, so as to reduce the delay of an external Audio playing device in the playing process, thereby ensuring a consistent sound and picture effect.
The foregoing describes a sound and image synchronization processing method provided in the present application, and to support the implementation of the foregoing embodiments, the present application further provides a sound and image synchronization processing device, where the device is used in association with a video and audio playing device including an external audio playing device, please refer to fig. 3, and an embodiment of the sound and image synchronization processing device provided in the present application includes:
a sending unit 301, configured to send a target sound signal playing instruction, where the target sound signal playing instruction is used to instruct an internal audio playing structure of the audio-video playing device and the external audio playing device to play a target sound signal at the same time;
a first audio playing unit 302, configured to play the target sound signal through the internal audio playing structure, and send out a first audio signal;
a second audio playing unit 303, configured to play the target sound signal through the external audio playing device, and send a second audio signal;
a first receiving unit 304, configured to receive the first audio signal, and record a receiving time as a first time point;
a second receiving unit 305, configured to receive the second audio signal and record a receiving time as a second time point;
an adjusting unit 306, configured to perform sound-picture synchronization adjustment based on a difference between the first time point and the second time point.
Optionally, the video and audio playing device is a television device.
Optionally, the first receiving unit is specifically configured to: receiving the first audio signal by a microphone;
the second receiving unit is specifically configured to: receiving the second audio signal through the microphone.
Optionally, the adjusting unit is specifically configured to:
judging whether the difference value between the first time point and the second time point is greater than a preset value or not;
if the difference value is larger than a preset value, carrying out the sound and picture synchronous adjustment process;
and if the difference is less than or equal to the preset value, the process of synchronously adjusting the sound and the picture is not carried out.
Optionally, the adjusting unit is specifically configured to:
and increasing the signal delay of the difference duration in the local signal processing process of the video and audio playing equipment, wherein the difference duration is equal to the difference between the first time point and the second time point.
Optionally, the adjusting unit is specifically configured to:
and adjusting the audio decoding mode of the external audio playing equipment.
Optionally, the microphone is disposed on a control device of the video playback device.
In this embodiment, the flow executed by each unit in the audio-video synchronization processing apparatus is similar to the method flow described in the embodiment corresponding to fig. 1, and is not described herein again.
Fig. 4 is a schematic structural diagram of an audio-visual playback device according to an embodiment of the present disclosure, where the audio-visual playback device 400 may include one or more processors 401 and a memory 402, where the memory 402 stores one or more application programs or data.
In this embodiment, the specific functional module division in the processor 401 may be similar to the functional module division manner of each unit described in the foregoing fig. 3, and is not described again here.
The audio/video playing device 400 further includes an internal audio playing structure 403 and an external audio playing device 404; the internal audio playing structure 403 may be a speaker or a loudspeaker, and the external audio playing device 404 may be an audio playing device controlled by the processor 401, such as a bluetooth sound box or a bluetooth headset, and having a data connection with the audio/video playing device 400.
The processor 401 may perform the operations performed by the sound-picture synchronization processing method in the embodiment shown in fig. 1 or fig. 2, which are not described herein again.
The embodiment of the application also provides a computer storage medium, which is used for storing computer software instructions for the sound-picture synchronous processing method and comprises a program for executing the sound-picture synchronous processing method.
The sound and picture synchronization processing method may be the sound and picture synchronization processing method described in the foregoing fig. 1 or fig. 2.
An embodiment of the present application further provides a computer program product, where the computer program product includes computer software instructions, and the computer software instructions may be loaded by a processor to implement a flow of the sound and picture synchronization processing method in any one of fig. 1 and fig. 2.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, equivalent circuit transformations, partitions of units, and logic functions may be merely one type of partitioning, and in actual implementation, there may be other partitioning manners, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The above description is intended to be illustrative of the preferred embodiment of the present invention and should not be taken as limiting the invention, but rather, the invention is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.
Claims (10)
1. A sound and picture synchronous processing method is applied to audio-video playing equipment with external audio playing equipment, and comprises the following steps:
sending a target sound signal playing instruction, wherein the target sound signal playing instruction is used for indicating an internal audio playing structure of the audio-video playing device and the external audio playing device to simultaneously play a target sound signal;
playing the target sound signal through the internal audio playing structure and sending out a first audio signal;
playing the target sound signal through the external audio playing equipment and sending out a second audio signal;
receiving the first audio signal, and recording the receiving time as a first time point;
receiving the second audio signal, and recording the receiving time as a second time point;
and performing sound and picture synchronization adjustment based on the difference between the first time point and the second time point.
2. The sound-picture synchronous processing method according to claim 1, wherein the video-audio playing device is a television device.
3. The sound-picture synchronization processing method according to claim 1, wherein the receiving the first audio signal comprises:
receiving the first audio signal by a microphone;
the receiving the second audio signal comprises:
receiving the second audio signal through the microphone.
4. The sound-picture synchronization processing method according to claim 1, wherein the adjusting of sound-picture synchronization based on the difference between the first time point and the second time point comprises:
judging whether the difference value between the first time point and the second time point is greater than a preset value or not;
if the difference value is larger than a preset value, carrying out the sound and picture synchronous adjustment process;
and if the difference value is less than or equal to the preset value, the sound and picture synchronous adjustment process is not carried out.
5. The sound-picture synchronization processing method according to claim 1, wherein the process of sound-picture synchronization adjustment comprises:
and adding signal delay of difference duration to the local signal processing process of the audio-video playing equipment, wherein the difference duration is equal to the difference between the first time point and the second time point.
6. The sound-picture synchronization processing method according to claim 1, wherein the sound-picture synchronization adjusting process includes:
and adjusting the audio decoding mode of the external audio playing equipment.
7. The sound-picture synchronous processing method according to claim 3, wherein the microphone is disposed on a control device of the video playback device.
8. A sound and picture synchronous processing device, which is used in association with an audio-video playing device including an external audio playing device, comprises:
the transmitting unit is used for transmitting a target sound signal playing instruction, and the target sound signal playing instruction is used for indicating the internal audio playing structure of the audio-video playing equipment and the external audio playing equipment to play a target sound signal simultaneously;
the first audio playing unit is used for playing the target sound signal through the internal audio playing structure and sending out a first audio signal;
the second audio playing unit is used for playing the target sound signal through the external audio playing equipment and sending out a second audio signal;
the first receiving unit is used for receiving the first audio signal and recording the receiving time as a first time point;
the second receiving unit is used for receiving the second audio signal and recording the receiving time as a second time point;
and the adjusting unit is used for carrying out sound and picture synchronization adjustment on the basis of the difference value between the first time point and the second time point.
9. An audio-visual playing device, comprising:
the system comprises a processor, a memory, an internal audio playing structure and an external audio playing device;
the memory is a transient storage memory or a persistent storage memory;
the processor is configured to communicate with the memory, and control the internal audio playback mechanism and the external audio playback device on the av playback device to execute the instruction operations in the memory to perform the method according to any one of claims 1 to 7.
10. A computer-readable storage medium comprising instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211368593.8A CN115802087A (en) | 2022-11-03 | 2022-11-03 | Sound and picture synchronous processing method and related equipment thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211368593.8A CN115802087A (en) | 2022-11-03 | 2022-11-03 | Sound and picture synchronous processing method and related equipment thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115802087A true CN115802087A (en) | 2023-03-14 |
Family
ID=85435204
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211368593.8A Pending CN115802087A (en) | 2022-11-03 | 2022-11-03 | Sound and picture synchronous processing method and related equipment thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115802087A (en) |
-
2022
- 2022-11-03 CN CN202211368593.8A patent/CN115802087A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10953327B2 (en) | Methods, apparatus and systems for optimizing communication between sender(s) and receiver(s) in computer-mediated reality applications | |
| US10178345B2 (en) | Apparatus, systems and methods for synchronization of multiple headsets | |
| US9788114B2 (en) | Acoustic device for streaming audio data | |
| US9736614B2 (en) | Augmenting existing acoustic profiles | |
| JP2015056905A (en) | Reachability of sound | |
| CN109379613A (en) | Audio-visual synchronization method of adjustment, TV, computer readable storage medium and system | |
| US11564050B2 (en) | Audio output apparatus and method of controlling thereof | |
| CN103702163A (en) | Method and system of dynamically outputting audio file and television | |
| CN111447519A (en) | Smart speaker, interaction method based on smart speaker and program product | |
| KR20200085595A (en) | Contents reproducing apparatus and method thereof | |
| CN114915874B (en) | Audio processing method, device, equipment and medium | |
| CN108650592B (en) | Method for realizing neck strap type surround sound and stereo control system | |
| CN115802087A (en) | Sound and picture synchronous processing method and related equipment thereof | |
| KR20080011457A (en) | Music accompaniment apparatus having delay control function of audio or video signal and method for controlling the same | |
| CN103327364A (en) | Wireless transmission method and device for audio and video playing | |
| CN115767158A (en) | Synchronous playing method, terminal equipment and storage medium | |
| US20200092639A1 (en) | Communication apparatus, communication method, program, and telepresence system | |
| KR20200080369A (en) | Display apparatus, method for controlling thereof and recording media thereof | |
| CN213693982U (en) | Audio-video system | |
| JP2007235519A (en) | Method and system for video sound synchronization | |
| CN113077799A (en) | Decoder arrangement with two audio links | |
| WO2018232327A1 (en) | Methods, apparatus and systems for optimizing communication between sender(s) and receiver(s) in computer-mediated reality applications | |
| CN213485081U (en) | Sound system with HDMI interface | |
| US11347473B2 (en) | Display device | |
| CN113129915B (en) | Audio sharing method, device, equipment, storage medium and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |