WO2017177524A1 - Procédé et dispositif de synchronisation de lecture audio et vidéo - Google Patents

Procédé et dispositif de synchronisation de lecture audio et vidéo Download PDF

Info

Publication number
WO2017177524A1
WO2017177524A1 PCT/CN2016/084944 CN2016084944W WO2017177524A1 WO 2017177524 A1 WO2017177524 A1 WO 2017177524A1 CN 2016084944 W CN2016084944 W CN 2016084944W WO 2017177524 A1 WO2017177524 A1 WO 2017177524A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
time
external sound
initial
sound device
Prior art date
Application number
PCT/CN2016/084944
Other languages
English (en)
Chinese (zh)
Inventor
柯杰燕
戚炎兴
孟梁军
Original Assignee
深圳Tcl新技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl新技术有限公司 filed Critical 深圳Tcl新技术有限公司
Publication of WO2017177524A1 publication Critical patent/WO2017177524A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams

Definitions

  • the present invention relates to the field of computer multimedia technologies, and in particular, to a method and apparatus for synchronous playback of audio and video.
  • the playing device can allow the user to adjust according to the delay of the external sound playing device, so that the playing sound is synchronized with the video.
  • the user often adjusts the confirmation manually according to the video and the sound step by step, and the adjustment method is cumbersome and affects the user experience.
  • the main object of the present invention is to provide a method and device for synchronous playback of audio and video, which aims to automatically adjust the synchronization of audio and video images when playing audio of a multimedia file through an external sound device.
  • a method for synchronous playback of audio and video includes the following steps:
  • the second audio time segment is marked and compared with the first audio to obtain an initial time period for receiving the external audio device to play the first audio, according to the initial time period. And determining, by the first initial time and the first time parameter, a delay time when the external sound device plays audio:
  • the initial value of i is 1, and i is less than or equal to N;
  • the present invention provides another method for determining audio and video synchronous playback, including:
  • the present invention further provides an apparatus for determining audio and video synchronous playback, and the apparatus for synchronously playing audio and video includes:
  • a first acquiring module configured to acquire device information of the external sound device when the audio of the multimedia file is played by the external sound device
  • a determining module configured to search a preset database according to the device information, and determine a delay time when the external sound device plays audio, where the preset database includes the device information and the delay time Correspondence relationship;
  • an adjustment module configured to adjust a video of the multimedia file according to the delay time, so that the audio is played synchronously with the video.
  • the device information of the external sound device is acquired; and the preset database is searched according to the device information, and the delay of playing the audio by the external sound device is determined.
  • the preset database includes a correspondence between the device information and the delay time; adjusting a video of the multimedia file according to the delay time, so that the audio is played synchronously with the video.
  • FIG. 1 is a schematic flow chart of a first embodiment of a method for synchronous playback of audio and video according to the present invention
  • FIG. 2 is a schematic flow chart of a second embodiment of a method for synchronous playback of audio and video according to the present invention
  • step S60 is a schematic flowchart of the refinement of step S60 in the embodiment shown in FIG. 2 according to the present invention
  • step S630 is a schematic flowchart of the refinement of step S630 in the embodiment shown in FIG. 3 according to the present invention.
  • FIG. 5 is a schematic diagram of a refinement process of determining whether to send a reminder message to a user according to the second time difference value in step S633 in the embodiment shown in FIG. 4;
  • FIG. 6 is a schematic structural diagram of functional modules of a first embodiment of an apparatus for synchronous playback of audio and video according to the present invention
  • FIG. 7 is a schematic structural diagram of functional modules of a second embodiment of an apparatus for synchronous playback of audio and video according to the present invention.
  • FIG. 8 is a schematic diagram of a refinement function module of the analysis determining module 60 in the embodiment shown in FIG. 7 of the present invention.
  • the invention provides a method for synchronous playback of audio and video.
  • the method for synchronously playing the audio and video includes:
  • Step S10 When playing audio of the multimedia file by using the external sound device, acquiring device information of the external sound device;
  • Step S20 searching for a preset database according to the device information, determining a delay time when the external sound device plays audio, and the preset database includes a correspondence between the device information and the delay time.
  • Step S30 adjusting a video of the multimedia file according to the delay time, so that the audio is played synchronously with the video.
  • the method for synchronously playing audio and video is used to synchronize the audio played by the external sound device with the video played by the terminal when the external audio device is used to play the audio of the multimedia file when the terminal is connected to the external sound device.
  • External sound devices are usually used to play sound when connected or paired with the terminal. Common external sound devices include Bluetooth speakers, Bluetooth headsets, etc.
  • the terminals have notebooks, desktop computers, mobile phones, and the like.
  • the multimedia file is a file containing audio and video.
  • the terminal When the terminal is connected to an external sound device and plays a multimedia file on the terminal, the screen is played on the terminal (such as a mobile phone or a computer), and the audio passes.
  • An external sound device plays.
  • the audio of the multimedia file is played by the external sound device, the device information of the external sound device is obtained, and the device information is information for identifying the external sound device, and the premise of obtaining the external sound device is to establish a connection relationship with the external sound device. .
  • the preset database is searched according to the device information, and the delay time when the external audio device plays the audio is determined.
  • the preset database stores the correspondence between the device information and the delay time. Therefore, according to the device information of the external sound device and searching in the preset database, the corresponding delay time when the external sound device plays the sound can be obtained.
  • the preset data inventory is located in the terminal that connects the external sound device to play audio, and may also exist in other places, and the specific address may be selected as needed.
  • the synchronization of the audio and video images can be automatically adjusted according to the delay time of the external sound device, and the method of synchronizing the audio and video images can be adjusted, and the video screen can be temporarily tentatively waiting for replay.
  • the length of the pause wait is equal to the length of the playback delay time.
  • the bluetooth speaker plays the audio of the multimedia file when playing a multimedia file on the mobile phone.
  • the device information of the bluetooth speaker Before playing the multimedia file, first obtain the device information of the bluetooth speaker, and then according to the obtained device information, find the delay time when the bluetooth speaker plays the audio according to the preset database, when the delay time is 5 seconds.
  • the video controlling the multimedia file is delayed for 5 seconds, and the video played by the terminal just after 5 seconds is just synchronized with the audio played by the Bluetooth speaker.
  • the device information of the external sound device is acquired; and the preset database is searched according to the device information, and the delay time when the external sound device plays the audio is determined.
  • the preset database includes a correspondence between the device information and the delay time; adjusting a video of the multimedia file according to the delay time, so that the audio is played synchronously with the video.
  • the foregoing step S10 includes:
  • Step S40 sending the preset first audio to the external sound device, and recording the first initial time for transmitting the first audio
  • Step S50 after transmitting the first audio, acquiring a second audio played by the external sound device and a first time parameter for receiving the second audio;
  • Step S60 marking the second audio time segment and performing comparison analysis with the first audio, to obtain an initial time period for receiving the external audio device to play the first audio, according to the initial time period, Determining, by the first initial time and the first time parameter, a delay time when the external sound device plays audio;
  • Step S70 saving the delay time and device information of the external sound device in the database.
  • the method for determining the delay time of the external sound device is analyzed. After the delay time of the external sound device is acquired, the delay time and the device information of the external sound device are saved in a preset database for When the audio of the multimedia file is played by using the external sound device, the delay time of the external sound device can be automatically obtained, and the audio and video of the multimedia file are synchronously played according to the delay time.
  • the preset first audio is a preset sound, which is used to distinguish common sounds of the user, avoids interference when analyzing and calculating the delay time of the external sound device, and sends the first audio to the external sound device.
  • the purpose is to analyze the delay time of acquiring the external sound device, and a sound with a specific sound length of a specific frequency can be selected as the first audio as needed.
  • the method of transmitting the preset first audio to the external sound device may be sent by means that the external sound device can receive directly, for example, by a device having a Bluetooth module. While transmitting the preset first audio to the external sound device, the record saves the first initial time at which the first audio is transmitted.
  • the second audio played by the external sound device is obtained.
  • the second audio may be played after the first audio is correctly received, and the first audio may not be correctly received.
  • the second audio played by the external sound device is acquired, and the first time parameter of the second audio is received, where the first time parameter is related to receiving the second audio.
  • the time parameter is specifically the time at which each audio data of the second audio is received while receiving the second audio. Therefore, the time at which each audio data of the second audio is received can be obtained according to the first time parameter.
  • the second audio time segment is then marked and compared with the first audio to obtain an initial time period for receiving the external audio device to play the first audio.
  • the first audio will be played after receiving the first audio
  • the second audio will contain the audio data of the first audio, so the initiality of playing the first audio by receiving the external sound device is determined.
  • the time period may determine when the external audio device is acquired to play the first audio after transmitting the first audio to the external sound device.
  • the first time parameter is a time parameter related to receiving the second audio, including the time of receiving each audio data of the second audio, when the initial time period of receiving the first audio is determined, the first time may be The parameter obtains an initial time point of receiving the initial time of the first audio, and then determines a delay time when the external sound device plays the audio according to the first initial time of transmitting the first audio.
  • the delay information of the external sound device is stored in the preset database corresponding to the device information, so that the delay information when the external sound device plays the sound can be Get it directly when needed.
  • the present invention by transmitting a preset first audio external sound device, recording the first initial time of the transmission, acquiring the second audio of the external sound device, and receiving the first time parameter of the second audio, and then according to the first Comparing the audio with the second audio to obtain an initial time period for receiving the first audio by the external sound device, and determining a delay time when the external sound device plays the sound according to the initial time period, the first initial time, and the first time parameter, and The delay time and the device information of the external sound device are saved, and the delay time for automatically acquiring and saving the external sound device is realized, and after the delay time and the device information are saved, the device can be saved according to the saved device next time. The information and delay time are automatically adjusted.
  • the audio and video pictures are synchronized when the external sound device is played.
  • the foregoing step S60 includes:
  • Step S610 segmenting the second audio according to a preset time interval, and dividing into N segments, where N is a positive integer;
  • Step S620 obtaining the i-th segment analysis audio after the second audio segment mark, the initial value of i is 1, and i is less than or equal to N;
  • Step S630 comparing and analyzing the ith segment analysis audio with the first audio, to obtain an initial time period for receiving the external audio device to play the first audio, according to the initial time period, the first The initial time and the first time parameter determine a delay time when the external sound device plays audio.
  • the first segment after the second audio segment mark is acquired as the first segment analysis audio, for example, 0-0.1 seconds of the second segment audio is acquired as the first segment analysis audio.
  • the purpose is to segment the second audio first and then compare it with the first audio.
  • the first audio is segmented and analyzed according to a preset time interval, and an initial time period for receiving the first audio by the external sound device is obtained, and then according to the initial time period, the first initial time, and the first time.
  • the parameter determines the delay time of the external sound device, so that the delay time of the external sound device can be automatically obtained without user judgment.
  • the first time parameter includes receiving the second audio. a second initial time, a third initial time for receiving the ith segment of the second audio, and an end time for receiving the second audio;
  • the refining step of the above step S630 includes:
  • Step S631 it is determined whether the similarity between the i-th segment analysis audio and the first audio is less than a preset value; if yes, step S632 is performed; otherwise, step S633 is performed;
  • Step S632 obtaining an initial time period in which the i th segment is the first audio, and determining that the first time difference between the third initial time of the i th segment analysis audio and the first initial time is the delay time. time;
  • Step S633 calculating a second time difference value between the end time and the second initial time, and determining, according to the second time difference value, whether to send a reminder message to the user.
  • the second initial time is a time when the second audio played by the external sound device is received
  • the third initial time is an initial time when the external audio device receives the ith segment of the analyzed audio
  • the end time is an external sound.
  • the device plays the end time of the analysis of the audio in the i-th segment, and since the first parameter is the time of continuous recording when the audio data of the second audio is received, the third initial time and the end time are also recorded.
  • the purpose of determining whether the similarity between the audio of the i-th segment and the first audio is less than a preset value is to compare the sound received by the external sound device with the sound of the transmitted sound, and determine that the external sound device is received.
  • the initial time period of an audio is to compare the sound received by the external sound device with the sound of the transmitted sound, and determine that the external sound device is received.
  • the i-th segment analysis audio is used to compare with the first audio.
  • the i-th segment analysis audio is compared with the first audio, as long as the audio similarity is within a certain range, it can be determined that the two are the same.
  • a sound where the preset value can be set as needed.
  • the i-th analysis audio and the first audio can be analyzed according to a selection method.
  • the similarity between the audio of the i-th segment and the first audio is less than the preset value, it indicates that the first audio is played in the analysis audio of the i-th segment, and the i-th segment is the initial time period for receiving the first audio by the external audio device. .
  • the first time difference when the second audio is received is subtracted from the initial time when the second audio is received, and the first time difference is obtained, and the first time difference is the delay time when the external sound device plays the sound.
  • the similarity between the audio of the i-th segment and the first piece of audio is not less than the preset value, it indicates that the two may not be the same segment of sound.
  • the second time difference between the end time of the second audio and the second initial time of receiving the second audio is the time length of the second audio. According to the length of time of the second audio, it is analyzed whether the receiving process is incorrect. If there is an error, the reminder message is directly fed back to the user to remind the user to perform the next operation.
  • the embodiment of the present invention compares the similarity between the i-th segment analysis audio and the first audio with a preset value, and analyzes an initial time period during which the external audio device receives the first audio, and calculates an initial time period for playing the first audio. Calculating a time difference between the initial time and the first initial time of transmitting the first audio, that is, when the similarity between the i-th segment analysis audio and the first audio is less than a preset value, calculating a third initial time of the i-th segment analysis audio and the first initial The time difference of time is taken as the delay time, thereby automatically obtaining the delay time when the external sound device plays the sound.
  • the step S633 is determined according to the second time difference.
  • the steps to refine the feedback message to the user include:
  • Step S301 determining whether the second time difference value is greater than a preset limit time; if yes, executing step S302, otherwise performing step S303;
  • Step S302 feeding back to the user, the reminder message that the delay time fails to be confirmed
  • the second time difference is the length of the second audio played by the external sound device.
  • the preset limit time is set as needed, and the purpose is to determine whether the length of the acquired second audio exceeds a certain limit.
  • the time of the second audio exceeds the preset limit time, indicating that the received second audio may be incorrect, and the external sound device may not be normal. Work, so send a message to the user that the confirmation delay time failed, or send a message to prompt the user to confirm whether the external sound device is working properly.
  • the user can perform the next operation according to the received message, for example, adjusting the external sound device and then sending the sound again. .
  • the second time period of the first audio is acquired at this time, 0.1 second to 0.2 second.
  • the audio in one segment compares the audio from 0.1 to 0.2 with the first audio.
  • the third segment of the analysis audio may continue to be acquired for comparison until two similar audios are found.
  • a message prompt may be sent to the user to confirm whether the sound segment is incorrect.
  • the start time of sending the first audio is 12:00
  • the time when the audio is received is 12:01
  • the second audio obtained is 3 seconds, divided into 30 segments, each segment is 0.1 seconds
  • the first segment The time period for analyzing audio is 12:01 to 12:02
  • the second analysis audio is 12:02 to 12:03
  • the fifth period of analysis audio is from 12:05 to 12:06.
  • the five-segment analysis audio is less than the preset value compared with the first audio, it indicates that the fifth segment is the starting time period for playing the first audio, and the delay time is 0.5 seconds, that is, 12:05 minus 12:00. Time difference.
  • the similarity between the audio and the first audio in the i-th segment is greater than a preset value
  • the present invention also provides an apparatus for synchronous playback of audio and video.
  • FIG. 6 a first embodiment of an apparatus for synchronous playback of audio and video according to the present invention is provided.
  • the apparatus for synchronous playback of audio and video includes:
  • the first obtaining module 10 is configured to acquire device information of the external sound device when the audio of the multimedia file is played by the external sound device;
  • the determining determining module 20 is configured to search a preset database according to the device information, and determine a delay time when the external sound device plays audio, where the preset database includes the device information and the delay time Correspondence between
  • the adjusting module 30 is configured to adjust a video of the multimedia file according to the delay time, so that the audio is played synchronously with the video.
  • the device for synchronously playing audio and video is configured to synchronize the audio played by the external sound device with the video played by the terminal when the terminal uses the external sound device to play the audio of the multimedia file when the terminal is connected to the external sound device.
  • External sound devices are usually used to play sound when connected or paired with the terminal. Common external sound devices include Bluetooth speakers, Bluetooth headsets, etc.
  • the terminals have notebooks, desktop computers, mobile phones, and the like.
  • the device information of the external sound device is acquired; and the preset database is searched according to the device information, and the delay time when the external sound device plays the audio is determined.
  • the preset database includes a correspondence between the device information and the delay time; adjusting a video of the multimedia file according to the delay time, so that the audio is played synchronously with the video.
  • the apparatus for synchronous playback of audio and video further includes:
  • the audio sending module 40 is configured to send the preset first audio to the external sound device, and record a first initial time for sending the first audio;
  • the second obtaining module 50 is configured to acquire, after the sending the first audio, a second audio played by the external sound device and a first time parameter for receiving the second audio;
  • An analysis determining module 60 configured to mark the second audio time segment and compare the analysis with the first audio, to obtain an initial time period for receiving the external audio device to play the first audio, according to the initial The time period, the first initial time, and the first time parameter determine a delay time when the external sound device plays audio;
  • the saving module 70 is configured to save the delay time and device information of the external sound device in the database.
  • the present invention by transmitting a preset first audio external sound device, recording the first initial time of the transmission, acquiring the second audio of the external sound device, and receiving the first time parameter of the second audio, and then according to the first Comparing the audio with the second audio to obtain an initial time period for receiving the first audio by the external sound device, and determining a delay time when the external sound device plays the sound according to the initial time period, the first initial time, and the first time parameter, and The delay time and the device information of the external sound device are saved, and the delay time for automatically acquiring and saving the external sound device is realized, and after the delay time and the device information are saved, the device can be saved according to the saved device next time. The information and delay time are automatically adjusted.
  • the audio and video pictures are synchronized when the external sound device is played.
  • the analysis determining module 60 includes:
  • the audio processing sub-module 610 is configured to segment the second audio according to a preset time interval, and divide it into N segments, where N is a positive integer;
  • the obtaining sub-module 620 is configured to obtain the ith segment analysis audio after the second audio segment flag, where the initial value of i is 1, and i is less than or equal to N;
  • a determining sub-module 630 configured to compare the ith segment analysis audio with the first audio, to obtain an initial time period for receiving the external audio device to play the first audio, according to the initial time period, The first initial time and the first time parameter determine a delay time when the external sound device plays audio.
  • the first audio is segmented and analyzed according to a preset time interval, and an initial time period for receiving the first audio by the external sound device is obtained, and then according to the initial time period, the first initial time, and the first time.
  • the parameter determines the delay time of the external sound device, so that the delay time of the external sound device can be automatically obtained without user judgment.
  • the first time parameter includes a second initial time for receiving the second audio.
  • the determining submodule 630 includes:
  • a determining unit configured to determine whether the similarity between the ith segment analysis audio and the first audio is less than a preset value
  • a determining unit configured to: when the i-th segment analysis audio and the first audio are less than a preset value, obtain an initial time period in which the i-th segment is playing the first audio, and determine the i-th segment A first time difference between the third initial time of the analysis audio and the first initial time is the delay time;
  • a calculating unit configured to calculate a second time difference between the end time and the second initial time when the similarity between the ith segment analysis audio and the first audio is not less than a preset value, according to the The second time difference determines whether the reminder message is fed back to the user.
  • the embodiment of the present invention compares the similarity between the i-th segment analysis audio and the first audio with a preset value, and analyzes an initial time period during which the external audio device receives the first audio, and calculates an initial time period for playing the first audio. Calculating a time difference between the initial time and the first initial time of transmitting the first audio, that is, when the similarity between the i-th segment analysis audio and the first audio is less than a preset value, calculating a third initial time of the i-th segment analysis audio and the first initial The time difference of time is taken as the delay time, thereby automatically obtaining the delay time when the external sound device plays the sound.
  • the calculating unit includes:
  • a determining subunit configured to determine whether the second time difference value is greater than a preset limit time
  • a message feedback subunit configured to: when the second time difference value is greater than a preset limit time, feed back to the user a reminder message that the delay time fails to be confirmed;
  • the audio is analyzed in the ith segment after the audio segmentation.
  • the similarity between the audio and the first audio in the i-th segment is greater than a preset value

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

L'invention concerne un procédé de synchronisation de lecture audio et vidéo, ainsi qu'un dispositif de synchronisation de lecture audio et vidéo. Le procédé comporte les étapes consistant: lorsque l'audio d'un fichier multimédia est lu via un dispositif sonore externe, à acquérir des informations de dispositif concernant le dispositif sonore externe; à explorer une base de données prédéfinie d'après les informations de dispositif, et à déterminer un temps de retard lorsque le dispositif sonore externe lit l'audio, la base de données prédéfinie contenant une corrélation entre les informations de dispositif et le temps de retard; et à régler une vidéo du fichier multimédia selon le temps de retard pour permettre à l'audio et à la vidéo d'être lus de façon synchrone. L'objectif consistant à régler automatiquement l'audio et une image vidéo en vue d'une synchronisation lorsque l'audio d'un fichier multimédia est lu via un dispositif sonore externe est atteint.
PCT/CN2016/084944 2016-04-11 2016-06-06 Procédé et dispositif de synchronisation de lecture audio et vidéo WO2017177524A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610221519.1A CN105898502B (zh) 2016-04-11 2016-04-11 音视频同步播放的方法及装置
CN201610221519.1 2016-04-11

Publications (1)

Publication Number Publication Date
WO2017177524A1 true WO2017177524A1 (fr) 2017-10-19

Family

ID=57012333

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/084944 WO2017177524A1 (fr) 2016-04-11 2016-06-06 Procédé et dispositif de synchronisation de lecture audio et vidéo

Country Status (2)

Country Link
CN (1) CN105898502B (fr)
WO (1) WO2017177524A1 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112073879A (zh) * 2020-09-11 2020-12-11 成都极米科技股份有限公司 音频同步播放方法、装置、视频播放设备及可读存储介质
CN113825022A (zh) * 2021-09-03 2021-12-21 成都欧珀通信科技有限公司 一种播放控制状态检测方法、装置、存储介质及电子设备
CN114070955A (zh) * 2021-11-29 2022-02-18 杭州逗酷软件科技有限公司 一种同步判断方法及装置、存储介质
CN114286145A (zh) * 2021-03-11 2022-04-05 海信视像科技股份有限公司 一种显示设备
CN116033228A (zh) * 2022-12-20 2023-04-28 深圳市东明炬创电子股份有限公司 一种多路音视频整合方法、装置、设备和介质
CN117768993A (zh) * 2023-12-25 2024-03-26 广东保伦电子股份有限公司 一种音频同步方法、音频播放系统和存储介质
WO2024088010A1 (fr) * 2022-10-28 2024-05-02 惠州市德赛西威汽车电子股份有限公司 Procédé et système pour réaliser une synchronisation de signaux d'invite de véhicule et véhicule

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106782598A (zh) * 2016-12-15 2017-05-31 深圳Tcl数字技术有限公司 电视画面和外设声音同步控制方法和装置
CN108616767B (zh) * 2018-04-28 2020-12-29 海信视像科技股份有限公司 一种音频数据传输方法及装置
US11416209B2 (en) * 2018-10-15 2022-08-16 Sonos, Inc. Distributed synchronization
CN109451339B (zh) * 2018-12-28 2021-10-01 深圳Tcl新技术有限公司 音频传输方法、装置、设备及可读存储介质
CN112449278B (zh) * 2019-09-03 2022-04-22 深圳Tcl数字技术有限公司 一种自动校准延时输出声音的方法、装置、设备及存储介质
CN110971783B (zh) 2019-11-29 2022-08-02 深圳创维－Rgb电子有限公司 电视音画同步自整定方法、装置和存储介质
CN113555132A (zh) * 2020-04-24 2021-10-26 华为技术有限公司 多源数据处理方法、电子设备和计算机可读存储介质
CN112004133A (zh) * 2020-09-04 2020-11-27 成都极米科技股份有限公司 音画同调方法、装置、投影设备及可读存储介质
CN113409817B (zh) * 2021-06-24 2022-05-13 浙江松会科技有限公司 一种基于声纹技术的音频信号实时追踪比对方法
CN113645544A (zh) * 2021-07-02 2021-11-12 武汉市聚芯微电子有限责任公司 一种播放控制方法、装置和电子设备
CN114040237A (zh) * 2021-09-30 2022-02-11 茂佳科技(广东)有限公司 音频视频同步播放方法、终端、多媒体播放系统及介质
WO2023070374A1 (fr) * 2021-10-27 2023-05-04 京东方科技集团股份有限公司 Procédé et appareil de synchronisation audio et vidéo, support de stockage et dispositif électronique

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120206650A1 (en) * 2011-02-16 2012-08-16 Amtran Technology Co., Ltd Method for synchronized playback of wireless audio and video and playback system using the same
CN103905880A (zh) * 2014-03-13 2014-07-02 北京奇艺世纪科技有限公司 音视频数据的播放方法、智能电视和移动设备
CN103905877A (zh) * 2014-03-13 2014-07-02 北京奇艺世纪科技有限公司 音视频数据的播放方法、智能电视和移动设备
CN104796578A (zh) * 2015-04-29 2015-07-22 成都陌云科技有限公司 一种基于节目声音特征的多屏同步方法
CN105451056A (zh) * 2015-11-20 2016-03-30 小米科技有限责任公司 音视频同步方法及装置

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8743284B2 (en) * 2007-10-08 2014-06-03 Motorola Mobility Llc Synchronizing remote audio with fixed video

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120206650A1 (en) * 2011-02-16 2012-08-16 Amtran Technology Co., Ltd Method for synchronized playback of wireless audio and video and playback system using the same
CN103905880A (zh) * 2014-03-13 2014-07-02 北京奇艺世纪科技有限公司 音视频数据的播放方法、智能电视和移动设备
CN103905877A (zh) * 2014-03-13 2014-07-02 北京奇艺世纪科技有限公司 音视频数据的播放方法、智能电视和移动设备
CN104796578A (zh) * 2015-04-29 2015-07-22 成都陌云科技有限公司 一种基于节目声音特征的多屏同步方法
CN105451056A (zh) * 2015-11-20 2016-03-30 小米科技有限责任公司 音视频同步方法及装置

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112073879A (zh) * 2020-09-11 2020-12-11 成都极米科技股份有限公司 音频同步播放方法、装置、视频播放设备及可读存储介质
CN114286145A (zh) * 2021-03-11 2022-04-05 海信视像科技股份有限公司 一种显示设备
CN114286145B (zh) * 2021-03-11 2023-02-24 海信视像科技股份有限公司 一种显示设备
CN113825022A (zh) * 2021-09-03 2021-12-21 成都欧珀通信科技有限公司 一种播放控制状态检测方法、装置、存储介质及电子设备
CN113825022B (zh) * 2021-09-03 2023-08-18 成都欧珀通信科技有限公司 一种播放控制状态检测方法、装置、存储介质及电子设备
CN114070955A (zh) * 2021-11-29 2022-02-18 杭州逗酷软件科技有限公司 一种同步判断方法及装置、存储介质
CN114070955B (zh) * 2021-11-29 2023-06-20 杭州逗酷软件科技有限公司 一种同步判断方法及装置、存储介质
WO2024088010A1 (fr) * 2022-10-28 2024-05-02 惠州市德赛西威汽车电子股份有限公司 Procédé et système pour réaliser une synchronisation de signaux d'invite de véhicule et véhicule
CN116033228A (zh) * 2022-12-20 2023-04-28 深圳市东明炬创电子股份有限公司 一种多路音视频整合方法、装置、设备和介质
CN117768993A (zh) * 2023-12-25 2024-03-26 广东保伦电子股份有限公司 一种音频同步方法、音频播放系统和存储介质

Also Published As

Publication number Publication date
CN105898502A (zh) 2016-08-24
CN105898502B (zh) 2019-09-20

Similar Documents

Publication Publication Date Title
WO2017177524A1 (fr) Procédé et dispositif de synchronisation de lecture audio et vidéo
WO2017005066A1 (fr) Procédé et appareil d'enregistrement d'estampille temporelle de synchronisation audio et vidéo
WO2019000792A1 (fr) Procédé et système pour ajuster la qualité sonore, et côté hôte et support de stockage
WO2018023926A1 (fr) Procédé et système d'interaction pour téléviseur et terminal mobile
WO2016091011A1 (fr) Dispositif et procédé de commutation de sous-titres
WO2016032021A1 (fr) Appareil et procédé de reconnaissance de commandes vocales
WO2019119771A1 (fr) Dispositif et procédé d'interaction vocale, et support d'informations lisible par ordinateur
WO2019128174A1 (fr) Procédé de lecture audio, téléviseur intelligent, et support d'informations lisible par ordinateur
WO2018045682A1 (fr) Procédé et dispositif de test de synchronisation d'audio et d'image
WO2019051902A1 (fr) Procédé de commande de terminal, climatiseur et support d'informations lisible par un ordinateur
WO2014187158A1 (fr) Procédé, serveur, et terminal pour contrôler le partage de données de terminal en nuage
WO2017054488A1 (fr) Procédé de commande de lecture de télévision, serveur et système de commande de lecture de télévision
WO2017088427A1 (fr) Procédé et dispositif de commande de sortie audio
WO2018028124A1 (fr) Téléviseur, et procédé de commutation de source de signal correspondant
WO2016101252A1 (fr) Procédé et appareil d'affichage d'informations de canal pour télévision intelligente
WO2016090991A1 (fr) Procédé et appareil pour télécharger des données multimédias de diffusion en continu
WO2017045441A1 (fr) Procédé et appareil de lecture audio utilisant une télévision intelligente
WO2015058570A1 (fr) Procédé et dispositif de reconnaissance automatique d'opérateur de réseau pour réaliser une configuration de données
WO2016095280A1 (fr) Dispositif et procédé de notation de karaoké
WO2017121066A1 (fr) Procédé et système d'affichage de programme d'application
WO2017005062A1 (fr) Procédé et dispositif de lecture de trame d'image
WO2015169177A1 (fr) Procédé et appareil d'affichage de page web
WO2017096764A1 (fr) Procédé et dispositif de délivrance de données audio
WO2017113600A1 (fr) Procédé et dispositif de lecture de vidéo
WO2022030857A1 (fr) Dispositif de traitement de signal audio et son procédé d'utilisation

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16898339

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 16898339

Country of ref document: EP

Kind code of ref document: A1