CN113660513A - Method, device and storage medium for synchronizing playing time - Google Patents
Method, device and storage medium for synchronizing playing time Download PDFInfo
- Publication number
- CN113660513A CN113660513A CN202110943512.1A CN202110943512A CN113660513A CN 113660513 A CN113660513 A CN 113660513A CN 202110943512 A CN202110943512 A CN 202110943512A CN 113660513 A CN113660513 A CN 113660513A
- Authority
- CN
- China
- Prior art keywords
- time
- equipment
- intelligent household
- target
- household equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23602—Multiplexing isochronously with the video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
Abstract
The present disclosure relates to a method, apparatus, and storage medium for synchronizing a play time. The method for synchronizing the playing time comprises the following steps: under a preset trigger mechanism, determining the distance between the intelligent household equipment and audio playing equipment in communication connection with the intelligent household equipment through a distance measuring device; taking each audio playing device as a target device one by one, and sending an instruction to the target device, wherein the instruction is used for instructing the target device to send a sound wave signal to the intelligent household device at the appointed sending time; responding to the received sound wave signal sent by the target equipment, and determining the time difference between the system time of the intelligent household equipment and the system time of the target equipment according to the receiving time and the sending time of the received sound wave signal and the distance between the target equipment and the intelligent household equipment; and when the intelligent household equipment starts to play the audio data, time compensation is carried out on the target equipment according to the system time and the time difference of the intelligent household equipment so as to realize synchronous playing of the audio data by the target equipment and the intelligent household equipment.
Description
Technical Field
The present disclosure relates to the field of smart home technologies, and in particular, to a method, an apparatus, and a storage medium for synchronizing playing time.
Background
With the development of the internet of things, a surround sound system formed by intelligent household equipment is more and more popular with consumers. For example, a surround sound system is formed by combining a smart television and a sound box, so that a better viewing experience can be provided for a user.
Disclosure of Invention
To overcome the problems in the related art, the present disclosure provides a method, an apparatus, and a storage medium for synchronizing a play time.
According to a first aspect of the embodiments of the present disclosure, a method for synchronizing playing time is provided, which is applied to an intelligent home device, where the intelligent home device has an audio and video playing function and is equipped with a distance measuring device, and the method includes:
under a preset trigger mechanism, determining the distance between the intelligent household equipment and audio playing equipment in communication connection with the intelligent household equipment through the distance measuring device, wherein the number of the audio playing equipment is at least two;
taking each audio playing device as a target device one by one, and sending an instruction to the target device, wherein the instruction is used for instructing the target device to send a sound wave signal to the intelligent household device at a specified sending time;
responding to the received sound wave signal sent by the target equipment, and determining the time difference between the system time of the intelligent household equipment and the system time of the target equipment according to the receiving time of the sound wave signal, the sending time and the distance between the target equipment and the intelligent household equipment;
and when the intelligent household equipment starts to play audio data, time compensation is carried out on the target equipment according to the system time of the intelligent household equipment and the time difference so as to realize that the target equipment and the intelligent household equipment synchronously play the audio data.
Optionally, the preset trigger mechanism includes:
monitoring that the smart home equipment starts a surround sound function; alternatively, the first and second electrodes may be,
and monitoring that the intelligent household equipment starts playing audio and video resources.
Optionally, the distance measuring device is a dual camera device or a multi-view camera device, and the determining, by the distance measuring device, the distance between the smart home device and the audio playing device in communication connection therewith includes:
and determining the distance between the intelligent household equipment and the audio playing equipment in communication connection with the intelligent household equipment by using a binocular ranging algorithm.
Optionally, the determining, according to the receiving time of receiving the sound wave signal, the sending time, and the distance between the target device and the smart home device, a time difference between the system time of the smart home device and the system time of the target device includes:
obtaining the flight time of the sound wave signal according to the distance between the target device and the intelligent household device and the sound transmission speed;
and determining the time difference between the system time of the intelligent household equipment and the system time of the target equipment according to the flight time, the receiving time and the sending time.
Optionally, the determining, according to the flight time, the receiving time, and the sending time, a time difference between the system time of the smart home device and the system time of the target device includes:
performing difference operation on the receiving time and the sending time to obtain first difference time;
and performing difference operation on the first difference time and the flight time to obtain the time difference.
Optionally, the time compensation for the target device according to the system time of the smart home device and the time difference includes:
determining a compensation direction for performing time compensation on the target equipment according to the system time of the intelligent household equipment and the time difference;
and performing time compensation on the target equipment according to the compensation direction and the time difference.
Optionally, the smart home device is a smart television, and the audio playing device is a sound box.
According to a second aspect of the embodiments of the present disclosure, a device for synchronizing playing time is provided, which is applied to smart home devices, the smart home devices have an audio and video playing function and are installed with a distance measuring device, the device includes:
the first determining module is used for determining the distance between the intelligent household equipment and audio playing equipment in communication connection with the intelligent household equipment through the distance measuring device under a preset triggering mechanism, wherein the number of the audio playing equipment is at least two;
the sending module is used for taking each audio playing device as a target device one by one and sending an instruction to the target devices, wherein the instruction is used for instructing the target devices to send sound wave signals to the intelligent home devices at the appointed sending time;
the second determining module is used for responding to the sound wave signal sent by the target equipment, and determining the time difference between the system time of the intelligent household equipment and the system time of the target equipment according to the receiving time of the sound wave signal, the sending time and the distance between the target equipment and the intelligent household equipment;
and the processing module is used for performing time compensation on the target equipment according to the system time of the intelligent home equipment and the time difference when the intelligent home equipment starts to play the audio data so as to realize synchronous playing of the audio data by the target equipment and the intelligent home equipment.
Optionally, the preset trigger mechanism includes:
monitoring that the smart home equipment starts a surround sound function; or monitoring that the intelligent household equipment starts to play the audio and video resources.
Optionally, the distance measuring device is a dual-camera device or a multi-view camera device, and the first determining module determines the distance between the smart home device and an audio playing device in communication connection with the smart home device in the following manner:
and determining the distance between the intelligent household equipment and the audio playing equipment in communication connection with the intelligent household equipment by using a binocular distance measuring algorithm through the distance measuring device.
Optionally, the second determining module determines a time difference between the system time of the smart home device and the system time of the target device according to the receiving time of the sound wave signal, the sending time, and the distance between the target device and the smart home device in the following manner:
obtaining the flight time of the sound wave signal according to the distance between the target device and the intelligent household device and the sound transmission speed;
and determining the time difference between the system time of the intelligent household equipment and the system time of the target equipment according to the flight time, the receiving time and the sending time.
Optionally, the second determining module determines a time difference between the system time of the smart home device and the system time of the target device according to the flight time, the receiving time, and the sending time in the following manner:
performing difference operation on the receiving time and the sending time to obtain first difference time;
and performing difference operation on the first difference time and the flight time to obtain the time difference.
Optionally, the time compensation for the target device according to the system time of the smart home device and the time difference includes:
determining a compensation direction for performing time compensation on the target equipment according to the system time of the intelligent household equipment and the time difference;
and performing time compensation on the target equipment according to the compensation direction and the time difference.
Optionally, the smart home device is a smart television, and the audio playing device is a sound box.
According to a third aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the method of synchronizing playout times provided by the first aspect of the present disclosure.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: the intelligent home equipment sends an instruction for indicating the audio playing equipment to send the sound wave signal to the intelligent home equipment at the appointed sending time, and the sound wave is stable in control transmission, so that the intelligent home equipment can accurately determine the time difference of the system time between the audio playing equipment and the intelligent home equipment according to the time for receiving the sound wave signal, the sending of the sound wave signal by the audio playing equipment and the distance between the intelligent home equipment and the audio playing equipment after receiving the sound wave signal. According to the time difference of the system time between the audio playing device and the intelligent home device, the surround sound system formed by the intelligent home device and the audio playing device can stably and synchronously play surround sound.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flow chart illustrating a method of synchronizing a play time according to an exemplary embodiment.
Fig. 2 is a block diagram illustrating an apparatus for synchronizing a play time according to an exemplary embodiment.
Fig. 3 is a block diagram illustrating an apparatus for synchronizing a play time according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
In the related art, for example, after a surround sound playing system is formed by connecting a smart television and a sound box WiFi, when a video is played, the smart television plays an image picture, and simultaneously, corresponding sound needs to be played by the smart television and the sound box. The smart television and all the sound boxes play the audio after a fixed time (for example, 1s) is appointed. However, the system time of all devices (smart television, each loudspeaker box) is different, and if the system time of all devices is the same, the played audio is asynchronous and the sound is messy. Therefore, all the sound boxes take the time of the intelligent television as a reference, the time difference between the sound boxes and the television is calculated through WiFi data interaction, and then local time compensation is carried out. On the basis that all the equipment time is aligned, the audio is played after fixed time, and synchronous playing of the audio can be realized.
However, the estimation of the time difference between the smart television and the sound box is realized through WiFi data interaction, but when the network is unstable and jitters, a great error exists in the estimated time difference, which causes the problem of sound asynchronization.
In view of this, in an exemplary embodiment of the present disclosure, the smart home device sends, to the audio playing device, an instruction indicating that the audio playing device sends the sound wave signal to the smart home device at the specified sending time, and since the transmission of the sound wave in the control is stable, after the smart home device receives the sound wave signal, according to the time for receiving the sound wave signal, the audio playing device sends the sound wave signal, and the distance between the smart home device and the audio playing device, the time difference of the system time between the audio playing device and the smart home device can be accurately determined. According to the time difference of the system time between the audio playing device and the intelligent home device, the surround sound system formed by the intelligent home device and the audio playing device can stably and synchronously play surround sound.
Fig. 1 is a flowchart illustrating a method for synchronizing playing time according to an exemplary embodiment, where as shown in fig. 1, the method for synchronizing playing time is used in a smart home device, and includes the following steps.
In step S11, under a preset trigger mechanism, a distance between the smart home device and an audio playing device communicatively connected thereto is determined through the distance measuring apparatus, where the audio playing device includes at least two audio playing devices.
In the disclosure, the preset triggering mechanism may be that it is monitored that the surround sound function is started by the smart home device, and accordingly, after the surround sound function is started, the smart home device may determine the distance between each audio playing device and the smart home device one by one according to the plurality of audio playing devices connected thereto through the distance measuring device.
Or, the preset trigger mechanism may be to monitor that the smart home device starts playing the audio and video resources. Accordingly, before the smart home device starts playing the audio and video resources, the smart home device and the plurality of audio playing devices are already in a communication connection state (for example, connected through WiFi), and the smart home device may determine the distance between each audio playing device and the smart home device one by one according to the plurality of audio playing devices connected thereto through the distance measuring device.
The smart home device may be a device having an audio/video playing function and provided with a distance measuring device, such as a smart television or a smart phone. The audio playing device may be a smart phone or a sound box or other devices with an audio playing function.
In one embodiment, the distance measuring device may be, for example, a binocular camera device or a multi-view camera device, and determining the distance between the smart home device and the audio playing device communicatively connected thereto by using the distance measuring device may include, for example: and obtaining the distance between the intelligent household equipment and the audio playing equipment in communication connection with the intelligent household equipment by using a binocular ranging algorithm.
In step S12, each audio playback device is taken as a target device one by one, and an instruction is sent to the target device, where the instruction is used to instruct the target device to send a sound wave signal to the smart home device at a specified sending time.
According to the audio playing devices in communication connection with the intelligent home devices, each audio playing device is used as a target device one by one, and a sound wave signal used for indicating the target device to send to the intelligent home devices at the appointed sending time is sent to the target device. The sound wave signal may be, for example, a chirp ultrasonic signal emitted by a speaker of the audio playing device.
In step S13, in response to receiving the sound wave signal transmitted by the target device, a time difference between the system time of the smart home device and the system time of the target device is determined according to the receiving time and the transmitting time of the received sound wave signal and the distance between the target device and the smart home device.
In one embodiment, the time difference between the system time of the smart home device and the system time of the target device may be determined, for example, as follows:
according to the distance between the target device and the intelligent household device and the sound transmission speed, the flight time of the sound wave signal is obtained, and according to the flight time, the receiving time and the sending time, the time difference between the system time of the intelligent household device and the system time of the target device is determined.
For example, the difference between the receiving time and the sending time may be calculated to obtain a first difference time, and the difference between the first difference time and the flight time may be calculated to obtain a time difference.
In step S14, when the smart home device starts playing the audio data, time compensation is performed on the target device according to the system time and the time difference of the smart home device, so that the target device and the smart home device can play the audio data synchronously.
After the time difference between the system time of the smart home device and the system time of each audio playing device is obtained, the compensation time for performing time compensation on each audio playing device can be determined according to the system time and the time difference of the smart home device, and then the target device is controlled to play audio data according to the compensation time.
The following description will be made of a method for synchronizing playing time by using the present disclosure, taking an intelligent home device as an intelligent television and an audio playing device as a sound box as an example.
The intelligent television is provided with a binocular camera device, and under a preset trigger mechanism, the intelligent television determines the position (x) of the ith sound box through the binocular camera device by using a binocular distance measurement algorithmi，yi). Let the position of the television be (x)a，ya) The distance between the smart television and the ith loudspeaker box can be characterized as follows:
the ith loudspeaker box is at T1Emitting chirp ultrasonic signal easy to detect at time T and TV set at time T2Received and detected. And then, carrying out difference operation on the receiving time and the sending time to obtain a first difference time, and carrying out difference operation on the first difference time and the flight time to obtain a time difference. I.e. can be characterized as:
TOAi＝T2-T1＝TOFi+Toffset
wherein TOFiFor time of flight, TOAiIs a first difference time, V is the sound propagation rate, ToffsetIs the time difference.
In obtaining ToffsetThen, according to the system time and T of the intelligent televisionoffsetA compensation direction for time compensation of the loudspeaker box can be determined, the compensation direction can comprise a positive direction and a negative direction, a root compensation direction and a compensation quantity (T)offset) And determining the delay time when the ith loudspeaker box plays the audio data. And then according to the delay time, the ith sound box and the intelligent television can be controlled to synchronously play audio data.
For example, after the smart television acquires video resources from a network, the video resources are decoded to obtain image data and audio data, the image data is played according to a normal flow, the audio data is divided into one frame according to a fixed length (20ms), then the playing time for dividing each audio data frame is packed together, and in order to reduce network load, the audio data frames can be encoded and compressed, so that the data volume is reduced. The audio data is then sent to the interconnected speakers in audio data frames. And each audio packet transmitted by the television comprises the corresponding divided playing time and the coded audio data. And then, the intelligent television performs time compensation on the sound box according to the compensation direction and the compensation amount (time difference) of the sound box in communication connection with the intelligent television, so that the time of the sound box is aligned with that of the intelligent television, and the sound box and the intelligent television can synchronously play audio data.
In an exemplary embodiment of the disclosure, the smart home device sends, to the audio playing device, an instruction indicating that the audio playing device sends the sound wave signal to the smart home device at the specified sending time, and since the transmission of the sound wave at the control is stable, after the smart home device receives the sound wave signal, the smart home device can accurately determine the time difference of the system time between the audio playing device and the smart home device according to the time for receiving the sound wave signal, the sending of the sound wave signal by the audio playing device, and the distance between the smart home device and the audio playing device. According to the time difference of the system time between the audio playing device and the intelligent home device, the surround sound system formed by the intelligent home device and the audio playing device can stably and synchronously play surround sound.
Fig. 2 is a block diagram 200 illustrating an apparatus for synchronizing a play time according to an example embodiment. Referring to fig. 2, the device of synchronous broadcast time is applied to intelligent household equipment, intelligent household equipment has audio and video broadcast function, and installs range unit, the device includes:
a first determining module 201, configured to determine, by using the distance measuring device, a distance between the smart home device and an audio playing device in communication connection with the smart home device under a preset trigger mechanism, where the number of the audio playing devices is at least two;
the sending module 202 is configured to take each of the audio playing devices as a target device one by one, and send an instruction to the target device, where the instruction is used to instruct the target device to send a sound wave signal to the smart home device at a specified sending time;
the second determining module 203 is configured to, in response to receiving the acoustic wave signal sent by the target device, determine a time difference between the system time of the smart home device and the system time of the target device according to the receiving time of the acoustic wave signal, the sending time, and the distance between the target device and the smart home device;
the processing module 204 is configured to perform time compensation on the target device according to the system time of the smart home device and the time difference when the smart home device starts to play audio data, so that the target device and the smart home device synchronously play the audio data.
Optionally, the preset trigger mechanism includes:
monitoring that the smart home equipment starts a surround sound function; or monitoring that the intelligent household equipment starts to play the audio and video resources.
Optionally, the distance measuring device is a dual camera device or a multi-view camera device, and the first determining module 201 determines the distance between the smart home device and an audio playing device in communication connection therewith in the following manner:
and determining the distance between the intelligent household equipment and the audio playing equipment in communication connection with the intelligent household equipment by using a binocular distance measuring algorithm through the distance measuring device.
Optionally, the second determining 203 module determines a time difference between the system time of the smart home device and the system time of the target device according to the receiving time of the sound wave signal, the sending time, and the distance between the target device and the smart home device in the following manner:
obtaining the flight time of the sound wave signal according to the distance between the target device and the intelligent household device and the sound transmission speed;
and determining the time difference between the system time of the intelligent household equipment and the system time of the target equipment according to the flight time, the receiving time and the sending time.
Optionally, the second determining module 203 determines a time difference between the system time of the smart home device and the system time of the target device according to the flight time, the receiving time, and the sending time in the following manner:
performing difference operation on the receiving time and the sending time to obtain first difference time;
and performing difference operation on the first difference time and the flight time to obtain the time difference.
Optionally, the processing module performs time compensation on the target device according to the system time of the smart home device and the time difference by using the following method, including:
determining a compensation direction for performing time compensation on the target equipment according to the system time of the intelligent household equipment and the time difference;
and performing time compensation on the target equipment according to the compensation direction and the time difference.
Optionally, the smart home device is a smart television, and the audio playing device is a sound box.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
The present disclosure also provides a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the method of synchronizing playout time provided by the present disclosure.
Fig. 3 is a block diagram illustrating an apparatus 800 for synchronizing airtimes according to an example embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 3, the apparatus 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.
The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the method of synchronizing airtimes described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the apparatus 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed status of the device 800, the relative positioning of components, such as a display and keypad of the device 800, the sensor assembly 814 may also detect a change in the position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration/deceleration of the device 800, and a change in the temperature of the device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described method of synchronizing the play time.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the apparatus 800 to perform the above-described method of synchronizing the play-out time is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
In another exemplary embodiment, a computer program product is also provided, which comprises a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-mentioned method of synchronizing playout times when executed by the programmable apparatus.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A method for synchronizing playing time is applied to intelligent household equipment, the intelligent household equipment has an audio and video playing function and is provided with a distance measuring device, and the method comprises the following steps:
under a preset trigger mechanism, determining the distance between the intelligent household equipment and audio playing equipment in communication connection with the intelligent household equipment through the distance measuring device, wherein the number of the audio playing equipment is at least two;
taking each audio playing device as a target device one by one, and sending an instruction to the target device, wherein the instruction is used for instructing the target device to send a sound wave signal to the intelligent household device at a specified sending time;
responding to the received sound wave signal sent by the target equipment, and determining the time difference between the system time of the intelligent household equipment and the system time of the target equipment according to the receiving time of the sound wave signal, the sending time and the distance between the target equipment and the intelligent household equipment;
and when the intelligent household equipment starts to play audio data, time compensation is carried out on the target equipment according to the system time of the intelligent household equipment and the time difference so as to realize that the target equipment and the intelligent household equipment synchronously play the audio data.
2. The method of claim 1, wherein the preset trigger mechanism comprises:
monitoring that the smart home equipment starts a surround sound function; alternatively, the first and second electrodes may be,
and monitoring that the intelligent household equipment starts playing audio and video resources.
3. The method according to claim 1, wherein the distance measuring device is a dual camera device or a multi-view camera device, and the determining the distance between the smart home device and an audio playing device communicatively connected thereto by the distance measuring device comprises:
and determining the distance between the intelligent household equipment and the audio playing equipment in communication connection with the intelligent household equipment by using a binocular ranging algorithm.
4. The method according to claim 1, wherein the determining a time difference between the system time of the smart home device and the system time of the target device according to the receiving time of the sound wave signal, the sending time, and the distance between the target device and the smart home device comprises:
obtaining the flight time of the sound wave signal according to the distance between the target device and the intelligent household device and the sound transmission speed;
and determining the time difference between the system time of the intelligent household equipment and the system time of the target equipment according to the flight time, the receiving time and the sending time.
5. The method according to claim 4, wherein the determining a time difference between the system time of the smart home device and the system time of the target device according to the flight time, the receiving time, and the sending time comprises:
performing difference operation on the receiving time and the sending time to obtain first difference time;
and performing difference operation on the first difference time and the flight time to obtain the time difference.
6. The method according to claim 1, wherein the time compensation of the target device according to the system time of the smart home device and the time difference comprises:
determining a compensation direction for performing time compensation on the target equipment according to the system time of the intelligent household equipment and the time difference;
and performing time compensation on the target equipment according to the compensation direction and the time difference.
7. The method according to any one of claims 1 to 6, wherein the smart home device is a smart television, and the audio playing device is a sound box.
8. The utility model provides a device of synchronous broadcast time, its characterized in that is applied to intelligent household equipment, intelligent household equipment has audio frequency and video broadcast function, and installs range unit, the device includes:
the first determining module is used for determining the distance between the intelligent household equipment and audio playing equipment in communication connection with the intelligent household equipment through the distance measuring device under a preset triggering mechanism, wherein the number of the audio playing equipment is at least two;
the sending module is used for taking each audio playing device as a target device one by one and sending an instruction to the target devices, wherein the instruction is used for instructing the target devices to send sound wave signals to the intelligent home devices at the appointed sending time;
the second determining module is used for responding to the sound wave signal sent by the target equipment, and determining the time difference between the system time of the intelligent household equipment and the system time of the target equipment according to the receiving time of the sound wave signal, the sending time and the distance between the target equipment and the intelligent household equipment;
and the processing module is used for performing time compensation on the target equipment according to the system time of the intelligent home equipment and the time difference when the intelligent home equipment starts to play the audio data so as to realize synchronous playing of the audio data by the target equipment and the intelligent home equipment.
9. An apparatus for synchronizing broadcast times, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to: the steps of carrying out the process of any one of claims 1 to 6.
10. A computer-readable storage medium, on which computer program instructions are stored, which program instructions, when executed by a processor, carry out the steps of the method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110943512.1A CN113660513A (en) | 2021-08-17 | 2021-08-17 | Method, device and storage medium for synchronizing playing time |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110943512.1A CN113660513A (en) | 2021-08-17 | 2021-08-17 | Method, device and storage medium for synchronizing playing time |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113660513A true CN113660513A (en) | 2021-11-16 |
Family
ID=78479998
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110943512.1A Pending CN113660513A (en) | 2021-08-17 | 2021-08-17 | Method, device and storage medium for synchronizing playing time |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113660513A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114173168A (en) * | 2021-11-17 | 2022-03-11 | 中国船舶重工集团公司第七一九研究所 | Acoustic system and method for realizing time synchronization of physical isolation information system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108496372A (en) * | 2017-06-30 | 2018-09-04 | 深圳市大疆创新科技有限公司 | The video and synchronous method of audio, equipment and unmanned plane |
| CN109831735A (en) * | 2019-01-11 | 2019-05-31 | 歌尔科技有限公司 | Suitable for the audio frequency playing method of indoor environment, equipment, system and storage medium |
| CN112136331A (en) * | 2017-06-08 | 2020-12-25 | Dts公司 | Correction for loudspeaker delay |
| CN112130616A (en) * | 2020-09-28 | 2020-12-25 | 北京小米松果电子有限公司 | Clock synchronization method, device and storage medium |
-
2021
- 2021-08-17 CN CN202110943512.1A patent/CN113660513A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112136331A (en) * | 2017-06-08 | 2020-12-25 | Dts公司 | Correction for loudspeaker delay |
| CN108496372A (en) * | 2017-06-30 | 2018-09-04 | 深圳市大疆创新科技有限公司 | The video and synchronous method of audio, equipment and unmanned plane |
| CN109831735A (en) * | 2019-01-11 | 2019-05-31 | 歌尔科技有限公司 | Suitable for the audio frequency playing method of indoor environment, equipment, system and storage medium |
| CN112130616A (en) * | 2020-09-28 | 2020-12-25 | 北京小米松果电子有限公司 | Clock synchronization method, device and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114173168A (en) * | 2021-11-17 | 2022-03-11 | 中国船舶重工集团公司第七一九研究所 | Acoustic system and method for realizing time synchronization of physical isolation information system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3125530B1 (en) | Video recording method and device | |
| US9961393B2 (en) | Method and device for playing multimedia file | |
| EP3163887A1 (en) | Method and apparatus for performing media synchronization | |
| EP2978234A1 (en) | Method and apparatus for sharing video information | |
| WO2017219347A1 (en) | Live broadcast display method, device and system | |
| CN109698794B (en) | Congestion control method and device, electronic equipment and storage medium | |
| CN112969096A (en) | Media playing method and device and electronic equipment | |
| EP3264774A1 (en) | Live broadcasting method and device for live broadcasting | |
| CN112114765A (en) | Screen projection method and device and storage medium | |
| KR20170023769A (en) | Event prompting mehtod and device | |
| CN106792024B (en) | Multimedia information sharing method and device | |
| US11388459B2 (en) | Method and apparatus for determining bandwidth, and electronic device and storage medium | |
| CN112910592B (en) | Clock synchronization method and device, terminal and storage medium | |
| CN108206884B (en) | Terminal, adjusting method for communication signal transmitted by terminal and electronic equipment | |
| CN113660513A (en) | Method, device and storage medium for synchronizing playing time | |
| CN112243142A (en) | Method, device and storage medium for processing audio data | |
| CN111698262B (en) | Bandwidth determination method, device, terminal and storage medium | |
| CN110113256B (en) | Information interaction method and device, server, user terminal and readable storage medium | |
| CN110213531B (en) | Monitoring video processing method and device | |
| CN109712629B (en) | Audio file synthesis method and device | |
| US11689690B2 (en) | Method and device for audio and video synchronization | |
| CN114007101B (en) | Processing method, device and storage medium of fusion display device | |
| CN110955328B (en) | Control method and device of electronic equipment and storage medium | |
| CN113542773B (en) | Multimedia resource sharing method and device, electronic equipment and storage medium | |
| CN112019677B (en) | Electronic equipment control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |