WO2021159864A1 - 一种传输视频音频数据的方法、云端服务器和系统 - Google Patents

一种传输视频音频数据的方法、云端服务器和系统 Download PDF

Info

Publication number
WO2021159864A1
WO2021159864A1 PCT/CN2020/138640 CN2020138640W WO2021159864A1 WO 2021159864 A1 WO2021159864 A1 WO 2021159864A1 CN 2020138640 W CN2020138640 W CN 2020138640W WO 2021159864 A1 WO2021159864 A1 WO 2021159864A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
time
terminal device
audio
wearable device
Prior art date
Application number
PCT/CN2020/138640
Other languages
English (en)
French (fr)
Inventor
康俊腾
张希文
周晓鹏
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2021159864A1 publication Critical patent/WO2021159864A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams

Definitions

  • This application relates to the field of video and audio transmission, and more specifically, to a method, cloud server, and system for transmitting video and audio data.
  • Cloud computing realizes the migration of complex and changing software and hardware to the cloud server.
  • the computing work of the terminal device is also migrated to the cloud server, and the cloud server carries the specific application computing tasks of the terminal device.
  • the terminal device is connected to the cloud server through the network to obtain cloud resources, which greatly simplifies the software and hardware of the terminal device.
  • the cloud server when the cloud server transmits audio and video to the terminal device, it first transmits the video code stream to the terminal device.
  • the terminal device obtains the audio code stream by decoding the video code stream, and then sends the audio code stream to the terminal device via the network. Headphones cause users to perceive that the sound and picture are out of sync, and the experience is poor.
  • This application provides a method, cloud server and system for transmitting video and audio data, which avoids the time delay caused by the terminal device when forwarding the audio code stream to the wearable device, ensures the synchronization of audio and video, and improves the user experience. .
  • a method for transmitting video and audio data includes: a cloud server sends a video code stream and first information to a terminal device, where the first information is used to determine when the terminal device plays the video; the cloud The server sends an audio code stream and second information to the wearable device. The second information is used to determine the time when the wearable device plays audio. The first information and the second information make the terminal device play the video and the The wearable device plays audio at the same time; the terminal device receives the video code stream and the first information, and plays the video according to the time determined by the first information; the wearable device receives the audio code stream and the second information according to The audio is played at the time determined by the second information.
  • the cloud server splits the video code stream and the audio code stream, and respectively sends the video code stream and the first information used to determine the time when the terminal device plays the video to the terminal device, and the audio code stream and the first information used to determine the The second information about the time when the wearable device plays audio is sent to the wearable device, and the first information and the second information make the terminal device play the video at the same time as the wearable device play audio.
  • the terminal device The first information is used to determine the time to play the video, and the wearable device uses the second information to determine the time to play the audio, so that the wearable device is playing audio at the same time the terminal device is playing the video, which prevents the terminal device from turning the audio
  • the time delay caused when the code stream is forwarded to the wearable device ensures the synchronization of audio and video and improves the user experience.
  • the time for the terminal device to play video and the time for the wearable device to play audio may also be preset in advance, for example, according to the length of the system video stream and the time required for decoding, and The length of the system audio stream and the time required for decoding are set in advance for the terminal device to play video and the wearable device to play audio.
  • the cloud server may only send video code streams to the terminal device, and the cloud server may only send audio code streams to the wearable device.
  • the terminal device decodes the video code stream when it receives it. After the preset time is reached, the terminal device plays the video.
  • the wearable device decodes the audio code stream when it reaches the preset time. Then, the wearable device plays the audio.
  • the cloud server splits the video code stream and the audio code stream, and sends the video code stream to the terminal device and the audio code stream to the wearable device. According to the preset time, the terminal device plays the video.
  • the wearable device plays audio, avoiding the delay caused by the terminal device when forwarding the audio code stream to the wearable device, ensuring the synchronization of audio and video, and improving the user experience.
  • the cloud server is based on the length of the video stream and/or the time required for the terminal device to decode the video stream, and the length of the system audio stream And/or the time required for the wearable device to decode the audio code stream, and determine the first information and the second information.
  • the cloud server is based on the length of the video stream and/or the time required for the terminal device to decode the video stream, and the length of the system audio stream And/or the time required for the wearable device to decode the audio code stream, and the time to transmit the video code stream to the terminal device, and the time to transmit the audio code stream to the wearable device (or both Time difference) to determine the first information and the second information.
  • the first information and the second information are time information; or the first information is time information, the second information is indication information, and the second information Used to instruct the wearable device to send a request message to the terminal device, the request message is used to request the wearable device to play the audio time; or the first information is indication information, the first information is used to indicate the terminal device A request message is sent to the wearable device, the request message is used to request the terminal device to play the audio time, and the second information is time information.
  • the first information is used to determine the time for the terminal device to play video
  • the second information is used to determine the time for the wearable device to play audio, but the specific content forms of the first information and the second information are not limited, and are sufficient. Improve the flexibility of the method.
  • the first information and the second information are both at time T1
  • the terminal device plays the video at the time T1
  • the wearable device plays the video at the time T1. Play audio.
  • the cloud server splits the video code stream and the audio code stream, and sends the video code stream and time T1 to the terminal device respectively, and sends the audio code stream and time T1 to the wearable device, and the terminal device parses the video Stream, play the video at time T1, the wearable device parses the audio code stream, and plays the audio at time T1, so that the terminal device is playing the audio at the same time the wearable device is playing the video, which prevents the terminal device from turning the audio
  • the time delay caused when the code stream is forwarded to the wearable device ensures the synchronization of audio and video and improves the user experience.
  • the first information is time T2, and the terminal device plays a video at the time T2;
  • the second information is indication information, and the wearable device is based on the second
  • the information sends the request message to the terminal device;
  • the terminal device receives the request message;
  • the terminal device sends a confirmation message to the wearable device, the confirmation message is used to indicate the time for the wearable device to play the audio, where the confirmation The time for the wearable device to play the audio indicated by the message is time T2.
  • the cloud server splits the video code stream and the audio code stream, sends the video code stream and time T2 to the terminal device respectively, and sends the audio code stream and the request information to the wearable device, and the terminal device parses Video code stream, the video is played at time T2, the wearable device parses the audio code stream, and sends request information to the terminal device.
  • the terminal device receives the request information and sends confirmation information for playing audio to the wearable device.
  • the wearable device Confirm that the time for the wearable device to play the audio indicated by the confirmation message is time T2, and the wearable device plays the audio at time T2, so that the wearable device is playing audio at the same time the terminal device is playing the video, thus avoiding the terminal device
  • the delay caused by the audio code stream when it is forwarded to the wearable device ensures the synchronization of audio and video, and improves the user experience.
  • the confirmation message is the time T2, or the confirmation message is the start value of the timer, and the time when the timer expires is the time T2.
  • the terminal device when the first information is time T2 and the second information is indication information, the terminal device can use the time T2 as the reference time, and the terminal device can decode according to whether the video code stream is decoded. Complete and the system parameters of the terminal device re-determine the time T′ 2 for playing video and audio.
  • the terminal device receives the request information sent by the wearable device, it can send the re-determined time T′ 2 to the wearable device , So that the wearable device is playing audio at the same time the terminal device is playing the video, which avoids the delay caused by the terminal device when forwarding the audio code stream to the wearable device.
  • the terminal device uses the time T2 as the reference time, and re-determines the video and audio playback time T′ 2 according to whether the video code stream is decoded and the system parameters of the terminal device, which can avoid the low network speed or
  • the poor quality of the network causes the terminal device and the wearable device to have the problem of non-synchronization of audio and video according to the time determined by the cloud server to play the audio and video, which further improves the user experience.
  • the request information may also include the degree of completion of the wearable device's decoding of the audio code stream or the network status of the wearable device.
  • the terminal device determines to play the video according to whether the decoding of its own video code stream is completed and the system parameters of the terminal device, and the degree of completion of the wearable device’s decoding of the audio code stream or the wearable device’s network conditions And the audio time T′ 2 .
  • the terminal device uses the time T2 as the reference time, based on whether the video code stream is decoded and the system parameters of the terminal device, and the degree of completion of the wearable device’s decoding of the audio code stream or the wearable device’s network conditions
  • T2 the time of playing audio and video determined by the cloud server
  • the synchronization problem further improves the user experience.
  • the second information is time T3, and the wearable device plays a video at time T3;
  • the first information is indication information, and the terminal device is based on the first
  • the information sends the request message to the wearable device;
  • the wearable device receives the request message;
  • the wearable device sends a confirmation message to the terminal device, and the confirmation message is used to indicate the time for the terminal device to play the audio, where the The time for the terminal device to play the audio indicated by the confirmation message is time T3.
  • the confirmation message is the time T3, or the confirmation message is the start value of the timer, and the time when the timer expires is the time T3.
  • the wearable device when the second information is the time T3 and the first information is the indication information, the wearable device can use the time T3 as the reference time, and the wearable device can use the audio code stream as the reference time. Whether the decoding is completed and the system parameters of the wearable device re-determine the time T′ 2 to play video and audio.
  • the wearable device receives the request information sent by the terminal device, it can send the re-determined time T′ 2 to the terminal Device, so that the wearable device is playing audio at the same time when the terminal device is playing a video, which avoids the delay caused by the terminal device when forwarding the audio code stream to the wearable device.
  • the wearable device uses the time T3 as the reference time, and re-determines the time T′ 3 to play video and audio according to whether the audio code stream is decoded and the system parameters of the wearable device, which can avoid the network speed Low or poor network quality causes the terminal device and the wearable device to have a problem that the audio and video are not synchronized according to the time determined by the cloud server to play the audio and video, which further improves the user experience.
  • the request information may also include the degree of completion of the terminal device's decoding of the video stream or the network condition of the terminal device.
  • the device determines to play the video and audio according to whether the decoding of its own audio stream is completed and the system parameters of the wearable device, and the degree of completion of decoding the video stream of the terminal device or the network condition of the wearable device. ⁇ T′ 3 .
  • the wearable device uses the time T3 as the reference time, according to whether the video code stream is decoded and the system parameters of the terminal device, and the degree of completion of the wearable device’s decoding of the audio code stream or the wearable device’s network
  • re-determining the time T′ 3 for playing video and audio can prevent the terminal device and the wearable device from producing audio and video according to the time determined by the cloud server to play audio and video due to low network speed or poor network quality.
  • the problem of out-of-synchronization, as well as the problem of out-of-sync sound and picture due to incomplete decoding, further improves the user experience.
  • the terminal device obtains the identification information of the wearable device; the terminal device sends the identification information of the wearable device to the cloud server; The identification information of the wearable device sends the audio code stream to the wearable device.
  • identification information of the wearable device may be an independent IP address.
  • the first information is located before the video code stream; the second information is located before the audio code stream.
  • the first information is located before the video code stream, and the second information is located before the audio code stream, so as to avoid bit errors during transmission and decoding, and improve accuracy.
  • a system for transmitting video and audio includes a cloud server, a terminal device, and a wearable device.
  • the cloud server sends a video code stream and first information to the terminal device.
  • the first information is used to determine The time for the terminal device to play the video;
  • the cloud server sends an audio code stream and second information to the wearable device, the second information is used to determine the time for the wearable device to play audio, wherein the first information and the second information
  • the information enables the terminal device to play the video at the same time as the wearable device to play the audio;
  • the terminal device receives the video stream and the first information, and plays the video according to the time determined by the first information;
  • the wearable device receives The audio code stream and the second information play audio according to the time determined by the second information.
  • the first information and the second information are time information; or the first information is time information, the second information is indication information, and the second information Used to instruct the wearable device to send a request message to the terminal device, the request message is used to request the wearable device to play the audio time; or the first information is indication information, the first information is used to indicate the terminal device A request message is sent to the wearable device, the request message is used to request the terminal device to play the audio time, and the second information is time information.
  • the first information and the second information are both at time T1
  • the terminal device plays the video at the time T1
  • the wearable device plays the video at the time T1. Play audio.
  • the first information is time T2
  • the terminal device plays a video at time T2
  • the second information is indication information
  • the wearable device is based on the second
  • the information sends the request message to the terminal device; the terminal device receives the request message; the terminal device sends a confirmation message to the wearable device, the confirmation message is used to indicate the time for the wearable device to play the audio, where the confirmation The time for the wearable device to play the audio indicated by the message is time T2.
  • the confirmation message is the time T2, or the confirmation message is the start value of the timer, and the time when the timer expires is the time T2.
  • the second information is time T3, and the wearable device plays a video at the time T3;
  • the first information is indication information, and the terminal device is based on the first
  • the information sends the request message to the wearable device;
  • the wearable device receives the request message;
  • the wearable device sends a confirmation message to the terminal device, and the confirmation message is used to indicate the time for the terminal device to play the audio, where the The time for the terminal device to play the audio indicated by the confirmation message is time T3.
  • the confirmation message is the time T3, or the confirmation message is the start value of the timer, and the time when the timer expires is the time T3.
  • the terminal device obtains the identification information of the wearable device
  • the terminal device sends the identification information of the wearable device to the cloud server;
  • the cloud server sends the audio code stream to the wearable device according to the identification information of the wearable device.
  • the first information is located before the video code stream; the second information is located before the audio code stream.
  • a cloud server in a third aspect, includes a sending module for sending a video code stream and first information to the terminal device.
  • the first information is used to determine when the terminal device plays the video.
  • the sending module is also used to send an audio code stream and second information to the wearable device, the second information is used to determine the time for the wearable device to play audio, wherein the first information and the second information make the terminal
  • the time for the device to play the video is the same as the time for the wearable device to play the audio.
  • the first information and the second information are time information; or the first information is time information, the second information is indication information, and the second information Used to instruct the wearable device to send a request message to the terminal device, the request message is used to request the wearable device to play the audio time; or the first information is indication information, the first information is used to indicate the terminal device A request message is sent to the wearable device, the request message is used to request the terminal device to play the audio time, and the second information is time information.
  • the first information and the second information are both at time T1
  • the terminal device plays the video at the time T1
  • the wearable device plays the video at the time T1. Play audio.
  • the first information is time T2, and the terminal device plays a video at time T2;
  • the second information is indication information, and the wearable device is based on the second
  • the information sends a request message to the terminal device, and the request message is used to request the wearable device to play the audio time.
  • the second information is time T3, and the wearable device plays a video at time T3;
  • the first information is indication information, and the terminal device is based on the first
  • the information sends a request message to the wearable device, and the request message is used to request the terminal device to play the audio time.
  • the cloud server further includes a receiving module configured to receive the identification information of the wearable device sent by the terminal device; the sending module according to the wearable The identification information of the device sends the audio code stream to the wearable device.
  • the first information is located before the video code stream; the second information is located before the audio code stream.
  • a terminal device including a receiving module and a playing module, the receiving module is used to receive a video code stream and first information sent by a cloud server, and the first information is used to determine when the terminal device plays the video ;
  • the playing module is used to play the video according to the time determined by the first information.
  • the first information is the time T1
  • the terminal device plays the video at the time T1.
  • the first information is time T2, and the terminal device plays a video at time T2;
  • the receiving module is configured to receive the request message sent by the wearable device, and the The request message is used to request the wearable device to play the audio time;
  • the sending module is used to send a confirmation message to the wearable device, the confirmation message is used to indicate the wearable device to play the audio time, where the confirmation message The indicated time for the wearable device to play the audio is T2.
  • the confirmation message is the time T2, or the confirmation message is the start value of the timer, and the time when the timer expires is the time T2.
  • the first information is indication information
  • the sending module is used to send a request message to the wearable device, and the request message is used to request the terminal device to play the audio
  • the receiving module is used to receive the confirmation message sent by the wearable device, the confirmation message is used to indicate the time for the terminal device to play the audio, where the time for the terminal device to play the audio indicated by the confirmation message is T3 time.
  • the confirmation message is the time T3, or the confirmation message is the start value of the timer, and the time when the timer expires is the time T3.
  • the terminal device further includes an acquiring module, the acquiring module is used to acquire the identification information of the wearable device; the sending module is used to send the cloud server to the cloud server The identification information of the wearable device.
  • the first information is located before the video bitstream.
  • a wearable device including a receiving module and a playing module, the receiving module is used to receive an audio code stream and second information sent by a cloud server, and the second information is used to determine that the wearable device plays audio
  • the playback module is used to play the audio according to the time determined by the second information.
  • the second information is time T1
  • the wearable device plays audio at the time T1.
  • the second information is indication information
  • the wearable device further includes a sending module configured to send a request message to the terminal device according to the second information ,
  • the request message is used to request the wearable device to play the audio time;
  • the receiving module is used to receive the confirmation message sent by the terminal device, the confirmation message is used to indicate the wearable device to play the audio time, where the The time for the wearable device to play the audio indicated by the confirmation message is time T2.
  • the confirmation message is the time T2, or the confirmation message is the start value of the timer, and the time when the timer expires is the time T2.
  • the second information is time T3, and the wearable device plays a video at the time T3;
  • the receiving module is configured to receive the terminal device according to the first information to send The request message is used to request the terminal device to play the audio time;
  • the sending module is used to send a confirmation message to the terminal device, the confirmation message is used to instruct the terminal device to play the audio time, where the The time for the terminal device to play the audio indicated by the confirmation message is time T3.
  • the confirmation message is the time T3, or the confirmation message is the start value of the timer, and the time when the timer expires is the time T3.
  • the sending module sends the identification information of the wearable device to the terminal device.
  • the second information is located before the audio code stream.
  • a cloud server includes a processor and a memory, the memory stores instructions, and when the processor executes the instructions, the cloud server executes the first aspect or any possible implementation of the first aspect The method in the way.
  • a terminal device is characterized by comprising a processor and a memory, and instructions are stored in the memory.
  • the processor executes the instructions, the terminal device is caused to execute the first aspect or the first aspect. Any possible implementation method.
  • a wearable device is characterized by comprising a processor and a memory, the memory stores instructions, and when the processor executes the instructions, the wearable device executes the first aspect or any of the first aspects Methods in possible implementations.
  • a computer-readable storage medium stores a computer program or instruction, and when the computer program or instruction is executed by a cloud server, the cloud server executes the first aspect or any possibility of the first aspect The method in the implementation.
  • a computer-readable storage medium storing a computer program or instruction, when the computer program or instruction is executed by a terminal device, causes the terminal device to execute the first aspect or any possibility of the first aspect The method in the implementation.
  • An eleventh aspect a computer-readable storage medium storing a computer program or instruction, and when the computer program or instruction is executed by a wearable device, the wearable device executes the first aspect or the first aspect Any possible implementation of the method.
  • a computer program product includes a computer program that, when executed by a cloud server, causes the cloud server to execute the first aspect or any possible implementation of the first aspect Methods.
  • a computer program product includes a computer program that, when executed by a terminal device, causes the terminal device to execute the first aspect or any possible implementation of the first aspect Methods.
  • a computer program product includes a computer program that, when executed by a wearable device, causes the wearable device to execute the first aspect or any possible implementation of the first aspect The method in the way.
  • a chip in a fifteenth aspect, includes: a processor for calling and running a computer program from a memory, so that a device installed with the chip executes the first aspect or any possible implementation manner of the first aspect In the method.
  • a method for transmitting video and audio data includes: a cloud server sends a video code stream to a terminal device; the cloud server sends an audio code stream and second information to the wearable device, the second information Used to instruct the wearable device to send information requesting to play the audio code stream to the terminal device to determine the time when the wearable device plays audio, and to make the terminal device play video and the wearable device play time The audio time is the same; the wearable device receives the audio code stream and the second information, sends information requesting to play the audio code stream to the terminal device according to the second information, and plays the audio code stream according to the received instruction Audio code stream; the terminal device receives the video code stream, receives information sent by the wearable device requesting to play the audio code stream, determines the time for the wearable device to play the audio code stream and instructs the Wearable device for playback.
  • the cloud server performs a split operation on the video code stream and the audio code stream, respectively sends the video code stream to the terminal device, and sends the audio code stream and the second information to the wearable device
  • the terminal device parses the video code stream; the wearable device parses the audio code stream, and sends request information to the terminal device according to the second information, the terminal device receives the request information, and sends a confirmation of playing the audio code stream to the wearable device Information, the confirmation message instructs the wearable device to play the audio code stream immediately, or the time to play the audio code stream is T2; the wearable device plays the audio code stream according to the received instruction, so that the terminal device is playing The wearable device is playing audio at the same time of the video, avoiding the delay caused by the terminal device when forwarding the audio code stream to the wearable device, ensuring the synchronization of audio and video, and improving the user experience.
  • determining the time for the wearable device to play the audio code stream and instructing the wearable device to play is specifically: the terminal device decodes The information of the video code stream and the system parameters of the terminal device determine the time to play the audio code stream, and send the determined time to play the audio code stream to the wearable device.
  • determining the time for the wearable device to play the audio code stream and instructing the wearable device to play is specifically:
  • the terminal device decodes the information of the video code stream and the system parameters of the terminal device according to the information
  • the degree of completion of decoding the audio code stream by the wearable device and/or the network condition of the wearable device determine the time to play the audio code stream, and send it to the wearable device to play the audio code stream determined time.
  • FIG. 1 is a schematic diagram of an example of a communication system applicable to a method for transmitting video and audio data according to an embodiment of the present application;
  • FIG. 2 is a schematic interaction diagram of a method for transmitting video and audio provided by an embodiment of the present application
  • FIG. 3 is a schematic interaction diagram of a method for transmitting video and audio according to an embodiment of the present application
  • FIG. 4 is a schematic interaction diagram of a method for transmitting video and audio according to an embodiment of the present application
  • FIG. 5 is a schematic block diagram of a cloud server provided by an embodiment of the present application.
  • FIG. 6 is a schematic block diagram of a terminal device provided by an embodiment of the present application.
  • FIG. 7 is a schematic block diagram of a wearable device provided by an embodiment of the present application.
  • Fig. 8 is a schematic block diagram of a communication device provided by an embodiment of the present application.
  • GSM Global System of Mobile Communication
  • CDMA Code Division Multiple Access
  • WCDMA Wideband Code Division Multiple Access
  • GSM Global System of Mobile Communication
  • GPRS General Packet Radio Service
  • LTE Long Term Evolution
  • FDD Frequency Division Duplex
  • TDD Time Division Duplex
  • UMTS Universal Mobile Telecommunication System
  • WiMAX Worldwide Interoperability for Microwave Access
  • 5G 5th Generation
  • 5NR New Radio
  • the terminal equipment in the embodiments of the present application may refer to user equipment, mobile equipment, user terminals, terminals, wireless communication equipment, user agents, or user devices.
  • Terminal devices can also be smart phones, laptops, smart TVs, tablets, wearable VR devices, projectors, handheld devices with wireless communication functions, computing devices or other processing devices connected to wireless modems, vehicle-mounted devices, and 5G in the future
  • the terminal equipment in the network or the terminal equipment in the public land mobile network Public Land Mobile Network, PLMN) that will evolve in the future, etc., are not limited in this embodiment of the present application.
  • the wearable device in the embodiment of the application may be a device used to communicate with a terminal device.
  • the wearable device can decode and play audio.
  • the wearable device may be a wired headset, a Bluetooth headset, a smart watch, or a smart band, etc.,
  • the embodiments of the application are not limited.
  • the terminal device, wearable device or cloud server includes a hardware layer, an operating system layer running on the hardware layer, and an application layer running on the operating system layer.
  • the hardware layer includes hardware such as a central processing unit (CPU), a memory management unit (MMU), and memory (also referred to as main memory).
  • the operating system can be any one or more computer operating systems that implement business processing through processes, for example, Linux operating systems, Unix operating systems, Android operating systems, iOS operating systems, or windows operating systems.
  • the application layer includes applications such as browsers, address books, word processing software, and instant messaging software.
  • the embodiments of the application do not specifically limit the specific structure of the execution body of the method provided in the embodiments of the application, as long as the program that records the codes of the methods provided in the embodiments of the application can be provided in accordance with the embodiments of the application.
  • the execution subject of the method provided in this embodiment of the application can be a terminal device, a wearable device, or a cloud server, or a terminal device, a wearable device, or a cloud server that can call and execute the program Functional modules.
  • various aspects or features of the present application can be implemented as methods, devices, or products using standard programming and/or engineering techniques.
  • article of manufacture used in this application encompasses a computer program accessible from any computer-readable device, carrier, or medium.
  • computer-readable media may include, but are not limited to: magnetic storage devices (for example, hard disks, floppy disks, or tapes, etc.), optical disks (for example, compact discs (CD), digital versatile discs (DVD)) Etc.), smart cards and flash memory devices (for example, erasable programmable read-only memory (EPROM), cards, sticks or key drives, etc.).
  • various storage media described herein may represent one or more devices and/or other machine-readable media for storing information.
  • Cloud computing is a supercomputing model based on the Internet. In a remote data center, thousands of computers and servers are connected to form a computer cloud.
  • Cloud computing includes “cloud” and terminal equipment in terms of resource distribution.
  • “Cloud” is a metaphor for the Internet or large server clusters. It consists of distributed Internet infrastructure, such as network equipment, servers, storage devices, and security devices. Almost all data and applications can be stored in the "cloud”.
  • Terminal devices such as personal computers, PCs, mobile phones, and in-vehicle electronic devices, only need to have a full-featured browser and install a simple operating system, and connect to the "cloud” through the network to use the computing resources in the cloud.
  • Cloud computing realizes the migration of complex and changing software and hardware to the cloud server.
  • the computing work of the terminal device is also migrated to the cloud server, and the cloud server carries the specific application computing tasks of the terminal device.
  • the terminal device is connected to the cloud server through the network to obtain cloud resources, which greatly simplifies the software and hardware of the terminal device.
  • Cloud computing is increasingly applied to various fields, such as cloud games and cloud videos. Let's take cloud games as an example for a brief description. Traditional online games often need to purchase high-configuration PCs, professional gaming keyboards, mice, gamepads and other hardware, which requires high hardware and relatively high user costs. In addition to the high hardware requirements, users also need to download huge installation packages. Can not be transplanted and run between systems; the network transmission rate is low, the delay is high, and the user experience of competitive games is poor. Cloud gaming is based on cloud computing technology. The calculation, storage, rendering, compression and other tasks are completely carried out in the cloud, that is, the game is run on the server, and the result of the calculation is transmitted to the terminal through the network in the form of audio and video streams. The terminal equipment It does not require any high-end processors and graphics cards, only basic video decompression capabilities, control, and communication capabilities are required, which greatly reduces the cost and pressure of the terminal.
  • cloud computing realizes the migration of complex and changing software and hardware to cloud servers, it simplifies the software and hardware of terminal equipment.
  • the cloud server transmits audio and video to the terminal device, it first transmits the video code stream to the terminal device.
  • the terminal device receives the video code stream sent by the cloud server.
  • the terminal device obtains the audio code stream by decoding the video code stream, and then processes and sends it through Bluetooth. .
  • Headphones then process and receive, resulting in too high end-to-end delay, causing users to perceive that the sound and picture are out of sync, and the experience is poor.
  • there is a problem of unsynchronized sound and picture there is a problem of unsynchronized sound and picture.
  • the following is an example of cloud gaming. The user clicks the fire button on the mobile phone.
  • the cloud server recognizes the user to fire through the network.
  • the cloud server performs audio and video rendering, generates a video stream and sends it to the mobile phone.
  • the mobile phone receives the video stream and parses the video stream. You have already seen the picture of the fire on the mobile phone.
  • the mobile phone also needs to send the gunfire through the audio channel to the headset.
  • the headset's Bluetooth port receives the gunfire.
  • the headset is processed before the user hears the sound of the fire.
  • the mobile phone receives the sound first, and then transmits the sound to the earphone.
  • the earphone is playing the sound, causing an end-to-end delay, causing the sound and picture to be out of sync, which reduces the user experience.
  • this application provides a method for transmitting video and audio.
  • the cloud server performs splitting operations on the video code stream and the audio code stream, and separates the video code stream and the first information used to determine the time when the terminal device plays the video.
  • Send to the terminal device, the audio code stream and the second information used to determine the time for the wearable device to play audio are sent to the wearable device, the first information and the second information make the terminal device play the video time Same as the time when the wearable device plays the audio
  • the terminal device uses the first information to determine the time to play the video
  • the wearable device uses the second information to determine the time to play the audio, so that the terminal device is playing the video at the same time
  • the wearable device is playing audio, avoiding the time delay caused by the terminal device when forwarding the audio code stream to the wearable device, ensuring the synchronization of audio and video, and improving the user experience.
  • FIG. 1 is a schematic diagram of a communication system 100 applicable to a method for transmitting video and audio data according to an embodiment of the present application.
  • the communication system 100 includes three communication devices, for example, a cloud server 110, a terminal device 120 and a wearable device 130.
  • the communication system shown in FIG. 1 may also include more network nodes, such as multiple terminal devices or multiple cloud servers.
  • the communication system shown in FIG. 1 includes cloud servers, terminal devices or wearable devices. It can be a cloud server, terminal device, or wearable device in the above-mentioned various forms. The embodiments of this application are not shown one by one in the figure.
  • FIG. 2 is a schematic interaction diagram of a method 200 for transmitting video and audio according to an embodiment of the present application.
  • the method 200 can be applied to the method shown in FIG. In the illustrated scenario, it can of course also be applied to other communication scenarios, and the embodiment of the present application does not limit it here.
  • a cloud server, a terminal device, and a wearable device are taken as an example of the execution subject of the execution method to describe the method.
  • the execution subject of the execution method may also be a chip, a chip system, or a processor applied to cloud servers, terminal devices, and wearable devices.
  • the method 200 shown in FIG. 2 may include S210 to S260. Each step in the method 200 will be described in detail below with reference to FIG. 2.
  • the cloud server sends a video code stream and first information to the terminal device, where the first information is used to determine the time when the terminal device plays the video.
  • the cloud server sends an audio code stream and second information to the wearable device, where the second information is used to determine the time for the wearable device to play audio, where the first information and the second information enable the terminal device to play video The time is the same as the time the wearable device plays audio.
  • S230 The terminal device receives the video code stream and the first information.
  • S240 The terminal device plays the video according to the time determined by the first information.
  • the wearable device receives the audio code stream and the second information.
  • S260 The wearable device plays audio according to the time determined by the second information.
  • the cloud server splits the video code stream and the audio code stream, and respectively sends the video code stream and the first information used to determine the time when the terminal device plays the video to the terminal device, and the audio code stream and the first information used to determine the The second information about the time when the wearable device plays audio is sent to the wearable device, and the first information and the second information make the terminal device play the video at the same time as the wearable device play audio.
  • the terminal device The first information is used to determine the time to play the video, and the wearable device uses the second information to determine the time to play the audio, so that the wearable device is playing audio at the same time the terminal device is playing the video, which prevents the terminal device from turning the audio
  • the time delay caused when the code stream is forwarded to the wearable device ensures the synchronization of audio and video and improves the user experience.
  • the time for the terminal device to play video and the time for the wearable device to play audio may also be preset in advance, for example, according to the length of the system video stream and the time required for decoding, and The length of the system audio stream and the time required for decoding are set in advance for the terminal device to play video and the wearable device to play audio.
  • the cloud server may only send video code streams to the terminal device, and the cloud server may only send audio code streams to the wearable device.
  • the terminal device decodes the video code stream when it receives it. After the preset time is reached, the terminal device plays the video, and the wearable device decodes the audio code stream when it reaches the preset time. Then, the wearable device plays the audio.
  • the cloud server splits the video code stream and the audio code stream, and sends the video code stream to the terminal device and the audio code stream to the wearable device. According to the preset time, the terminal device plays the video.
  • the wearable device plays audio, avoiding the delay caused by the terminal device when forwarding the audio code stream to the wearable device, ensuring the synchronization of audio and video, and improving the user experience.
  • the first information and the second information are time information; or the first information is time information, the second information is indication information, and the second information is used to instruct the wearable device to send to the terminal device Request message, the request message is used to request the wearable device to play the audio time; or the first information is indication information, the first information is used to instruct the terminal device to send a request message to the wearable device, the request message It is used to request the terminal device to play the audio time, and the second information is time information.
  • the first information is used to determine the time for the terminal device to play video
  • the second information is used to determine the time for the wearable device to play audio, but the specific content forms of the first information and the second information are not limited, and are sufficient. Improve the flexibility of the method.
  • the first information and the second information are both at time T1
  • the terminal device plays a video at the time T1
  • the wearable device plays audio at the time T1.
  • the cloud server splits the video code stream and the audio code stream, and sends the video code stream and time T1 to the terminal device respectively, and sends the audio code stream and time T1 to the wearable device, and the terminal device parses the video Stream, play the video at time T1, the wearable device parses the audio code stream, and plays the audio at time T1, so that the terminal device is playing the audio at the same time the wearable device is playing the video, which prevents the terminal device from turning the audio
  • the time delay caused when the code stream is forwarded to the wearable device ensures the synchronization of audio and video and improves the user experience.
  • the first information is time T2
  • the terminal device plays a video at time T2
  • the second information is indication information
  • the wearable device sends a request to the terminal device according to the second information Message
  • the request message is used to request the wearable device to play the audio
  • the terminal device receives the request message
  • the terminal device sends a confirmation message to the wearable device, the confirmation message is used to instruct the wearable device to play the audio
  • the audio time where the time for the wearable device to play the audio indicated by the confirmation message is time T2.
  • FIG. 3 is a schematic interaction diagram of a method for transmitting video and audio 300 according to an embodiment of the present application.
  • the method 300 can be applied to the method shown in FIG. In the illustrated scenario, it can of course also be applied to other communication scenarios, and the embodiment of the present application does not limit it here.
  • the method 300 shown in FIG. 3 may include S310 to S390.
  • the steps in the method 300 will be described in detail below in conjunction with FIG. 3.
  • S310 The cloud server sends a video code stream and first information to the terminal device, where the first information is time T2.
  • S320 The cloud server sends an audio code stream and second information to the wearable device, where the second information is indication information, and the indication message is used to indicate the wearable device to request the terminal device to play the audio time.
  • the terminal device receives the video code stream and the first information.
  • S340 The terminal device plays the video according to the time determined by the first information.
  • the wearable device receives the audio code stream and the second information.
  • S360 Send a request message to the terminal device according to the second information.
  • the terminal device receives the request message.
  • S380 The terminal device sends a confirmation message to the wearable device, where the confirmation message is used to indicate a time for the wearable device to play the audio, where the time for the wearable device to play the audio indicated by the confirmation message is time T2.
  • the wearable device receives the confirmation message, and plays audio according to the time determined by the confirmation message.
  • the cloud server splits the video code stream and the audio code stream, sends the video code stream and time T2 to the terminal device respectively, and sends the audio code stream and the request information to the wearable device, and the terminal device parses Video code stream, the video is played at time T2, the wearable device parses the audio code stream, and sends request information to the terminal device.
  • the terminal device receives the request information and sends confirmation information for playing audio to the wearable device.
  • the wearable device Confirm that the time for the wearable device to play the audio indicated by the confirmation message is time T2, and the wearable device plays the audio at time T2, so that the wearable device is playing audio at the same time the terminal device is playing the video, thus avoiding the terminal device
  • the delay caused by the audio code stream when it is forwarded to the wearable device ensures the synchronization of audio and video, and improves the user experience.
  • the confirmation message is the time T2, or the confirmation message is the start value of the timer, and the time when the timer expires is the time T2.
  • the terminal device when the first information is the time T2 and the second information is the request information, the terminal device can use the time T2 as the reference time, and the terminal device can decode according to whether the video code stream is decoded. Complete and the system parameters of the terminal device re-determine the time T′ 2 for playing video and audio.
  • the terminal device receives the request information sent by the wearable device, it can send the re-determined time T′ 2 to the wearable device , So that the wearable device is playing audio at the same time the terminal device is playing the video, which avoids the delay caused by the terminal device when forwarding the audio code stream to the wearable device.
  • the terminal device uses the time T2 as the reference time, and re-determines the video and audio playback time T′ 2 according to whether the video code stream is decoded and the system parameters of the terminal device, which can avoid the low network speed or
  • the poor quality of the network causes the terminal device and the wearable device to have the problem of non-synchronization of audio and video according to the time determined by the cloud server to play the audio and video, which further improves the user experience.
  • the request information may also include the degree of completion of the wearable device's decoding of the audio code stream or the network status of the wearable device.
  • the terminal device determines to play the video according to whether the decoding of its own video code stream is completed and the system parameters of the terminal device, and the degree of completion of the wearable device’s decoding of the audio code stream or the wearable device’s network conditions And the audio time T′ 2 .
  • the terminal device uses the time T2 as the reference time, based on whether the video code stream is decoded and the system parameters of the terminal device, and the degree of completion of the wearable device’s decoding of the audio code stream or the wearable device’s network conditions
  • T2 the time T2
  • the terminal device and the wearable device produce audio and video problems according to the time determined by the cloud server to play audio and video due to low network speed or poor network quality.
  • the synchronization problem further improves the user experience.
  • the second information is time T3, and the wearable device plays a video at time T3;
  • the first information is instruction information, and the terminal device sends to the wearable device according to the first information Request message, the request message is used to request the terminal device to play the audio time;
  • the wearable device receives the request message;
  • the wearable device sends a confirmation message to the terminal device, the confirmation message is used to instruct the terminal device to play the audio
  • the audio time where the time for the terminal device to play the audio indicated by the confirmation message is time T3.
  • FIG. 4 is a schematic interaction diagram of a method for transmitting video and audio 400 according to an embodiment of the present application.
  • the method 400 can be applied to the method shown in FIG. In the illustrated scenario, it can of course also be applied to other communication scenarios, and the embodiment of the present application does not limit it here.
  • the method 400 shown in FIG. 4 may include S410 to S490.
  • each step in the method 400 will be described in detail with reference to FIG. 4.
  • the cloud server sends a video code stream and first information to the terminal device, where the first information is request information, and the request message is used by the terminal device to request the wearable device to play the audio time.
  • S420 The cloud server sends the audio code stream and second information to the wearable device, where the second information is time T3.
  • the wearable device receives the audio code stream and the second information.
  • S440 The wearable device plays audio according to the time determined by the second information.
  • S450 The terminal device receives the video code stream and the first information.
  • S460 Send a request message to the wearable device according to the first information.
  • S470 The wearable device receives the request message.
  • the wearable device sends a confirmation message to the terminal device, where the confirmation message is used to indicate the time for the terminal device to play the video, where the time for the terminal device to play the audio indicated by the confirmation message is time T3.
  • S490 The terminal device receives the confirmation message, and plays the video according to the time determined by the confirmation message.
  • the cloud server splits the video code stream and the audio code stream, sends the video code stream and request information to the terminal device respectively, and sends the audio code stream and time T3 to the wearable device, and the terminal device parses the video
  • the code stream sends request information to the wearable device, the wearable device receives the request information, and sends confirmation information for playing the video to the terminal device.
  • the confirmation message indicates that the terminal device plays the audio at time T3,
  • the terminal device plays the video at time T3, the wearable device parses the audio code stream, and plays the audio at T3, so that the wearable device is playing audio at the same time the terminal device is playing the video, which prevents the terminal device from translating the audio code
  • the delay caused by the stream when it is forwarded to the wearable device ensures the synchronization of audio and video and improves the user experience.
  • the confirmation message is time T3, or the confirmation message is the start value of a timer, and the time when the timer expires is time T3.
  • the wearable device when the second information is the time T3 and the first information is the request information, the wearable device can use the time T3 as the reference time, and the wearable device can use the audio code stream as the reference time. Whether the decoding is completed and the system parameters of the wearable device re-determine the time T′ 3 to play video and audio.
  • the wearable device receives the request information sent by the terminal device, it can send the re-determined time T′ 3 to the terminal Device, so that the wearable device is playing audio at the same time when the terminal device is playing a video, which avoids the delay caused by the terminal device when forwarding the audio code stream to the wearable device.
  • the wearable device uses the time T3 as the reference time, and re-determines the time T′ 3 to play video and audio according to whether the audio code stream is decoded and the system parameters of the wearable device, which can avoid the network speed Low or poor network quality causes the terminal device and the wearable device to have a problem that the audio and video are not synchronized according to the time determined by the cloud server to play the audio and video, which further improves the user experience.
  • the request information may also include the degree of completion of the terminal device's decoding of the video stream or the network condition of the terminal device.
  • the device determines to play the video and audio according to whether the decoding of its own audio stream is completed and the system parameters of the wearable device, and the degree of completion of decoding the video stream of the terminal device or the network condition of the wearable device. ⁇ T′ 3 .
  • the wearable device uses the time T3 as the reference time, according to whether the video code stream is decoded and the system parameters of the terminal device, and the degree of completion of the wearable device’s decoding of the audio code stream or the wearable device’s network
  • re-determining the time T′ 3 for playing video and audio can prevent the terminal device and the wearable device from producing audio and video according to the time determined by the cloud server to play audio and video due to low network speed or poor network quality.
  • the problem of out-of-synchronization, as well as the problem of out-of-sync sound and picture due to incomplete decoding, further improves the user experience.
  • the terminal device obtains the identification information of the wearable device; the terminal device sends the identification information of the wearable device to the cloud server; the cloud server sends the identification information of the wearable device to the wearable device according to the identification information of the wearable device Audio stream.
  • identification information of the wearable device may be an independent IP address.
  • the first information is located before the video code stream; the second information is located before the audio code stream.
  • the first information is located before the video code stream, and the second information is located before the audio code stream, so as to avoid bit errors during transmission and decoding, and improve accuracy.
  • FIG. 5 shows a schematic block diagram of a cloud server 500 according to an embodiment of the present application.
  • the cloud server 500 may correspond to the cloud server described in the above method 200 to method 400, or may be a chip or component applied to a terminal device, and, Each module or unit in the cloud server 300 is used to execute each action or process performed by the cloud server in the above method 200 to method 400, respectively.
  • the cloud server 500 may include a sending module 510.
  • the sending module 510 is used to send a video code stream and first information to the terminal device, and the first information is used to determine when the terminal device plays the video; the sending module 510 is also used to send an audio code stream to the wearable device And second information, the second information is used to determine the time for the wearable device to play audio, wherein the first information and the second information make the terminal device play the video at the same time as the wearable device play audio.
  • the cloud server further includes a receiving module 520 configured to receive the identification information of the wearable device sent by the terminal device; the sending module 510 sends the identification information of the wearable device to the wearable device Send the audio stream.
  • the cloud server 500 is used to perform various operations of the cloud server in the method 200 to 400 of the present application for transmitting video and audio. For similar descriptions, reference may be made to the description in the corresponding method. To avoid repetition, I won’t repeat them here.
  • FIG. 6 shows a schematic block diagram of a terminal device 600 according to an embodiment of the present application.
  • the terminal device 600 may correspond to the cloud server described in the foregoing method 200 to method 400, or may be a chip or component applied to the terminal device, and, Each module or unit in the terminal device 600 is respectively used to execute each action or processing procedure performed by the terminal device in the above-mentioned method 200 to method 400.
  • the terminal device 600 includes a receiving module 610 and a playing module 620.
  • the receiving module 610 is used to receive a video code stream and first information sent by a cloud server.
  • the first information is used to determine that the terminal device plays a video.
  • the time; the playing module 620 is used to play the video at the time determined according to the first information.
  • the terminal device 600 is used to perform various operations of the terminal device in a method 200 to 400 of the present application for transmitting video and audio.
  • FIG. 7 shows a schematic block diagram of a wearable device 700 according to an embodiment of the present application.
  • the wearable device 700 may correspond to the cloud server described in the foregoing method 200 to method 400, or may be a chip or component applied to a terminal device.
  • each module or unit in the wearable device 700 is respectively used to execute each action or processing procedure performed by the wearable device in the aforementioned method 200 to method 400.
  • the wearable device 700 includes a receiving module 710 and a playing module 720.
  • the receiving module 710 is used to receive an audio code stream and second information sent by a cloud server.
  • the second information is used to determine the wearable device
  • the playing module 720 is configured to play the audio according to the time determined by the second information.
  • terminal device 600 is used to perform various operations of the wearable device in the method 200 to 400 of the present application for transmitting video and audio.
  • Fig. 8 is a schematic block diagram of a communication device according to an embodiment of the present application. It should be understood that the communication device may refer to the aforementioned cloud server, terminal device, and wearable device.
  • the communication device 800 shown in FIG. 8 can be used to perform steps corresponding to the steps performed by the cloud server, terminal device, and wearable device in the method 200 to the method 400 in FIG. 2 to FIG. 4.
  • the communication device embodiment and the method embodiment correspond to each other.
  • the communication device 800 includes a processor 810, a memory 820, and a transceiver 830.
  • the processor 810, the memory 820, and the transceiver 830 are connected through communication.
  • the memory 820 stores instructions
  • the processor 810 is configured to execute instructions stored in the memory 820
  • the transceiver 830 is configured to execute specific signal transceiving under the driving of the processor 810.
  • each unit in the device can be all implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; part of the units can also be implemented in the form of software called by the processing elements, and some of the units can be implemented in the form of hardware.
  • each unit can be a separate processing element, or it can be integrated in a certain chip of the device for implementation.
  • it can also be stored in the memory in the form of a program, which is called and executed by a certain processing element of the device. Function.
  • the processing element may also be called a processor, and may be an integrated circuit with signal processing capability.
  • each step of the above method or each of the above units may be implemented by an integrated logic circuit of hardware in a processor element or implemented in a form of being called by software through a processing element.
  • the unit in any of the above devices may be one or more integrated circuits configured to implement the above methods, for example: one or more application specific integrated circuits (ASIC), or, one or Multiple digital signal processors (digital signal processors, DSP), or, one or more field programmable gate arrays (FPGA), or a combination of at least two of these integrated circuits.
  • ASIC application specific integrated circuits
  • DSP digital signal processors
  • FPGA field programmable gate arrays
  • the unit in the device can be implemented in the form of a processing element scheduler
  • the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processors that can call programs.
  • CPU central processing unit
  • these units can be integrated together and implemented in the form of a system-on-a-chip (SOC).
  • the above-mentioned embodiments may be implemented in whole or in part by software, hardware, firmware or any other combination.
  • the above-mentioned embodiments may be implemented in the form of a computer program product in whole or in part.
  • the computer program product includes one or more computer instructions or computer programs.
  • the computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • the computer instruction may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.
  • the computer instruction may be transmitted from a website, computer, server, or data center through a cable (For example, infrared, wireless, microwave, etc.) to transmit to another website, computer, server or data center.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center containing one or more sets of available media.
  • the usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium.
  • the semiconductor medium may be a solid state drive.
  • the embodiment of the present application also provides a communication system, which includes the aforementioned cloud server, wearable device, and terminal device.
  • the embodiments of the present application also provide a computer-readable medium on which a computer program is stored, and when the computer program is executed by a computer, it realizes the steps performed by the terminal device in any of the above embodiments, or the steps performed by the cloud server, or The steps performed by the wearable device.
  • the readable medium may be a read-only memory (ROM) or a random access memory (RAM), which is not limited in the embodiment of the present application.
  • the embodiments of the present application also provide a computer program product that, when executed by a computer, implements the steps performed by the terminal device in any of the above embodiments, or the steps performed by the cloud server, or the steps performed by the wearable device.
  • An embodiment of the present application also provides a system chip, which includes: a communication unit and a processing unit.
  • the processing unit may be a processor, for example.
  • the communication unit may be, for example, a communication interface, an input/output interface, a pin or a circuit, or the like.
  • the processing unit can execute computer instructions so that the chip in the communication device executes the steps performed by the terminal device provided in the embodiments of the present application, or the steps performed by the cloud server, or the steps performed by the communication device.
  • any communication device provided in the foregoing embodiments of the present application may include the system chip.
  • the computer instructions are stored in a storage unit.
  • the storage unit is a storage unit in the chip, such as a register, a cache, etc.
  • the storage unit can also be a storage unit in the terminal located outside the chip, such as a ROM or other storage units that can store static information and instructions.
  • static storage devices RAM, etc.
  • the processor mentioned in any of the above may be a CPU, a microprocessor, an ASIC, or one or more integrated circuits used to control the program execution of the above resource request method.
  • the processing unit and the storage unit can be decoupled, respectively set on different physical devices, and connected in a wired or wireless manner to realize the respective functions of the processing unit and the storage unit, so as to support the system chip to implement the above-mentioned embodiments Various functions in.
  • the processing unit and the memory may also be coupled to the same device.
  • the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory can be read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), and electrically available Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • the volatile memory may be random access memory (RAM), which is used as an external cache.
  • RAM random access memory
  • static random access memory static random access memory
  • DRAM dynamic random access memory
  • DRAM synchronous dynamic random access memory
  • Access memory synchronous DRAM, SDRAM
  • double data rate synchronous dynamic random access memory double data rate SDRAM, DDR SDRAM
  • enhanced synchronous dynamic random access memory enhanced SDRAM, ESDRAM
  • synchronous connection dynamic random access memory Take memory (synchlink DRAM, SLDRAM) and direct memory bus random access memory (direct rambus RAM, DR RAM).
  • system and "network” in this article are often used interchangeably in this article.
  • the disclosed system, device, and method can be implemented in other ways.
  • the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of the present application essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium.
  • a computer device which may be a personal computer, a server, or a network device, etc.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请提供了一种传输视频音频数据的方法、云端服务器和系统。在所述方法中，云端服务器向终端设备发送视频码流和第一信息，第一信息用于确定终端设备播放视频的时间；云端服务器向可穿戴设备发送音频码流和第二信息，第二信息用于确定可穿戴设备播放音频的时间，其中第一信息和所述第二信息使得终端设备播放视频的时间和可穿戴设备播放音频的时间相同；终端设备接收视频码流，根据第一信息确定的时间播放视频；可穿戴设备接收所述音频码流，根据第二信息确定的时间播放音频。所述方法使得所述终端设备在播放视频的同一时刻所述可穿戴设备在播放音频，避免了终端设备将音频码流在转发给所述可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。

Description

一种传输视频音频数据的方法、云端服务器和系统
本申请要求于2020年02月11日提交中国专利局、申请号为202010087244.3、申请名称为“一种传输视频音频的方法、设备和系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及视频音频传输领域，并且更具体的，涉及一种传输视频音频数据的方法、云端服务器和系统。
背景技术
随着多核处理器、虚拟化、分布式存储、宽带互联网和自动化管理等技术的发展，云计算应运而生。云计算实现了将复杂并且变化的软硬件迁移到云端服务器，同时终端设备的计算工作也迁移到云服务器，由云端服务器承载终端设备的具体应用计算任务。终端设备通过网络连接到云端服务器，便可以获取云端资源，从而使得终端设备的软硬件都极大简化。
在现有的云计算应用中，云端服务器向终端设备传输音频视频时，首先将视频码流传送给终端设备，终端设备通过解码视频码流获取音频码流，再通过网络将音频码流发送给耳机，导致用户感知到声画不同步，体验感差。
因此，在云网络下如何传输音频视频是亟需解决的问题。
发明内容
本申请提供一种传输视频音频数据的方法、云端服务器和系统，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
第一方面，提供了一种传输视频音频数据的方法，该方法包括：云端服务器向终端设备发送视频码流和第一信息，该第一信息用于确定该终端设备播放视频的时间；该云端服务器向可穿戴设备发送音频码流和第二信息，该第二信息用于确定该可穿戴设备播放音频的时间，其中该第一信息和该第二信息使得该终端设备播放视频的时间和该可穿戴设备播放音频的时间相同；该终端设备接收该视频码流和该第一信息，根据该第一信息确定的时间播放视频；该可穿戴设备接收该音频码流和该第二信息，根据该第二信息确定的时间播放音频。因此，云端服务器对视频码流和音频码流进行分流操作，分别将视频码流和用于确定该终端设备播放视频的时间的第一信息发送给该终端设备，将音频码流和用于确定该可穿戴设备播放音频的时间的第二信息发送给该可穿戴设备，该第一信息和该第二信息使得该终端设备播放视频的时间和该可穿戴设备播放音频的时间相同，该终端设备通过该第一信息确定播放视频的时间，该可穿戴设备通过该第二信息确定播放音频的时间，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
应理解，在本申请实施例中，该终端设备播放视频的时间和该可穿戴设备播放音频的时间也可以是事先预设的，如根据系统视频码流的长度以及解码所需的时间，和系统音频码流的长度以及解码所需的时间事先设置该终端设备播放视频和该可穿戴设备播放音频的时间。该云端服务器可以向该终端设备只发送视频码流，和该云端服务器可以向该可穿戴设备只发送音频码流。该终端设备在收到该视频码流时解码，在到达事先预设的时间后，该终端设备播放该视频，该可穿戴设备在收到该音频码流时解码，在到达事先预设的时间后，该可穿戴设备播放该音频。云端服务器对视频码流和音频码流进行分流操作，分别将视频码流给该终端设备，将音频码流发送给该可穿戴设备，根据事先预设的时间，该终端设备播放视频，该可穿戴设备播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
结合第一方面，在第一方面的某些实现方式中，该云端服务器根据该视频码流的长度和/或该终端设备解码该视频码流所需的时间，以及该系统音频码流的长度和/或该可穿戴设备解码该音频码流所需的时间，确定该第一信息和第二信息。
结合第一方面，在第一方面的某些实现方式中，该云端服务器根据该视频码流的长度和/或该终端设备解码该视频码流所需的时间，以及该系统音频码流的长度和/或该可穿戴设备解码该音频码流所需的时间，以及将该视频码流传输到该终端设备的时间，和将该音频码流传输到该可穿戴设备的时间(或者两者的时间差)，确定该第一信息和第二信息。
结合第一方面，在第一方面的某些实现方式中，该第一信息和该第二信息为时间信息；或该第一信息为时间信息，该第二信息为指示信息，该第二信息用于指示该可穿戴设备向该终端设备发送请求消息，该请求消息用于请求该可穿戴设备播放该音频的时间；或该第一信息为指示信息，该第一信息用于指示该终端设备向该可穿戴设备发送请求消息，该请求消息用于请求该终端设备播放该音频的时间，该第二信息为时间信息。
该第一信息用于确定该终端设备播放视频的时间，该第二信息用于确定该可穿戴设备播放音频的时间，但该第一信息和该第二信息的具体内容形式不做限定，充分提高了该方法的灵活性。
结合第一方面，在第一方面的某些实现方式中，该第一信息和该第二信息均为时刻T1，该终端设备在该时刻T1时播放视频，该可穿戴设备在该时刻T1时播放音频。
因此，该云端服务器对视频码流和音频码流进行分流操作，分别将视频码流和时刻T1发送给该终端设备，将音频码流和时刻T1发送给该可穿戴设备，该终端设备解析视频码流，在时刻T1时播放视频，该可穿戴设备解析音频码流，在时刻T1时播放音频，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
结合第一方面，在第一方面的某些实现方式中，该第一信息为时刻T2，该终端设备在该T2时刻播放视频；该第二信息为指示信息，该可穿戴设备根据该第二信息向该终端设备发送该请求消息；该终端设备接收该请求消息；该终端设备向该可穿戴设备发送确认消息，该确认消息用于指示该可穿戴设备播放该音频的时间，其中，该确认消息指示的该可穿戴设备播放该音频的时间为T2时刻。
因此，该云端服务器对视频码流和音频码流进行分流操作，分别将视频码流和时刻T2发送给该终端设备，将音频码流和该请求信息发送给该可穿戴设备，该终端设备解析 视频码流，在时刻T2时播放视频，该可穿戴设备解析音频码流，向该终端设备发送请求信息，该终端设备接收到该请求信息，向该可穿戴设备发送播放音频的确认信息，该确认消息指示的该可穿戴设备播放该音频的时间为T2时刻，该可穿戴设备在时刻T2时播放音频，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
结合第一方面，在第一方面的某些实现方式中，该确认消息为时刻T2，或该确认消息为定时器的起始值，该定时器定时结束时的时间为T2时刻。
应理解，在本申请实施例中，当该第一信息为时刻T2，该第二信息为指示信息时，该终端设备可以将该时刻T2作为参考时间，该终端设备可以根据视频码流是否解码完成以及终端设备的系统参数重新确定播放视频和音频的时间T′ 2，在该终端设备接收到该可穿戴设备发送的请求信息时，可以将重新确定的时间T′ 2发送给该可穿戴设备，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延。并且，在该方法中，该终端设备将该时刻T2作为参考时间，根据视频码流是否解码完成以及终端设备的系统参数重新确定播放视频和音频的时间T′ 2，可以避免由于网速低或者网络质量差的原因，导致该终端设备和该可穿戴设备根据该云端服务器确定的播放音频视频的时间产生声画不同步的问题，进一步提高了用户体验感。
应理解，在本申请实施例中，该可穿戴设备在向该终端设备发送请求信息时，该请求信息还可以包括该可穿戴设备解码音频码流的完成度或者该可穿戴设备的网络情况，该终端设备在接收到该请求信息后，根据自身视频码流是否解码完成以及终端设备的系统参数，和该可穿戴设备解码音频码流的完成度或者该可穿戴设备的网络情况，确定播放视频和音频的时间T′ 2。在该方法中，该终端设备将该时刻T2作为参考时间，根据视频码流是否解码完成以及终端设备的系统参数，和该可穿戴设备解码音频码流的完成度或者该可穿戴设备的网络情况，重新确定播放视频和音频的时间T′ 2，可以避免由于网速低或者网络质量差的原因，导致该终端设备和该可穿戴设备根据该云端服务器确定的播放音频视频的时间产生声画不同步的问题，进一步提高了用户体验感。
结合第一方面，在第一方面的某些实现方式中，该第二信息为时刻T3，该可穿戴设备在该T3时刻播放视频；该第一信息为指示信息，该终端设备根据该第一信息向该可穿戴设备发送该请求消息；该可穿戴设备接收该请求消息；该可穿戴设备向该终端设备发送确认消息，该确认消息用于指示该终端设备播放该音频的时间，其中，该确认消息指示的该终端设备播放该音频的时间为T3时刻。
结合第一方面，在第一方面的某些实现方式中，该确认消息为时刻T3，或该确认消息为定时器的起始值，该定时器定时结束时的时间为T3时刻。
应理解，在本申请实施例中，当该第二信息为时刻T3，该第一信息为指示信息时，该可穿戴设备可以将该时刻T3作为参考时间，该可穿戴设备可以根据音频码流是否解码完成以及可穿戴设备的系统参数重新确定播放视频和音频的时间T′ 2，在可穿戴设备接收到该终端设备发送的请求信息时，可以将重新确定的时间T′ 2发送给该终端设备，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延。并且，在该方法中，该可穿戴设备将该时刻T3作为参考时间，根据音频码流是否解码完成以及可穿戴设备的系统参数重新确定播放视频和音频的 时间T′ 3，可以避免由于网速低或者网络质量差的原因，导致该终端设备和该可穿戴设备根据该云端服务器确定的播放音频视频的时间产生声画不同步的问题，进一步提高了用户体验感。
应理解，在本申请实施例中，该终端设备在向可穿戴设备发送请求信息时，该请求信息还可以包括该终端设备解码视频码流的完成度或者该终端设备的网络情况，该可穿戴设备在接收到该请求信息后，根据自身音频码流是否解码完成以及可穿戴设备的系统参数，和该终端设备解码视频码流的完成度或者该可穿戴设备的网络情况，确定播放视频和音频的时间T′ 3。在该方法中，该可穿戴设备将该时刻T3作为参考时间，根据视频码流是否解码完成以及终端设备的系统参数，和该可穿戴设备解码音频码流的完成度或者该可穿戴设备的网络情况，重新确定播放视频和音频的时间T′ 3，可以避免由于网速低或者网络质量差的原因，导致该终端设备和该可穿戴设备根据该云端服务器确定的播放音频视频的时间产生声画不同步的问题，以及由于解码不完全导致的声画不同步问题，进一步提高了用户体验感。
结合第一方面，在第一方面的某些实现方式中，该终端设备获取该可穿戴设备的标识信息；该终端设备向该云端服务器发送该可穿戴设备的标识信息；该云端服务器根据该可穿戴设备的标识信息向该可穿戴设备发送该音频码流。
应理解，该可穿戴设备的标识信息可以是独立IP地址。
结合第一方面，在第一方面的某些实现方式中，该第一信息位于该视频码流之前；该第二信息位于该音频码流之前。
将该第一信息位于该视频码流之前，该第二信息位于该音频码流之前，避免了在传输过程以及解码时，出现误码，提高准确度。
第二方面，提供了一种传输视频音频的系统，该系统包括云端服务器，终端设备和可穿戴设备，该云端服务器向该终端设备发送视频码流和第一信息，该第一信息用于确定该终端设备播放视频的时间；该云端服务器向该可穿戴设备发送音频码流和第二信息，该第二信息用于确定该可穿戴设备播放音频的时间，其中该第一信息和该第二信息使得该终端设备播放视频的时间和该可穿戴设备播放音频的时间相同；该终端设备接收该视频码流和该第一信息，根据该第一信息确定的时间播放视频；该可穿戴设备接收该音频码流和该第二信息，根据该第二信息确定的时间播放音频。
结合第二方面，在第二方面的某些实现方式中，该第一信息和该第二信息为时间信息；或该第一信息为时间信息，该第二信息为指示信息，该第二信息用于指示该可穿戴设备向该终端设备发送请求消息，该请求消息用于请求该可穿戴设备播放该音频的时间；或该第一信息为指示信息，该第一信息用于指示该终端设备向该可穿戴设备发送请求消息，该请求消息用于请求该终端设备播放该音频的时间，该第二信息为时间信息。
结合第二方面，在第二方面的某些实现方式中，该第一信息和该第二信息均为时刻T1，该终端设备在该时刻T1时播放视频，该可穿戴设备在该时刻T1时播放音频。
结合第二方面，在第二方面的某些实现方式中，该第一信息为时刻T2，该终端设备在该T2时刻播放视频；该第二信息为指示信息，该可穿戴设备根据该第二信息向该终端设备发送该请求消息；该终端设备接收该请求消息；该终端设备向该可穿戴设备发送确认消息，该确认消息用于指示该可穿戴设备播放该音频的时间，其中，该确认消息指示的该 可穿戴设备播放该音频的时间为T2时刻。
结合第二方面，在第二方面的某些实现方式中，该确认消息为时刻T2，或该确认消息为定时器的起始值，该定时器定时结束时的时间为T2时刻。
结合第二方面，在第二方面的某些实现方式中，该第二信息为时刻T3，该可穿戴设备在该T3时刻播放视频；该第一信息为指示信息，该终端设备根据该第一信息向该可穿戴设备发送该请求消息；该可穿戴设备接收该请求消息；该可穿戴设备向该终端设备发送确认消息，该确认消息用于指示该终端设备播放该音频的时间，其中，该确认消息指示的该终端设备播放该音频的时间为T3时刻。
结合第二方面，在第二方面的某些实现方式中，该确认消息为时刻T3，或该确认消息为定时器的起始值，该定时器定时结束时的时间为T3时刻。
结合第二方面，在第二方面的某些实现方式中，该终端设备获取该可穿戴设备的标识信息；
该终端设备向该云端服务器发送该可穿戴设备的标识信息；
该云端服务器根据该可穿戴设备的标识信息向该可穿戴设备发送该音频码流。
结合第二方面，在第二方面的某些实现方式中，该第一信息位于该视频码流之前；该第二信息位于该音频码流之前。
第三方面，提供了一种云端服务器，该云端服务器包括发送模块，该发送模块用于向该终端设备发送视频码流和第一信息，该第一信息用于确定该终端设备播放视频的时间；该发送模块还用于向该可穿戴设备发送音频码流和第二信息，该第二信息用于确定该可穿戴设备播放音频的时间，其中该第一信息和该第二信息使得该终端设备播放视频的时间和该可穿戴设备播放音频的时间相同。
结合第三方面，在第三方面的某些实现方式中，该第一信息和该第二信息为时间信息；或该第一信息为时间信息，该第二信息为指示信息，该第二信息用于指示该可穿戴设备向该终端设备发送请求消息，该请求消息用于请求该可穿戴设备播放该音频的时间；或该第一信息为指示信息，该第一信息用于指示该终端设备向该可穿戴设备发送请求消息，该请求消息用于请求该终端设备播放该音频的时间，该第二信息为时间信息。
结合第三方面，在第三方面的某些实现方式中，该第一信息和该第二信息均为时刻T1，该终端设备在该时刻T1时播放视频，该可穿戴设备在该时刻T1时播放音频。
结合第三方面，在第三方面的某些实现方式中，该第一信息为时刻T2，该终端设备在该T2时刻播放视频；该第二信息为指示信息，该可穿戴设备根据该第二信息向该终端设备发送请求消息，该请求消息用于请求该可穿戴设备播放该音频的时间。
结合第三方面，在第三方面的某些实现方式中，该第二信息为时刻T3，该可穿戴设备在该T3时刻播放视频；该第一信息为指示信息，该终端设备根据该第一信息向该可穿戴设备发送请求消息，该请求消息用于请求该终端设备播放该音频的时间。
结合第三方面，在第三方面的某些实现方式中，该云端服务器还包括接收模块，该接收模块用于接收该终端设备发送的该可穿戴设备的标识信息；该发送模块根据该可穿戴设备的标识信息向该可穿戴设备发送该音频码流。
结合第三方面，在第三方面的某些实现方式中，该第一信息位于该视频码流之前；该第二信息位于该音频码流之前。
第四方面，提供了一种终端设备，包括接收模块和播放模块，该接收模块用于接收云端服务器发送的视频码流和第一信息，该第一信息用于确定该终端设备播放视频的时间；该播放模块用于根据该第一信息确定的时间播放视频。
结合第四方面，在第四方面的某些实现方式中，该第一信息为时刻T1，该终端设备在该时刻T1时播放视频。
结合第四方面，在第四方面的某些实现方式中，该第一信息为时刻T2，该终端设备在该T2时刻播放视频；该接收模块用于接收该可穿戴设备发送的请求消息，该请求消息用于请求该可穿戴设备播放该音频的时间；该发送模块用于向该可穿戴设备发送确认消息，该确认消息用于指示该可穿戴设备播放该音频的时间，其中，该确认消息指示的该可穿戴设备播放该音频的时间为T2。
结合第四方面，在第四方面的某些实现方式中，该确认消息为时刻T2，或该确认消息为定时器的起始值，该定时器定时结束时的时间为T2时刻。
结合第四方面，在第四方面的某些实现方式中，该第一信息为指示信息，该发送模块用于向该可穿戴设备发送请求消息，该请求消息用于请求该终端设备播放该音频的时间；该接收模块用于接收该可穿戴设备发送的确认消息，该确认消息用于指示该终端设备播放该音频的时间，其中，该确认消息指示的该终端设备播放该音频的时间为T3时刻。
结合第四方面，在第四方面的某些实现方式中，该确认消息为时刻T3，或该确认消息为定时器的起始值，该定时器定时结束时的时间为T3时刻。
结合第四方面，在第四方面的某些实现方式中，该终端设备还包括获取模块，该获取模块用于获取该可穿戴设备的标识信息；该发送模块用于向该云端服务器发送该可穿戴设备的标识信息。
结合第四方面，在第四方面的某些实现方式中，该第一信息位于该视频码流之前。
第五方面，提供了一种可穿戴设备，包括接收模块和播放模块，该接收模块用于接收云端服务器发送的音频码流和第二信息，该第二信息用于确定该可穿戴设备播放音频的时间，该播放模块用于根据该第二信息确定的时间播放音频。
结合第五方面，在第五方面的某些实现方式中，该第二信息为时刻T1，该可穿戴设备在该时刻T1时播放音频。
结合第五方面，在第五方面的某些实现方式中，该第二信息为指示信息，该可穿戴设备还包括发送模块，该发送模块用于根据该第二信息向该终端设备发送请求消息，该请求消息用于请求该可穿戴设备播放该音频的时间；该接收模块用于接收该终端设备发送的确认消息，该确认消息用于指示该可穿戴设备播放该音频的时间，其中，该确认消息指示的该可穿戴设备播放该音频的时间为T2时刻。
结合第五方面，在第五方面的某些实现方式中，该确认消息为时刻T2，或该确认消息为定时器的起始值，该定时器定时结束时的时间为T2时刻。
结合第五方面，在第五方面的某些实现方式中，该第二信息为时刻T3，该可穿戴设备在该T3时刻播放视频；该接收模块用于接收该终端设备根据该第一信息发送的请求消息，该请求消息用于请求该终端设备播放该音频的时间；该发送模块用于向该终端设备发送确认消息，该确认消息用于指示该终端设备播放该音频的时间，其中，该确认消息指示的该终端设备播放该音频的时间为T3时刻。
结合第五方面，在第五方面的某些实现方式中，该确认消息为时刻T3，或该确认消息为定时器的起始值，该定时器定时结束时的时间为T3时刻。
结合第五方面，在第五方面的某些实现方式中，该发送模块向该终端设备发送该可穿戴设备的标识信息。
结合第五方面，在第五方面的某些实现方式中，该第二信息位于该音频码流之前。
第六方面，一种云端服务器，包括处理器和存储器，所述存储器中存储有指令，所述处理器执行所述指令时，使得该云端服务器执行第一方面或第一方面的任意可能的实现方式中的方法。
第七方面，一种终端设备，其特征在于，包括处理器和存储器，所述存储器中存储有指令，所述处理器执行所述指令时，使得该终端设备执行第一方面或第一方面的任意可能的实现方式中的方法。
第八方面，一种可穿戴设备，其特征在于，包括处理器和存储器，该存储器中存储有指令，该处理器执行该指令时，使得该可穿戴设备执行第一方面或第一方面的任意可能的实现方式中的方法。
第九方面，一种计算机可读存储介质，该存储介质中存储有计算机程序或指令，当该计算机程序或指令被云端服务器执行时，使得该云端服务器执行第一方面或第一方面的任意可能的实现方式中的方法。
第十方面，一种计算机可读存储介质，该存储介质中存储有计算机程序或指令，当该计算机程序或指令被终端设备执行时，使得该终端设备执行第一方面或第一方面的任意可能的实现方式中的方法。
第十一方面，一种计算机可读存储介质，该存储介质中存储有计算机程序或指令，当该计算机程序或指令被可穿戴设备执行时，使得该可穿戴设备执行第一方面或第一方面的任意可能的实现方式中的方法。
第十二方面，提供了一种计算机程序产品，该计算机程序产品包括计算机程序，该计算机程序在被云端服务器执行时，使得该云端服务器执行第一方面或第一方面的任意可能的实现方式中的方法。
第十三方面，提供了一种计算机程序产品，该计算机程序产品包括计算机程序，该计算机程序在被终端设备执行时，使得该终端设备执行第一方面或第一方面的任意可能的实现方式中的方法。
第十四方面，提供了一种计算机程序产品，该计算机程序产品包括计算机程序，该计算机程序在被可穿戴设备执行时，使得该可穿戴设备执行第一方面或第一方面的任意可能的实现方式中的方法。
第十五方面，提供了一种芯片，该芯片包括：处理器，用于从存储器中调用并运行计算机程序，使得安装有该芯片的设备执行第一方面或第一方面的任意可能的实现方式中的方法。
第十六方面，提供一种传输视频和音频数据的方法，该方法包括：云端服务器向终端设备发送视频码流；该云端服务器向可穿戴设备发送音频码流和第二信息，该第二信息用于指示所述可穿戴设备向所述终端设备发送请求播放所述音频码流的信息，以确定该可穿戴设备播放音频的时间，并使得该终端设备播放视频的时间和该可穿戴设备播放音频的时 间相同；该可穿戴设备接收该音频码流和该第二信息，根据该第二信息向所述终端设备发送请求播放所述音频码流的信息，并根据接收到的指示播放所述音频码流；所述终端设备接收该视频码流，接收所述可穿戴设备发送的请求播放所述音频码流的信息，确定所述可穿戴设备播放所述音频码流的时间并指示所述可穿戴设备进行播放。
应理解，在本申请实施例中，该云端服务器对视频码流和音频码流进行分流操作，分别将视频码流发送给终端设备，将音频码流和第二信息发送给该可穿戴设备，该终端设备解析视频码流；该可穿戴设备解析音频码流，根据第二信息向该终端设备发送请求信息，该终端设备接收到该请求信息，向该可穿戴设备发送播放音频码流的确认信息，该确认消息指示该可穿戴设备立即播放该音频码流，或者播放该音频码流的时间为T2时刻；该可穿戴设备根据接收到的指示播放该音频码流，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
结合第十六方面，在第十六方面的某些实现方式中，确定所述可穿戴设备播放所述音频码流的时间并指示所述可穿戴设备进行播放具体为：所述终端设备根据解码所述视频码流的信息以及所述终端设备的系统参数，确定播放所述音频码流的时间，并发送给所述可穿戴设备所述确定的播放所述音频码流的时间。
结合第十六方面，在第十六方面的某些实现方式中，确定所述可穿戴设备播放所述音频码流的时间并指示所述可穿戴设备进行播放具体为：
所述终端设备根据解码所述视频码流的信息以及所述终端设备的系统参数；和
该可穿戴设备解码音频码流的完成度和/或者该可穿戴设备的网络情况，确定播放所述音频码流的时间，并发送给所述可穿戴设备所述确定的播放所述音频码流的时间。
附图说明
图1是一例适用于本申请实施例的一种传输视频音频数据的方法的通信系统的架构示意图；
图2是本申请实施例提供的一种传输视频音频的方法的示意性交互图；
图3是本申请实施例提供的一种传输视频音频的方法的示意性交互图；
图4是本申请实施例提供的一种传输视频音频的方法的示意性交互图；
图5是本申请实施例提供的云端服务器的示意性框图；
图6是本申请实施例提供的终端设备的示意性框图；
图7是本申请实施例提供的可穿戴设备的示意性框图；
图8是本申请实施例提供的通信装置的示意性框图。
具体实施方式
下面将结合附图，对本申请中的技术方案进行描述。
本申请实施例的技术方案可以应用于各种通信系统，例如：全球移动通讯(Global System of Mobile communication，GSM)系统、码分多址(Code Division Multiple Access，CDMA)系统、宽带码分多址(Wideband Code Division Multiple Access，WCDMA)系统、通用分组无线业务(General Packet Radio Service，GPRS)、长期演进(Long Term Evolution，LTE)系统、LTE频分双工(Frequency Division Duplex，FDD)系统、LTE时分双工(Time  Division Duplex，TDD)、通用移动通信系统(Universal Mobile Telecommunication System，UMTS)、全球互联微波接入(Worldwide Interoperability for Microwave Access，WiMAX)通信系统、未来的第五代(5th Generation，5G)系统或新无线(New Radio，NR)等。
本申请实施例中的终端设备可以指用户设备、移动设备、用户终端、终端、无线通信设备、用户代理或用户装置。终端设备还可以是智能手机、笔记本电脑、智能电视、平板电脑、穿戴式VR设备、投影仪、具有无线通信功能的手持设备、计算设备或连接到无线调制解调器的其它处理设备、车载设备，未来5G网络中的终端设备或者未来演进的公用陆地移动通信网络(Public Land Mobile Network，PLMN)中的终端设备等，本申请实施例对此并不限定。
本申请实施例中的可穿戴设备可以是用于与终端设备通信的设备，该可穿戴设备可以解码并且播放音频，该可穿戴设备可以是有线耳机、蓝牙耳机、智能手表或只能手环等，本申请实施例并不限定。
在本申请实施例中，终端设备、可穿戴设备或云端服务器包括硬件层、运行在硬件层之上的操作系统层，以及运行在操作系统层上的应用层。该硬件层包括中央处理器(central processing unit，CPU)、内存管理单元(memory management unit，MMU)和内存(也称为主存)等硬件。该操作系统可以是任意一种或多种通过进程(process)实现业务处理的计算机操作系统，例如，Linux操作系统、Unix操作系统、Android操作系统、iOS操作系统或windows操作系统等。该应用层包含浏览器、通讯录、文字处理软件、即时通信软件等应用。并且，本申请实施例并未对本申请实施例提供的方法的执行主体的具体结构特别限定，只要能够通过运行记录有本申请实施例的提供的方法的代码的程序，以根据本申请实施例提供的方法进行通信即可，例如，本申请实施例提供的方法的执行主体可以是终端设备、可穿戴设备或云端服务器，或者，是终端设备、可穿戴设备或云端服务器中能够调用程序并执行程序的功能模块。
另外，本申请的各个方面或特征可以实现成方法、装置或使用标准编程和/或工程技术的制品。本申请中使用的术语“制品”涵盖可从任何计算机可读器件、载体或介质访问的计算机程序。例如，计算机可读介质可以包括，但不限于:磁存储器件(例如，硬盘、软盘或磁带等)，光盘(例如，压缩盘(compact disc，CD)、数字通用盘(digital versatile disc，DVD)等)，智能卡和闪存器件(例如，可擦写可编程只读存储器(erasable programmable read-only memory，EPROM)、卡、棒或钥匙驱动器等)。另外，本文描述的各种存储介质可代表用于存储信息的一个或多个设备和/或其它机器可读介质。
随着计算机技术的发展，传统的应用需要面对越来越多的问题，如需要支持更多的用户，需要更强的计算能力，需要更加稳定安全等。为了支撑这些不断增长的需求，企业不得不去购买各类硬件设备(服务器，存储，带宽等)和软件(数据库，中间件等)，另外企业还需要组建一个完整的运维团队来支持这些设备或软件的正常运作，这些维护工作就包括安装、配置、测试、运行、升级以及保证系统的安全等。进而使得企业为了支持这些应用的开销变得非常巨大。为了改变这一状况，云计算应运而生，云计算(cloud computing)是一种基于因特网的超级计算模式，在远程的数据中心里，成千上万台电脑和服务器连接成一片电脑云。云计算在资源分布上包括“云”和终端设备。“云”是互联网或大型服务器集群的一种比喻，由分布的互联网基础设施，如网络设备、服务器、存储设备、安全设 备等构成，几乎所有的数据和应用都可存储在“云”里。终端设备，例如个人电脑PC、手机、车载电子设备等，只需要拥有一个功能完备的浏览器并安装一个简单的操作系统，通过网络接入“云”，就可以使用云中的计算资源。云计算实现了将复杂并且变化的软硬件迁移到云端服务器，同时终端设备的计算工作也迁移到云服务器，由云端服务器承载终端设备的具体应用计算任务。终端设备通过网络连接到云端服务器，便可以获取云端资源，从而使得终端设备的软硬件都极大简化。
云计算越来越多的应用到各个领域，如云游戏，云视频。下面以云游戏为例，进行简单说明。传统网络游戏往往需要购买高配置的PC、专业的游戏键盘、鼠标、游戏手柄等硬件，对硬件要求高，用户成本相对较高；除了硬件要求过高以外，用户还需要下载巨大的安装包，无法系统间移植运行；网络传输速率较低，延迟较高，竞技类游戏用户体验差等。云游戏就是基于云计算技术，将计算、储存、渲染、压缩等工作完全放在云端进行，即在服务器上运行游戏，将运算的结果以音视频流的方式通过网络传送到终端上，终端设备不需要任何高端处理器和显卡，只需要基本的视频解压能力、操控、通讯的能力即可，大大降低了终端的成本和压力。
云计算虽然实现了将复杂并且变化的软硬件迁移到云端服务器，简化了终端设备的软硬件。但是云端服务器向终端设备传输音频视频时，首先将视频码流传送给终端设备，终端设备接收云端服务器发送的视频码流，终端设备通过解码视频码流获取音频码流，再通过蓝牙处理和发送。耳机再进行处理和接收，造成端到端时延过高导致用户感知到声画不同步，体验感差。在云游戏和云视频中都存在声画不同步的问题。下面以云游戏为例进行说明。用户在手机上点了开火键，云端服务器经过网络识别到用户开火，云端服务器进行音视频渲染，生成视频码流发送给手机，手机接收到视频码流，经过解析视频码流，此时用户在手机上已经看到开火的画面，手机还需要将枪声经过音频通路发送到耳机，耳机的蓝牙空口接收到枪声，耳机在经过处理，用户才听到开火的声音。手机先接收声音，再将声音传送到耳机，耳机在播放声音，造成端到端的延时，导致声画不同步，降低了用户体验。
有鉴于此，本申请提供了一种传输视频音频的方法，云端服务器对视频码流和音频码流进行分流操作，分别将视频码流和用于确定该终端设备播放视频的时间的第一信息发送给该终端设备，将音频码流和用于确定该可穿戴设备播放音频的时间的第二信息发送给该可穿戴设备，该第一信息和该第二信息使得该终端设备播放视频的时间和该可穿戴设备播放音频的时间相同，该终端设备通过该第一信息确定播放视频的时间，该可穿戴设备通过该第二信息确定播放音频的时间，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
为便于理解本申请实施例，首先结合图1简单介绍适用于本申请实施例的通信系统。
图1是适用于本申请实施例的一种传输视频音频数据的方法的通信系统100的示意图。如图1所示，该通信系统100包括三个通信设备，例如，云端服务器110，终端设备120和可穿戴设备130。应理解，图1所示的通信系统中还可以包括更多的网络节点，例如多个终端设备或多个云端服务器，图1所示的通信系统中包括的云端服务器、终端设备或可穿戴设备可以是上述各种形式的云端服务器、终端设备或可穿戴设备。本申请实施例在图 中不再一一示出。
下面结合图2详细说明本申请提供的一种传输视频音频的方法，图2是本申请一个实施例的一种传输视频音频的方法200的示意性交互图，该方法200可以应用在图1所示的场景中，当然也可以应用在其他通信场景中，本申请实施例在此不作限制。
还应理解，在本申请实施例中，以云端服务器、终端设备和可穿戴设备作为执行方法的执行主体为例，对方法进行说明。作为示例而非限定，执行方法的执行主体也可以是应用于云端服务器、终端设备和可穿戴设备的芯片、芯片系统、或处理器等。
如图2所示，图2中示出的方法200可以包括S210至S260。下面结合图2详细说明方法200中的各个步骤。
S210，云端服务器向终端设备发送视频码流和第一信息，该第一信息用于确定该终端设备播放视频的时间。
S220，该云端服务器向可穿戴设备发送音频码流和第二信息，该第二信息用于确定该可穿戴设备播放音频的时间，其中该第一信息和该第二信息使得该终端设备播放视频的时间和该可穿戴设备播放音频的时间相同。
S230,该终端设备接收该视频码流和该第一信息。
S240，该终端设备根据该第一信息确定的时间播放视频。
S250，该可穿戴设备接收该音频码流和该第二信息。
S260，该可穿戴设备根据该第二信息确定的时间播放音频。
因此，云端服务器对视频码流和音频码流进行分流操作，分别将视频码流和用于确定该终端设备播放视频的时间的第一信息发送给该终端设备，将音频码流和用于确定该可穿戴设备播放音频的时间的第二信息发送给该可穿戴设备，该第一信息和该第二信息使得该终端设备播放视频的时间和该可穿戴设备播放音频的时间相同，该终端设备通过该第一信息确定播放视频的时间，该可穿戴设备通过该第二信息确定播放音频的时间，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
应理解，在本申请实施例中，该终端设备播放视频的时间和该可穿戴设备播放音频的时间也可以是事先预设的，如根据系统视频码流的长度以及解码所需的时间，和系统音频码流的长度以及解码所需的时间事先设置该终端设备播放视频和该可穿戴设备播放音频的时间。该云端服务器可以向该终端设备只发送视频码流，和该云端服务器可以向该可穿戴设备只发送音频码流。该终端设备在收到该视频码流时解码，在到达事先预设的时间后，该终端设备播放该视频，该可穿戴设备在收到该音频码流时解码，在到达事先预设的时间后，该可穿戴设备播放该音频。云端服务器对视频码流和音频码流进行分流操作，分别将视频码流给该终端设备，将音频码流发送给该可穿戴设备，根据事先预设的时间，该终端设备播放视频，该可穿戴设备播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
可选的，该第一信息和该第二信息为时间信息；或该第一信息为时间信息，该第二信息为指示信息，该第二信息用于指示该可穿戴设备向该终端设备发送请求消息，该请求消息用于请求该可穿戴设备播放该音频的时间；或该第一信息为指示信息，该第一信息用于指示该终端设备向该可穿戴设备发送请求消息，该请求消息用于请求该终端设备播放该音 频的时间，该第二信息为时间信息。
该第一信息用于确定该终端设备播放视频的时间，该第二信息用于确定该可穿戴设备播放音频的时间，但该第一信息和该第二信息的具体内容形式不做限定，充分提高了该方法的灵活性。
可选的，该第一信息和该第二信息均为时刻T1，该终端设备在该时刻T1时播放视频，该可穿戴设备在该时刻T1时播放音频。
因此，该云端服务器对视频码流和音频码流进行分流操作，分别将视频码流和时刻T1发送给该终端设备，将音频码流和时刻T1发送给该可穿戴设备，该终端设备解析视频码流，在时刻T1时播放视频，该可穿戴设备解析音频码流，在时刻T1时播放音频，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
在本申请另一实施例中，该第一信息为时刻T2，该终端设备在该T2时刻播放视频；该第二信息为指示信息，该可穿戴设备根据该第二信息向该终端设备发送请求消息，该请求消息用于请求该可穿戴设备播放该音频的时间；该终端设备接收该请求消息；该终端设备向该可穿戴设备发送确认消息，该确认消息用于指示该可穿戴设备播放该音频的时间，其中，该确认消息指示的该可穿戴设备播放该音频的时间为T2时刻。
下面结合图3详细说明本申请提供的一种传输视频音频的方法，图3是本申请一个实施例的一种传输视频音频的方法300的示意性交互图，该方法300可以应用在图1所示的场景中，当然也可以应用在其他通信场景中，本申请实施例在此不作限制。
如图3所示，图3中示出的方法300可以包括S310至S390。下面结合图3详细说明方法300中的各个步骤。
S310，云端服务器向终端设备发送视频码流和第一信息，该第一信息为时刻T2。
S320，该云端服务器向可穿戴设备发送音频码流和第二信息，该第二信息为指示信息，该指示消息用于指示该可穿戴设备向该终端设备请求播放该音频的时间。
S330，该终端设备接收该视频码流和该第一信息，
S340，该终端设备根据该第一信息确定的时间播放视频。
S350,该可穿戴设备接收该音频码流和该第二信息。
S360，根据该第二信息向该终端设备发送请求消息。
S370，该终端设备接收该请求消息。
S380，该终端设备向该可穿戴设备发送确认消息，该确认消息用于指示该可穿戴设备播放该音频的时间，其中，该确认消息指示的该可穿戴设备播放该音频的时间为T2时刻。
S390，该可穿戴设备接收该确认消息，根据该确认消息确定的时间播放音频。
因此，该云端服务器对视频码流和音频码流进行分流操作，分别将视频码流和时刻T2发送给该终端设备，将音频码流和该请求信息发送给该可穿戴设备，该终端设备解析视频码流，在时刻T2时播放视频，该可穿戴设备解析音频码流，向该终端设备发送请求信息，该终端设备接收到该请求信息，向该可穿戴设备发送播放音频的确认信息，该确认消息指示的该可穿戴设备播放该音频的时间为T2时刻，该可穿戴设备在时刻T2时播放音频，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
可选的，该确认消息为时刻T2，或该确认消息为定时器的起始值，该定时器定时结束时的时间为T2时刻。
应理解，在本申请实施例中，当该第一信息为时刻T2，该第二信息为请求信息时，该终端设备可以将该时刻T2作为参考时间，该终端设备可以根据视频码流是否解码完成以及终端设备的系统参数重新确定播放视频和音频的时间T′ 2，在该终端设备接收到该可穿戴设备发送的请求信息时，可以将重新确定的时间T′ 2发送给该可穿戴设备，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延。并且，在该方法中，该终端设备将该时刻T2作为参考时间，根据视频码流是否解码完成以及终端设备的系统参数重新确定播放视频和音频的时间T′ 2，可以避免由于网速低或者网络质量差的原因，导致该终端设备和该可穿戴设备根据该云端服务器确定的播放音频视频的时间产生声画不同步的问题，进一步提高了用户体验感。
应理解，在本申请实施例中，该可穿戴设备在向该终端设备发送请求信息时，该请求信息还可以包括该可穿戴设备解码音频码流的完成度或者该可穿戴设备的网络情况，该终端设备在接收到该请求信息后，根据自身视频码流是否解码完成以及终端设备的系统参数，和该可穿戴设备解码音频码流的完成度或者该可穿戴设备的网络情况，确定播放视频和音频的时间T′ 2。在该方法中，该终端设备将该时刻T2作为参考时间，根据视频码流是否解码完成以及终端设备的系统参数，和该可穿戴设备解码音频码流的完成度或者该可穿戴设备的网络情况，重新确定播放视频和音频的时间T′ 2，可以避免由于网速低或者网络质量差的原因，导致该终端设备和该可穿戴设备根据该云端服务器确定的播放音频视频的时间产生声画不同步的问题，进一步提高了用户体验感。
在本申请又一实施例中，该第二信息为时刻T3，该可穿戴设备在该T3时刻播放视频；该第一信息为指示信息，该终端设备根据该第一信息向该可穿戴设备发送请求消息，该请求消息用于请求该终端设备播放该音频的时间；该可穿戴设备接收该请求消息；该可穿戴设备向该终端设备发送确认消息，该确认消息用于指示该终端设备播放该音频的时间，其中，该确认消息指示的该终端设备播放该音频的时间为T3时刻。
下面结合图4详细说明本申请提供的一种传输视频音频的方法，图4是本申请一个实施例的一种传输视频音频的方法400的示意性交互图，该方法400可以应用在图1所示的场景中，当然也可以应用在其他通信场景中，本申请实施例在此不作限制。
如图4所示，图4中示出的方法400可以包括S410至S490。下面结合图4详细说明方法400中的各个步骤。
S410，云端服务器向终端设备发送视频码流和第一信息，该第一信息为请求信息，该请求消息用于该终端设备向该可穿戴设备请求播放该音频的时间。
S420，该云端服务器向可穿戴设备发送音频码流和第二信息，该第二信息为时刻T3，。
S430，该可穿戴设备接收该音频码流和该第二信息.
S440，该可穿戴设备根据该第二信息确定的时间播放音频。
S450,该终端设备接收该视频码流和该第一信息.
S460，根据该第一信息向该可穿戴设备发送请求消息。
S470，该可穿戴设备接收该请求消息。
S480，该可穿戴设备向该终端设备发送确认消息，该确认消息用于指示该终端设备播 放该视频的时间，其中，该确认消息指示的该终端设备播放该音频的时间为T3时刻。
S490，该终端设备接收该确认消息，根据该确认消息确定的时间播放视频。
因此，该云端服务器对视频码流和音频码流进行分流操作，分别将视频码流和请求信息发送给该终端设备，将音频码流和时刻T3发送给该可穿戴设备，该终端设备解析视频码流，向该可穿戴设备发送请求信息，该可穿戴设备接收到该请求信息，向该终端设备发送播放视频的确认信息，该确认消息指示的该终端设备播放该音频的时间为T3时刻，该终端设备在时刻T3时播放视频，该可穿戴设备解析音频码流，在T3时播放音频，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延，保证了声画同步，提高了用户体验感。
可选的，该确认消息为时刻T3，或该确认消息为定时器的起始值，该定时器定时结束时的时间为T3时刻。
应理解，在本申请实施例中，当该第二信息为时刻T3，该第一信息为请求信息时，该可穿戴设备可以将该时刻T3作为参考时间，该可穿戴设备可以根据音频码流是否解码完成以及可穿戴设备的系统参数重新确定播放视频和音频的时间T′ 3，在可穿戴设备接收到该终端设备发送的请求信息时，可以将重新确定的时间T′ 3发送给该终端设备，使得该终端设备在播放视频的同一时刻该可穿戴设备在播放音频，避免了终端设备将音频码流在转发给该可穿戴设备时带来的时延。并且，在该方法中，该可穿戴设备将该时刻T3作为参考时间，根据音频码流是否解码完成以及可穿戴设备的系统参数重新确定播放视频和音频的时间T′ 3，可以避免由于网速低或者网络质量差的原因，导致该终端设备和该可穿戴设备根据该云端服务器确定的播放音频视频的时间产生声画不同步的问题，进一步提高了用户体验感。
应理解，在本申请实施例中，该终端设备在向可穿戴设备发送请求信息时，该请求信息还可以包括该终端设备解码视频码流的完成度或者该终端设备的网络情况，该可穿戴设备在接收到该请求信息后，根据自身音频码流是否解码完成以及可穿戴设备的系统参数，和该终端设备解码视频码流的完成度或者该可穿戴设备的网络情况，确定播放视频和音频的时间T′ 3。在该方法中，该可穿戴设备将该时刻T3作为参考时间，根据视频码流是否解码完成以及终端设备的系统参数，和该可穿戴设备解码音频码流的完成度或者该可穿戴设备的网络情况，重新确定播放视频和音频的时间T′ 3，可以避免由于网速低或者网络质量差的原因，导致该终端设备和该可穿戴设备根据该云端服务器确定的播放音频视频的时间产生声画不同步的问题，以及由于解码不完全导致的声画不同步问题，进一步提高了用户体验感。
可选的，该终端设备获取该可穿戴设备的标识信息；该终端设备向该云端服务器发送该可穿戴设备的标识信息；该云端服务器根据该可穿戴设备的标识信息向该可穿戴设备发送该音频码流。
应理解，该可穿戴设备的标识信息可以是独立IP地址。
可选的，该第一信息位于该视频码流之前；该第二信息位于该音频码流之前。
将该第一信息位于该视频码流之前，该第二信息位于该音频码流之前，避免了在传输过程以及解码时，出现误码，提高准确度。
还应理解，在本申请的实施例中涉及的各种数字编号仅为描述方便进行的区分，并不 用来限制本申请的实施例的范围。上述各过程的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本申请实施例的实施过程构成任何限定。
还应理解，上述只是为了帮助本领域技术人员更好地理解本申请实施例，而非要限制本申请实施例的范围。本领域技术人员根据所给出的上述示例，显然可以进行各种等价的修改或变化，例如，上述方法200中某些步骤可以是不必须的，或者可以新加入某些步骤等。或者上述任意两种或者任意多种实施例的组合。这样的修改、变化或者组合后的方案也落入本申请实施例的范围内。
以上结合图1至图4对本申请实施例的一种传输视频音频的方法做了详细说明。以下，结合图5至图8对本申请实施例装置进行详细说明。
图5示出了本申请实施例的云端服务器500的示意性框图，该云端服务器500可以对应上述方法200至方法400中描述的云端服务器，也可以是应用于终端设备的芯片或组件，并且，该云端服务器300中各模块或单元分别用于执行上述方法200至方法400中云端服务器所执行的各动作或处理过程。
如图5所示，该云端服务器500可以包发送模块510。该发送模块510用于向该终端设备发送视频码流和第一信息，该第一信息用于确定该终端设备播放视频的时间；该发送模块510还用于向该可穿戴设备发送音频码流和第二信息，该第二信息用于确定该可穿戴设备播放音频的时间，其中该第一信息和该第二信息使得该终端设备播放视频的时间和该可穿戴设备播放音频的时间相同。
可选的，该云端服务器还包括接收模块520，该接收模块520用于接收该终端设备发送的该可穿戴设备的标识信息；该发送模块510根据该可穿戴设备的标识信息向该可穿戴设备发送该音频码流。
应理解，该云端服务器500用于执行本申请的一种传输视频音频的方法200至方法400中云端服务器的各个操作，类似的描述可以参考前述对应的方法中的描述。为避免重复，这里不再赘述。
图6示出了本申请实施例的终端设备600的示意性框图，该终端设备600可以对应上述方法200至方法400中描述的云端服务器，也可以是应用于终端设备的芯片或组件，并且，该终端设备600中各模块或单元分别用于执行上述方法200至方法400中终端设备所执行的各动作或处理过程。
如图6所示，该终端设备600包括接收模块610和播放模块620，该接收模块610用于接收云端服务器发送的视频码流和第一信息，该第一信息用于确定该终端设备播放视频的时间；该播放模块620用于根据该第一信息确定的时间播放视频。
应理解，该终端设备600用于执行本申请的一种传输视频音频的方法200至方法400中终端设备的各个操作，类似的描述可以参考前述对应的方法中的描述，为避免重复，这里不再赘述。
图7示出了本申请实施例的可穿戴设备700的示意性框图，该可穿戴设备700可以对应上述方法200至方法400中描述的云端服务器，也可以是应用于终端设备的芯片或组件，并且，该可穿戴设备700中各模块或单元分别用于执行上述方法200至方法400中可穿戴设备所执行的各动作或处理过程。
如图7所示，该可穿戴设备700包括接收模块710和播放模块720，该接收模块710用于接收云端服务器发送的音频码流和第二信息，该第二信息用于确定该可穿戴设备播放音频的时间，该播放模块720用于根据该第二信息确定的时间播放音频。
应理解，该终端设备600用于执行本申请的一种传输视频音频的方法200至方法400中可穿戴设备的各个操作，类似的描述可以参考前述对应的方法中的描述。为避免重复，这里不再赘述。
图8是本申请一个实施例的通信装置的示意性框图。应理解，该通信装置可以指上述的云端服务器、终端设备和可穿戴设备。图8所示的通信装置800可以用于执行对应于图2至图4中、方法200至方法400中云端服务器、终端设备和可穿戴设备执行的步骤。通信装置实施例与方法实施例相互对应，类似的描述可以参照方法实施例，该通信装置800包括：处理器810、存储器820和收发器830，处理器810、存储器820和收发器830通过通信连接，存储器820存储指令，处理器810用于执行存储器820存储的指令，收发器830用于在处理器810的驱动下执行具体的信号收发。
还应理解，以上装置中单元的划分仅仅是一种逻辑功能的划分，实际实现时可以全部或部分集成到一个物理实体上，也可以物理上分开。且装置中的单元可以全部以软件通过处理元件调用的形式实现；也可以全部以硬件的形式实现；还可以部分单元以软件通过处理元件调用的形式实现，部分单元以硬件的形式实现。例如，各个单元可以为单独设立的处理元件，也可以集成在装置的某一个芯片中实现，此外，也可以以程序的形式存储于存储器中，由装置的某一个处理元件调用并执行该单元的功能。这里该处理元件又可以称为处理器，可以是一种具有信号处理能力的集成电路。在实现过程中，上述方法的各步骤或以上各个单元可以通过处理器元件中的硬件的集成逻辑电路实现或者以软件通过处理元件调用的形式实现。
在一个例子中，以上任一装置中的单元可以是被配置成实施以上方法的一个或多个集成电路，例如：一个或多个专用集成电路(application specific integrated circuit，ASIC)，或，一个或多个数字信号处理器(digital signal processor，DSP)，或，一个或者多个现场可编程门阵列(field programmable gate array，FPGA)，或这些集成电路形式中至少两种的组合。再如，当装置中的单元可以通过处理元件调度程序的形式实现时，该处理元件可以是通用处理器，例如中央处理器(central processing unit，CPU)或其它可以调用程序的处理器。再如，这些单元可以集成在一起，以片上系统(system-on-a-chip，SOC)的形式实现。
上述实施例，可以全部或部分地通过软件、硬件、固件或其他任意组合来实现。当使用软件实现时，上述实施例可以全部或部分地以计算机程序产品的形式实现。该计算机程序产品包括一个或多个计算机指令或计算机程序。在计算机上加载或执行该计算机指令或计算机程序时，全部或部分地产生按照本申请实施例的流程或功能。该计算机可以为通用计算机、专用计算机、计算机网络、或者其他可编程装置。该计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，该计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。该计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介 质集合的服务器、数据中心等数据存储设备。该可用介质可以是磁性介质(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或者半导体介质。半导体介质可以是固态硬盘。
根据本申请实施例提供的方法，本申请实施例还提供一种通信系统，其包括前述的云端服务器、可穿戴设备和终端设备。
本申请实施例还提供了一种计算机可读介质，其上存储有计算机程序，该计算机程序被计算机执行时实现上述任一实施例中的终端设备执行的步骤，或者云端服务器执行的步骤，或者可穿戴设备执行的步骤。该可读介质可以是只读存储器(read-only memory，ROM)或随机存取存储器(random access memory，RAM)，本申请实施例对此不做限制。
本申请实施例还提供了一种计算机程序产品，该计算机程序产品被计算机执行时实现上述任一实施例中的终端设备执行的步骤，或者云端服务器执行的步骤，或者可穿戴设备执行的步骤。
本申请实施例还提供了一种系统芯片，该系统芯片包括：通信单元和处理单元。该处理单元，例如可以是处理器。该通信单元例如可以是通信接口、输入/输出接口、管脚或电路等。该处理单元可执行计算机指令，以使该通信装置内的芯片执行上述本申请实施例提供的终端设备执行的步骤，或者云端服务器执行的步骤，或者通信装置执行的步骤。
可选地，上述本申请实施例中提供的任意一种通信装置可以包括该系统芯片。
可选地，该计算机指令被存储在存储单元中。
可选地，该存储单元为该芯片内的存储单元，如寄存器、缓存等，该存储单元还可以是该终端内的位于该芯片外部的存储单元，如ROM或可存储静态信息和指令的其他类型的静态存储设备，RAM等。其中，上述任一处提到的处理器，可以是一个CPU，微处理器，ASIC，或一个或多个用于控制上述的资源请求的方法的程序执行的集成电路。该处理单元和该存储单元可以解耦，分别设置在不同的物理设备上，通过有线或者无线的方式连接来实现该处理单元和该存储单元的各自的功能，以支持该系统芯片实现上述实施例中的各种功能。或者，该处理单元和该存储器也可以耦合在同一个设备上。
可以理解，本申请实施例中的存储器可以是易失性存储器或非易失性存储器，或可包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(read-only memory，ROM)、可编程只读存储器(programmable ROM，PROM)、可擦除可编程只读存储器(erasable PROM，EPROM)、电可擦除可编程只读存储器(electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory，RAM)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的随机存取存储器(random access memory，RAM)可用，例如静态随机存取存储器(static RAM，SRAM)、动态随机存取存储器(DRAM)、同步动态随机存取存储器(synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(double data rate SDRAM，DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM，SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM，DR RAM)。
本文中术语“系统”和“网络”在本文中常被可互换使用。
在本申请中可能出现的对各种消息/信息/设备/网元/系统/装置/动作/操作/流程/概念等各类客体进行了赋名，可以理解的是，这些具体的名称并不构成对相关客体的限定，所赋 名称可随着场景，语境或者使用习惯等因素而变更，对本申请中技术术语的技术含义的理解，应主要从其在技术方案中所体现/执行的功能和技术效果来确定。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统、装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应所述理解到，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者所述技术方案的部分可以以软件产品的形式体现出来，所述计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (21)

  1. 一种传输视频音频数据的方法，其特征在于，包括：
    云端服务器向终端设备发送视频码流和第一信息，所述第一信息用于确定所述终端设备播放视频的时间；
    所述云端服务器向可穿戴设备发送音频码流和第二信息，所述第二信息用于确定所述可穿戴设备播放音频的时间，其中所述第一信息和所述第二信息使得所述终端设备播放视频的时间和所述可穿戴设备播放音频的时间相同；
    所述终端设备接收所述视频码流和所述第一信息，根据所述第一信息确定的时间播放视频；
    所述可穿戴设备接收所述音频码流和所述第二信息，根据所述第二信息确定的时间播放音频。
  2. 根据权利要求1所述的方法，其特征在于，所述第一信息和所述第二信息为时间信息；或
    所述第一信息为时间信息，所述第二信息为指示信息，所述第二信息用于指示所述可穿戴设备向所述终端设备发送请求消息，所述请求消息用于请求所述可穿戴设备播放所述音频的时间；或
    所述第一信息为指示信息，所述第一信息用于指示所述终端设备向所述可穿戴设备发送请求消息，所述请求消息用于请求所述终端设备播放所述音频的时间，所述第二信息为时间信息。
  3. 根据权利要求2所述的方法，其特征在于，所述第一信息和所述第二信息均为时刻T1，所述终端设备在所述时刻T1时播放视频，所述可穿戴设备在所述时刻T1时播放音频。
  4. 根据权利要求2所述的方法，其特征在于，所述第一信息为时刻T2，所述终端设备在所述T2时刻播放视频；
    所述第二信息为指示信息，所述可穿戴设备根据所述第二信息向所述终端设备发送所述请求消息；
    所述终端设备接收所述请求消息；
    所述终端设备向所述可穿戴设备发送确认消息，所述确认消息用于指示所述可穿戴设备播放所述音频的时间，其中，所述确认消息指示的所述可穿戴设备播放所述音频的时间为T2时刻。
  5. 根据权利要求4所述的方法，其特征在于，所述确认消息为时刻T2，或所述确认消息为定时器的起始值，所述定时器定时结束时的时间为T2时刻。
  6. 根据权利要求2所述的方法，其特征在于，所述第二信息为时刻T3，所述可穿戴设备在所述T3时刻播放视频；
    所述第一信息为指示信息，所述终端设备根据所述第一信息向所述可穿戴设备发送所述请求消息；
    所述可穿戴设备接收所述请求消息；
    所述可穿戴设备向所述终端设备发送确认消息，所述确认消息用于指示所述终端设备播放所述音频的时间，其中，所述确认消息指示的所述终端设备播放所述音频的时间为T2时刻。
  7. 根据权利要求6所述的方法，其特征在于，所述确认消息为时刻T3，或所述确认消息为定时器的起始值，所述定时器定时结束时的时间为T3时刻。
  8. 根据权利要求1至7中任一项所述的方法，其特征在于，所述终端设备获取所述可穿戴设备的标识信息；
    所述终端设备向所述云端服务器发送所述可穿戴设备的标识信息；
    所述云端服务器根据所述可穿戴设备的标识信息向所述可穿戴设备发送所述音频码流。
  9. 根据权利要求1至8中任一项所述的方法，其特征在于，所述第一信息位于所述视频码流之前；所述第二信息位于所述音频码流之前。
  10. 一种传输视频音频数据的系统，所述系统包括云端服务器，终端设备和可穿戴设备，其特征在于，包括：
    所述云端服务器向所述终端设备发送视频码流和第一信息，所述第一信息用于确定所述终端设备播放视频的时间；
    所述云端服务器向所述可穿戴设备发送音频码流和第二信息，所述第二信息用于确定所述可穿戴设备播放音频的时间，其中所述第一信息和所述第二信息使得所述终端设备播放视频的时间和所述可穿戴设备播放音频的时间相同；
    所述终端设备接收所述视频码流和所述第一信息，根据所述第一信息确定的时间播放视频；
    所述可穿戴设备接收所述音频码流和所述第二信息，根据所述第二信息确定的时间播放音频。
  11. 根据权利要求10所述的系统，其特征在于，所述第一信息和所述第二信息为时间信息；或
    所述第一信息为时间信息，所述第二信息为指示信息，所述第二信息用于指示所述可穿戴设备向所述终端设备发送请求消息，所述请求消息用于请求所述可穿戴设备播放所述音频的时间；或
    所述第一信息为指示信息，所述第一信息用于指示所述终端设备向所述可穿戴设备发送请求消息，所述请求消息用于请求所述终端设备播放所述音频的时间，所述第二信息为时间信息。
  12. 根据权利要求11所述的系统，其特征在于，所述第一信息和所述第二信息均为时刻T1，所述终端设备在所述时刻T1时播放视频，所述可穿戴设备在所述时刻T1时播放音频。
  13. 根据权利要求11所述的系统，其特征在于，所述第一信息为时刻T2，所述终端设备在所述T2时刻播放视频；
    所述第二信息为指示信息，所述可穿戴设备根据所述第二信息向所述终端设备发送所述请求消息；
    所述终端设备接收所述请求消息；
    所述终端设备向所述可穿戴设备发送确认消息，所述确认消息用于指示所述可穿戴设备播放所述音频的时间，其中，所述确认消息指示的所述可穿戴设备播放所述音频的时间为T2时刻。
  14. 根据权利要求13所述的系统，其特征在于，所述确认消息为时刻T2，或所述确认消息为定时器的起始值，所述定时器定时结束时的时间为T2时刻。
  15. 根据权利要求11所述的系统，其特征在于，所述第二信息为时刻T3，所述可穿戴设备在所述T3时刻播放视频；
    所述第一信息为请求信息，所述终端设备根据所述第一信息向所述可穿戴设备发送所述请求消息；
    所述可穿戴设备接收所述请求消息；
    所述可穿戴设备向所述终端设备发送确认消息，所述确认消息用于指示所述终端设备播放所述音频的时间，其中，所述确认消息指示的所述终端设备播放所述音频的时间为T2时刻。
  16. 根据权利要求15所述的系统，其特征在于，所述确认消息为时刻T3，或所述确认消息为定时器的起始值，所述定时器定时结束时的时间为T3时刻。
  17. 根据权利要求10至16中任一项所述的系统，其特征在于，所述终端设备获取所述可穿戴设备的标识信息；
    所述终端设备向所述云端服务器发送所述可穿戴设备的标识信息；
    所述云端服务器根据所述可穿戴设备的标识信息向所述可穿戴设备发送所述音频码流。
  18. 根据权利要求10至17中任一项所述的系统，其特征在于，所述第一信息位于所述视频码流之前；所述第二信息位于所述音频码流之前。
  19. 一种云端服务器，其特征在于，包括：
    存储器；
    多个应用程序；
    以及一个或多个计算机程序，其中所述一个或多个计算机程序被存储在所述存储器中，所述一个或多个计算机程序包括指令，当所述指令被所述云端服务器执行时，使得所述云端服务器执行以下步骤：
    根据需要同时播放的视频码流和音频码流，确定第一信息和第二信息，其中所述第一信息用于确定终端设备播放所述视频码流的时间；所述第二信息用于确定可穿戴设备播放所述音频码流的时间，其中所述第一信息和所述第二信息使得所述终端设备播放所述视频码流的时间和所述可穿戴设备播放所述音频码流的时间相同；
    向所述终端设备发送所述视频码流；
    向所述可穿戴设备发送所述音频码流。
  20. 根据权利要求19所述的云端服务器，其特征在于，所述根据需要同时播放的视频码流和音频码流，确定第一信息和第二信息具体包括：
    根据所述视频码流的长度及解码所需时间确定第一信息，根据所述音频码流的长度及解码所需时间确定第二信息。
  21. 一种计算机可读存储介质，其特征在于，所述存储介质中存储有计算机程序或指 令，当所述计算机程序或指令被云端服务器执行时，实现如权利要求1至9中任一项所述的方法。
PCT/CN2020/138640 2020-02-11 2020-12-23 一种传输视频音频数据的方法、云端服务器和系统 WO2021159864A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010087244.3A CN111954051B (zh) 2020-02-11 2020-02-11 传输视频音频数据的方法、系统、云端服务器和存储介质
CN202010087244.3 2020-02-11

Publications (1)

Publication Number Publication Date
WO2021159864A1 true WO2021159864A1 (zh) 2021-08-19

Family

ID=73337041

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/138640 WO2021159864A1 (zh) 2020-02-11 2020-12-23 一种传输视频音频数据的方法、云端服务器和系统

Country Status (2)

Country Link
CN (1) CN111954051B (zh)
WO (1) WO2021159864A1 (zh)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113923473A (zh) * 2021-09-28 2022-01-11 安徽听见科技有限公司 影音播放方法、装置、电子设备和存储介质
CN114339326A (zh) * 2021-12-10 2022-04-12 北京拼响天空文化科技有限公司 基于视频播放的声画同步方法、装置和系统
CN114339419A (zh) * 2021-12-29 2022-04-12 青岛海信移动通信技术股份有限公司 一种视频流拉流处理的方法、装置及存储介质
CN115379283A (zh) * 2022-08-16 2022-11-22 维沃移动通信有限公司 视频通话方法和装置
WO2023109862A1 (zh) * 2021-12-17 2023-06-22 华为技术有限公司 视频播放中协同播放音频的方法及通信系统

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111954051B (zh) * 2020-02-11 2021-10-26 华为技术有限公司 传输视频音频数据的方法、系统、云端服务器和存储介质
CN114401432B (zh) * 2022-01-27 2024-01-26 广州艾美网络科技有限公司 Mv播放方法、播放终端、服务器设备及娱乐设备系统
CN115334053B (zh) * 2022-08-03 2023-07-18 深圳乐播科技有限公司 一种云会议中关联投屏的实现方法及相关产品

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104079958A (zh) * 2014-04-25 2014-10-01 中国传媒大学 一种视频与多声道音频同步播出的方法
CN107734378A (zh) * 2017-10-31 2018-02-23 维沃移动通信有限公司 一种音视频同步方法、装置及移动终端
US20180061449A1 (en) * 2016-08-30 2018-03-01 Bragi GmbH Binaural Audio-Video Recording Using Short Range Wireless Transmission from Head Worn Devices to Receptor Device System and Method
CN109040245A (zh) * 2018-08-02 2018-12-18 北京奇虎科技有限公司 一种多个视频、音频共享的方法及装置
CN111954051A (zh) * 2020-02-11 2020-11-17 华为技术有限公司 一种传输视频音频的方法、设备和系统

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203522954U (zh) * 2013-07-18 2014-04-02 康佳集团股份有限公司 一种无线音响电视系统
CN105100858A (zh) * 2014-05-08 2015-11-25 亚历克斯·漆 视频播放系统和方法
KR20170030510A (ko) * 2014-07-07 2017-03-17 임머숀 코퍼레이션 제2 스크린 햅틱
CN106331562B (zh) * 2015-06-16 2020-04-24 南宁富桂精密工业有限公司 云端服务器、控制设备及音频视频同步方法
CN106488289B (zh) * 2016-10-08 2019-07-16 Oppo广东移动通信有限公司 音频同步播放方法、装置及系统
CN106507142B (zh) * 2016-12-26 2019-09-06 余焰 一种非流媒体音视频文件的同步播放方法、装置
CN108055565A (zh) * 2017-12-26 2018-05-18 合肥中科云巢科技有限公司 音视频的重定向方法及装置
CN108371815A (zh) * 2018-04-13 2018-08-07 合肥芯福传感器技术有限公司 一种沉浸式电子游戏操作系统及游戏方法
CN109151194B (zh) * 2018-08-14 2021-03-02 Oppo广东移动通信有限公司 数据传输方法、装置、电子设备以及存储介质
CN109413342B (zh) * 2018-12-21 2021-01-08 广州酷狗计算机科技有限公司 音视频处理方法、装置、终端及存储介质
CN110072137B (zh) * 2019-04-26 2021-06-08 湖南琴岛网络传媒科技有限公司 一种视频直播的数据传输方法及传输装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104079958A (zh) * 2014-04-25 2014-10-01 中国传媒大学 一种视频与多声道音频同步播出的方法
US20180061449A1 (en) * 2016-08-30 2018-03-01 Bragi GmbH Binaural Audio-Video Recording Using Short Range Wireless Transmission from Head Worn Devices to Receptor Device System and Method
CN107734378A (zh) * 2017-10-31 2018-02-23 维沃移动通信有限公司 一种音视频同步方法、装置及移动终端
CN109040245A (zh) * 2018-08-02 2018-12-18 北京奇虎科技有限公司 一种多个视频、音频共享的方法及装置
CN111954051A (zh) * 2020-02-11 2020-11-17 华为技术有限公司 一种传输视频音频的方法、设备和系统

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113923473A (zh) * 2021-09-28 2022-01-11 安徽听见科技有限公司 影音播放方法、装置、电子设备和存储介质
CN114339326A (zh) * 2021-12-10 2022-04-12 北京拼响天空文化科技有限公司 基于视频播放的声画同步方法、装置和系统
CN114339326B (zh) * 2021-12-10 2023-06-27 北京拼响天空文化科技有限公司 基于视频播放的声画同步方法、装置和系统
WO2023109862A1 (zh) * 2021-12-17 2023-06-22 华为技术有限公司 视频播放中协同播放音频的方法及通信系统
CN114339419A (zh) * 2021-12-29 2022-04-12 青岛海信移动通信技术股份有限公司 一种视频流拉流处理的方法、装置及存储介质
CN114339419B (zh) * 2021-12-29 2024-04-02 青岛海信移动通信技术有限公司 一种视频流拉流处理的方法、装置及存储介质
CN115379283A (zh) * 2022-08-16 2022-11-22 维沃移动通信有限公司 视频通话方法和装置

Also Published As

Publication number Publication date
CN111954051B (zh) 2021-10-26
CN111954051A (zh) 2020-11-17

Similar Documents

Publication Publication Date Title
WO2021159864A1 (zh) 一种传输视频音频数据的方法、云端服务器和系统
US11213743B2 (en) Method, system and electronic device for achieving remote control of computer game by game controller
CN107222326B (zh) 用于设备间服务的访问方法、配置方法及装置
US20140289415A1 (en) Continuous and concurrent device experience in a multi-device ecosystem
US20170286055A1 (en) Method and Apparatus for Audio Mixing and Playing
CN104834623A (zh) 音频播放方法及装置
WO2016173251A1 (zh) 一种连接Wi-Fi网络的方法、无线音箱及终端
WO2018049892A1 (zh) 数据传输方法、装置及终端
WO2021175297A1 (zh) 一种分布式数据传输的方法、装置和系统
US11758087B2 (en) Multimedia conference data processing method and apparatus, and electronic device
JP2022527232A (ja) ミニプログラム処理方法、装置、機器及び記憶媒体
WO2019205555A1 (zh) 消息推送方法及装置
WO2019062667A1 (zh) 会议内容的传输方法及装置
CN113079139B (zh) 基于区块链的共识组主节点确定方法、装置及系统
CN105786441A (zh) 一种音频处理的方法、服务器、用户设备及系统
WO2022110943A1 (zh) 语音预览的方法及装置
WO2019079971A1 (zh) 群组的通信方法及装置、计算机存储介质、计算机设备
WO2023165309A1 (zh) 可共享远程直接数据存取链接的创建方法及装置
WO2023193574A1 (zh) 投屏方法、系统、设备及存储介质
JP2021028819A (ja) スマートサービス方法、装置及び機器
CN110034828B (zh) 云应用的音频采集方法及服务器
WO2013078614A1 (zh) 一种虚拟桌面场景下音频压缩算法选择方法、装置及通信系统
TW201327370A (zh) 資源分享系統與方法及其播放裝置
CN112637626A (zh) 推流方法、系统、装置、电子设备及存储介质
US20220182713A1 (en) Device and system for streaming media interaction

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20918161

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20918161

Country of ref document: EP

Kind code of ref document: A1