WO2023024894A1 - 一种多设备同步播放方法及装置 - Google Patents

一种多设备同步播放方法及装置 Download PDF

Info

Publication number
WO2023024894A1
WO2023024894A1 PCT/CN2022/111117 CN2022111117W WO2023024894A1 WO 2023024894 A1 WO2023024894 A1 WO 2023024894A1 CN 2022111117 W CN2022111117 W CN 2022111117W WO 2023024894 A1 WO2023024894 A1 WO 2023024894A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal device
transmission path
transfer
terminal
capability
Prior art date
Application number
PCT/CN2022/111117
Other languages
English (en)
French (fr)
Inventor
李树为
孙渊
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP22860240.5A priority Critical patent/EP4366244A1/en
Publication of WO2023024894A1 publication Critical patent/WO2023024894A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/12—Shortest path evaluation
    • H04L45/124—Shortest path evaluation using a combination of metrics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/24—Negotiation of communication capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44227—Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • H04N21/8113—Monomedia components thereof involving special audio data, e.g. different tracks for different languages comprising music, e.g. song in MP3 format
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/22—Alternate routing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/302—Route determination based on requested QoS
    • H04L45/306—Route determination based on the nature of the carried application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72442—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for playing music files

Definitions

  • the embodiments of the present application relate to the field of audio technology, and in particular to a multi-device synchronous playback method and device.
  • Embodiments of the present application provide a multi-device synchronous playback method and device, which are used to solve the problem in the related art that there are certain limitations in implementing multi-device audio synchronous playback.
  • the embodiment of the present application provides a multi-device synchronous playback method, the method includes: the first terminal device acquires the transfer capability evaluation values of N second terminal devices, where N is a positive integer; A terminal device obtains the transfer availability of the N second terminal devices to the first terminal device according to the N evaluation values of the transfer capability; The transfer availability of the first terminal device is selected, and the destination transmission path is selected from N transmission paths, and the N transmission paths correspond to the N second terminal devices one by one; the first terminal device transmits from the destination The second terminal device corresponding to the path acquires the audio data to be played.
  • the transfer availability of the second terminal device to the first terminal device is greater, it means that the transmission efficiency, stability, and reliability of the first terminal device selecting the transmission path corresponding to the second terminal device as the destination transmission path are higher.
  • the first terminal device may preferentially select the second terminal device with higher transfer availability to the first terminal device.
  • the embodiment of this application evaluates the transfer capability of the terminal device included in the application scenario, and determines whether the terminal device can be used as another terminal device through the transfer capability Obtain the transit node of the audio data to be played, so as to provide multiple optional transmission paths for other terminal devices and realize path optimization.
  • the embodiment of the present application can improve the efficiency, stability and reliability of the acquisition of the same audio data to be played by multiple terminal devices etc., so as to improve the user experience of multi-device synchronous playback.
  • the first terminal device obtains the transfer availability of the N second terminal devices to the first terminal device according to the N evaluation values of the transfer capability, which may be implemented as: The first terminal device determines N relative signal strengths corresponding to the N second terminal devices; the first terminal device assigns relay availability to the N second terminal devices respectively based on the N relative signal strengths weighting factor; for the ith second terminal device, the first terminal device uses the product of the transfer capability evaluation value of the ith second terminal device and the transfer availability weight factor as the weight factor of the ith terminal device Transit availability; the i is any positive integer from 1 to N.
  • the first terminal device may assign a smaller High transit availability weighting factor.
  • the first terminal device assigns different transfer availability weight factors to different second terminal devices through the relative relationship with each second terminal device, which can improve the transfer availability of the second terminal device with a better relative relationship. , so that the accuracy of the selection of the destination transmission path can be guaranteed.
  • the first terminal device may also transfer the audio data to be played for other terminal devices, which may be determined according to the evaluation value of the transfer capability of the first terminal device.
  • This design may be implemented as follows: the first terminal device uses a first evaluation parameter group to determine a first transfer capability evaluation value of the first terminal device, and the first evaluation parameter group includes but is not limited to one of the following evaluation parameters A combination of one or more: the network signal strength of the first terminal device, the network transmission status of the first terminal device, the type of the first terminal device, the usage status of the first terminal device, the The charging frequency of the first terminal device; if the first transfer capability evaluation value meets the preset transfer capability threshold condition, the first terminal device sends the first transfer capability evaluation value, etc.
  • the second terminal devices may also use the design described above to determine their respective transfer capability evaluation values.
  • the evaluation value of the transfer capability of the first terminal device it is also possible to evaluate whether the first terminal device can be used as a transfer node for other terminal devices, thereby providing possible transmission paths for other terminal devices to achieve optimal multi-device The purpose of synchronizing the overall stability and efficiency of playback scenes.
  • the first terminal device uses the first evaluation parameter group to determine the first transfer capability evaluation value of the first terminal device.
  • An optional implementation manner is: the first terminal device obtains the The transfer capability weight factors corresponding to each evaluation parameter included in the first evaluation parameter group; the first terminal device calculates the transfer capability weight factors respectively corresponding to each evaluation parameter in the first evaluation parameter group Each of the included evaluation parameters is weighted and summed to obtain the first transit capacity evaluation value.
  • the weight factor of the transfer capability may be predefined, or obtained according to experience, and the like.
  • the first terminal device may also adopt an implementation manner of determining the first transit capability evaluation value, such as adopting a machine learning method, which is not limited in this application.
  • the first terminal device determines the first transfer capability evaluation value based on multiple evaluation parameters in the first evaluation parameter group, which can more accurately evaluate the transfer capability of the first terminal device, thereby ensuring multi-device synchronization Stability, efficiency and reliability of playback scenarios.
  • the first terminal device may also periodically update the first transfer capability evaluation value.
  • the first terminal device can obtain more accurate evaluation results through periodic updates, thereby ensuring the efficiency, reliability and stability of multi-device synchronous playback.
  • the first terminal device may perform role division, and may perform different processing in different roles.
  • the first terminal device may be classified into a common player role or an end player role according to the playback capability evaluation value.
  • the terminal playing role indicates that the playing ability of the first terminal device is not good.
  • the first terminal device uses a second evaluation parameter group to determine the first playback capability evaluation value of the first terminal device, and the second evaluation parameter group includes a combination of one or more of the following evaluation parameters : the network signal strength of the first terminal device, the network transmission state of the first terminal device, and the type of the first terminal device.
  • the first terminal device may select a destination from N transmission paths corresponding to N second terminal devices. Transmission path to obtain the audio data to be played.
  • the first playback capability evaluation value may be greater than or equal to the preset playback capability threshold, indicating that the condition is met .
  • the first terminal device can be triggered in time to optimize the destination transmission path, for example, search and find a better destination transmission path and switch it, thus ensuring multiple The efficiency, reliability and stability of device synchronization playback.
  • the first terminal device selects a destination transmission path from N transmission paths based on the transfer availability of the N second terminal devices to the first terminal device, which may be implemented as: The first terminal device determines that none of the transfer availability of the N second terminal devices to the first terminal device meets the transfer capability threshold condition, and the first terminal device uses the current transmission path as the destination transmission path. Or it may also be implemented as follows: the first terminal device determines that the transfer availability of at least one second terminal device to the first terminal device meets the transfer capability threshold condition, and the first terminal device obtains from the at least one second terminal device A destination transmission path is selected from at least one transmission path corresponding to the terminal device.
  • the first terminal device determines that the transfer availability of at least one second terminal device to the first terminal device meets the transfer capability threshold condition, and the transfer capability of the at least one second terminal device to the first terminal device
  • the transfer availability of a terminal device does not meet the preset switching condition compared with the transfer availability of the second terminal device corresponding to the current transmission path to the first terminal device, and the first terminal device uses the current transmission path as the transfer availability of the first terminal device. Destination transmission path.
  • the first terminal device can select the destination transmission path more accurately by evaluating the transit availability of multiple transmission paths, thereby ensuring the efficiency, reliability and stability of multi-device synchronous playback.
  • the design compares the transit availability of multiple optional transmission paths with the transit availability of the current transmission path, and can set the optional transmission path to meet the preset switching conditions compared with the current transmission path (for example, certain transit Availability difference), and then perform switching, which can better ensure the stability of the transmission path and avoid frequent switching of the destination transmission path.
  • the first terminal device may also periodically update the first playback capability evaluation value.
  • the first terminal device can obtain more accurate evaluation results through periodic updates, thereby ensuring the efficiency, reliability and stability of multi-device synchronous playback.
  • the first terminal device may also ensure the transmission efficiency and stability of the audio data to be played by predicting the current transmission path. It may be implemented that the first terminal device predicts the stability of the current transmission path based on the first processing data, and obtains the stability evaluation value of the current transmission path at the first moment; the first processing data is the first The terminal device statistics are obtained by using the processing data generated by the current transmission path; and, the first terminal device predicts the transfer capability of the current transmission path based on the second processing data, and obtains that the current transmission path is at the second moment The transfer capability evaluation value of the second terminal device; the second processed data is obtained by the first terminal device from counting the transfer capability evaluation value of the second terminal device corresponding to the current transmission path.
  • the first terminal device detects a first trigger condition, perform pre-connection of at least one backup transmission path; wherein, the first trigger condition includes a combination of one or more of the following conditions: the first moment The stability evaluation value of the value meets the preset stability threshold condition, and the transfer capacity evaluation value at the second moment meets the preset transfer capacity threshold condition.
  • the selecting the target transmission path from the N transmission paths by the first terminal device includes: selecting the target transmission path from the at least one backup transmission path by the first terminal device.
  • the first terminal device can realize the pre-connection of the backup transmission path according to the prediction, so that when the first terminal device selects the destination transmission path, it can be determined from the backup transmission path, thereby improving the efficiency of transmission path switching. accuracy and efficiency.
  • the first terminal device predicts the stability of the current transmission path based on the first processed data, which may be implemented as the first terminal device adopts a time series learning algorithm to predict the current Predict the stability of the transmission path; the first terminal device predicts the transfer capability of the current transmission path based on the second processing data, including: the first terminal device adopts a time series learning algorithm based on the second processing data to The transfer capability of the current transmission path is predicted.
  • the stability evaluation value is determined by but not limited to a combination of one or more of the following information: the power-off confidence level of the second terminal device, the The load status of the device, the network status of the second terminal device, and the like.
  • the first terminal device evaluates the stability of the current transmission path by predicting the power-off status, load status, or network status of the second terminal device corresponding to the current transmission path, which can improve the first terminal device's ability to target
  • the efficiency of transmission path switching ensures the efficiency and reliability of multi-device synchronous playback.
  • the first terminal device may receive and respond to the playback instruction, and play the audio data to be played; the playback instruction uses To instruct at least one terminal device to synchronously play the audio data to be played, where the at least one terminal device includes the first terminal device and the N second terminal devices.
  • the synchronous playback can be realized based on the playback instruction.
  • the embodiment of the present application also provides a terminal device, including: one or more processors; one or more memories; the one or more memories are used to store one or more computer programs and data information; wherein the one or more computer programs include instructions; when the instructions are executed by the one or more processors, the terminal device is executed as described in any possible design of the first aspect above. described method.
  • an embodiment of the present application further provides a communication system, including at least one terminal device as described in the second aspect above.
  • the embodiment of the present application provides a computer-readable storage medium.
  • the computer-readable medium stores a computer program (also referred to as code, or instruction) which, when run on a computer, causes the computer to perform the above-mentioned first A method in any one of the possible implementations of the aspect.
  • the embodiment of the present application provides a computer program product
  • the computer program product includes: a computer program (also referred to as code, or instruction), when the computer program is executed, it causes the computer to perform any of the above-mentioned first aspects.
  • a computer program also referred to as code, or instruction
  • the embodiment of the present application also provides a graphical user interface on a terminal device, the terminal device has a display screen, one or more memories, and one or more processors, and the one or more processors are used to Executing one or more computer programs stored in the one or more memories, the graphical user interface includes a graphical user interface displayed when the terminal device executes any possible implementation manner of the first aspect of the embodiments of the present application.
  • FIG. 1 is an application scenario under a home network
  • FIG. 2 is a schematic diagram of a hardware structure of a possible terminal device provided by an embodiment of the present application
  • FIG. 3 is a software structural block diagram of a terminal device provided in an embodiment of the present application.
  • FIG. 4 is one of the application scene schematic diagrams of a multi-device synchronous playback method provided in the embodiment of the present application;
  • FIG. 5 is one of the schematic flow diagrams of a multi-device synchronous playback method provided in the embodiment of the present application.
  • FIG. 6 is the second schematic diagram of an application scenario of a multi-device synchronous playback method provided in the embodiment of the present application.
  • FIG. 7 is the second schematic flow diagram of a multi-device synchronous playback method provided in the embodiment of the present application.
  • FIG. 8 is the third schematic diagram of the application scenario of a multi-device synchronous playback method provided in the embodiment of the present application.
  • FIG. 9 is the third schematic flow diagram of a multi-device synchronous playback method provided in the embodiment of the present application.
  • FIG. 10 is a fourth schematic diagram of an application scenario of a multi-device synchronous playback method provided in the embodiment of the present application.
  • FIG. 11 is a schematic structural diagram of a terminal device provided in an embodiment of the present application.
  • a device may also be called a “terminal device” or a “terminal”, and they may be used interchangeably in the following embodiments.
  • the local area network may be a home network, an enterprise network, and the like.
  • FIG. 1 shows an application scenario under a home network.
  • the home network shown in FIG. 1 includes room 1 , room 2 , room 3 and room 4 , and each room is respectively equipped with a terminal device capable of playing audio, such as a speaker device.
  • Each terminal device in the home network can be connected to the local area network configured by an access point (access point, AP) (such as a wireless router, switch, etc.) located in room 1, for realizing functions such as data transmission through the local area network ,
  • AP access point
  • users can use multiple speaker devices to play music synchronously, so that users in each room can hear the same music synchronously, or when users go to different rooms, they will not feel the music delay, which improves the user experience.
  • the local area network may also be an enterprise network, and in an enterprise network, multiple broadcast terminal devices may be placed on multiple different floors or offices. Synchronous playback of the same audio content can be performed by multiple broadcast terminal devices.
  • the terminal terminal device can be understood as a terminal device whose network signal status is poor to a certain extent, usually a terminal device far away from the wireless router or a terminal device with many obstacles between the wireless router and the like.
  • the terminal device in FIG. 1 is speaker device D
  • speaker devices A, B, C and D acquire the same audio data to be played for synchronous playback, due to the network signal of speaker device D
  • the state is poor, and it takes the longest time to obtain the audio data to be played. Therefore, the start time of the audio data to be played by speaker devices A, B, C, and D depends on the time spent on obtaining the audio data by speaker device D, and there is a start-up delay. longer question. That is to say, when speaker devices A, B, and C have acquired the audio data to be played but D has not yet acquired the audio data to be played, speaker devices A, B, and C need to wait for D to also acquire the audio data to be played before starting synchronous playback.
  • speaker devices A, B, C, and D start to play synchronously after obtaining the audio data to be played in the first fragment, and obtain
  • the playback of the first segment may have been completed, but there are speaker devices in speaker devices A, B, C, and D that have not completed the acquisition of the audio data to be played in the second segment, resulting in playback pause.
  • an embodiment of the present application provides a multi-device synchronous playback method.
  • multi-device audio synchronous playback comprehensively consider the performance and status of multiple terminal devices included in the scenario, based on the idea that each terminal device can also serve as a transit node between other terminal devices and the wireless router, By selecting the target transmission path from multiple possible transmission paths for the terminal device in this scenario, a technical solution that can improve the fluency, stability and user experience of multi-device synchronous playback is designed.
  • the audio data (audio data) in the embodiment of the present application can also be referred to as sound data, which is used to represent sound, and is data obtained after processing an audio file (such as an ogg file).
  • the audio data is obtained by decoding, decompressing, or performing sound effects on the audio file.
  • the audio file includes audio data, and may be an MP3 file, an MP4 file, or a file in other formats, which is not limited. That is, the terminal device can implement sound playback based on the audio data.
  • the terminal device in the embodiment of the present application may be a smart home device (for example, a smart TV, a smart screen, a smart speaker, etc.), a mobile phone, a tablet computer, a wearable device (for example, a watch, a helmet, a headset, etc.), an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) devices, notebook computers, ultra-mobile personal computers (ultra-mobile personal computer, UMPC), netbooks, personal digital assistants (personal digital assistant, PDA), etc. equipment. It can be understood that the embodiment of the present application does not impose any limitation on the specific type of the terminal device.
  • the terminal equipment that the embodiment of the present application can be applied to, the exemplary embodiment includes but not limited to carrying Or portable terminal equipment with other operating systems.
  • the above-mentioned portable terminal device may also be other portable terminal devices, such as a laptop computer (Laptop) with a touch-sensitive surface (such as a touch panel).
  • Fig. 2 shows a schematic diagram of a hardware structure of a possible terminal device.
  • the terminal device 200 includes: a radio frequency (radio frequency, RF) circuit 210, a power supply 220, a processor 230, a memory 240, an input unit 250, a display unit 260, an audio circuit 270, a communication interface 280, and a wireless fidelity ( wireless-fidelity, Wi-Fi) module 290 and other components.
  • RF radio frequency
  • the terminal device 200 shown in FIG. 2 does not constitute a limitation on the terminal device 200, and the terminal device 200 provided in the embodiment of the present application may include more or less components than those shown in the illustration , two or more components may be combined, or may have different component configurations.
  • the various components shown in Figure 2 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.
  • the components of the terminal device 200 are specifically introduced below in conjunction with FIG. 2 :
  • the RF circuit 210 can be used for receiving and sending data during communication or calling. Specifically, after receiving the downlink data from the base station, the RF circuit 210 sends it to the processor 230 for processing; in addition, sends the uplink data to be sent to the base station.
  • the RF circuit 210 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (low noise amplifier, LNA), a duplexer, and the like.
  • the RF circuit 210 can also communicate with networks and other devices through wireless communication.
  • the wireless communication can use any communication standard or protocol, including but not limited to global system of mobile communication (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), e-mail, short message service (short messaging service, SMS), etc.
  • GSM global system of mobile communication
  • general packet radio service general packet radio service
  • GPRS general packet radio service
  • CDMA code division multiple access
  • WCDMA wideband code division multiple access
  • LTE long term evolution
  • e-mail short message service
  • SMS short message service
  • the Wi-Fi technology belongs to the short-distance wireless transmission technology, and the terminal device 200 can connect to an access point (access point, AP) through the Wi-Fi module 290, so as to realize data network access.
  • the Wi-Fi module 290 can be used for receiving and sending data during communication.
  • the terminal device 200 can also connect to APs such as wireless routers and gateways through the Wi-Fi module 290, so as to realize access to the data network, such as receiving audio data to be played, and the like.
  • the terminal device 200 can be physically connected to other devices through the communication interface 280 .
  • the communication interface 280 is connected to the communication interface of the other device through a cable, so as to implement data transmission between the terminal device 200 and other devices.
  • the terminal device 200 can implement communication services and interact with other terminal devices, the terminal device 200 needs to have a data transmission function, that is, the terminal device 200 needs to include a communication module inside.
  • FIG. 2 shows communication modules such as the RF circuit 210, the Wi-Fi module 290, and the communication interface 280, it can be understood that at least one of the above-mentioned components exists in the terminal device 200 or Other communication modules (such as bluetooth module) for realizing communication, in order to carry out data transmission.
  • Other communication modules such as bluetooth module
  • the terminal device 200 when the terminal device 200 is a mobile phone, the terminal device 200 may include the RF circuit 210, may also include the Wi-Fi module 290, or may include a Bluetooth module (not shown in FIG. 2 ); When the terminal device 200 is a computer, the terminal device 200 may include the communication interface 280, may also include the Wi-Fi module 290, or may include a bluetooth module (not shown in FIG. 2 ); When the terminal device 200 is a tablet computer, the terminal device 200 may include the Wi-Fi module, or may include a Bluetooth module (not shown in FIG. 2 ).
  • the memory 240 can be used to store software programs and modules.
  • the processor 230 executes various functional applications and data processing of the terminal device 200 by running software programs and modules stored in the memory 240 .
  • the memory 240 may mainly include an area for storing programs and an area for storing data.
  • the storage program area can store the operating system (mainly including the corresponding software programs or modules such as the kernel layer, the system layer, the application program framework layer, and the application program layer).
  • the memory 240 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
  • the input unit 250 can be used to receive editing operations of various types of data objects such as numbers or character information input by the user, and generate key signal input related to user settings and function control of the terminal device 200 .
  • the input unit 250 may include a touch panel 251 and other input devices 252 .
  • the touch panel 251 also referred to as a touch screen
  • the other input devices 252 may include but not limited to one or more of physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, joysticks, and the like.
  • function keys such as volume control keys, switch keys, etc.
  • trackballs mice, joysticks, and the like.
  • the display unit 260 can be used to display information input by the user or information provided to the user and various menus of the terminal device 200 .
  • the display unit 260 is the display system of the terminal device 200, and is used to present an interface and realize human-computer interaction.
  • the display unit 260 may include a display panel 261 .
  • the display panel 261 may be configured in the form of a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (organic light-emitting diode, OLED), or the like.
  • the display unit 260 may not be set on the terminal device, for example, the smart speaker device does not need to be provided with a display screen; or the display unit 260 may also be used on the terminal device to display the pending
  • the audio data is played for display. For example, if the audio data to be played is music, the corresponding lyrics or pictures of the music can be played on the display panel 261 .
  • the processor 230 is the control center of the terminal device 200, and uses various interfaces and lines to connect various components, by running or executing software programs and/or modules stored in the memory 240, and calling the stored in the
  • the data in the memory 240 executes various functions of the terminal device 200 and processes data, so as to realize various services based on the terminal device 200 .
  • the processor 230 is used to implement the method provided in the embodiment of the present application, and further provide a technical solution that can improve the playback fluency, stability and user experience of multi-device synchronous playback.
  • the terminal device 200 also includes a power source 220 (such as a battery) for supplying power to various components.
  • a power source 220 such as a battery
  • the power supply 220 may be logically connected to the processor 230 through a power management system, so that functions such as charging, discharging, and power consumption can be managed through the power management system.
  • the terminal device 200 further includes an audio circuit 270 , a microphone 271 and a speaker 272 , which can provide an audio interface between the user and the terminal device 200 .
  • the audio circuit 270 can be used to convert the audio data into a signal that the speaker 272 can recognize, and transmit the signal to the speaker 272, and the speaker 272 converts the signal into a sound signal for output.
  • the microphone 271 is used to collect external sound signals (such as the voice of people speaking, or other sounds, etc.), and convert the collected external sound signals into signals that the audio circuit 270 can recognize, and send them to the audio circuit 270 .
  • the audio circuit 270 can also be used to convert the signal sent by the microphone 271 into audio data, and then output the audio data to the RF circuit 220 for sending to another terminal device, or output the audio data to the memory 240 for subsequent further processing.
  • the terminal device 200 may also include at least one sensor, camera, etc., which will not be repeated here.
  • the at least one sensor may include, but is not limited to, a pressure sensor, an air pressure sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a touch sensor, a temperature sensor, and the like.
  • the operating system (operating system, OS) involved in the embodiment of the present application is the most basic system software running on the terminal device 200. Taking a smart speaker as an example, the operating system can be a HarmonyOS system, an Android system or an IOS system.
  • the software system of the terminal device 200 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In this embodiment of the present application, an operating system adopting a layered architecture is taken as an example to illustrate the software structure of the terminal device 200 .
  • FIG. 3 is a block diagram of a software structure of a terminal device provided by an embodiment of the present application.
  • the software structure of the terminal device may be a layered architecture, for example, the software may be divided into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
  • the operating system is divided into five layers, which are application program layer, application program framework layer (framework, FWK), runtime and system library, kernel layer, and hardware layer from top to bottom.
  • the application layer can consist of a series of application packages.
  • the application program layer may include camera, settings, skin module, user interface (user interface, UI), three-party application program and so on.
  • the three-party application program may include WLAN, music, call, Bluetooth, video and so on.
  • the application layer may be used to implement the presentation of an editing interface, and the above editing interface may be used for user operations.
  • the smart speaker includes a display panel 261
  • the user can perform user operations such as playing music on the main interface displayed on the display panel 261 .
  • the application program can be developed using the Java language and completed by calling the application programming interface (application programming interface, API) provided by the application program framework layer, and the developer can communicate with the application program framework layer.
  • the bottom layer of the system (such as hardware layer, kernel layer, etc.) interacts and develops its own application program.
  • the application framework layer is mainly a series of services and management systems of the operating system.
  • the application framework layer provides application programming interfaces and programming frameworks for applications in the application layer.
  • the application framework layer includes some predefined functions. As shown in Figure 3, the application framework layer may include a shortcut icon management module, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
  • the shortcut icon management module is used to manage the shortcut icons displayed on the terminal device, such as creating shortcut icons, removing shortcut icons, monitoring whether the shortcut icons meet the display conditions, and so on.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make it accessible to applications. Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.
  • the view system can be used to build applications.
  • a display interface can consist of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the telephony manager is used to provide the communication function of the terminal equipment. For example, the management of call status (including connected, hung up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is issued, the terminal device vibrates, and the indicator light flashes, etc.
  • the application framework layer is mainly responsible for invoking the service interface communicated with the hardware layer, so as to transfer the user's operation request to the hardware layer, and the operation request may include the user opening a certain APP operation requests, etc.
  • the runtime includes the core library and virtual machine.
  • the runtime is responsible for the scheduling and management of the operating system.
  • the core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of the operating system.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application program layer and the application program framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • a system library can include multiple function modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • a 3D graphics processing library can be used to draw a 3D motion track image
  • a 2D graphics engine can be used to draw a 2D motion track image
  • the kernel layer is the layer between hardware and software.
  • the kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.
  • the hardware layer may include various types of sensors, such as acceleration sensors, gyroscope sensors, touch sensors, and the like.
  • the terminal device 200 can run multiple application programs at the same time. Simpler, one application can correspond to one process, and more complex, one application can correspond to multiple processes. Each process has a process number (process ID).
  • At least one in the embodiments of the present application refers to one or more, and “multiple” refers to two or more.
  • “And/or” describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone, where A, B can be singular or plural.
  • the character “/” generally indicates that the contextual objects are an “or” relationship.
  • At least one (item) of the following” or similar expressions refer to any combination of these items, including any combination of single item(s) or plural item(s).
  • At least one item (unit) of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, wherein a, b, c Can be single or multiple.
  • a plurality referred to in the embodiment of the present application means greater than or equal to two.
  • terminal device In addition, in the embodiments of this application, “terminal device”, “equipment”, “mobile phone” and so on can be used interchangeably, that is, various devices that can be used to implement the embodiments of this application; the terms “application” and “mobile phone” in the embodiments of this application "Applications” can also be used in combination, and both refer to programs or clients with certain service-providing capabilities, that is to say, applications and clients can also be used in combination. For example, video clients and game clients can also be called video applications or game applications. wait.
  • the hardware structure of the terminal device may be as shown in FIG. 2, and the software architecture may be as shown in FIG.
  • the software programs and applications stored in the memory 240 can be run to execute the flow of a multi-device synchronous playback method provided by the embodiment of the present application.
  • the embodiment of the present application is applicable to the application scenario of multi-device audio synchronous playback.
  • multiple terminal devices are connected to the same local area network, as shown in the scenario shown in FIG. 1 .
  • the application scenario of multi-device audio synchronous playback described in FIG. The type of the device and the type of the terminal device are not limited.
  • FIG. 4 shows a schematic diagram of an application scenario of another multi-device synchronous playback method provided by the embodiment of the present application, and a speaker device D is taken as an example.
  • An optional acquisition method is that, based on the connection between the speaker device D and the wireless router through the Wi-Fi module 290, the speaker device D can obtain the audio data to be played through the wireless router. As shown in transmission path 1 in Figure 4 (wireless router ⁇ speaker device D).
  • Another optional acquisition method is that, due to factors such as a long distance between the speaker device D and the wireless router or many obstacles, the state of the network signal connected between the speaker device D and the wireless router is not good.
  • speakers A, B, and C will also obtain the same audio data to be played, so speaker device D can also obtain the audio data to be played through the relay of speaker devices A, B, or C .
  • transmission path 2 wireless router ⁇ speaker device B ⁇ speaker device D
  • transmission path 3 wireless router ⁇ speaker device A ⁇ speaker device D
  • transmission path 4 wireless router ⁇ speaker device C ⁇ Speaker equipment D.
  • the speaker device A, B or C can obtain the audio data to be played through a wireless router.
  • the transmission of the audio data to be played between the terminal devices may be based on wireless or wired routers, Bluetooth, Wi-Fi direct connection and other transmission methods to achieve transmission, which is not limited in this application.
  • the terminal device itself not only has the playback capability, but also has the transfer capability.
  • the playback capability indicates the efficiency of the terminal device to obtain the audio data to be played and to play the audio data to be played, such as the time spent in obtaining the audio data to be played, etc., which can be used to reflect the continuous and stable acquisition of the audio data to be played by the terminal device and the treatment of the audio data to be played.
  • the transfer capability indicates the efficiency, performance, continuity and reliability of the terminal device acquiring the audio data to be played and transmitting the audio data to be played to other terminal devices. The total time spent on transmitting audio data to other terminal devices, the stability of the terminal device's own operating status, and the continuous stability of the terminal device during the transfer process of the audio data to be played, etc.
  • each terminal device can select a transmission path from multiple transmission paths to obtain the audio data to be played, in order to improve the audio synchronous playback in this scenario Fluency, stability, and user experience, etc., when this application is implemented, it can combine the transfer capability and playback capability of multiple terminal devices to provide a technical solution for how to select the destination transmission path for each terminal device in this scenario, so as to realize the Optimize the transmission path for at least one terminal device to obtain audio data to be played, improve the efficiency and reliability of multiple terminal devices to obtain audio data to be played, etc., reduce the time-consuming acquisition of audio data to be played by terminal devices and improve the acquisition of audio data to be played Data stability.
  • FIG. 5 is a schematic flowchart of a multi-device synchronous playback method provided in the embodiment of the present application. Assuming that there are multiple terminal devices in the scenario of synchronous audio playback, the following embodiments take one of the terminal devices (that is, the first terminal device in the following embodiments) as an example to introduce the methods provided in the embodiments of the present application. It can be understood that the implementation manner of other terminal devices (that is, any terminal device among the N second terminal devices in the following embodiments) may refer to the implementation manner of the first terminal device.
  • the first terminal device may receive multiple possible trigger events, where the trigger events are used to instruct the first terminal device to execute the method flow shown in FIG. 5 .
  • the method shown in Figure 5 selects a destination transmission path. It should be noted that, generally, the first terminal device may use the transmission path corresponding to the wireless router (such as transmission path 1 in Figure 4) as the default transmission path, or the first terminal device may transmit the destination determined during the last multi-device synchronous playback. The path is saved as the default transfer path.
  • the first terminal device may trigger based on network parameters such as its own network signal strength (eg, actual available bandwidth), network transmission status, and the like.
  • network parameters such as its own network signal strength (eg, actual available bandwidth), network transmission status, and the like.
  • the first terminal device may trigger selection of a destination transmission path. If there is a destination transmission path different from the current transmission path, the first terminal device may switch to the destination transmission path to obtain audio data to be played, so as to improve acquisition efficiency, stability and reliability.
  • the basic requirement for the first terminal device to acquire the audio data to be played may be preset, for example, the downlink transmission rate is set to 100 Kbps based on the requirement.
  • the first terminal device may set a trigger period for determining the destination transmission path. In this way, by periodically acquiring the destination transmission path of the first terminal device, the short-board effect caused when the first terminal device is abnormal during use can be reduced, thereby improving the stability of audio acquisition.
  • the first terminal device can also be set to execute the method flow of acquiring the destination transmission path shown in FIG. 5 based on other possible trigger scenarios, which is not limited in this application.
  • the first terminal device acquires transfer capability evaluation values of N second terminal devices; N is a positive integer.
  • the transfer capability evaluation value is used to indicate the transfer capability of the second terminal device, and when the second terminal device meets the preset transfer capability threshold condition, the transfer capability evaluation value may be sent to be acquired by the first terminal device.
  • the evaluation value of the transfer capability of the second terminal device is larger, it means that the transfer capability of the second terminal device is stronger; if the evaluation value of the transfer capability of the second terminal device is smaller, it means that the second terminal device The weaker the transfer capability of the terminal device is; in other words, when the transfer capability evaluation value of the second terminal device is greater than the preset transfer capability threshold, it may indicate that the preset transfer capability threshold condition is met.
  • the worse the stability of the first terminal device using the second terminal device to obtain the audio data to be played for example, the transmission rate fluctuates in a larger range or fluctuates in a larger frequency, and the smoothness is lower, etc.
  • the weaker the transfer capability of the second terminal device is.
  • the first terminal device obtains the transfer capability evaluation values of one or more second terminal devices, it can select a suitable target second terminal device from the N second terminal devices to obtain the audio data to be played.
  • this embodiment of the present application provides an implementation manner of determining a transfer capability evaluation value of the second terminal device. Taking any second terminal device as an example, the implementation manners of other second terminal devices are similar. It may be implemented that the second terminal device uses the first evaluation parameter set to determine the transfer capability evaluation value.
  • the first evaluation parameter group may include but not limited to the following parameters: network signal strength of the second terminal device, network transmission status of the first terminal device, type of the second terminal device, use of the second terminal device state, and the charged frequency of the second terminal device. It should be noted that “first” and “second” are only used as distinguishing descriptions, and it can be understood that when determining the transfer capability evaluation value of the first terminal device, the evaluation parameter group corresponding to the first terminal device is used.
  • Network signal strength for example, can be represented by received signal strength indication (RSSI), which can be used to indicate the actual available transmission bandwidth of the terminal device, thereby affecting the network transmission rate of the terminal device.
  • RSSI received signal strength indication
  • the RSSI value is larger, it means that the signal strength is stronger, and the data loading fluency is better when the user uses the second terminal device; The data loading fluency is poor, and there may even be problems such as freezes and loading failures. It can be understood that the stronger the network signal strength of the second terminal device is, the stronger the relay capability is, and vice versa.
  • the network transmission status can be characterized by parameters such as transmission bandwidth, transmission delay, and delay jitter. Among them, if the terminal device has higher data throughput, and/or larger transmission bandwidth, and/or lower transmission delay and/or smaller delay jitter, it means that the terminal device has a better network transfer status.
  • the quality of network transmission status can usually be determined by the router connected to the terminal device. For example, the more terminal devices connected to the connected router, the smaller the transmission bandwidth allocated to each terminal device. It can be understood that the better the network transmission status of the second terminal device is, the stronger the transfer capability is, and vice versa.
  • the type of the terminal device can be determined by factors such as the model and specification of hardware modules such as the processor and network card of the terminal device, and can be used to evaluate the performance of the terminal device, such as processing performance or power consumption performance.
  • different sub-assessment values can be determined for different types of terminal devices, and the determination method can be pre-defined, or obtained according to empirical values, or determined by comprehensively considering multiple hardware modules contained in the terminal device.
  • This application The specific implementation manner of determining the sub-evaluation value for the second terminal device according to the type of the terminal device is not limited. It can be understood that the better the performance of the type of the second terminal device, the stronger the relay capability, and vice versa.
  • the usage state of the terminal device can be determined according to the load condition of the terminal device, such as CPU load, network card load, and the like. Since the processing performance of the terminal device is fixed, the new processing task running on the second terminal device will be affected by the current load of the second terminal device. If the load of the second terminal device is higher, the processing capability of the new processing task is lower. It can be understood that the less the current load of the second terminal device is, the stronger the transfer capability is, and vice versa.
  • the charging frequency of the terminal equipment can be used to represent the probability that the terminal equipment is in the open state, and can be obtained according to the statistical prediction of whether the terminal equipment is charged or not within a period of time in history.
  • exemplary taking the speaker device B in room 2 in FIG. 4 as an example, assuming that room 2 is a living room, by making statistics on whether the speaker device B is charged (turned on) within a period of time in history, it is determined that the speaker device B after ten o'clock in the evening The probability of B being shut down gradually increases. It can be understood that if the second terminal device is in an unpowered state, the audio data to be played cannot be transferred for the first terminal device. At this time, the evaluation value of the transfer capability of the second terminal device can be set to be low, so as to avoid problems caused by the second terminal device being powered off. (Shutdown) causes the first terminal device to fail to acquire the audio data to be played.
  • the second terminal device uses the first evaluation parameter group to determine that the transfer capability evaluation value may meet the requirements of the following formula 1:
  • Transability k represents the transit capability evaluation value of the kth (k is a positive integer less than or equal to N) second terminal equipment; ⁇ i represents the ith evaluation (i is a positive integer within the range of 1 to n) Transit capability weight factor for parameter allocation; ⁇ i represents the sub-evaluation value of the i-th evaluation parameter in the first evaluation parameter group; n represents the number of evaluation parameters contained in the first evaluation parameter group.
  • the first evaluation parameter group includes the network signal strength, network transmission status, terminal device type, terminal device usage status, and terminal device charging frequency introduced in the above content, then the value of n is 5.
  • the transfer capacity weight factor assigned to each evaluation parameter can be obtained based on historical experience, or can be customized; and can be adjusted in time.
  • the second terminal device may publish the transit service by means of service availability registration and discovery, or may also publish the transit capability evaluation value in the form of broadcast or multicast packets, so that the second terminal device A terminal device may obtain the evaluation value of the transfer capability of the second terminal device, and transfer the audio data to be played through the second terminal device.
  • the speaker devices A, B and C included in Figure 4 broadcast Transability k under the local area network established based on the wireless router, so that the speaker device D as an end terminal device can receive Transability A , Transability B and Transability C , and then can It is realized that the speaker device B has the transmission paths 1, 2, 3 and 4 as shown in FIG. 4 .
  • the embodiment of the application evaluates the transfer capability of the terminal device included in the application scenario, and determines whether the terminal device can be used as another terminal device to obtain the waiting list through the transfer capability. It is a transfer node for playing audio data, so as to provide multiple optional transmission paths for other terminal devices and realize path optimization.
  • the embodiments of the present application can improve the efficiency, stability and reliability of multiple terminal devices in obtaining the same audio data to be played etc., so as to improve the user experience of multi-device synchronous playback.
  • the first terminal device may also determine its own transfer capability evaluation value, so as to evaluate whether it has the ability to forward audio data to be played for other terminal devices.
  • the first terminal device determines that its relay capability evaluation value is greater than the relay capability threshold (the relay capability threshold may indicate that the first terminal device has the ability to forward audio data to be played for other terminal devices)
  • the first terminal device Transit services can be published. It can also be understood that the first terminal device can be found and connected by other terminal devices for data transmission.
  • the first terminal device may obtain the relay capability evaluation value of the second terminal device, indicating that the second terminal device has the relay capability, that is, the second terminal device has issued a relay service.
  • FIG. 6 shows a schematic diagram of an application scenario of another multi-device synchronous playback method provided in the embodiment of the present application.
  • the local area network shown in FIG. 6 shows a schematic diagram of another multi-device synchronous playback method provided in the embodiment of the present application.
  • speaker device D is used as the first terminal device; speaker device A and Speaker device C has issued a relay service, which can be used as a second terminal device (the wireless router acts as an AP, and can transmit audio data to be played to speaker device D, so it can be understood that it can be used as a second terminal device); speaker device B has not issued a relay service. service but has playback capability and can be used as a third terminal device.
  • the first terminal device, the second terminal device or the third terminal device may or may not have released a relay service at different times and locations.
  • the first terminal device may periodically release the transit capability evaluation value from time T1 through service availability registration and discovery, or broadcast or multicast packets, and detects that the transit capability evaluation value no longer satisfies the requirement greater than the transit capability at time T2. Capability threshold, at this time, no longer publish the transit capability evaluation value through service availability registration and discovery, broadcast or multicast.
  • the first terminal device obtains the transfer availability of the N second terminal devices to the first terminal device according to the N transfer capability evaluation values.
  • the first terminal device obtains the transfer capability evaluation values of one or more second terminal devices, and can obtain the strength of each second terminal device's own transfer capability. Since the first terminal device is affected by factors such as the relative distance from any second terminal device, its placement, and whether it is in the same room, the efficiency with which the first terminal device acquires audio data to be played also depends on the first terminal device.
  • the relative signal strength of the device and the second terminal device; wherein, the relative signal strength of the second terminal device may be expressed as the signal strength of the second terminal device detected by the first terminal device. Exemplarily, if the relative signal strength of the second terminal device is greater, it means that the relative signal attenuation between the first terminal device and the second terminal device is smaller; otherwise, the relative signal attenuation is greater.
  • the relay availability of the second terminal device to the first terminal device may be jointly determined by the relay capability evaluation value of the second terminal device and the relative signal strength between the second terminal device and the first terminal device.
  • the first terminal device may assign different relay availability weight factors to each second terminal device according to the relative signal strength with each second terminal device; wherein, the first terminal The device may assign a larger relay availability weight factor to the second terminal device with a larger relative signal strength.
  • the first terminal device may also pre-store the transfer availability weight factor assigned to each second terminal pole device.
  • the first terminal device determines the transfer availability of each second terminal device based on the transfer availability weight factor and transfer capability evaluation value of each second terminal device.
  • the determination by the first terminal device of the transfer availability of the kth second terminal device to the first terminal device may meet the requirements of the following formula 2:
  • Score X ⁇ k represents the transit availability of the kth (k takes a positive integer) second terminal device relative to the first terminal device (X can represent the identity of the first terminal device); ⁇ X ⁇ k represents the first terminal device Transit availability weighting factor assigned to the kth second terminal device.
  • speaker device D is used as the first terminal device
  • speaker device A, speaker device B, speaker device C, and wireless router are used as the second terminal device as an example.
  • Speaker device D can obtain the evaluation value of the transit capability of speaker device A, speaker device B, speaker device C, and wireless router, and determine each second terminal device according to the relative signal strength between speaker device D and each second terminal device Relay availability weighting factor relative to speaker device D.
  • the transfer availability weight factor and transfer capability evaluation value of each second terminal device the transfer availability of each second terminal device relative to the first terminal device is obtained.
  • Table 1 the following is illustrated by Table 1:
  • the relay availability of each second terminal device obtained by the speaker device D is jointly determined by the evaluation value of the relay capability and the weight factor of the relay availability.
  • the evaluation value of the transfer capability of the wireless router is usually stronger than the evaluation value of the transfer capability of speaker device A, speaker device B, or speaker device C; and need to pass through two walls in the middle), so the ⁇ D ⁇ AP assigned by the speaker device D to the wireless router is relatively small; while the relative signal strength between the speaker device C and the speaker device D is small, and the speaker device D is the speaker device
  • the ⁇ D ⁇ C allocated by the device C is relatively large, so the value of Score D ⁇ C may be larger than the value of Score D ⁇ AP .
  • the first terminal device selects a destination transmission path from N transmission paths based on the transfer availability of the N second terminal devices to the first terminal device.
  • the N transmission paths are in one-to-one correspondence with the N second terminal devices. For example, transmission path 1 (wireless router ⁇ speaker device D), transmission path 2 (wireless router ⁇ speaker device B ⁇ speaker device D) corresponding to speaker device D in Figure 4, or transmission path 3 (wireless router ⁇ speaker device A ⁇ speaker device D), or transmission path 4 (wireless router ⁇ speaker device C ⁇ speaker device D).
  • the first terminal device may select the transmission path corresponding to the second terminal device with the highest transfer availability as the destination transmission path .
  • the speaker device D can select the transmission path 4 corresponding to the speaker device C as the destination transmission path.
  • a transmission path may be randomly selected from N transmission paths corresponding to N second terminal devices whose transit availability meets a preset transit capability threshold condition as the destination transmission path.
  • the preset transfer capability threshold condition may be that transfer availability is greater than or equal to a preset transfer threshold.
  • the first terminal device already has a transmission path, when it is determined according to the transit availability that the current transmission path meets the preset transit capability threshold condition, even if there is a better transmission path. No need to switch.
  • the current transmission path cannot satisfy the preset threshold condition of transit capability, it may be selected from other transmission paths satisfying the preset threshold condition of transit capability. For example, if the current transmission path of the speaker device D shown in FIG.
  • the transmission path 4 is the transmission path 1 corresponding to the wireless router, and the transmission path 1 satisfies the preset transfer capability threshold condition, even if the speaker device A, B, or C is connected to the speaker device
  • the relay availability of D is greater than the availability of the wireless router to the speaker device D, and there is no need to switch the destination transmission path.
  • the relay availability does not meet the preset switching condition, and the first terminal device may maintain the current transmission path.
  • the current transmission path of the speaker device D shown in FIG. 4 is transmission path 1, and the transmission path 2 satisfies the transit capability threshold condition but has a small gain compared to transmission path 1, so there is no need to switch the transmission path, so that Ensure the stability of multi-device audio synchronous playback scenarios.
  • the corresponding physical transmission channel is used to realize data transmission.
  • the second terminal device is usually a wireless router
  • there is a physical transmission channel between the second terminal device and the first terminal device such as a physical transmission channel based on a wireless local area network, etc.
  • the first terminal device can send The corresponding destination second terminal device initiates a request for establishing a physical transmission channel.
  • the audio data to be played can be obtained, and the first terminal device can receive the target second terminal device through the physical transmission channel.
  • the audio data to be played transmitted by the device.
  • the source address contained in the data packet containing the audio data to be played received by the first terminal device may be different.
  • the source address contained in the data packet containing the audio data to be played is the MAC address of the wireless router; when the destination transmission path of the first terminal device is transmission path 2 , the source address contained in the data packet containing the audio data to be played is the MAC address of the speaker device B.
  • the transmission rate, stability and reliability of the target transmission path can also be simulated by pre-connecting the corresponding test transmission channel. The result meets the requirements, and then the actual physical transmission channel is established. In this way, the efficiency and reliability of data transmission can be guaranteed, and the playback efficiency of multi-device synchronous playback application scenarios can be guaranteed.
  • the first terminal device acquires audio data to be played from a second terminal device corresponding to the destination transmission path.
  • the first terminal device may send a request message to the destination second terminal device corresponding to the destination transmission path, and the request message is used to request the destination second terminal device to obtain the After the audio data to be played, the audio data to be played is transmitted to the first terminal device.
  • the target second terminal device itself can also buffer the audio data to be played, so as to realize multi-device audio synchronous playback together with the first terminal device.
  • the multi-device synchronous playback method provided by the embodiment of the present application can also realize the dynamic analysis of the destination transmission path determined for each terminal device in the application scenario of multi-device audio synchronous playback.
  • the periodic analysis of multiple terminal devices included in the application scenario can dynamically adjust the destination transmission path of the terminal device in a timely and accurate manner, so as to ensure the stability of the multi-device audio synchronous playback application scenario, improve playback fluency, and enhance user experience.
  • the implementation of selecting the destination transmission path for each terminal device in the multi-device audio synchronous playback application scenario the playback capability of each terminal device can also be evaluated during the implementation of this application.
  • the optimization and stability guarantee of the destination transmission path of the terminal device in the application scenario can be realized.
  • FIG. 7 shows another schematic flowchart of a multi-device synchronous playback method.
  • the role of the first terminal device is divided based on the transfer capability and playback capability of the first terminal device and the transfer availability of N second terminal devices to the first terminal device.
  • the first terminal device can be treated differently in combination with the characteristics of different roles, so as to ensure that each terminal device included in the multi-device audio synchronous playback application scenario can have a better
  • the acquisition efficiency of audio data can ensure the stability and fluency of audio playback in this application scenario.
  • the transfer capability of the first terminal device and the evaluation method of the transfer availability of the first terminal device by the N second terminal devices may be combined with the content of the above-mentioned embodiments introduced in FIG. 4 to FIG. 6 , which will not be repeated here.
  • the playback capability of the first terminal device can be realized by the playback capability evaluation value.
  • the playback capability evaluation value may be used to represent the playback capability of the first terminal device.
  • the playback capability evaluation value of the first terminal device may indicate that the playback capability of the first terminal device is stronger; in other words, the first terminal device takes less time to acquire the audio data to be played, and the stability is better And the higher the reliability, the smaller the impact on the short-board effect of multi-device audio synchronous playback.
  • the embodiment of the present application provides an implementation manner of determining the playback capability evaluation value of the first terminal device, which may be implemented as follows: the first terminal device uses the second evaluation parameter set to determine the playback capability evaluation value of each second terminal device.
  • the second evaluation parameter group may include but not limited to the following parameters: network signal strength, network transmission status, and terminal device type.
  • the evaluation parameters included in the second evaluation parameter group reference may be made to the content introduced above in conjunction with FIG. 5 , and the present application will not introduce it redundantly here.
  • the first terminal device uses the second evaluation parameter group to determine the evaluation value of the playback capability may meet the requirements of the following formula 3:
  • Playbackability X represents the playback capability evaluation value of the first terminal device (X may represent the identity of the first terminal device); Indicates the playback ability weight factor assigned to the jth evaluation parameter (j is a positive integer within the range of 1 to m); ⁇ i represents the sub-evaluation value of the jth evaluation parameter in the second evaluation parameter group; m represents the Two The number of evaluation parameters contained in the evaluation parameter group. For example, if the second evaluation parameter group includes the network signal strength, network transmission status, and terminal device type introduced in the above content, then the value of m is 3. It should be noted that the playback ability weight factor assigned to each evaluation parameter may be obtained based on historical experience, or may be customized; and may be adjusted in time.
  • the process shown in FIG. 7 may include:
  • the first terminal device updates the transfer capability evaluation value.
  • the first terminal device may periodically update the transfer capability evaluation value according to the first evaluation parameter group.
  • the update cycle can also be dynamically adjusted according to the scene where multiple devices play audio synchronously. For example, when the first terminal device uses a high-frequency period, the update cycle can be set to a shorter time interval; and when the first terminal device uses a low-frequency period, the update cycle can be set to a longer time interval; for example, in the evening time period The update period can be set to a few minutes, and the update period in the early morning period can be set to a few hours.
  • the accuracy of the transfer capability of the first terminal device as a transfer node can be improved, thereby ensuring that the first terminal device is selected as the data source for obtaining the audio data to be played
  • the playback capabilities of other terminal devices can be improved, so as to improve user experience.
  • the first terminal device may be preset with a relay capability threshold, and the relay capability threshold may be used as an evaluation basis for judging whether the first terminal device can issue the relay service.
  • the transfer capability threshold can be determined based on historical experience, for example, based on the statistics of historical data in the multi-device audio synchronous playback scenario, or the analysis of experimental data, it can be obtained that when the transfer capability evaluation value is greater than the transfer capability
  • the threshold is set, the application scenario can obtain a better user experience.
  • the first terminal device publishes a relay service, and determines itself as a relay role. After the first terminal device publishes the transfer service, it can be searched by other terminal devices, so as to serve as a transmission path for other terminal devices to obtain the audio data to be played, and obtain the audio data to be played by multiple terminal devices in the multi-device audio synchronous playback scenario
  • the source of the data provides a variety of possible transmission path options.
  • the first terminal device may register and discover service availability, or publish a relay service through broadcast or multicast packets, and the relay service may be, for example, a relay capability evaluation value.
  • S701b to S706 and the above S701a to S703a is not limited.
  • S701b to S706 and the above S701a to S703a may be executed in parallel.
  • the first terminal device updates the playback capability evaluation value. Similar to the update method of the transfer capability evaluation value, the first terminal device can also periodically update the playback capability evaluation value, so that the playback capability of the first terminal device can be evaluated more accurately and in a timely manner, thereby ensuring synchronous audio playback of multiple devices The synchronous playback efficiency of the scene.
  • the playback capability evaluation value of the first terminal device is greater than the playback capability threshold, continue to execute S707; otherwise, continue to execute S703b.
  • the playback capability threshold is similar to the transfer capability threshold, and may also be preset, so details will not be repeated here. It should be noted that, in this embodiment, if the playback capability evaluation value of the first terminal device is greater, it means that the playback capability of the first terminal device is stronger; if the playback capability evaluation value of the first terminal device is smaller, it means As an example, the weaker the playback capability of the first terminal device, there may be another possible correlation in actual implementation, such as a negative correlation, and S702b may make corresponding changes at this time.
  • the first terminal device searches for N second terminal devices that publish the relay service. When the first terminal device determines that the current playback capability cannot meet the preset playback capability threshold, it indicates that the transmission status of the transmission path through which the audio data to be played is currently obtained is not good, and at this time the first terminal device can start switching the target transmission path. processing flow. It may be implemented that the first terminal device first determines N second terminal devices that can provide transmission paths for the first terminal device.
  • the process shown in FIG. 7 can also be applied to the scenario where the first terminal device is initially started. At this time, the first terminal device may not have a current transmission path, and the first Selected transfer path. In addition, after the first terminal device selects the transmission path for the first time, it can save the transmission path selected for the first time as the default transmission path, and then use the default transmission path to obtain the transmission data to be played after the first terminal device is started, so that the first terminal device In the scenario of multi-device audio synchronous playback, the processing efficiency can be improved.
  • the first terminal device performs a transfer availability analysis on each of the second terminal devices.
  • the implementation process of the transit availability analysis performed by the first terminal device reference may be made to the implementation process introduced in FIG. 5 , which will not be introduced redundantly in this application.
  • the first terminal device determines that there are N second terminal devices whose transfer availability is greater than the transfer availability threshold among the second terminal devices, continue to execute S706; otherwise, continue to execute S707.
  • the transit availability threshold is similar to the transit capability threshold, and may also be preset, and will not be repeated here.
  • being greater than the transit availability threshold is used to indicate that obtaining the audio data to be played through the transmission path corresponding to the second terminal device can meet the basic multi-device audio synchronous playback requirements; for example, the time-consuming to obtain the audio data to be played through the transmission path It is lower than the set maximum time-consuming threshold requirement.
  • the first terminal device switches the destination transmission path, and determines to be the end player role.
  • the first terminal device analyzes the availability of multiple relays, and if there is a destination transmission path that can meet the basic requirements of multi-device audio synchronous playback, based on the judgment result in S702b that the current playback capability of the first terminal device is not good, Switching the destination transmission path for the first terminal device to obtain the audio data to be played can improve the data acquisition efficiency of the first terminal device and reduce the time-consuming data acquisition, thereby reducing the short-term delay of the first terminal device for multi-device audio synchronous playback scenarios. plate effect.
  • the first terminal device can be determined as the end player role, that is, the end terminal device introduced in the foregoing embodiments.
  • the fluency of multi-device audio synchronous playback depends more on the influence of the terminal device in the end playback role. Therefore, in order to improve the user experience of multi-device audio synchronous playback, it is possible to improve the efficiency of the terminal playback role in obtaining the audio data to be played, and reduce the acquisition time.
  • the source address contained in the data packet containing the audio data to be played is different before and after the destination transmission path is switched by the first terminal device.
  • the first terminal device is determined to be a normal player role.
  • the terminal device in the role of ordinary player can basically meet the requirements of multi-device audio synchronous playback, and participate in the realization of multi-device audio synchronous playback scene. negative impact.
  • the first terminal device may also be determined as a transfer role and a normal player role at the same time.
  • different roles can be assigned to the terminal devices included in the multi-device audio synchronous playback scenario, so that different terminal devices can be processed differently more accurately. For example, for a terminal device in the end player role, considering that the terminal device will have a greater impact on the playback experience, the efficiency of the end player role in obtaining audio data to be played can be improved, thereby reducing the impact on the playback experience.
  • personalized reminders can also be customized for users according to the terminal device in the end player role; , and an operation instruction asking the user whether to remove the terminal device from the current multi-device audio synchronous playback scene.
  • the reminder can be embodied in the form of text message, phone call, pop-up window, etc., which is not limited in this application.
  • FIG. 8 is a schematic diagram of an application scenario of another multi-device synchronous playback method shown in the embodiment of the present application.
  • the terminal devices included in this application scenario may respectively have corresponding evaluation values of transfer capability and evaluation values of playback capability.
  • the wireless router since the wireless router usually does not participate in audio playback, there is no need to determine the playback capability evaluation value.
  • the speaker device D can also determine the transfer availability of multiple second terminal devices to the speaker device D based on the evaluation values of the transfer capabilities of multiple second terminal devices, and obtain the The relay availability list shown is used to switch the destination transmission path.
  • the default transmission path can usually be the transmission path 1 shown in FIG. 8 , that is, the audio data to be played can be obtained from the wireless router.
  • the transfer capability evaluation value and the playback capability evaluation value can be periodically updated based on the content introduced in FIG. 7 , so as to evaluate the role of the speaker device D at different times.
  • speaker device D can be used as a normal player at time T1, and after acquiring the audio data to be played through transmission path 1, it can realize multi-device synchronous playback with other speaker devices.
  • Speaker device D can also serve as a relay role in addition to its normal playback role at T2. At this time, speaker device D can issue a relay service and provide an optional transmission path for other terminal devices (such as terminal playback devices).
  • the speaker device D determines according to the playback capability evaluation value updated at time T3 that it is no longer greater than the playback capability threshold, then the speaker device D needs to switch the target transmission path based on the indications shown in S703b to S705. If the speaker device D determines that it is necessary to switch the destination transmission path, the destination transmission path may be determined according to the relay availability of multiple second terminal devices to the speaker device D. For example, the value of relay availability D ⁇ C shown in FIG. 8 satisfies the preset relay capability threshold condition, then the speaker device D can switch from obtaining the audio data to be played through the transmission path 1 to obtaining it through the transmission path 4 .
  • the dynamic analysis of the destination transmission path can be realized based on the embodiment shown in FIG. Efficiency, stability and reliability of audio data.
  • FIG. 9 is another schematic flowchart of a multi-device synchronous playback method provided by the embodiment of the present application.
  • the first terminal device still taking the first terminal device as an example, during the process of multi-device synchronous playback by the first terminal device, it is also possible to perform long-term state Monitoring and data learning analysis. Based on the long-term state monitoring results and data learning and analysis results of the first terminal device, the stability and transfer capability of the current transmission path of the first terminal device can be predicted and analyzed, so that the first terminal device can be selected in a timely and accurate manner. Or switch an appropriate transmission path, so as to ensure the stability, fluency and user experience of audio playback in the multi-device audio synchronous playback scenario.
  • the specific processing flow of this embodiment includes:
  • the first terminal device collects statistics on the status of the current transmission path.
  • the first terminal device collects first processed data generated by multi-device synchronous playback processing using the current transmission path; wherein the first processed data is used to indicate the stability of the current transmission path state, and the first processing
  • the data may include, for example, the load status, network status, network status, Types of information such as historical power-on time, historical power-off time, or historical startup time.
  • the first terminal device may collect the first processed data within a specified time period. For example, the first terminal device collects the first processed data of the past week, or further the first terminal device collects the first processed data of the past week from 8 am to 11 pm. In this way, the first terminal device can perform long-term state monitoring and prediction on the collection of historical first processing data, which can improve the accuracy and timeliness of prediction, and at the same time avoid excessive occupation of the first terminal due to excessive load The processing performance of the device.
  • the first terminal device predicts the stability of the current transmission path.
  • the first terminal device may predict the stability of the current transmission path based on a time series learning algorithm, that is, the first terminal device predicts whether the current transmission path can still be used normally or stably in a period of time in the future.
  • the first terminal device may perform prediction based on the stability evaluation value.
  • the stability evaluation value can be determined by one or a combination of the following information: power-off confidence, load status (such as CPU usage, etc.), network status (such as transmission rate, transmission bandwidth, etc.).
  • whether the terminal device will be powered off may be indicated by the power-off confidence degree, and if the power-off confidence degree increases, it indicates that the probability that the current transmission path cannot be used normally increases.
  • the current transmission path of speaker device D is transmission path 4, that is, the transmission path corresponding to speaker device C, according to the statistical results of the current transmission path status in S901a, according to the historical first processing data
  • the power-off confidence of the speaker device C can be predicted. In this way, the first terminal device can execute the processing in S903 based on the predicted power-off confidence level.
  • the specific processing rules will be introduced in S903 below and will not be described in detail here.
  • the first terminal device collects statistics on the transfer capability of the second terminal device corresponding to the current transmission path.
  • the first terminal device collects the second processing data generated by the multi-device synchronous playback process using the current transmission path; wherein the second processing data is used to represent the transfer of the second terminal device corresponding to the current transmission path Capability; for example, the transit capability evaluation value introduced in the foregoing embodiments.
  • the collection of the second processing data can also collect the data generated within a specified time, and then the collected historical second processing data can be used as a sample for statistics to realize the transfer capability of the current transmission path. predict.
  • the first terminal device predicts the transfer capability of the current transmission path.
  • the first terminal device may predict the transit capability of the current transmission path based on a time series learning algorithm, that is, the first terminal device predicts the transit capability of the terminal device corresponding to the current transmission path within a period of time in the future .
  • a time series learning algorithm that is, the first terminal device predicts the transit capability of the terminal device corresponding to the current transmission path within a period of time in the future .
  • the current transmission path of the speaker device D is transmission path 4
  • the statistical result of the transfer capability of the current transmission path is obtained through S901b, and the speaker device can be predicted according to the historical second processing data.
  • C Estimated transfer capacity evaluation value in a period of time in the future.
  • the first terminal device can perform the processing in S903 by predicting the estimated transfer capability evaluation value obtained by the prediction.
  • the specific processing rules are introduced in S903 below, and will not be described in detail here.
  • the first terminal device judges whether to perform backup transmission path pre-connection, and if so, continue to execute S904a; otherwise, continue to execute S904b. Based on S901a-S902a, S901b-S902b, the first terminal device can respectively obtain the stability evaluation value and the transfer capability evaluation value of the current transmission path within a certain period of time in the future (or at a certain moment in the future).
  • a possible example is that the first terminal device determines to perform backup transmission path pre-connection when the stability evaluation value of the current transmission path is greater than the stability threshold after determining the first time period (or at a first moment in the future).
  • the greater the stability evaluation value the greater the fluctuation of the current transmission path, that is, the more unstable; if the stability evaluation value is smaller, it indicates that the current transmission path is more unstable. is less than the stability threshold.
  • Another possible example is that after the first terminal device determines that the transit capability evaluation value of the current transmission path is less than or equal to the transit capability threshold after the second time period (or at a second moment in the future), it determines to perform backup transmission path pre-connection.
  • the second duration may be the same duration as the first duration, or may be different from the first duration.
  • the second duration can be set to be longer than the first duration, because the power-off of the terminal device that establishes the current transmission path usually means that the terminal device cannot transmit the audio data to be played for the first terminal device until it is powered on next time , so if it is predicted that the stability evaluation value is high, it can be determined that pre-connection of the backup transmission path is required.
  • the poor transfer capability of the terminal equipment that establishes the current transmission path may be temporary and may recover after a period of time. Therefore, in order to improve the stability of the transmission path, it can be delayed for a period of time compared with the first time period. If the current transmission path is still predicted The transfer capability of the terminal device corresponding to the path is poor, and it is determined that a backup transmission path pre-connection is required at this time.
  • FIG. 10 shows another application scenario diagram of multi-device synchronous playback provided by the embodiment of the present application.
  • the current transmission path is the transmission path 1 established through the wireless router, and the pre-connection of the backup transmission path is determined through S903, which can also be understood as establishing the physical transmission channel corresponding to the backup transmission path; at this time, the speaker device D can pre-connect transmission path 2, transmission path 3, and transmission path 4 as the backup transmission path of transmission path 1, that is, speaker device D can send physical transmission channels to speaker device A, speaker device B, and speaker device C respectively The build request for .
  • speaker device D initiates a Bluetooth connection request to speaker device B, indicating that a physical transmission channel has been established after connecting to Bluetooth; speaker device D initiates a Wi-Fi direct connection request to speaker device A, and indicates the establishment of a Wi-Fi direct connection after establishing the physical transmission channel.
  • the first terminal device maintains the connection of the current transmission path. Exemplarily, if the first terminal device determines that the current transmission path can meet the transmission capacity of the audio data to be played within a certain period of time in the future, it may continue to maintain the connection of the current transmission path and wait for the next judgment. It should be noted that the processing flow shown in FIG. 9 may also be performed periodically, so as to ensure the stability of multi-device audio synchronous playback scenarios.
  • the first terminal device may perform pre-connection processing on the backup transmission path for possible abnormalities of the current transmission path in the future.
  • the first terminal device can also perform real-time detection of the current stability and transfer capability of the current transmission path, and if it is determined that the transmission path switching condition is satisfied , continue to execute S906; otherwise, return to execute S904b.
  • the first terminal device determines to switch the transmission path. For another example, if the first terminal device detects that the transfer capability of the terminal device on the current transmission path becomes worse and is less than or equal to the transfer capability threshold, it determines to switch the transmission path.
  • the first terminal device selects a target transmission path from the at least one backup transmission path, and performs switching. As shown in the application scenario diagram in Figure 10, the first terminal device can select a transmission path as the destination transmission path from the transmission path 2, the transmission path 3, and the transmission path 4 as the backup transmission path, for example, the speaker device D will pass the transmission path
  • the acquisition of the audio data to be played by the path 1 is switched to the acquisition of the audio data to be played by the (standby) transmission path 4 .
  • the terminal device can realize the pre-establishment of the backup transmission path, so that when the current state of the current transmission path is detected to be poor, the transmission path can be quickly switched. In turn, it improves the fluency and stability of audio playback in the multi-device audio synchronous playback scenario, and reduces the longest time-consuming time for multiple devices to obtain audio data to be played, so as to improve user experience.
  • FIG. 11 shows a terminal device 1100 provided in an embodiment of the present application.
  • the terminal device 1100 includes one or more processors 1101 ; one or more memories 1102 ; a communication interface 1103 , and one or more computer programs 1104 , and the above components can be connected through one or more communication buses 1105 .
  • the communication interface 1103 is used to implement communication with other devices (such as terminal devices), for example, the communication interface may be a transceiver.
  • the one or more computer programs 1104 are stored in the above-mentioned memory 1102 and configured to be executed by the one or more processors 1101, the one or more computer programs 1104 include instructions, and the above-mentioned instructions can be used to perform the following steps ,include:
  • the first terminal device acquires N evaluation values of the transfer capabilities of the second terminal devices, where N is a positive integer; the first terminal device obtains the N evaluation values of the transfer capabilities of the second terminal devices according to the N evaluation values of the transfer capabilities.
  • Transit availability of the first terminal device the first terminal device selects a destination transmission path from N transmission paths based on the transit availability of the N second terminal devices to the first terminal device, and the N The transmission paths correspond to the N second terminal devices one by one; the first terminal device obtains the audio data to be played from the second terminal device corresponding to the destination transmission path.
  • the first terminal device obtains the transfer availability of the N second terminal devices to the first terminal device according to the N evaluation values of the transfer capability, which may be implemented as: The first terminal device determines N relative signal strengths corresponding to the N second terminal devices; the first terminal device assigns relay availability to the N second terminal devices respectively based on the N relative signal strengths weighting factor; for the ith second terminal device, the first terminal device uses the product of the transfer capability evaluation value of the ith second terminal device and the transfer availability weight factor as the weight factor of the ith terminal device Transit availability; the i is any positive integer from 1 to N.
  • the first terminal device may assign a smaller High transit availability weighting factor.
  • the first terminal device may also transfer the audio data to be played for other terminal devices, which may be determined according to the evaluation value of the transfer capability of the first terminal device.
  • This design may be implemented as follows: the first terminal device uses a first evaluation parameter group to determine a first transfer capability evaluation value of the first terminal device, and the first evaluation parameter group includes but is not limited to one of the following evaluation parameters A combination of one or more: the network signal strength of the first terminal device, the network transmission status of the first terminal device, the type of the first terminal device, the usage status of the first terminal device, the The charging frequency of the first terminal device; if the first transfer capability evaluation value meets the preset transfer capability threshold condition, the first terminal device sends the first transfer capability evaluation value, etc. It can be understood that, before the first terminal device acquires the transfer capability evaluation values of the N second terminal devices, the second terminal devices may also use the design described above to determine their respective transfer capability evaluation values.
  • the first terminal device uses the first evaluation parameter group to determine the first transfer capability evaluation value of the first terminal device.
  • An optional implementation manner is: the first terminal device obtains the The transfer capability weight factors corresponding to each evaluation parameter included in the first evaluation parameter group; the first terminal device calculates the transfer capability weight factors respectively corresponding to each evaluation parameter in the first evaluation parameter group Each of the included evaluation parameters is weighted and summed to obtain the first transit capacity evaluation value.
  • the first terminal device may also adopt an implementation manner of determining the first transit capability evaluation value, such as adopting a machine learning method, which is not limited in this application.
  • the first terminal device may also periodically update the first transfer capability evaluation value.
  • the first terminal device may perform role division, and may perform different processing in different roles. For example, the first terminal device may be classified into a common player role or an end player role according to the playback capability evaluation value. Wherein, the terminal playing role indicates that the playing ability of the first terminal device is not good. Based on this, the first terminal device uses a second evaluation parameter group to determine the first playback capability evaluation value of the first terminal device, and the second evaluation parameter group includes a combination of one or more of the following evaluation parameters : the network signal strength of the first terminal device, the network transmission status of the first terminal device, and the type of the first terminal device.
  • the first terminal device may select a destination from N transmission paths corresponding to N second terminal devices. Transmission path to obtain the audio data to be played.
  • the first terminal device selects a destination transmission path from N transmission paths based on the transfer availability of the N second terminal devices to the first terminal device, which may be implemented as: The first terminal device determines that none of the transfer availability of the N second terminal devices to the first terminal device meets the transfer capability threshold condition, and the first terminal device uses the current transmission path as the destination transmission path. Or it may also be implemented as follows: the first terminal device determines that the transfer availability of at least one second terminal device to the first terminal device meets the transfer capability threshold condition, and the first terminal device obtains from the at least one second terminal device A destination transmission path is selected from at least one transmission path corresponding to the terminal device.
  • the first terminal device determines that the transfer availability of at least one second terminal device to the first terminal device meets the transfer capability threshold condition, and the transfer capability of the at least one second terminal device to the first terminal device
  • the transfer availability of a terminal device does not meet the preset switching condition compared with the transfer availability of the second terminal device corresponding to the current transmission path to the first terminal device, and the first terminal device uses the current transmission path as the transfer availability of the first terminal device. Destination transmission path.
  • the first terminal device may also periodically update the first playback capability evaluation value.
  • the first terminal device may also ensure the transmission efficiency and stability of the audio data to be played by predicting the current transmission path. It may be implemented that the first terminal device predicts the stability of the current transmission path based on the first processing data, and obtains the stability evaluation value of the current transmission path at the first moment; the first processing data is the first The terminal device statistics are obtained by using the processing data generated by the current transmission path; and, the first terminal device predicts the transfer capability of the current transmission path based on the second processing data, and obtains that the current transmission path is at the second moment The transfer capability evaluation value of the second terminal device; the second processed data is obtained by the first terminal device from counting the transfer capability evaluation value of the second terminal device corresponding to the current transmission path.
  • the first terminal device detects a first trigger condition, perform pre-connection of at least one backup transmission path; wherein, the first trigger condition includes a combination of one or more of the following conditions: the first moment The stability evaluation value of the value meets the preset stability threshold condition, and the transfer capacity evaluation value at the second moment meets the preset transfer capacity threshold condition.
  • the selecting the target transmission path from the N transmission paths by the first terminal device includes: selecting the target transmission path from the at least one backup transmission path by the first terminal device.
  • the first terminal device predicts the stability of the current transmission path based on the first processed data, which may be implemented as the first terminal device adopts a time series learning algorithm to predict the current Predict the stability of the transmission path; the first terminal device predicts the transfer capability of the current transmission path based on the second processing data, including: the first terminal device adopts a time series learning algorithm based on the second processing data to The transfer capability of the current transmission path is predicted.
  • the stability evaluation value is determined by but not limited to a combination of one or more of the following information: the power-off confidence level of the second terminal device, the The load status of the device, the network status of the second terminal device, and the like.
  • the first terminal device may receive and respond to the playback instruction, and play the audio data to be played; the playback instruction uses To instruct at least one terminal device to synchronously play the audio data to be played, where the at least one terminal device includes the first terminal device and the N second terminal devices.
  • Each functional unit in each embodiment of the embodiment of the present application may be integrated into one processing unit, or each unit may physically exist separately, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage
  • the medium includes several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk, and other various media capable of storing program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

本申请涉及音频技术领域，公开了一种多设备同步播放方法及装置，用以提升多设备音频同步播放的效率。该方法为，第一终端设备获取N个第二终端设备的中转能力评估值，所述N为正整数；所述第一终端设备根据N个所述中转能力评估值，得到所述N个第二终端设备对所述第一终端设备的中转可用性；所述第一终端设备基于所述N个第二终端设备对所述第一终端设备的中转可用性，从N条传输路径中选取目的传输路径，所述N条传输路径与所述N个第二终端设备一一对应；所述第一终端设备从所述目的传输路径对应的第二终端设备获取待播放音频数据。

Description

一种多设备同步播放方法及装置
相关申请的交叉引用
本申请要求在2021年08月27日提交中华人民共和国知识产权局、申请号为202110993559.9、申请名称为“一种多设备同步播放方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及音频技术领域，尤其涉及一种多设备同步播放方法及装置。
背景技术
随着智慧网络技术的发展，多设备协同管理的场景越来越多，为用户带来更好的用户体验。比如，在家庭等局域网中存在多个可以用于播放音频的设备基础上，使用多个不同设备进行音频同步播放的场景越来越多。
然而，受到不同设备具有不同的摆放位置以及不同的网络信号状态等因素的影响，实现多设备音频同步播放时会受到一定的限制，从而导致用户体验差。如，由于多设备中的一个设备获取待播放音频数据的耗时较长，导致多设备同步播放的起播等待时间较久或者同步播放过程中出现卡顿等问题。
因此，如何提升多设备音频同步播放的效率是具有研究价值的。
发明内容
本申请实施例提供一种多设备同步播放方法及装置，用以解决相关技术中实现多设备音频同步播放时会受到一定的限制的问题。
第一方面，本申请实施例提供了一种多设备同步播放方法，所述方法包括：第一终端设备获取N个第二终端设备的中转能力评估值，所述N为正整数；所述第一终端设备根据N个所述中转能力评估值，得到所述N个第二终端设备对所述第一终端设备的中转可用性；所述第一终端设备基于所述N个第二终端设备对所述第一终端设备的中转可用性，从N条传输路径中选取目的传输路径，所述N条传输路径与所述N个第二终端设备一一对应；所述第一终端设备从所述目的传输路径对应的第二终端设备获取待播放音频数据。可选的，假设第二终端设备对第一终端设备的中转可用性越大，表示第一终端设备选取所述第二终端设备对应的传输路径作为目的传输路径的传输效率、稳定性、可靠性越好，则第一终端设备在确定目的传输路径时，可以优先选择对第一终端设备的中转可用性较高的第二终端设备。
通过本申请提供的方法，在多设备同步播放的应用场景下，本申请实施例中对该应用场景下包含的终端设备进行中转能力的评估，通过中转能力确定该终端设备是否可以作为其他终端设备获取待播放音频数据的中转节点，以实现为其他终端设备提供多条可选的传输路径，实现路径优化。相比于现有技术中每个终端设备均从路由器中获取待播放音频数据的传输方式，本申请实施例可以提升多个终端设备对相同的待播放音频数据的获取效率、 稳定性和可靠性等，从而可以提升多设备同步播放的用户体验。
在一种可能的设计中，所述第一终端设备根据N个所述中转能力评估值，得到所述N个第二终端设备对所述第一终端设备的中转可用性，可以实施为：所述第一终端设备确定与所述N个第二终端设备对应的N个相对信号强度；所述第一终端设备基于所述N个相对信号强度，为所述N个第二终端设备分别分配中转可用性权重因子；针对第i个第二终端设备，所述第一终端设备将所述第i个第二终端设备的中转能力评估值和中转可用性权重因子的乘积，作为所述第i个终端设备的中转可用性；所述i为1至N中的任一正整数。可选的，假设第二终端设备的相对信号强度越大表示第二终端设备对第一终端设备的中转可用性越高，第一终端设备则可以为相对信号强度越大的第二终端设备分配较高的中转可用性权重因子。
该设计中，第一终端设备通过与各第二终端设备之间的相对关系，为不同的第二终端设备分配不同的中转可用性权重因子，可以提升相对关系较好的第二终端设备的中转可用性，从而可以保障对目的传输路径选取的准确性。
在一种可能的设计中，第一终端设备也可以为其他终端设备中转待播放音频数据，可以根据第一终端设备的中转能力评估值来确定。该设计可以实施为：所述第一终端设备采用第一评估参数组确定所述第一终端设备的第一中转能力评估值，所述第一评估参数组包括但不限于以下评估参数中的一种或多种的组合：所述第一终端设备的网络信号强度、所述第一终端设备的网络传输状态、所述第一终端设备的类型、所述第一终端设备的使用状态、所述第一终端设备的带电频率；若所述第一中转能力评估值符合预设中转能力阈值条件，所述第一终端设备发送所述第一中转能力评估值等。可以理解，第一终端设备获取N个第二终端设备的中转能力评估值之前，第二终端设备也可以采用上述介绍的设计来确定各自的中转能力评估值。可选的，假设第一终端设备的第一中转能力评估值越大表示第一终端设备的中转能力越强，则第一中转能力评估值可以大于或等于预设中转能力阈值时，表示符合条件。
该设计中，通过计算第一终端设备的中转能力评估值，还可以评估第一终端设备是否可以作为其他终端设备的中转节点，从而可以为其他终端设备提供可能的传输路径，以达到优化多设备同步播放场景的整体稳定性和效率的目的。
在上述设计中，所述第一终端设备采用第一评估参数组确定所述第一终端设备的第一中转能力评估值，一种可选的实施方式为：所述第一终端设备获取所述第一评估参数组中所包含的各评估参数分别对应的中转能力权重因子；所述第一终端设备根据所述各评估参数分别对应的中转能力权重因子，对所述第一评估参数组中所包含的各所述评估参数采用加权求和方式得到所述第一中转能力评估值。其中，中转能力权重因子可以是预先定义的，或者根据经验得到的等。另一可选的，第一终端设备还可以采用确定第一中转能力评估值的实施方式，例如采用机器学习方式等，本申请不进行限定。
该设计中，第一终端设备基于第一评估参数组中的多个评估参数确定第一中转能力评估值，可以更加准确的实现对第一终端设备的中转能力的评估，从而可以保障多设备同步播放场景的稳定性、效率和可靠性。
在一种可能的设计中，所述第一终端设备还可以周期性更新所述第一中转能力评估值。
该设计中，第一终端设备通过周期性更新，可以得到更加准确的评估结果，从而可以保障多设备同步播放的效率、可靠性以及稳定性。
在一种可能的设计中，第一终端设备可以进行角色划分，在不同角色下可以进行不同的处理。例如，第一终端设备可以根据播放能力评估值划分为普通播放角色或者末端播放角色。其中，末端播放角色表示第一终端设备的播放能力不佳。基于此，所述第一终端设备采用第二评估参数组确定所述第一终端设备的第一播放能力评估值，所述第二评估参数组包括以下评估参数中的一种或多种的组合：所述第一终端设备的网络信号强度、所述第一终端设备的网络传输状态、所述第一终端设备的类型。可选的，若所述第一终端设备确定所述第一播放能力评估值不符合播放能力阈值条件，所述第一终端设备可以从N个第二终端设备对应的N条传输路径中选取目的传输路径，来获取待播放音频数据。可选的，假设第一终端设备的第一播放能力评估值越大表示第一终端设备的播放能力越强，则第一播放能力评估值可以大于或等于预设播放能力阈值时，表示符合条件。
该设计中，通过对第一终端设备的播放能力的评估，可以及时地触发第一终端设备进行目的传输路径的优化，例如，搜索并发现更优的目的传输路径并进行切换，从而可以保障多设备同步播放的效率、可靠性以及稳定性。
在一种可能的设计中，所述第一终端设备基于所述N个第二终端设备对所述第一终端设备的中转可用性，从N条传输路径中选取目的传输路径，可以实施为：所述第一终端设备确定所述N个第二终端设备对所述第一终端设备的中转可用性均不符合中转能力阈值条件，所述第一终端设备将当前传输路径作为所述目的传输路径。或者还可以实施为：所述第一终端设备确定至少一个第二终端设备对所述第一终端设备的中转可用性符合所述中转能力阈值条件，所述第一终端设备从所述至少一个第二终端设备对应的至少一条传输路径中选取目的传输路径。或者又可以实施为：所述第一终端设备确定至少一个第二终端设备对所述第一终端设备的中转可用性符合所述中转能力阈值条件、且所述至少一个第二终端设备对所述第一终端设备的中转可用性与所述当前传输路径对应的第二终端设备对所述第一终端设备的中转可用性相比不符合预设切换条件，所述第一终端设备将当前传输路径作为所述目的传输路径。
该设计中，第一终端设备通过对多条传输路径的中转可用性的评估，可以实现更加准确地选择目的传输路径，从而可以保障多设备同步播放的效率、可靠性以及稳定性。并且，该设计通过对多条可选的传输路径的中转可用性，与当前传输路径的中转可用性之间的比较，可以设置可选的传输路径相比当前传输路径符合预设切换条件(例如一定中转可用性差值)时再执行切换，这样还可以较好地保证传输路径的稳定性，避免目的传输路径频繁切换。
在一种可能的设计中，所述第一终端设备还可以周期性更新所述第一播放能力评估值。
该设计中，第一终端设备通过周期性更新，可以得到更加准确的评估结果，从而可以保障多设备同步播放的效率、可靠性以及稳定性。
在一种可能的设计中，第一终端设备还可以通过对当前传输路径的预测来保障待播放音频数据的传输效率和稳定性。可实施为，第一终端设备基于第一处理数据对当前传输路径的稳定性进行预测，得到所述当前传输路径在第一时刻的稳定性评估值；所述第一处理数据为所述第一终端设备统计采用所述当前传输路径所产生的处理数据得到的；以及，第一终端设备基于第二处理数据对所述当前传输路径的中转能力进行预测，得到所述当前传输路径在第二时刻的中转能力评估值；所述第二处理数据为所述第一终端设备统计所述当前传输路径对应的第二终端设备的中转能力评估值得到的。若所述第一终端设备检测到第 一触发条件，进行至少一条备用传输路径的预连接；其中，所述第一触发条件包括以下条件中的一种或多种的组合：所述第一时刻的稳定性评估值符合预设稳定性阈值条件、所述第二时刻的中转能力评估值符合预设中转能力阈值条件。
该设计中，通过对当前传输路径在未来一段时间的稳定性和中转能力的预测，可以实现在稳定性不佳或者中转能力不好的场景下，预先进行备用传输路径的连接，从而可以实现目的传输路径的有效切换，保障多设备同步播放的稳定性。
在一种可能的设计中，所述第一终端设备从N条传输路径中选取目的传输路径，包括：所述第一终端设备从所述至少一条备用传输路径中选取所述目的传输路径。
该设计中，基于上一设计中，第一终端设备根据预测可以实现备用传输路径的预连接，这样第一终端设备选择目的传输路径时可以从备用传输路径中确定，从而可以提升传输路径切换的准确性和效率。
在一种可能的设计中，所述第一终端设备基于第一处理数据对当前传输路径的稳定性进行预测，可实施为所述第一终端设备基于第一处理数据采用时间序列学习算法对当前传输路径的稳定性进行预测；所述第一终端设备基于第二处理数据对所述当前传输路径的中转能力进行预测，包括：所述第一终端设备基于第二处理数据采用时间序列学习算法对所述当前传输路径的中转能力进行预测。
该设计中，通过时间序列学习算法，可以通过对历史处理数据的统计，得到更加准确的预测结果。
在一种可能的设计中，所述稳定性评估值通过但不限于以下信息中的一种或多种的组合来确定：所述第二终端设备的下电置信度、所述第二终端设备的负载状态、所述第二终端设备的网络状态等。
该设计中，第一终端设备通过对当前传输路径对应的第二终端设备的下电状态、负载状态或者网络状态等进行预测，来评估当前传输路径的稳定性，可以提升第一终端设备对目的传输路径切换的效率，从而保障多设备同步播放的效率和可靠性。
在一种可能的设计中，在第一终端设备获取到待播放音频数据之后，所述第一终端设备可以接收并响应于播放指令，对所述待播放音频数据进行播放；所述播放指令用于指示至少一个终端设备对所述待播放音频数据进行同步播放，所述至少一个终端设备包括所述第一终端设备和所述N个第二终端设备。
该设计中，通过本申请提供的方法，在第一终端设备和其他参与同步播放的其他终端设备均获取到待播放音频数据之后，可以基于播放指令实现同步播放。
第二方面，本申请实施例还提供了一种终端设备，包括：一个或多个处理器；一个或多个存储器；所述一个或多个存储器，用于存储一个或多个计算机程序以及数据信息；其中所述一个或多个计算机程序包括指令；当所述指令被所述一个或多个处理器执行时，使得所述终端设备执行如上述第一方面中任一项可能的设计中所述的方法。
第三方面，本申请实施例还提供了一种通信系统，包括至少一个如上述第二方面所述的终端设备。
第四方面，本申请实施例提供了一种计算机可读存储介质，计算机可读介质存储有计算机程序(也可以称为代码，或指令)当其在计算机上运行时，使得计算机执行上述第一方面中任一种可能实现方式中的方法。
第五方面，本申请实施例提供了一种计算机程序产品，计算机程序产品包括：计算机 程序(也可以称为代码，或指令)，当计算机程序被运行时，使得计算机执行上述第一方面中任一种可能实现方式中的方法。
第六方面，本申请实施例还提供一种终端设备上的图形用户界面，该终端设备具有显示屏、一个或多个存储器、以及一个或多个处理器，所述一个或多个处理器用于执行存储在所述一个或多个存储器中的一个或多个计算机程序，所述图形用户界面包括所述终端设备执行本申请实施例第一方面任一可能的实现方式时显示的图形用户界面。
上述第二方面至第六方面中任一方面的有益效果请具体参阅上述第一方面中各种可能的设计的有益效果，在此不再赘述。
附图说明
图1为一种家庭网络下的应用场景；
图2为本申请实施例提供的一种可能的终端设备的硬件结构示意图；
图3为本申请实施例提供的一种终端设备的软件结构框图；
图4为本申请实施例中提供的一种多设备同步播放方法的应用场景示意图之一；
图5为本申请实施例中提供的一种多设备同步播放方法的流程示意图之一；
图6为本申请实施例中提供的一种多设备同步播放方法的应用场景示意图之二；
图7为本申请实施例中提供的一种多设备同步播放方法的流程示意图之二；
图8为本申请实施例中提供的一种多设备同步播放方法的应用场景示意图之三；
图9为本申请实施例中提供的一种多设备同步播放方法的流程示意图之三；
图10为本申请实施例中提供的一种多设备同步播放方法的应用场景示意图之四；
图11为本申请实施例中提供的一种终端设备的结构示意图。
具体实施方式
随着智慧网络技术的发展，多设备协同管理的场景越来越多。其中，设备也可以称为“终端设备”或“终端”，以下实施例中可以互相被替换使用。
在局域网中包含多个可以用于播放音频的终端设备的协同管理场景中，使用多个不同的终端设备进行音频同步播放的需求越来越强烈。其中，局域网可以为家庭网络、企业网络等。
例如，图1为一种家庭网络下的应用场景。在图1示出的家庭网络中包含房间1、房间2、房间3和房间4，并且每个房间中分别安置一个可用于播放音频的终端设备，比如音箱设备等。该家庭网络中的每个终端设备可以均连接在位于房间1的访问接入点(access point，AP)(比如无线路由器、交换机等)配置的局域网中，用于通过该局域网实现数据传输等功能，比如用户可以使用多个音箱设备进行音乐同步播放，使得处于每个房间的用户都可以同步听到相同的音乐，或者用户去到不同房间时感知不到音乐延迟，提升用户的使用体验。
又例如，局域网还可以为企业网络，在一个企业网络中可以在多个不同的楼层或办公室内安置多个广播终端设备。通过多个广播终端设备可以进行对相同音频内容的同步播放。
然而，受到不同设备具有不同的摆放位置以及不同的网络信号状态等因素的影响，实现多设备音频同步播放时会受到一定的限制。结合图1示出的场景，由于不同音箱设备与 无线路由器的距离不同、摆放在相同或不同房间、音箱设备接收音频数据的带宽以及网络信号状态等因素的影响，可能会导致不同音箱设备获取同一音频数据的耗时不同，从而导致同步播放的体验不佳等问题。例如，距离无线路由器较远的音箱设备的网络信号状态通常较差，与无线路由器摆放在相同房间的音箱设备的网络信号状态一般更好。
在多设备音频同步播放的场景下，基于短板效应的考虑下，同步播放的流畅性容易受到末端终端设备的影响。其中，末端终端设备可以理解为网络信号状态差到一定程度的终端设备，通常为距离无线路由器较远的终端设备或者与无线路由器之间障碍物较多的终端设备等。
示例性的，假设图1中的末端终端设备为音箱设备D，在音箱设备A、B、C和D对相同的待播放音频数据进行获取以进行同步播放的过程中，由于音箱设备D网络信号状态较差，对待播放音频数据的获取耗时最长，因此音箱设备A、B、C和D对该待播放音频数据的起播时间取决于音箱设备D的获取耗时，存在起播时延较长的问题。也就是说，在音箱设备A、B、C已经获取而D尚未获取该待播放音频数据时，音箱设备A、B、C需要等待D也获取该待播放音频数据后才可以开始进行同步播放。
另一示例性的，若待播放音频数据通过分片或分组形式传输给音箱设备A、B、C和D，在同步播放过程中还可能存在由于下一分片或分组的待播放音频数据未获取完全，而导致同步播放过程中存在卡顿问题。比如，假设待播放音频数据为一首音乐，分为两个分片进行传输，音箱设备A、B、C和D在获取到第一分片的待播放音频数据之后开始进行同步播放，同时获取第二分片的待播放音频数据，可能存在第一分片播放已经完成，但音箱设备A、B、C和D中存在音箱设备未对第二分片的待播放音频数据获取完成，导致播放暂停。
此外，在多设备音频同步播放的场景下，可以理解，随着参与同步播放的末端终端设备数量的增多，同步播放的流畅性也可能会越来越差。
有鉴于此，本申请实施例提供一种多设备同步播放方法。在多设备音频同步播放的场景下，综合考虑该场景下包含的多个终端设备的性能和状态等因素，基于每个终端设备还可以作为其他终端设备与无线路由器之间的中转节点的思想，通过为该场景下的终端设备从多条可能的传输路径中选择目的传输路径的方式，设计一种可以提升多设备同步播放的播放流畅性、稳定性以及用户体验的技术方案。
下面将结合附图，对本申请实施例进行详细描述。
可以理解的是，本申请实施例的音频数据(audio data)又可以称之为声音数据，用于表征声音，为对音频文件(如ogg文件)处理后得到的数据。示例的，对音频文件进行解码、解压缩或音效等处理得到音频数据。音频文件包括音频数据，可以为MP3文件、MP4文件或其它格式的文件，对此不作限定。即终端设备基于音频数据可以实现声音的播放。
本申请实施例的终端设备可以是诸如智能家居设备(例如，智能电视，智慧屏，智能音箱等)、手机、平板电脑、可穿戴设备(例如，手表、头盔、耳机等)、增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)等具有音频播放能力的设备。可以理解的是，本申请实施例对终端设备的具体类型 不作任何限制。
本申请实施例可以应用到的终端设备，示例性实施例包括但不限于搭载
Figure PCTCN2022111117-appb-000001
Figure PCTCN2022111117-appb-000002
或者其它操作系统的便携式终端设备。上述便携式终端设备也可以是其它便携式终端设备，诸如具有触敏表面(例如触控面板)的膝上型计算机(Laptop)等。
图2示出了一种可能的终端设备的硬件结构示意图。其中，所述终端设备200包括：射频(radio frequency，RF)电路210、电源220、处理器230、存储器240、输入单元250、显示单元260、音频电路270、通信接口280、以及无线保真(wireless-fidelity，Wi-Fi)模块290等部件。本领域技术人员可以理解，图2中示出的终端设备200的硬件结构并不构成对终端设备200的限定，本申请实施例提供的终端设备200可以包括比图示更多或更少的部件，可以组合两个或更多的部件，或者可以具有不同的部件配置。图2中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
下面结合图2对所述终端设备200的各个构成部件进行具体的介绍：
所述RF电路210可用于通信或通话过程中，数据的接收和发送。特别地，所述RF电路210在接收到基站的下行数据后，发送给所述处理器230处理；另外，将待发送的上行数据发送给基站。通常，所述RF电路210包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(low noise amplifier，LNA)、双工器等。
此外，RF电路210还可以通过无线通信与网络和其他设备进行通信。所述无线通信可以使用任一通信标准或协议，包括但不限于全球移动通讯系统(global system of mobile communication，GSM)、通用分组无线服务(general packet radio service，GPRS)、码分多址(code division multiple access，CDMA)、宽带码分多址(wideband code division multiple access，WCDMA)、长期演进(long term evolution，LTE)、电子邮件、短消息服务(short messaging service，SMS)等。
Wi-Fi技术属于短距离无线传输技术，所述终端设备200通过Wi-Fi模块290可以连接访问接入点(access point，AP)，从而实现数据网络的访问。所述Wi-Fi模块290可用于通信过程中，数据的接收和发送。在本申请实施例中，所述终端设备200还可以通过Wi-Fi模块290与无线路由器、网关等AP进行连接，从而实现对数据网络的访问，例如接收待播放音频数据等。
所述终端设备200可以通过所述通信接口280与其他设备实现物理连接。可选的，所述通信接口280与所述其他设备的通信接口通过电缆连接，实现所述终端设备200和其他设备之间的数据传输。
由于在本申请实施例中，所述终端设备200能够实现通信业务，与其他终端设备实现交互，因此所述终端设备200需要具有数据传输功能，即所述终端设备200内部需要包含通信模块。虽然图2示出了所述RF电路210、所述Wi-Fi模块290、和所述通信接口280等通信模块，但是可以理解的是，所述终端设备200中存在上述部件中的至少一个或者其他用于实现通信的通信模块(如蓝牙模块)，以进行数据传输。
例如，当所述终端设备200为手机时，所述终端设备200可以包含所述RF电路210，还可以包含所述Wi-Fi模块290，或可以包含蓝牙模块(图2中未示出)；当所述终端设备200为计算机时，所述终端设备200可以包含所述通信接口280，还可以包含所述Wi-Fi 模块290，或可以包含蓝牙模块(图2中未示出)；当所述终端设备200为平板电脑时，所述终端设备200可以包含所述Wi-Fi模块，或可以包含蓝牙模块(图2中未示出)。
所述存储器240可用于存储软件程序以及模块。所述处理器230通过运行存储在所述存储器240的软件程序以及模块，从而执行所述终端设备200的各种功能应用以及数据处理。可选的，所述存储器240可以主要包括存储程序区和存储数据区。其中，存储程序区可存储操作系统(主要包括内核层、系统层、应用程序框架层和应用程序层等各自对应的软件程序或模块)。
此外，所述存储器240可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
所述输入单元250可用于接收用户输入的数字或字符信息等多种不同类型的数据对象的编辑操作，以及产生与所述终端设备200的用户设置以及功能控制有关的键信号输入。可选的，输入单元250可包括触控面板251以及其他输入设备252。
其中，所述触控面板251，也称为触摸屏，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在所述触控面板251上或在所述触控面板251附近的操作)，并根据预先设定的程序驱动相应的连接装置。
可选的，所述其他输入设备252可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
所述显示单元260可用于显示由用户输入的信息或提供给用户的信息以及所述终端设备200的各种菜单。所述显示单元260即为所述终端设备200的显示系统，用于呈现界面，实现人机交互。所述显示单元260可以包括显示面板261。可选的，所述显示面板261可以采用液晶显示屏(liquid crystal display，LCD)、有机发光二极管(organic light-emitting diode，OLED)等形式来配置。本申请实施例中，在终端设备上可以不设置显示单元260，例如智能音箱设备无需设置显示屏；或者在终端设备上还可以通过显示单元260显示终端设备200通过Wi-Fi模块接收到的待播放音频数据进行显示，例如，若待播放音频数据为音乐，则可在显示面板261播放音乐对应的歌词或画面等。
所述处理器230是所述终端设备200的控制中心，利用各种接口和线路连接各个部件，通过运行或执行存储在所述存储器240内的软件程序和/或模块，以及调用存储在所述存储器240内的数据，执行所述终端设备200的各种功能和处理数据，从而实现基于所述终端设备200的多种业务。本申请实施例中，处理器230用来实现本申请实施例提供的方法，进而提供一种可以提升多设备同步播放的播放流畅性、稳定性以及用户体验的技术方案。
所述终端设备200还包括用于给各个部件供电的电源220(比如电池)。可选的，所述电源220可以通过电源管理系统与所述处理器230逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗等功能。
如图2所示，终端设备200还包括音频电路270、麦克风271和扬声器272，可提供用户与终端设备200之间的音频接口。音频电路270可用于将音频数据转换为扬声器272能够识别的信号，并将信号传输到扬声器272，由扬声器272转换为声音信号输出。麦克风271用于收集外部的声音信号(如人说话的声音、或者其它声音等)，并将收集的外部的声音信号转换为音频电路270能够识别的信号，发送给音频电路270。音频电路270还可用于将麦克风271发送的信号转换为音频数据，再将音频数据输出至RF电路220以发送给比如另一终端设备，或者将音频数据输出至存储器240以便后续进一步处理。
尽管未示出，所述终端设备200还可以包括至少一种传感器、摄像头等，在此不再赘述。至少一种传感器可以包含但不限于压力传感器、气压传感器、加速度传感器、距离传感器、指纹传感器、触摸传感器、温度传感器等。
本申请实施例涉及的操作系统(operating system，OS)，是运行在终端设备200上的最基本的系统软件。以智能音箱为例，操作系统可以是鸿蒙系统(harmonyos)或安卓(android)系统或IOS系统。终端设备200的软件系统可以采用分层架构，事件驱动架构，微核架构，微服务架构，或云架构。本申请实施例以采用分层架构的操作系统为例，示例性说明终端设备200的软件结构。
图3为本申请实施例提供的一种终端设备的软件结构框图。如图3所示，终端设备的软件结构可以是分层架构，例如可以将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将操作系统分为五层，从上至下分别为应用程序层，应用程序框架层(framework，FWK)，运行时和系统库，内核层，以及硬件层。
应用程序层可以包括一系列应用程序包。如图3所示，应用程序层可以包括相机、设置、皮肤模块、用户界面(user interface，UI)、三方应用程序等。其中，三方应用程序可以包括WLAN、音乐、通话、蓝牙、视频等。
在本申请一些实施例中，应用程序层可以用于实现编辑界面的呈现，上述编辑界面可以用于用户进行操作。例如，若智能音箱包含显示面板261，用户可以在显示面板261显示的主界面上进行播放音乐等用户操作。
一种可能的实现方式中，应用程序可以使用java语言开发，通过调用应用程序框架层所提供的应用程序编程接口(application programming interface，API)来完成，开发者可以通过应用程序框架层来与操作系统的底层(例如硬件层、内核层等)进行交互，开发自己的应用程序。该应用程序框架层主要是操作系统的一系列的服务和管理系统。
应用程序框架层为应用程序层的应用程序提供应用编程接口和编程框架。应用程序框架层包括一些预定义函数。如图3所示，应用程序框架层可以包括快捷图标管理模块，窗口管理器，内容提供器，视图系统，电话管理器，资源管理器，通知管理器等。
快捷图标管理模块用于对终端设备上显示的快捷图标进行管理，例如创建快捷图标、移除快捷图标、监控快捷图标是否满足显示条件等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。
视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如，包括短信通知图标的显示界面，可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供终端设备的通信功能。例如通话状态的管理(包括接通，挂断等)。
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提 醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，终端设备振动，指示灯闪烁等。
在本申请一些实施例中，该应用程序框架层主要负责调用与硬件层之间通信的服务接口，以将用户进行操作的操作请求传递到硬件层，所述操作请求可以包含用户打开某一APP的操作请求等。
运行时包括核心库和虚拟机。运行时负责操作系统的调度和管理。
核心库包含两部分：一部分是java语言需要调用的功能函数，另一部分是操作系统的核心库。应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。
系统库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(media libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。
表面管理器用于对显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。
三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
在一些实施例中，三维图形处理库可以用于绘制三维的运动轨迹图像，2D图形引擎可以用于绘制二维的运动轨迹图像。
内核层是硬件和软件之间的层。内核层至少包含显示驱动，摄像头驱动，音频驱动，传感器驱动。
硬件层可以包括各类传感器，例如加速度传感器、陀螺仪传感器、触摸传感器等。
通常终端设备200可以同时运行多个应用程序。较为简单的，一个应用程序可以对应一个进程，较为复杂的，一个应用程序可以对应多个进程。每个进程具备一个进程号(进程ID)。
结合上述图2中对终端设备的硬件结构的介绍，以及图3中对终端设备的软件框架的介绍，下面结合多个实施例和附图，示例性说明终端设备执行本申请实施例中提出的一种多设备同步播放方法的软件以及硬件的工作原理。
应理解，本申请实施例中“至少一个”是指一个或者多个，“多个”是指两个或两个以上。“和/或”，描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B的情况，其中A、B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一(项)个”或其类似表达，是指的这些项中的任意组合，包括单项(个)或复数项(个)的任意组合。例如，a、b或c中的至少一项(个)，可以表示：a，b，c，a和b，a和c，b和c，或a、b和c，其中a、b、c可以是单个，也可以是多个。
本申请实施例涉及的多个，是指大于或等于两个。
另外，需要理解的是，在本申请的描述中，“第一”、“第二”等词汇，仅用于区分描述的目的，而不能理解为指示或暗示相对重要性，也不能理解为指示或暗示顺序。
此外，本申请实施例中，“终端设备”、“设备”、“手机”等可以混用，即指可以用于实现本申请实施例的各种设备；本申请实施例中的“应用”和“应用程序”也可以混用，均指具有一定业务提供能力的程序或客户端等，也就是说应用和客户端也可混用，比如视频客户端、游戏客户端也可以称之为视频应用或游戏应用等。
应理解，终端设备的硬件结构可以如图2所示，软件架构可以如图3所示，其中，终端设备中的软件架构对应的软件程序和/或模块可以存储在存储器240中，处理器230可以运行存储器240中存储的软件程序和应用以执行本申请实施例提供的一种多设备同步播放方法的流程。
为了便于理解本申请提供的一种多设备同步播放方法，以下结合图4至图10中所示的内容，对采用本申请提供的方法的实现过程进行介绍。
本申请实施例适用于多设备音频同步播放的应用场景。通常，多个终端设备连接到相同的局域网中，如图1示出的场景。需要说明的是，图1所述的多设备音频同步播放的应用场景仅为一个示例说明，本申请实施例对多设备音频同步播放的应用场景中包含的无线AP数量、终端设备数量、无线AP的类型以及终端设备的类型均不作限定。
在上述应用场景中，终端设备在获取待播放音频数据的过程中，可以通过无线路由器来实现获取，还可以采用其他终端设备中转待播放音频数据的方式来获取。示例性的，图4示出的为本申请实施例提供的另一种多设备同步播放方法的应用场景示意图，以音箱设备D作为示例。
一种可选的获取方式为，基于音箱设备D通过Wi-Fi模块290与无线路由器进行连接，音箱设备D可以通过无线路由器来获取待播放音频数据。如图4中的传输路径1(无线路由器→音箱设备D)。
另一种可选的获取方式为，由于音箱设备D与无线路由器之间的距离较远或障碍物较多等因素，音箱设备D与无线路由器之间连接的网络信号状态不佳。在多设备音频同步播放的场景中，基于音箱A、B和C也会获取相同的待播放音频数据，因此音箱设备D还可以通过音箱设备A、B或者C的中转来获取到待播放音频数据。如图4中的传输路径2(无线路由器→音箱设备B→音箱设备D)、或传输路径3(无线路由器→音箱设备A→音箱设备D)、或传输路径4(无线路由器→音箱设备C→音箱设备D)。其中，音箱设备A、B或C可以通过无线路由器来实现对待播放音频数据的获取。需要说明的是，终端设备与终端设备之间对待播放音频数据的传输可以采用基于无线或有线路由器、蓝牙、Wi-Fi直连等传输方式来实现传输，本申请对此不进行限定。
可以理解的是，终端设备本身不仅具有播放能力，还可以具有中转能力。其中，播放能力表示终端设备获取待播放音频数据，以及对待播放音频数据进行播放的效率，例如获取待播放音频数据的耗时等，可以用于反映终端设备持续稳定地获取待播放音频数据以及对待播放音频数据的管理、缓冲等处理能力。中转能力表示终端设备获取到待播放音频数据，并将待播放音频数据传输给其他终端设备的效率、性能、持续性和可靠性等，例如终端设备从获取待播放音频数据开始到将所述待播放音频数据传输到其他终端设备的总耗时、终端设备本身运行状态的稳定性、终端设备对待播放音频数据进行中转过程中的持续稳定性等。
通过图4中的场景介绍，在多设备音频同步播放的场景下，基于每个终端设备可以从多条传输路径中选择一条传输路径来获取待播放音频数据，为了提升该场景下音频同步播 放的流畅性、稳定性以及用户体验等，本申请实施时可以结合多个终端设备的中转能力和播放能力，提供一种如何为该场景下的每个终端设备选择目的传输路径的技术方案，实现对至少一个终端设备获取待播放音频数据的传输路径优化，提升多个终端设备获取待播放音频数据的效率和可靠性等，为末端终端设备减少获取待播放音频数据的耗时以及提升获取待播放音频数据的稳定性。
一种可选的实施例中，图5为本申请实施例提供的一种多设备同步播放方法的流程示意图。假设在音频同步播放的场景下存在多个终端设备，以下实施例中以其中一个终端设备(即以下实施例中的第一终端设备)作为示例，对本申请实施例提供的方法进行介绍。可以理解，其他终端设备(即以下实施例中的N个第二终端设备中的任一终端设备)的实现方式可以参照第一终端设备的实现方式。
第一终端设备可以接收多个可能的触发事件，所述触发事件用于指示所述第一终端设备执行图5示出的方法流程。
作为一种可能的触发场景，第一终端设备在接收到多设备同步播放事件的基础上，若第一终端设备没有保存对应的获取待播放音频数据的默认传输路径，可以采用图5示出的方法流程选取目的传输路径。需要说明的是，通常第一终端设备可以将无线路由器对应的传输路径(如图4中的传输路径1)作为默认传输路径，或者第一终端设备将上次多设备同步播放时确定的目的传输路径保存为默认传输路径。
作为另一种可能的触发场景，第一终端设备可以根据自身的网络信号强度(例如实际可用带宽)、网络传输状态等网络参数来触发。当第一终端设备检测到自身的网络参数无法满足获取待播放音频数据的基本要求时，则可以触发选取目的传输路径。若存在与当前传输路径不同的目的传输路径，第一终端设备可以切换至目的传输路径获取待播放音频数据，以提升获取效率、稳定性和可靠性。示例性的，第一终端设备获取待播放音频数据的基本要求可以为预先设置的，例如设置下行传输速率基于要求为100Kbps。
作为又一种可能的触发场景，第一终端设备可以设置确定目的传输路径的触发周期。这样，通过周期性地对第一终端设备的目的传输路径进行获取，可以降低第一终端设备在使用过程中出现异常时导致的短板效应，从而提升音频获取的稳定性。
需要说明的是，在多设备同步播放的场景下，还可以设置第一终端设备基于其他可能的触发场景，执行图5示出的获取目的传输路径的方法流程，本申请对此不做限定。
S501，第一终端设备获取N个第二终端设备的中转能力评估值；所述N为正整数。其中，中转能力评估值用于指示第二终端设备的中转能力，当第二终端设备符合预设中转能力阈值条件时，可以发送中转能力评估值以被第一终端设备获取到。一种可能的应用场景中，若第二终端设备的中转能力评估值越大，表示该第二终端设备的中转能力越强；若第二终端设备的中转能力评估值越小，表示该第二终端设备的中转能力越弱；换言之第二终端设备的中转能力评估值大于预设中转能力阈值时，可以表示符合预设中转能力阈值条件。例如，第一终端设备采用第二终端设备中转获取待播放音频数据的耗时越久，对造成多设备音频同步播放短板效应的影响越大，表示第二终端设备的中转能力越弱。或者又例如，第一终端设备采用第二终端设备中转获取待播放音频数据的稳定性越差(比如传输速率波动范围较大或波动频率较大、平滑程度较低等)，对造成多设备音频同步播放短板效 应的影响越大，表示第二终端设备的中转能力越弱。这样，第一终端设备在获取到一个或多个第二终端设备的中转能力评估值之后，可以从N个第二终端设备中选取合适的目的第二终端设备来获取待播放音频数据。
一种可选的示例中，本申请实施例提供一种确定第二终端设备中转能力评估值的实现方式。以任一第二终端设备作为示例，其他第二终端设备的实现方式类似。可实施为，第二终端设备采用第一评估参数组确定所述中转能力评估值。示例性的，所述第一评估参数组可以包括但不限于以下参数：第二终端设备的网络信号强度、第一终端设备的网络传输状态、第二终端设备的类型、第二终端设备的使用状态、第二终端设备的带电频率。需要说明，“第一”、“第二”仅用作区分描述，可以理解在确定第一终端设备的中转能力评估值时，采用的为第一终端设备所对应的评估参数组。
(1)网络信号强度，例如可以通过接收信号强度指示(received signal strength indication，RSSI)来表示，可以用于指示终端设备的实际可用传输带宽，进而影响终端设备的网络传输速率。通常可以由信号所工作的信道的干扰、传输距离、路由器摆放位置、天线增益、路由器发射功率以及房间格局等因素来决定。若RSSI的值越大，表示信号强度越强，用户在使用第二终端设备时数据加载流畅性越好；反之RSSI的值越小，表示信号强度越弱，则用户在使用第二终端设备时数据加载流畅性较差，甚至可能存在卡顿、加载失败等问题。可以理解，第二终端设备的网络信号强度越强，则中转能力越强，反之中转能力越弱。
(2)网络传输状态，可以通过传输带宽、传输时延和时延抖动等参数来表征。其中，若终端设备具有更高的数据吞吐量、和/或更大的传输带宽、和/或更低的传输时延和/或更小的时延抖动，表示该终端设备具有更优的网络传输状态。网络传输状态的优劣通常可以由终端设备所连接的路由器所决定的，比如所连接的路由器上连接的终端设备数量越多，分配给每个终端设备的传输带宽越小。可以理解，第二终端设备的网络传输状态越好，则中转能力越强，反之中转能力越弱。
(3)终端设备的类型，可以通过终端设备的处理器、网卡等硬件模块的型号、规格等因素确定，可以用于评估终端设备的性能，如处理性能或功耗性能等。实施时，可以为不同的终端设备的类型确定不同的子评估值，确定方式可以为预先定义的、或者根据经验值获取、或者综合考虑终端设备包含的多个硬件模块来确定等方式，本申请对为第二终端设备根据终端设备的类型确定子评估值的具体实现方式不做限定。可以理解，第二终端设备的类型的性能越好，则中转能力越强，反之中转能力越弱。
(4)终端设备的使用状态，可以通过终端设备的负载情况来确定，例如CPU负载、网卡负载等。由于终端设备的处理性能是一定的，第二终端设备上运行的新处理任务会受到第二终端设备当前负载情况影响。若第二终端设备负载越高，对新处理任务的处理能力越差。可以理解，第二终端设备当前负载越少，则中转能力越强，反之中转能力越弱。
(5)终端设备的带电频率，可以来表示终端设备处于开启状态的概率，可以根据对历史一段时间内终端设备是否带电的情况进行统计预测得到的。示例性的，以图4中处于房间2的音箱设备B作为示例，假设房间2为客厅，通过对历史一段时间内音箱设备B是否带电(开启)的情况进行统计，确定晚上十点之后音箱设备B被关闭的概率逐渐升高。可以理解，如果第二终端设备处于未带电状态，则无法为第一终端设备中转待播放音频数据，此时可以设置第二终端设备的中转能力评估值较低，避免由于第二终端设备下电(关机)之后导致第一终端设备获取待播放音频数据失败的问题。
可选的，第二终端设备采用第一评估参数组确定所述中转能力评估值可符合以下公式1的要求：
Figure PCTCN2022111117-appb-000003
其中，Transability k表示第k(k取小于或等于N的正整数)个第二终端设备的中转能力评估值；θ i表示为第i(i取值1～n范围内的正整数)个评估参数分配的中转能力权重因子；α i表示第一评估参数组中的第i个评估参数的子评估值；n表示第一评估参数组中包含的评估参数的数量。例如，若第一评估参数组包含上述内容中介绍到的网络信号强度、网络传输状态、终端设备的类型、终端设备的使用状态、终端设备的带电频率，则n的取值为5。需要说明的是，为每个评估参数分配的中转能力权重因子，可以是根据历史经验得到的，或者还可以为自定义的；并且可以进行及时地调整。
在一种可能的实现方式中，第二终端设备可以采用服务可用性注册与发现的方式来发布中转服务，或者还可以通过广播或者组播报文的方式将中转能力评估值进行发布，以使第一终端设备可以获取到第二终端设备的中转能力评估值，采用通过第二终端设备中转待播放音频数据。例如，图4中包含的音箱设备A、B和C在基于无线路由器建立的局域网下广播Transability k，从而使得作为末端终端设备的音箱设备D可以接收到Transability A、Transability B和Transability C，进而可以实现音箱设备B具有如图4示出的传输路径1、2、3和4。
通过以上示例，在多设备音频同步播放的应用场景下，本申请实施例中对该应用场景下包含的终端设备进行中转能力的评估，通过中转能力确定该终端设备是否可以作为其他终端设备获取待播放音频数据的中转节点，以实现为其他终端设备提供多条可选的传输路径，实现路径优化。相比于现有技术中每个终端设备均从路由器中获取待播放音频数据的传输方式，本申请实施例可以提升多个终端设备对相同的待播放音频数据的获取效率、稳定性和可靠性等，从而可以提升多设备同步播放的用户体验。
此外，本申请实施时第一终端设备也可以确定自身的中转能力评估值，以评估自身是否具有为其他终端设备转发待播放音频数据的能力。可选的，若第一终端设备确定自身的中转能力评估值大于中转能力阈值(中转能力阈值可表示第一终端设备具有为其他终端设备转发待播放音频数据的能力的阈值)，第一终端设备可以发布中转服务。也可以理解为，第一终端设备可以被其他终端设备搜索发现并连接，以进行数据传输。换言之，在S501中，第一终端设备可以获取到第二终端设备的中转能力评估值，表示第二终端设备具有中转能力，即第二终端设备发布了中转服务。
需要说明的是，在第一终端设备与N个第二终端设备所在的局域网中，还可以存在其他不具有中转能力或中转能力不满足预设中转能力阈值要求但具有播放能力的第三终端设备，其中第三终端设备用于在获取到待播放音频数据之后，与所述第一终端设备、所述N个第二终端设备实现对所述待播放音频数据的同步播放。例如，图6示出为本申请实施例中提供的又一种多设备同步播放方法的应用场景示意图，在图6示出的局域网中，以音箱设备D为第一终端设备；音箱设备A和音箱设备C发布了中转服务，可以作为第二终端设备(无线路由器作为AP，可以向音箱设备D传输待播放音频数据，故可理解为本身可作为第二终端设备)；音箱设备B没有发布中转服务但具有播放能力，可以作为第三终端设备。
在一种可能的实现方式中，上述第一终端设备、第二终端设备或第三终端设备在不同 时刻、不同位置可能发布有中转服务，也可能未发布中转服务。例如，第一终端设备可以从T1时刻通过服务可用性注册与发现或者广播或组播报文的方式周期性将中转能力评估值进行发布，而在T2时刻检测到中转能力评估值不再满足大于中转能力阈值，此时不再通过服务可用性注册与发现或者广播或组播的方式发布中转能力评估值。
S502，所述第一终端设备根据N个所述中转能力评估值，得到所述N个第二终端设备对所述第一终端设备的中转可用性。
第一终端设备从S501中获取到一个或多个第二终端设备的中转能力评估值，可以获取到每个第二终端设备本身中转能力的强弱。由于第一终端设备受到与任一第二终端设备之间的相对距离、摆放位置以及是否处于相同的房间等因素的影响，第一终端设备获取待播放音频数据的效率还取决于第一终端设备与第二终端设备的相对信号强度；其中，第二终端设备的相对信号强度可以表示为第一终端设备检测到的第二终端设备的信号强度。示例性的，若第二终端设备相对信号强度越大，表示第一终端设备与第二终端设备之间的相对信号衰减越小；反之相对信号衰减越大。换言之，第二终端设备对第一终端设备的中转可用性可以由第二终端设备的中转能力评估值和第二终端设备与第一终端设备的相对信号强度共同确定。
基于此，一种可选的示例中，第一终端设备可以根据与每个第二终端设备的相对信号强度，分别为每个第二终端设备分配不同的中转可用性权重因子；其中，第一终端设备可以为相对信号强度较大的第二终端设备分配较大的中转可用性权重因子。另一可选的示例中，第一终端设备还可以预先存储为每个第二终端杆设备分配的中转可用性权重因子。
然后第一终端设备基于每个第二终端设备的中转可用性权重因子和中转能力评估值，确定每个第二终端设备的中转可用性。可选的，第一终端设备确定第k个第二终端设备对第一终端设备的中转可用性可符合以下公式2的要求：
Score X←k＝γ X←k*Transability k        公式2
其中，Score X←k表示第k个(k取正整数)第二终端设备相对于第一终端设备(X可表示第一终端设备的标识)的中转可用性；γ X←k表示第一终端设备为第k个第二终端设备分配的中转可用性权重因子。
例如，结合图4示出的应用场景图，以音箱设备D作为第一终端设备，以及音箱设备A、音箱设备B、音箱设备C、无线路由器作为第二终端设备为示例。音箱设备D可以获取音箱设备A、音箱设备B、音箱设备C以及无线路由器的中转能力评估值，以及根据音箱设备D与每个第二终端设备之间的相对信号强度确定每个第二终端设备相对于音箱设备D的中转可用性权重因子。最后根据每个第二终端设备的中转可用性权重因子和中转能力评估值，得到每个第二终端设备相对于第一终端设备的中转可用性。为了便于理解，以下通过表1来进行说明：
表1
Figure PCTCN2022111117-appb-000004
Figure PCTCN2022111117-appb-000005
在以上表1中，音箱设备D得到每个第二终端设备的中转可用性是由中转能力评估值和中转可用性权重因子共同决定的。比如，无线路由器的中转能力评估值通常比音箱设备A或音箱设备B或音箱设备C的中转能力评估值强；但由于无线路由器与音箱设备D的相对信号强度较大(比如由于相对距离较远且中间需要穿过两面墙体的因素导致的)，故音箱设备D为无线路由器分配的γ D←AP较小；而音箱设备C与音箱设备D的相对信号强度较小，音箱设备D为音箱设备C分配的γ D←C较大，因此可能存在Score D←C比Score D←AP的值大的情况。这样，虽然无线路由器的中转能力评估值较强，但音箱设备D通过传输路径1获取待播放音频数据的耗时，可能相比采用传输路径4的耗时要更久，因此音箱设备D可以根据每个第二终端设备的中转可用性，选取更优的传输路径。
S503，所述第一终端设备基于所述N个第二终端设备对所述第一终端设备的中转可用性，从N条传输路径中选取目的传输路径。其中，所述N条传输路径与所述N个第二终端设备一一对应。例如图4中音箱设备D所对应的传输路径1(无线路由器→音箱设备D)、传输路径2(无线路由器→音箱设备B→音箱设备D)、或传输路径3(无线路由器→音箱设备A→音箱设备D)、或传输路径4(无线路由器→音箱设备C→音箱设备D)。
示例性，如S502中所介绍到的内容，第一终端设备在获取到每个第二终端设备的中转可用性之后，可以选取中转可用性最强的第二终端设备所对应的传输路径作为目的传输路径。举例来说，针对图4中示出的音箱设备D，假设Score D←C＞Score D←B＞Score D←A＞Score ←AP，则音箱设备D可以选择与音箱设备C对应的传输路径4作为目的传输路径。
或者还可以从中转可用性满足预设中转能力阈值条件的N个第二终端设备所对应的N条传输路径中随机选取一条传输路径作为目的传输路径。其中，预设中转能力阈值条件可以为中转可用性大于或等于预设的中转阈值。
或者为了保障多设备音频同步播放场景下的稳定性，若第一终端设备已经存在传输路径，在根据中转可用性确定当前传输路径符合预设中转能力阈值条件时，即使存在更优的传输路径，也无需切换。换言之，在当前传输路径无法满足预设中转能力阈值条件时，可以从其他满足预设中转能力阈值条件的传输路径中进行选择。例如，若图4中示出的音箱设备D的当前传输路径为与无线路由器对应的传输路径1，传输路径1满足预设中转能力阈值条件，此时即使音箱设备A或B或C对音箱设备D的中转可用性大于无线路由器对音箱设备D的可用性，也无需进行目的传输路径的切换。
又或者，第一终端设备在确定至少一个第二终端设备对所述第一终端设备的中转可用性符合所述中转能力阈值条件、但所述至少一个第二终端设备对所述第一终端设备的中转可用性与所述当前传输路径对应的第二终端设备对所述第一终端设备的中转可用性相比不符合预设切换条件，所述第一终端设备可以保持当前传输路径。例如，图4中示出的音箱设备D的当前传输路径为传输路径1，传输路径2满足中转能力阈值条件但相比于传输路径1的增益不大，则可以无需进行传输路径切换，从而可以保障多设备音频同步播放场景的稳定性。
需要说明的是，第一终端设备在选取目的传输路径之后，若所述目的传输路径具有对 应的物理传输通道，则采用对应的物理传输通道实现数据传输，例如通常若第二终端设备为无线路由器，第二终端设备与第一终端设备存在物理传输通道，比如基于无线局域网的物理传输通道等；若所述目的传输路径不存在对应的物理传输通道，第一终端设备可以向所述目的传输路径对应的目的第二终端设备发起物理传输通道的建立请求。这样，在第一终端设备与目的第二终端设备存在物理传输通道之后，基于目的第二终端设备可以获取待播放音频数据，第一终端设备可以从所述物理传输通道中接收到目的第二终端设备传输来的待播放音频数据。
在一种可能的实现方式中，在多设备同步播放应用场景下，随着至少一个终端设备变更不同的位置，可能存在第一终端设备触发切换不同的目的传输路径(例如第一终端设备变更位置、或者第一终端设备的当前传输路径对应的第二终端设备变更位置)，此时，第一终端设备接收到包含待播放音频数据的数据包中包含的源地址可能不同。例如，第一终端设备的目的传输路径为传输路径1时，则包含待播放音频数据的数据包中包含的源地址为无线路由器的MAC地址；第一终端设备的目的传输路径为传输路径2时，则包含待播放音频数据的数据包中包含的源地址为音箱设备B的MAC地址。
此外，为了保障目的传输路径的实际可用性，在建立实际的物理传输通道之前，还可以通过预连接对应的测试传输通道来模拟所述目的传输路径的传输速率、稳定性和可靠性等，若测试结果符合要求，再进行实际的物理传输通道的建立。这样，可以保障数据传输的效率和可靠性，保障多设备同步播放应用场景的播放效率。
S504，所述第一终端设备从所述目的传输路径对应的第二终端设备获取待播放音频数据。
实施时，第一终端设备在确定目的传输路径之后，可以向目的传输路径所对应的目的第二终端设备发送请求消息，所述请求消息用于请求所述目的第二终端设备在获取到所述待播放音频数据后，将所述待播放音频数据传输给第一终端设备。可以理解，所述目的第二终端设备本身还可对待播放音频数据进行缓存，用于与第一终端设备共同实现多设备音频同步播放。
上述如图5介绍到的实现过程，对多设备音频同步播放应用场景下参与的一个或多个终端设备，基于终端设备还可以作为中转节点的设计思想，通过对该应用场景下每个终端设备与其他多个终端设备之间的相对信号强度分析，实现终端设备可以具有多种传输路径选择；以及，每个终端设备通过对中转可用性的分析，可以选择合适的传输路径获取待播放音频数据。这样，相比于现有技术中多设备音频同步播放应用场景下，每个终端设备均需从无线路由器上获取待播放音频数据的方式，可以提升多设备音频同步播放的效率、流畅性、稳定性以及用户体验等。
另一可选的实施例中，本申请实施例提供的多设备同步播放方法，还可以实现对多设备音频同步播放应用场景下为每个终端设备确定的目的传输路径的动态分析，通过对该应用场景下包含的多个终端设备的周期性分析，及时、准确地对终端设备的目的传输路径进行动态调整，从而可以保障多设备音频同步播放应用场景的稳定性，提升播放流畅性，以及增强用户体验。
基于前述内容中基于终端设备的中转能力，实现多设备音频同步播放应用场景下为每 个终端设备选取目的传输路径的实施方式，本申请实施时还可以评估每个终端设备的播放能力。通过对每个终端设备的中转能力和播放能力的评估，可以实现对该应用场景下终端设备的目的传输路径的优化和稳定性保障。
一种可选的实施方式中，图7示出的为一种多设备同步播放方法的又一流程示意图。在该实施方式中，以第一终端设备作为示例，基于第一终端设备的中转能力、播放能力以及N个第二终端设备对第一终端设备的中转可用性对第一终端设备进行角色划分。这样，通过判断第一终端设备的角色，可以结合不同角色的特性对第一终端设备进行不同的处理，以保障多设备音频同步播放应用场景中包含的每个终端设备可以具有较佳的对待播放音频数据的获取效率，从而可以保障该应用场景音频播放的稳定性和流畅性等。
其中，第一终端设备的中转能力以及N个第二终端设备对第一终端设备的中转可用性的评估方式可以结合前述对图4至图6中介绍到的实施例内容，在此不再赘述。基于类似的评估思想，第一终端设备的播放能力可以通过播放能力评估值来实现。其中，播放能力评估值可用于表示第一终端设备的播放能力。可以理解，若第一终端设备的播放能力评估值越大，可以表示该第一终端设备的播放能力越强；换言之，第一终端设备获取待播放音频数据的耗时越少、稳定性越好以及可靠性越高等，对造成多设备音频同步播放短板效应的影响越小。
可选的，本申请实施例提供一种确定第一终端设备播放能力评估值的实现方式可实施为，第一终端设备采用第二评估参数组确定每个第二终端设备的播放能力评估值。示例性的，所述第二评估参数组可以包括但不限于以下参数：网络信号强度、网络传输状态、终端设备的类型。其中，第二评估参数组中包含的评估参数的定义可以参阅前述结合图5介绍到的内容，本申请在此不再冗余介绍。
其中，第一终端设备采用第二评估参数组确定所述播放能力评估值可符合以下公式3的要求：
Figure PCTCN2022111117-appb-000006
其中，Playbackability X表示第一终端设备(X可表示第一终端设备的标识)的播放能力评估值；
Figure PCTCN2022111117-appb-000007
表示为第j(j取值1～m范围内的正整数)个评估参数分配的播放能力权重因子；β i表示第二评估参数组中的第j个评估参数的子评估值；m表示第二评估参数组中包含的评估参数的数量。例如，若第二评估参数组包含上述内容中介绍到的网络信号强度、网络传输状态、终端设备的类型，则m的取值为3。需要说明的是，为每个评估参数分配的播放能力权重因子，可以是根据历史经验得到的，或者还可以为自定义的；并且可以进行及时地调整。
基于上述对中转能力、播放能力以及N个第二终端设备对第一终端设备的中转可用性的说明，图7示出的流程可以包括：
S701a、第一终端设备更新中转能力评估值。
示例性的，第一终端设备可以周期性根据第一评估参数组更新中转能力评估值。其中，更新的周期也可以根据多设备音频同步播放的场景进行动态调整。例如，在第一终端设备使用高频时期内，更新的周期可以设置为较短时间间隔；而在第一终端设备使用低频时期内，更新的周期可以设置为较长时间间隔；比如晚间时间段更新的周期可以设置为几分钟、凌晨时期更新的周期可以设置为几小时。这样，通过对第一终端设备的中转能力评估值的动态更新，可以提升第一终端设备作为中转节点的中转能力准确性，进而可以保障选取该 第一终端设备作为获取待播放音频数据的数据来源的其他终端设备的播放能力。因此，可以提升多设备音频同步播放场景下音频播放的流畅性和稳定性，以提升用户体验。
S702a、若第一终端设备的中转能力评估值大于中转能力阈值，继续执行S703a；否则继续执行S707。其中，第一终端设备可以预先设置有中转能力阈值，通过该中转能力阈值可以作为判断第一终端设备是否可以发布中转服务的评估依据。可选的，中转能力阈值可以为根据历史经验值确定的，比如根据对多设备音频同步播放场景下历史数据的统计，或者对实验数据的分析，可以得到在中转能力评估值在大于该中转能力阈值时，该应用场景可以得到较优的用户体验等。
S703a、第一终端设备发布中转服务，以及确定自身为中转角色。在第一终端设备发布中转服务之后，可以被其他终端设备搜索到，从而作为其他终端设备获取待播放音频数据的一条传输路径，为多设备音频同步播放场景下多个终端设备获取待播放音频数据的数据来源提供了多种可能传输路径的选择。
在一种可能的实现方式中，第一终端设备可以采用服务可用性注册与发现的方式，或者通过广播或组播报文方式发布中转服务，中转服务例如可以是中转能力评估值。
需要说明的是，以下S701b至S706与上述S701a至S703a之间的执行顺序不进行限定。可选的，S701b至S706和上述S701a至S703a可以并行执行。
S701b、第一终端设备更新播放能力评估值。与中转能力评估值的更新方式类似，第一终端设备也可以周期性更新播放能力评估值，从而可以对第一终端设备的播放能力具有较准确、及时地评估，进而可以保障多设备音频同步播放场景的同步播放效率。
S702b、若第一终端设备的播放能力评估值大于播放能力阈值，继续执行S707；否则继续执行S703b。其中，播放能力阈值与中转能力阈值类似，也可以为预先设置的，在此不再赘述。需要说明的是，该实施例中，以若第一终端设备的播放能力评估值越大，表示该第一终端设备的播放能力越强；若第一终端设备的播放能力评估值越小，表示该第一终端设备的播放能力越弱作为示例，实际实施时还可以存在另一可能的相关关系，例如负相关，此时S702b可以进行相应变更。
S703b、第一终端设备搜索发布中转服务的N个第二终端设备。在第一终端设备确定当前的播放能力无法满足预先设置的播放能力阈值时，表示通过当前获取待播放音频数据的传输路径的传输状态不佳，此时第一终端设备可以启动切换目的传输路径的处理流程。可实施为，第一终端设备首先确定可以为第一终端设备提供传输路径的N个第二终端设备。
需要说明的是，图7示出的流程也可以适用于第一终端设备初启动的场景下，此时第一终端设备可以未存在当前传输路径，通过S703b至S706的处理流程，也可以确定首次选择的传输路径。此外，第一终端设备在首次选择传输路径之后，可以将首次选择的传输路径保存为默认传输路径，后续第一终端设备启动之后采用该默认传输路径获取待播放传输数据，以便于第一终端设备在多设备音频同步播放场景下，可以提升处理效率。
S704、第一终端设备对各所述第二终端设备进行中转可用性分析。第一终端设备进行中转可用性分析的实现过程可以参阅结合图5中所介绍的实现过程，本申请在此不再冗余介绍。
S705、若第一终端设备确定各所述第二终端设备中存在中转可用性大于中转可用性阈值的N个第二终端设备，继续执行S706；否则继续执行S707。其中，中转可用性阈值与中转能力阈值类似，也可以为预先设置的，在此不再赘述。可选的，大于中转可用性阈值 用于表示通过第二终端设备对应的传输路径获取待播放音频数据可以满足基本的多设备音频同步播放要求；例如，通过该传输路径获取待播放音频数据的耗时低于设置的最高耗时阈值要求。
S706、第一终端设备进行目的传输路径切换，以及确定为末端播放角色。
示例性的，第一终端设备通过对多个中转可用性的分析，如果存在可以满足多设备音频同步播放基本要求的目的传输路径，基于S702b中对第一终端设备当前播放能力不佳的判断结果，将第一终端设备获取待播放音频数据的目的传输路径进行切换，可以提升第一终端设备的数据获取效率，减少数据获取耗时，从而可以降低第一终端设备对多设备音频同步播放场景的短板效应影响。
此外，通过S701b-S706的处理，可以判断第一终端设备获取待播放音频数据的能力不佳，可以将第一终端设备确定为末端播放角色，也即前述实施例中介绍到的末端终端设备。可以理解，在多设备音频同步播放场景中，多设备音频同步播放的流畅性等较多地取决于处于末端播放角色的终端设备的影响。因此，为了提升多设备音频同步播放的用户体验，可以提高末端播放角色获取待播放音频数据的效率，减少获取耗时。
在一种可能的实现方式中，第一终端设备进行目的传输路径切换前后，包含待播放音频数据的数据包中包含的源地址不同。
S707、第一终端设备确定为普通播放角色。其中，处于普通播放角色的终端设备可以基本满足多设备音频同步播放的要求，参与多设备音频同步播放场景的实现，相比于处于末端播放角色的终端设备可以对多设备音频同步播放产生更小的负面影响。需要说明的是，第一终端设备还可以同时被确定为中转角色和普通播放角色。
基于以上实施例的介绍，本申请实施时通过为多设备音频同步播放场景下包含的终端设备划分不同的角色，可以更为准确地对不同的终端设备进行不同的处理。例如，对处于末端播放角色的终端设备，考虑到该终端设备对播放体验会产生较大的影响，可以提高末端播放角色获取待播放音频数据的效率，从而降低对播放体验产生的影响。此外，本申请实施时，还可以根据处于末端播放角色的终端设备为用户定制个性化的提醒；例如，在识别到处于末端播放角色的终端设备，可以向用户发送该终端设备可能会影响同步播放的体验的提示，以及询问用户是否将该终端设备移除当前多设备音频同步播放场景的操作指示。其中，提示可以为短信、电话、弹窗等形式来体现，本申请对此不做限定。
为便于理解，图8为本申请实施例示出的另一种多设备同步播放方法的应用场景示意图。可以理解，在该应用场景下包含的终端设备可以分别具有对应的中转能力评估值和播放能力评估值。其中由于无线路由器通常不参与音频播放，可以无需确定播放能力评估值。以音箱设备D作为第一终端设备为例，音箱设备D还可以基于多个第二终端设备的中转能力评估值，确定多个第二终端设备对音箱设备D的中转可用性，得到如图8中示出的中转可用性列表，以进行目的传输路径的切换。
音箱设备D启动后，默认传输路径通常可以为图8中示出的传输路径1，即可以从无线路由器中获取待播放音频数据。
在音箱设备D运行过程中，可以基于图7介绍的内容周期性更新中转能力评估值和播放能力评估值，从而评估音箱设备D在不同时间内的角色。例如，音箱设备D在T1时刻可以作为普通播放角色，在通过传输路径1获取到待播放音频数据之后，可以与其他音箱设备实现多设备同步播放。音箱设备D在T2时刻在作为普通播放角色的基础上，还可以 作为中转角色，此时音箱设备D可以发布中转服务，可以为其他终端设备(例如末端播放设备)提供可选的传输路径。
又例如，音箱设备D根据T3时刻更新的播放能力评估值确定不再大于播放能力阈值，则音箱设备D此时基于S703b至S705示出的是否需要进行目标传输路径的切换。如果音箱设备D确定需要进行目的传输路径的切换，可以根据多个第二终端设备对音箱设备D的中转可用性确定目的传输路径。比如图8示出的中转可用性 D←C的值满足预设中转能力阈值条件，则音箱设备D可以从通过传输路径1获取待播放音频数据切换至通过传输路径4获取。
可以理解，在音箱设备D运行过程中，可以基于图7示出的实施方式实现对目的传输路径的动态分析，从而可以及时、准确地实现目的传输路径的切换，以可以保障终端设备获取待播放音频数据的效率、稳定性及可靠性。
另一可选的实施方式中，图9为本申请实施例提供的一种多设备同步播放方法的另一流程示意图。在该实施方式中，仍然以第一终端设备作为示例，在第一终端设备进行多设备同步播放的处理过程中，还可以对第一终端设备在进行多设备同步播放的处理数据进行长时状态监测和数据学习分析。基于第一终端设备的长时状态监测结果以及数据学习分析结果，可以对第一终端设备的当前传输路径的稳定性和中转能力进行预测和分析，从而可以及时、准确地为第一终端设备选取或切换合适的传输路径，从而可以保障多设备音频同步播放场景下音频播放的稳定性、流畅性以及用户体验。该实施例的具体处理流程包括：
S901a、第一终端设备对当前传输路径状态进行统计。示例性的，第一终端设备对采用当前传输路径所进行的多设备同步播放处理所产生的第一处理数据进行采集；其中第一处理数据用于表示当前传输路径状态的稳定性，第一处理数据例如可以包括待播放音频数据的数据来源终端设备(如图8中音箱设备D通过传输路径4获取待播放音频数据时，所述数据来源终端设备为音箱设备C)的负载状态、网络状态、历史上电时间、历史下电时间或者历史启动时间等类型信息。
具体实施时，第一终端设备可以采集指定时间段内的第一处理数据。例如，第一终端设备对过去一周的第一处理数据进行采集，或者进一步第一终端设备对过去一周早上八点至晚上十一点的第一处理数据进行采集。这样，第一终端设备可以对历史第一处理数据的采集来进行长时状态监测以及预测，可以提高预测的准确性和及时性，同时还可以避免由于负载过高导致过多的占用第一终端设备的处理性能。
S902a、第一终端设备对所述当前传输路径的稳定性进行预测。可选的，第一终端设备可以基于时间序列学习算法对当前传输路径的稳定性进行预测，即第一终端设备对当前传输路径在未来一段时间内是否还可以正常使用或稳定使用的预测。实施时，第一终端设备可以通过稳定性评估值来进行预测。其中稳定性评估值可以通过以下信息中的一种或组合来确定：下电置信度、负载状态(比如CPU使用率等)、网络状态(比如传输速率、传输带宽等)。
其中，可以通过下电置信度来表示终端设备是否将要下电，若下电置信度增大，则表示当前传输路径无法正常使用的概率增强。结合图8示出的应用场景图，若音箱设备D的当前传输路径为传输路径4，即音箱设备C对应的传输路径，通过S901a中对当前传输路径状态的统计结果，根据历史第一处理数据可以预测出音箱设备C的下电置信度。这样， 第一终端设备通过预测得到的下电置信度可以执行S903中的处理，具体的处理规则在以下S903中介绍，在此暂不详述。
S901b、第一终端设备对当前传输路径对应的第二终端设备的中转能力进行统计。示例性的，第一终端设备对采用当前传输路径所进行的多设备同步播放处理所产生的第二处理数据进行采集；其中第二处理数据用于表示当前传输路径对应的第二终端设备的中转能力；例如前述实施例中介绍到的中转能力评估值。与第一处理数据类似，第二处理数据的采集也可以对指定时间内产生的数据进行采集，进而可以将采集的历史第二处理数据作为样本进行统计，以实现对当前传输路径的中转能力的预测。
S902b、第一终端设备对所述当前传输路径的中转能力进行预测。可选的，第一终端设备可以基于时间序列学习算法对当前传输路径的中转能力进行预测，即第一终端设备对当前传输路径所对应的终端设备在未来一段时间内的中转能力好坏进行预测。例如，结合图8示出的应用场景图，若音箱设备D的当前传输路径为传输路径4，通过S901b获取对当前传输路径的中转能力的统计结果，根据历史第二处理数据可以预测出音箱设备C未来一段时间内的预估中转能力评估值。这样，第一终端设备通过预测得到的预估中转能力评估值可以执行S903中的处理，具体的处理规则在以下S903中介绍，在此暂不详述。
S903、第一终端设备进行是否进行备用传输路径预连接的判断，若是则继续执行S904a；否则继续执行S904b。基于S901a-S902a、S901b-S902b，第一终端设备可以分别得到未来一段时间内(或未来某一时刻)当前传输路径的稳定性评估值和中转能力评估值。
一种可能的示例为，第一终端设备确定第一时长后(或未来第一时刻)所述当前传输路径的稳定性评估值大于稳定性阈值时，确定进行备用传输路径预连接。其中，该示例中，稳定性评估值越大表示当前传输路径的波动越大，即越不稳定；若采用稳定性评估值越小来表示当前传输路径越不稳定，则大于稳定性阈值可以变更为小于稳定性阈值。
另一种可能的示例为，第一终端设备确定第二时长后(或未来第二时刻)所述当前传输路径的中转能力评估值小于或等于中转能力阈值，确定进行备用传输路径预连接。
其中，第二时长可以与第一时长为相同时长，也可以与第一时长为不同时长。例如，本申请实施时可以设置第二时长比第一时长长，由于建立当前传输路径的终端设备下电通常表示该终端设备在下次重新上电之前，无法为第一终端设备传输待播放音频数据，因此若预测到稳定性评估值较高时，便可以确定需要进行备用传输路径预连接。而建立当前传输路径的终端设备中转能力差可能是暂时性的，在一段时长之后可能恢复，因此为了提高传输路径的稳定性，可以相比第一时长延迟一段时长之后，若仍然预测到当前传输路径所对应的终端设备中转能力较差，此时再确定需要进行备用传输路径预连接。
S904a、第一终端设备进行至少一条备用传输路径预连接。示例性的，图10示出的为本申请实施例提供的一种多设备同步播放的另一应用场景图。以音箱设备D作为示例，当前传输路径为通过无线路由器建立的传输路径1，通过S903确定需要进行备用传输路径的预连接，也可以理解为建立备用传输路径对应的物理传输通道；此时音箱设备D可以对传输路径2、传输路径3和传输路径4进行预连接，以作为传输路径1的备用传输路径，即音箱设备D可以分别向音箱设备A、音箱设备B和音箱设备C发送物理传输信道的建立请求。例如，音箱设备D向音箱设备B发起蓝牙连接请求，在连接蓝牙之后表示建立了物 理传输信道；音箱设备D向音箱设备A发起Wi-Fi直连请求，在建立Wi-Fi直连之后表示建立了物理传输信道。
需要说明的是，本申请实施时也可以仅对中转可用性较佳的一条或几条备用传输路径进行预连接，无需将所有满足中转可用性的传输路径均进行连接，避免增加处理负载。并且，在第一终端设备将目的传输路径由当前传输路径切换至备用传输路径之前，备用传输路径上不进行对待播放音频数据的传输。
S904b、第一终端设备保持所述当前传输路径的连接。示例性的，若第一终端设备确定当前传输路径在未来一段时间内可以满足对待播放音频数据的传输能力，则可以继续保持当前传输路径的连接，等待下一次的判断。需要说明的是，图9示出的处理流程也可以是周期性进行的，以保障多设备音频同步播放场景的稳定性。
S905、第一终端设备是否进行当前传输路径到备用传输路径的切换。基于前述步骤内容中的预测，第一终端设备可以预先为当前传输路径在未来一段时间内可能存在的异常进行备用传输路径的预连接处理。为了更加准确地基于当前传输路径的稳定性和中转能力进行传输路径的及时切换，第一终端设备还可以对当前传输路径的当下稳定性和中转能力进行即时检测，若确定满足传输路径切换条件时，继续执行S906；否则返回执行S904b。
例如，若第一终端设备检测到当前传输路径的传输状态为中断(可能作为数据来源的终端设备下电)，则确定进行传输路径的切换。又例如，若第一终端设备检测到当前传输路径的终端设备的中转能力变差，且小于或等于中转能力阈值，则确定进行传输路径切换。
S906、第一终端设备从所述至少一条备用传输路径中选取目的传输路径，并进行切换。如图10示出的应用场景图，第一终端设备可以从作为备用传输路径的传输路径2、传输路径3以及传输路径4中选择一条传输路径作为目的传输路径，例如，音箱设备D将通过传输路径1获取待播放音频数据切换为通过(备用)传输路径4获取待播放音频数据。
通过图9示出的实施方式，通过对当前传输路径的预测，终端设备可以实现对备用传输路径的预先建立，从而在检测到当前传输路径当下状态较差时，可以实现传输路径得快速切换，进而提升多设备音频同步播放场景下音频播放的流畅性和稳定性，减少多设备获取待播放音频数据的最长耗时，以提升用户体验。
基于相同的技术构思，图11所示为本申请实施例提供的一种终端设备1100。该终端设备1100包括一个或多个处理器1101；一个或多个存储器1102；通信接口1103，以及一个或多个计算机程序1104，上述各器件可以通过一个或多个通信总线1105连接。通信接口1103用于实现与其他设备(比如终端设备)的通信，比如通信接口可以是收发器。其中该一个或多个计算机程序1104被存储在上述存储器1102中并被配置为被该一个或多个处理器1101执行，该一个或多个计算机程序1104包括指令，上述指令可以用于执行如下步骤，包括：
第一终端设备获取N个第二终端设备的中转能力评估值，所述N为正整数；所述第一终端设备根据N个所述中转能力评估值，得到所述N个第二终端设备对所述第一终端设备的中转可用性；所述第一终端设备基于所述N个第二终端设备对所述第一终端设备的中转可用性，从N条传输路径中选取目的传输路径，所述N条传输路径与所述N个第二终端设备一一对应；所述第一终端设备从所述目的传输路径对应的第二终端设备获取待播放音频数据。
在一种可能的设计中，所述第一终端设备根据N个所述中转能力评估值，得到所述N 个第二终端设备对所述第一终端设备的中转可用性，可以实施为：所述第一终端设备确定与所述N个第二终端设备对应的N个相对信号强度；所述第一终端设备基于所述N个相对信号强度，为所述N个第二终端设备分别分配中转可用性权重因子；针对第i个第二终端设备，所述第一终端设备将所述第i个第二终端设备的中转能力评估值和中转可用性权重因子的乘积，作为所述第i个终端设备的中转可用性；所述i为1至N中的任一正整数。可选的，假设第二终端设备的相对信号强度越大表示第二终端设备对第一终端设备的中转可用性越高，第一终端设备则可以为相对信号强度越大的第二终端设备分配较高的中转可用性权重因子。
在一种可能的设计中，第一终端设备也可以为其他终端设备中转待播放音频数据，可以根据第一终端设备的中转能力评估值来确定。该设计可以实施为：所述第一终端设备采用第一评估参数组确定所述第一终端设备的第一中转能力评估值，所述第一评估参数组包括但不限于以下评估参数中的一种或多种的组合：所述第一终端设备的网络信号强度、所述第一终端设备的网络传输状态、所述第一终端设备的类型、所述第一终端设备的使用状态、所述第一终端设备的带电频率；若所述第一中转能力评估值符合预设中转能力阈值条件，所述第一终端设备发送所述第一中转能力评估值等。可以理解，第一终端设备获取N个第二终端设备的中转能力评估值之前，第二终端设备也可以采用上述介绍的设计来确定各自的中转能力评估值。
在上述设计中，所述第一终端设备采用第一评估参数组确定所述第一终端设备的第一中转能力评估值，一种可选的实施方式为：所述第一终端设备获取所述第一评估参数组中所包含的各评估参数分别对应的中转能力权重因子；所述第一终端设备根据所述各评估参数分别对应的中转能力权重因子，对所述第一评估参数组中所包含的各所述评估参数采用加权求和方式得到所述第一中转能力评估值。另一可选的，第一终端设备还可以采用确定第一中转能力评估值的实施方式，例如采用机器学习方式等，本申请不进行限定。
在一种可能的设计中，所述第一终端设备还可以周期性更新所述第一中转能力评估值。
在一种可能的设计中，第一终端设备可以进行角色划分，在不同角色下可以进行不同的处理。例如，第一终端设备可以根据播放能力评估值划分为普通播放角色或者末端播放角色。其中，末端播放角色表示第一终端设备的播放能力不佳。基于此，所述第一终端设备采用第二评估参数组确定所述第一终端设备的第一播放能力评估值，所述第二评估参数组包括以下评估参数中的一种或多种的组合：所述第一终端设备的网络信号强度、所述第一终端设备的网络传输状态、所述第一终端设备的类型。可选的，若所述第一终端设备确定所述第一播放能力评估值不符合播放能力阈值条件，所述第一终端设备可以从N个第二终端设备对应的N条传输路径中选取目的传输路径，来获取待播放音频数据。
在一种可能的设计中，所述第一终端设备基于所述N个第二终端设备对所述第一终端设备的中转可用性，从N条传输路径中选取目的传输路径，可以实施为：所述第一终端设备确定所述N个第二终端设备对所述第一终端设备的中转可用性均不符合中转能力阈值条件，所述第一终端设备将当前传输路径作为所述目的传输路径。或者还可以实施为：所述第一终端设备确定至少一个第二终端设备对所述第一终端设备的中转可用性符合所述中转能力阈值条件，所述第一终端设备从所述至少一个第二终端设备对应的至少一条传输路径中选取目的传输路径。或者又可以实施为：所述第一终端设备确定至少一个第二终端设备对所述第一终端设备的中转可用性符合所述中转能力阈值条件、且所述至少一个第二终 端设备对所述第一终端设备的中转可用性与所述当前传输路径对应的第二终端设备对所述第一终端设备的中转可用性相比不符合预设切换条件，所述第一终端设备将当前传输路径作为所述目的传输路径。
在一种可能的设计中，所述第一终端设备还可以周期性更新所述第一播放能力评估值。
在一种可能的设计中，第一终端设备还可以通过对当前传输路径的预测来保障待播放音频数据的传输效率和稳定性。可实施为，第一终端设备基于第一处理数据对当前传输路径的稳定性进行预测，得到所述当前传输路径在第一时刻的稳定性评估值；所述第一处理数据为所述第一终端设备统计采用所述当前传输路径所产生的处理数据得到的；以及，第一终端设备基于第二处理数据对所述当前传输路径的中转能力进行预测，得到所述当前传输路径在第二时刻的中转能力评估值；所述第二处理数据为所述第一终端设备统计所述当前传输路径对应的第二终端设备的中转能力评估值得到的。若所述第一终端设备检测到第一触发条件，进行至少一条备用传输路径的预连接；其中，所述第一触发条件包括以下条件中的一种或多种的组合：所述第一时刻的稳定性评估值符合预设稳定性阈值条件、所述第二时刻的中转能力评估值符合预设中转能力阈值条件。
在一种可能的设计中，所述第一终端设备从N条传输路径中选取目的传输路径，包括：所述第一终端设备从所述至少一条备用传输路径中选取所述目的传输路径。
在一种可能的设计中，所述第一终端设备基于第一处理数据对当前传输路径的稳定性进行预测，可实施为所述第一终端设备基于第一处理数据采用时间序列学习算法对当前传输路径的稳定性进行预测；所述第一终端设备基于第二处理数据对所述当前传输路径的中转能力进行预测，包括：所述第一终端设备基于第二处理数据采用时间序列学习算法对所述当前传输路径的中转能力进行预测。
在一种可能的设计中，所述稳定性评估值通过但不限于以下信息中的一种或多种的组合来确定：所述第二终端设备的下电置信度、所述第二终端设备的负载状态、所述第二终端设备的网络状态等。
在一种可能的设计中，在第一终端设备获取到待播放音频数据之后，所述第一终端设备可以接收并响应于播放指令，对所述待播放音频数据进行播放；所述播放指令用于指示至少一个终端设备对所述待播放音频数据进行同步播放，所述至少一个终端设备包括所述第一终端设备和所述N个第二终端设备。
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算 机设备(可以是个人计算机，服务器，或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请实施例的具体实施方式，但本申请实施例的保护范围并不局限于此，任何在本申请实施例揭露的技术范围内的变化或替换，都应涵盖在本申请实施例的保护范围之内。因此，本申请实施例的保护范围应以所述权利要求的保护范围为准。

Claims (18)

  1. 一种多设备同步播放方法，其特征在于，所述方法包括：
    第一终端设备获取N个第二终端设备的中转能力评估值，所述N为正整数；
    所述第一终端设备根据N个所述中转能力评估值，得到所述N个第二终端设备对所述第一终端设备的中转可用性；
    所述第一终端设备基于所述N个第二终端设备对所述第一终端设备的中转可用性，从N条传输路径中选取目的传输路径，所述N条传输路径与所述N个第二终端设备一一对应；
    所述第一终端设备从所述目的传输路径对应的第二终端设备获取待播放音频数据。
  2. 根据权利要求1所述的方法，其特征在于，所述第一终端设备根据N个所述中转能力评估值，得到所述N个第二终端设备对所述第一终端设备的中转可用性，包括：
    所述第一终端设备确定与所述N个第二终端设备对应的N个相对信号强度；
    所述第一终端设备基于所述N个相对信号强度，为所述N个第二终端设备分别分配中转可用性权重因子；
    针对第i个第二终端设备，所述第一终端设备将所述第i个第二终端设备的中转能力评估值和中转可用性权重因子的乘积，作为所述第i个终端设备的中转可用性；所述i为1至N中的任一正整数。
  3. 根据权利要求1或2所述的方法，其特征在于，所述方法还包括：
    所述第一终端设备采用第一评估参数组确定所述第一终端设备的第一中转能力评估值，所述第一评估参数组包括以下评估参数中的一种或多种的组合：所述第一终端设备的网络信号强度、所述第一终端设备的网络传输状态、所述第一终端设备的类型、所述第一终端设备的使用状态、所述第一终端设备的带电频率；
    若所述第一中转能力评估值符合预设中转能力阈值条件，所述第一终端设备发送所述第一中转能力评估值。
  4. 根据权利要求3所述的方法，其特征在于，所述第一终端设备采用第一评估参数组确定所述第一终端设备的第一中转能力评估值，包括：
    所述第一终端设备获取所述第一评估参数组中所包含的各评估参数分别对应的中转能力权重因子；
    所述第一终端设备根据所述各评估参数分别对应的中转能力权重因子，对所述第一评估参数组中所包含的各所述评估参数采用加权求和方式得到所述第一中转能力评估值。
  5. 根据权利要求3或4所述的方法，其特征在于，所述方法还包括：
    所述第一终端设备周期性更新所述第一中转能力评估值。
  6. 根据权利要求1或2所述的方法，其特征在于，所述第一终端设备获取N个第二终端设备的中转能力评估值之前，所述方法还包括：
    所述第一终端设备采用第二评估参数组确定所述第一终端设备的第一播放能力评估值，所述第二评估参数组包括以下评估参数中的一种或多种的组合：所述第一终端设备的网络信号强度、所述第一终端设备的网络传输状态、所述第一终端设备的类型；
    所述第一终端设备确定所述第一播放能力评估值不符合播放能力阈值条件。
  7. 根据权利要求1或6所述的方法，其特征在于，所述第一终端设备基于所述N个第二终端设备对所述第一终端设备的中转可用性，从N条传输路径中选取目的传输路径，包 括：
    所述第一终端设备确定所述N个第二终端设备对所述第一终端设备的中转可用性均不符合中转能力阈值条件，所述第一终端设备将当前传输路径作为所述目的传输路径；或者
    所述第一终端设备确定至少一个第二终端设备对所述第一终端设备的中转可用性符合所述中转能力阈值条件，所述第一终端设备从所述至少一个第二终端设备对应的至少一条传输路径中选取目的传输路径；或者
    所述第一终端设备确定至少一个第二终端设备对所述第一终端设备的中转可用性符合所述中转能力阈值条件、且所述至少一个第二终端设备对所述第一终端设备的中转可用性与所述当前传输路径对应的第二终端设备对所述第一终端设备的中转可用性相比不符合预设切换条件，所述第一终端设备将当前传输路径作为所述目的传输路径。
  8. 根据权利要求6或7所述的方法，其特征在于，所述方法还包括：
    所述第一终端设备周期性更新所述第一播放能力评估值。
  9. 根据权利要求1所述的方法，其特征在于，所述方法还包括：
    第一终端设备基于第一处理数据对当前传输路径的稳定性进行预测，得到所述当前传输路径在第一时刻的稳定性评估值；所述第一处理数据为所述第一终端设备统计采用所述当前传输路径所产生的处理数据得到的；以及，
    第一终端设备基于第二处理数据对所述当前传输路径的中转能力进行预测，得到所述当前传输路径在第二时刻的中转能力评估值；所述第二处理数据为所述第一终端设备统计所述当前传输路径对应的第二终端设备的中转能力评估值得到的；
    所述第一终端设备检测到第一触发条件，进行至少一条备用传输路径的预连接；其中，所述第一触发条件包括以下条件中的一种或多种的组合：所述第一时刻的稳定性评估值符合预设稳定性阈值条件、所述第二时刻的中转能力评估值符合预设中转能力阈值条件。
  10. 根据权利要求9所述的方法，其特征在于，所述第一终端设备从N条传输路径中选取目的传输路径，包括：
    所述第一终端设备从所述至少一条备用传输路径中选取所述目的传输路径。
  11. 根据权利要求9所述的方法，其特征在于，所述第一终端设备基于第一处理数据对当前传输路径的稳定性进行预测，包括：
    所述第一终端设备基于第一处理数据采用时间序列学习算法对当前传输路径的稳定性进行预测；
    所述第一终端设备基于第二处理数据对所述当前传输路径的中转能力进行预测，包括：
    所述第一终端设备基于第二处理数据采用时间序列学习算法对所述当前传输路径的中转能力进行预测。
  12. 根据权利要求9至11中任一所述的方法，其特征在于，所述稳定性评估值通过以下信息中的一种或多种的组合来确定：所述第二终端设备的下电置信度、所述第二终端设备的负载状态、所述第二终端设备的网络状态。
  13. 根据权利要求1至12中任一项所述的方法，其特征在于，所述方法还包括：
    所述第一终端设备接收并响应于播放指令，对所述待播放音频数据进行播放；所述播放指令用于指示至少一个终端设备对所述待播放音频数据进行同步播放，所述至少一个终端设备包括所述第一终端设备和所述N个第二终端设备。
  14. 一种终端设备，其特征在于，包括：一个或多个处理器；一个或多个存储器；
    所述一个或多个存储器，用于存储一个或多个计算机程序以及数据信息；其中所述一个或多个计算机程序包括指令；
    当所述指令被所述一个或多个处理器执行时，使得所述终端设备执行如权利要求1～13中任一项所述的方法。
  15. 一种通信系统，其特征在于，包括至少一个如权利要求14所述的终端设备。
  16. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质用于存储计算机程序，当所述计算机程序在计算机上运行时，使得所述计算机执行如权利要求1至13中任意一项所述的方法。
  17. 一种计算机程序产品，其特征在于，包括计算机程序，当所述计算机程序在计算机上运行时，使得所述计算机执行如上述权利要求1至13中任意一项所述的方法。
  18. 一种终端设备上的图形用户界面，其特征在于，所述终端设备具有显示屏、存储器、以及处理器，所述处理器用于执行存储在所述存储器中的一个或多个计算机程序，所述图形用户界面包括所述终端设备执行上述权利要求1-13中任意一项所述的方法时显示的图形用户界面。
PCT/CN2022/111117 2021-08-27 2022-08-09 一种多设备同步播放方法及装置 WO2023024894A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22860240.5A EP4366244A1 (en) 2021-08-27 2022-08-09 Multi-device synchronous playback method and apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110993559.9 2021-08-27
CN202110993559.9A CN115733703A (zh) 2021-08-27 2021-08-27 一种多设备同步播放方法及装置

Publications (1)

Publication Number Publication Date
WO2023024894A1 true WO2023024894A1 (zh) 2023-03-02

Family

ID=85290156

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/111117 WO2023024894A1 (zh) 2021-08-27 2022-08-09 一种多设备同步播放方法及装置

Country Status (3)

Country Link
EP (1) EP4366244A1 (zh)
CN (1) CN115733703A (zh)
WO (1) WO2023024894A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09222848A (ja) * 1995-12-12 1997-08-26 N T T Data Tsushin Kk 遠隔講義システム及びネットワークシステム
CN104684042A (zh) * 2015-03-13 2015-06-03 深圳酷派技术有限公司 物联网中的数据传输方法、系统、物联网设备、终端
US20160105344A1 (en) * 2014-10-13 2016-04-14 Belkin International Inc. Mesh network transmission decisions based on node performance metrics
CN107172672A (zh) * 2017-05-10 2017-09-15 中国互联网络信息中心 一种采用d2d机制实现物联网设备路由优化的方法
US20180220353A1 (en) * 2015-07-24 2018-08-02 Voxp Pte Ltd System and method for relaying information
CN112335188A (zh) * 2018-12-05 2021-02-05 英特尔公司 用于设备到设备网络中无线通信的方法和设备

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9736548B2 (en) * 2011-06-08 2017-08-15 Qualcomm Incorporated Multipath rate adaptation
US9521074B2 (en) * 2012-05-10 2016-12-13 Sonos, Inc. Methods and apparatus for direct routing between nodes of networks
EP2738995A1 (en) * 2012-11-30 2014-06-04 Thomson Licensing Method and multi-homed equipment for establishing a multipath connection

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09222848A (ja) * 1995-12-12 1997-08-26 N T T Data Tsushin Kk 遠隔講義システム及びネットワークシステム
US20160105344A1 (en) * 2014-10-13 2016-04-14 Belkin International Inc. Mesh network transmission decisions based on node performance metrics
CN104684042A (zh) * 2015-03-13 2015-06-03 深圳酷派技术有限公司 物联网中的数据传输方法、系统、物联网设备、终端
US20180220353A1 (en) * 2015-07-24 2018-08-02 Voxp Pte Ltd System and method for relaying information
CN107172672A (zh) * 2017-05-10 2017-09-15 中国互联网络信息中心 一种采用d2d机制实现物联网设备路由优化的方法
CN112335188A (zh) * 2018-12-05 2021-02-05 英特尔公司 用于设备到设备网络中无线通信的方法和设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4366244A4 *

Also Published As

Publication number Publication date
EP4366244A4 (en) 2024-05-08
EP4366244A1 (en) 2024-05-08
CN115733703A (zh) 2023-03-03

Similar Documents

Publication Publication Date Title
CN110633151B (zh) 分布式发布消息集群分区平衡的方法、装置及存储介质
KR102509245B1 (ko) 써드 파티 애플리케이션으로의 디지털 어시스턴트 확장성
US9367214B2 (en) Wireless communication device having deterministic control of foreground access of the user interface
US10509829B2 (en) Contextual search using natural language
US10491535B2 (en) Adaptive data synchronization
KR102394296B1 (ko) 다수의 디바이스 상에 컴퓨팅 환경의 제시
US20140289415A1 (en) Continuous and concurrent device experience in a multi-device ecosystem
US8655338B2 (en) Method for operating portable terminal to reduce power during support of communication service and portable terminal supporting the same
US9191417B2 (en) Cross-process media handling in a voice-over-internet protocol (VOIP) application platform
EP3180684A1 (en) Quick navigation of message conversation history
WO2019024649A1 (zh) 应用程序的启动方法、装置、存储介质和终端
JP2016539432A (ja) ユーザインターフェースのフォアグラウンドアクセスの確定的な制御権を有するワイヤレス通信デバイス
EP2962448B1 (en) Dynamic power management of context aware services
WO2019127954A1 (zh) 一种网络性能提升的方法及设备
WO2022110939A1 (zh) 一种设备推荐方法及电子设备
US9319246B2 (en) Voice-over-internet protocol (VOIP) application platform
WO2018219118A1 (zh) 界面显示方法及相关产品
CN117407133A (zh) 一种任务处理方法、装置及计算机可读存储介质
WO2023024894A1 (zh) 一种多设备同步播放方法及装置
CN110209491B (zh) 一种资源管理方法、装置、服务器及存储介质
CN112306667B (zh) 一种动画播放方法、装置、计算机设备和存储介质
WO2024055708A1 (zh) 任务调度方法、装置、设备及介质
CN117395569A (zh) 一种音频播放系统、方法及终端设备
CN117811947A (zh) 一种多设备组网系统、方法及终端设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22860240

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022860240

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022860240

Country of ref document: EP

Effective date: 20240129

NENP Non-entry into the national phase

Ref country code: DE