WO2022228013A1 - Procédé de projection audio, et support de stockage lisible par ordinateur - Google Patents

Procédé de projection audio, et support de stockage lisible par ordinateur Download PDF

Info

Publication number
WO2022228013A1
WO2022228013A1 PCT/CN2022/084147 CN2022084147W WO2022228013A1 WO 2022228013 A1 WO2022228013 A1 WO 2022228013A1 CN 2022084147 W CN2022084147 W CN 2022084147W WO 2022228013 A1 WO2022228013 A1 WO 2022228013A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
audio
audio data
transmission channel
channel
Prior art date
Application number
PCT/CN2022/084147
Other languages
English (en)
Chinese (zh)
Inventor
徐露
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022228013A1 publication Critical patent/WO2022228013A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/70—Services for machine-to-machine communication [M2M] or machine type communication [MTC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/14—Direct-mode setup

Definitions

  • the present application relates to the technical field of terminals, and in particular, to a sound projection method and a computer-readable storage medium.
  • Sound projection (also called sound transmission) enables the first electronic device to play audio data using the playback capability of the second electronic device, thereby providing a better listening experience for the user, and is widely used.
  • One-touch sound projection also called one-touch sound transmission
  • the first electronic device and the second electronic device can be in contact or not contact
  • find the other party find the other party, and establish a short-distance wireless communication channel; through the channel, transmit audio data or link address, the second electronic device plays based on the audio data, or the second electronic device obtains the audio data based on the link address and play.
  • a quick and convenient user experience can be provided to the user.
  • how to further improve the above-mentioned sound projection method to provide users with a better experience has become our demand.
  • the present application provides a sound projection method, a first electronic device, a second electronic device and a computer-readable storage medium.
  • the technical solution provided by this application is aimed at the situation that audio data is transmitted from a first electronic device to a second electronic device and played by the second electronic device, through the perspectives of low latency and high-quality audio, combined with short-distance wireless communication
  • the different characteristics of the sound projection taking into account the sound projection response speed and sound projection quality as much as possible, provide users with a better listening experience; enable users to hear audio data faster and hear high-quality audio data earlier.
  • a sound projection method is provided, which is applied to a second electronic device, and the second electronic device and the first electronic device form a sound projection system.
  • the method includes: in response to the first electronic device and the second electronic device touching each other, the second electronic device discovers the first electronic device through near field communication NFC; in response to the first electronic device between the first electronic device and the second electronic device The transmission channel is established successfully, and the second electronic device receives audio data through the first transmission channel; the second electronic device plays the first audio, and the first audio is the audio data received by the second electronic device through the first transmission channel; in response to the first electronic device The second transmission channel between the device and the second electronic device is successfully established, and the second electronic device receives audio data through the second transmission channel; the second electronic device switches the played audio data from the first audio to the second audio, and the second The audio is audio data received by the second electronic device through the second transmission channel.
  • the sound is projected through the first transmission channel, which can reduce the delay of sound projection; after the establishment of the second transmission channel, the sound projection through the first transmission channel is stopped, and the Two transmission channel sound projection, can ensure better playback effect of high-quality audio.
  • the characteristics of the first transmission channel establishing a small delay low-latency audio delivery is guaranteed; in a short time before the second transmission channel is successfully established, the smart speaker has a poor effect of playing audio; if the second transmission channel is successfully established, the smart speaker After the second audio is played, a better playback effect of the high-quality audio can be guaranteed; both low-latency and high-quality audio are taken into account, providing users with a better sound projection playback experience.
  • the method before the second electronic device switches the played audio data from the first audio to the second audio, the method further includes: the second electronic device determines that the set condition is satisfied.
  • the setting condition includes that the second electronic device buffers the second audio of a preset duration; in another implementation, the setting condition includes that the second electronic device receives audio data from the second transmission channel .
  • the method before the second electronic device switches the played audio data from the first audio to the second audio, the method further includes: The electronic device receives a first message, where the first message is used to instruct the second electronic device to switch the played audio data from the first audio to the second audio. In this way, the first electronic device triggers the second electronic device to switch the played audio data from the first audio to the second audio. In an implementation manner, the first electronic device determines that the second transmission channel is successfully established, and then determines that the second electronic device switches the played audio data from the first audio to the second audio.
  • the first electronic device when the first electronic device receives from the second electronic device an instruction message (second message) to stop transmitting audio data through the first transmission channel, it is determined that the audio data to be played by the second electronic device is from the first transmission channel. One audio is switched to the second audio.
  • second message an instruction message
  • the method further includes: the second electronic device determines the first display timestamp PTS according to the first audio data packet of the currently played first audio, and according to the first The PTS determines the second audio data packet of the second audio; the second electronic device stops playing the first audio at the moment indicated by the first PTS, and starts to play the second audio data packet of the second audio.
  • the first electronic device sends the audio data
  • the same PTS is applied to the first audio data packet and the second audio data packet. In this way, by acquiring the corresponding second audio data packet according to the PTS of the first audio data packet, smooth switching of audio data can be realized.
  • the second electronic device determining the first display timestamp PTS according to the currently played first audio includes: the second electronic device converts the currently played first audio data packet The PTS value of the next audio data packet is determined as the first PTS.
  • the method further includes: the second electronic device resampling the received first audio at the first sampling rate and the first bit depth; the second electronic device The received second audio is resampled at the first sampling rate and the first bit depth.
  • the first audio data packet and the second audio data packet can be saved in the same format.
  • the PTS value in the first audio data packet is obtained from the corresponding second audio data packet; the seamless switching of the played audio data is ensured.
  • the method further includes: the second electronic device sends a second message to the first electronic device, where the second message is used to notify the first electronic device to stop using the first electronic device
  • the transmission channel transmits audio data.
  • the first electronic device stops transmitting audio data through the first transmission channel. In this way, redundant data transmission can be avoided, processing efficiency can be improved, and power consumption can be saved.
  • the second electronic device notifies the first electronic device to stop transmitting the audio data through the first transmission channel, so as to avoid stopping the transmission of the audio data through the first transmission channel before the second electronic device switches the played audio data from the first audio to the second audio Playback freezes caused by audio data.
  • the method further includes: the second message includes indication information, where the indication information is used to instruct the first electronic device to stop transmitting audio data through the first transmission channel.
  • the first transmission channel is a Bluetooth channel
  • the second transmission channel is a Wi-Fi channel
  • a second electronic device in a second aspect, includes: a processor; a memory; and a computer program, wherein the computer program is stored on the memory and, when executed by the processor, causes the second electronic device to perform the following steps: in response to the first electronic device and the second electronic device When the electronic devices touch, the second electronic device discovers the first electronic device through NFC; in response to the successful establishment of the first transmission channel between the first electronic device and the second electronic device, the second electronic device uses the first transmission The channel receives audio data; the second electronic device plays the first audio, and the first audio is the audio data received by the second electronic device through the first transmission channel; in response to the second transmission channel between the first electronic device and the second electronic device If the establishment is successful, the second electronic device receives audio data through the second transmission channel; the second electronic device switches the played audio data from the first audio to the second audio, and the second audio is received by the second electronic device through the second transmission channel audio data.
  • the second electronic device before the second electronic device switches the played audio data from the first audio to the second audio, the second electronic device further performs: determining that the set condition is satisfied.
  • the second electronic device further performs: the second electronic device buffers the second audio of a preset duration.
  • the second electronic device before the second electronic device switches the played audio data from the first audio to the second audio, the second electronic device further executes: from the first electronic device A first message is received, where the first message is used to instruct the second electronic device to switch the played audio data from the first audio to the second audio.
  • the second electronic device before the second electronic device switches the played audio data from the first audio to the second audio, the second electronic device further executes: according to the currently playing first audio data An audio determines the first display time stamp PTS, and determines the second audio data packet of the second audio based on the first PTS; stops playing the first audio at the time indicated by the first PTS, and starts playing the second audio data packet of the second audio.
  • the second electronic device further performs: determining the PTS value of the next first audio data packet of the currently playing first audio data packet as the first PTS.
  • the second electronic device further performs: re-sampling the received first audio at the first sampling rate and the first bit depth; The first bit depth resamples the received second audio.
  • the second electronic device further performs: sending a second message to the first electronic device, where the second message is used to notify the first electronic device to stop passing the first transmission channel Transmit audio data.
  • the second electronic device further performs: sending a second message including indication information to the first electronic device, where the indication information is used to instruct the first electronic device to stop using the The moment when a transmission channel transmits audio data.
  • a sound projection method is provided, which is applied to a first electronic device.
  • the method includes: in response to the first electronic device and the second electronic device touching each other, the first electronic device discovers the second electronic device through near field communication (NFC); in response to the first electronic device and the second electronic device The transmission channel is successfully established, and the first electronic device transmits audio data to the second electronic device through the first transmission channel; in response to the successful establishment of the second transmission channel between the first electronic device and the second electronic device, the first electronic device transmits audio data through the first electronic device.
  • the second transmission channel transmits audio data to the second electronic device.
  • the sound is projected through the first transmission channel, which can reduce the delay of sound projection; after the establishment of the second transmission channel, the sound projection through the first transmission channel is stopped, and the Two transmission channel sound projection, can ensure better playback effect of high-quality audio.
  • the characteristics of the first transmission channel establishing a small delay the low-latency audio is guaranteed; transmitting the audio through the second transmission channel can ensure a better playback effect of high-quality audio; taking into account both low-latency and high-quality audio, it is Provides users with a better sound projection playback experience.
  • the method further includes: the first electronic device sends a first message to the second electronic device, where the first message is used to indicate The second electronic device switches the played audio data from the first audio to the second audio.
  • the first electronic device triggers the second electronic device to switch the played audio data from the first audio to the second audio.
  • the first electronic device determines that the second transmission channel is successfully established, and then determines that the second electronic device switches the played audio data from the first audio to the second audio.
  • the first electronic device when the first electronic device receives from the second electronic device an instruction message (second message) to stop transmitting audio data through the first transmission channel, it is determined that the audio data to be played by the second electronic device is from the first transmission channel. One audio is switched to the second audio.
  • second message an instruction message
  • the method further includes: the first electronic device stops transmitting audio data through the first transmission channel. In this way, redundant data transmission can be avoided, processing efficiency can be improved, and power consumption can be saved.
  • the first electronic device stops transmitting audio data through the first transmission channel, which can avoid the playback card caused by stopping the transmission of audio data through the first transmission channel before the second electronic device switches the played audio data from the first audio to the second audio. pause.
  • the method before the first electronic device stops transmitting audio data through the first transmission channel, the method further includes: the first electronic device receives the second electronic device from the second electronic device message, and the second message is used to notify the first electronic device to stop transmitting audio data through the first transmission channel.
  • the second electronic device notifies the first electronic device to stop transmitting the audio data through the first transmission channel, so as to avoid stopping the transmission of the audio data through the first transmission channel before the second electronic device switches the played audio data from the first audio to the second audio Playback caused by audio data
  • the method further includes: the second message includes indication information, where the indication information is used to instruct the first electronic device to stop transmitting the audio data through the first transmission channel.
  • the stopping of the first electronic device from transmitting the audio data through the first transmission channel includes: the first electronic device stops transmitting the audio data through the first transmission channel at the moment indicated by the indication information.
  • the first transmission channel is a Bluetooth channel
  • the second transmission channel is a Wi-Fi channel
  • a first electronic device in a fourth aspect, includes: a processor; a memory; and a computer program, the computer program being stored on the memory and, when executed by the processor, causes the first electronic device to perform the following steps: in response to the first electronic device and the second electronic device When the devices touch, the first electronic device discovers the second electronic device through NFC; in response to the successful establishment of the first transmission channel between the first electronic device and the second electronic device, the first electronic device passes the first transmission channel transmitting audio data to the second electronic device; in response to the successful establishment of the second transmission channel between the first electronic device and the second electronic device, the first electronic device transmits the audio data to the second electronic device through the second transmission channel.
  • the first electronic device further executes: sending a first message to the second electronic device, where the first message is used to instruct the second electronic device to play the audio
  • the audio data is switched from the first audio to the second audio.
  • the first electronic device further performs: stopping the transmission of audio data through the first transmission channel.
  • the first electronic device before the first electronic device stops transmitting the audio data through the first transmission channel, the first electronic device further performs: receiving the second message from the second electronic device, The second message is used to notify the first electronic device to stop transmitting audio data through the first transmission channel.
  • the first electronic device further performs: receiving a second message including indication information from the second electronic device, where the indication information is used to instruct the first electronic device to stop using the The moment when a transmission channel transmits audio data.
  • the stopping of the first electronic device from transmitting the audio data through the first transmission channel includes: the first electronic device stops transmitting the audio data through the first transmission channel at the moment indicated by the indication information.
  • a computer-readable storage medium stores a computer program (also referred to as instructions or codes), which, when executed by the second electronic device, causes the second electronic device to execute the first aspect or any one of the implementations of the first aspect Methods.
  • a computer-readable storage medium stores a computer program (also referred to as instructions or codes), which, when executed by the first electronic device, causes the first electronic device to execute the third aspect or any one of the implementations of the third aspect Methods.
  • a computer program product when run on the second electronic device, causes the second electronic device to perform the method of the first aspect or any one of the embodiments of the first aspect.
  • a computer program product When running on the first electronic device, the computer program product causes the first electronic device to perform the method of the third aspect or any one of the embodiments of the third aspect.
  • a circuit system in a ninth aspect, includes processing circuitry configured to perform the method of the first aspect or any one of the embodiments of the first aspect.
  • a tenth aspect provides a circuit system.
  • the circuitry includes a processing circuit configured to perform the method of the third aspect or any one of the embodiments of the third aspect.
  • a chip system in an eleventh aspect, includes a processor and interface circuits.
  • the interface circuit is used to perform transceiver functions and send instructions to the processor.
  • the instructions when executed by the processor, cause the processor to perform the method of the first aspect or any one of the embodiments of the first aspect.
  • a twelfth aspect provides a chip system.
  • the chip system includes a processor and interface circuits.
  • the interface circuit is used to perform transceiver functions and send instructions to the processor.
  • the instructions when executed by the processor, cause the processor to perform the method of the third aspect or any one of the embodiments of the third aspect.
  • Fig. 1 is the scene schematic diagram of a kind of sound projection method provided
  • 2A is a schematic diagram of user operations and prompts provided by the sound projection method in the first manner
  • 2B is a schematic diagram of user operations and prompts provided by the voice projection method in the second manner
  • FIG. 3 is a schematic diagram of a communication mode between a first electronic device and a second electronic device involved in a sound projection method provided by an embodiment of the present application;
  • FIG. 4 is a schematic diagram of a hardware structure of a first electronic device provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a hardware structure of a second electronic device provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of the principle of a sound projection method provided by an embodiment of the present application.
  • FIGS. 7A-7C are schematic diagrams of principles of a sound projection method provided by an embodiment of the present application.
  • FIG. 8 is a schematic flowchart of a sound projection method provided by an embodiment of the present application.
  • 9A is a schematic diagram of user operations and prompts of a sound projection method provided by an embodiment of the present application.
  • 9B is a schematic diagram of the correspondence between two audio data packets in the sound projection method provided by the embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of a first electronic device according to an embodiment of the application.
  • FIG. 11 is a schematic structural diagram of a second electronic device according to an embodiment of the present application.
  • references in this specification to "one embodiment” or “some embodiments” and the like mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application.
  • appearances of the phrases “in one embodiment,” “in some embodiments,” “in other embodiments,” “in other embodiments,” etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless specifically emphasized otherwise.
  • the terms “including”, “including”, “having” and their variants mean “including but not limited to” unless specifically emphasized otherwise.
  • the term “connected” includes both direct and indirect connections unless otherwise specified.
  • first and second are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as “first” or “second” may expressly or implicitly include one or more of that feature.
  • words such as “exemplarily” or “for example” are used to represent examples, illustrations or illustrations. Any embodiment or design described in the embodiments of the present application as “exemplarily” or “such as” should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as “exemplarily” or “such as” is intended to present the related concepts in a specific manner.
  • One-touch sound projection also called one-touch sound transmission
  • the first electronic device and the second electronic device also called “touching”; the first electronic device and the second electronic device can be in contact or not contact
  • find the other party and establish a short-distance wireless communication channel; through the channel, transmit audio data or link address, the second electronic device plays based on the audio data, or the second electronic device obtains the audio data based on the link address and play.
  • the "touching" of the first electronic device and the second electronic device in this application means that the first electronic device and the second electronic device are close to each other, and the distance between the first electronic device and the second electronic device is less than A certain distance enables the first electronic device and the second electronic device to discover each other; it is not limited that the two devices meet.
  • the first electronic device is a mobile phone
  • the second electronic device is a smart speaker
  • the proximity discovery between the first electronic device and the second electronic device is realized through NFC for description.
  • first electronic device and the second electronic device may be other electronic devices.
  • the proximity discovery between the first electronic device and the second electronic device may also be implemented by other short-range wireless communication methods or other methods. This application does not limit this.
  • both the mobile phone and the smart speaker support NFC.
  • the mobile phone 100 is close to the smart speaker 200, and the mobile phone 100 and the smart speaker 200 discover each other through NFC to establish a transmission channel.
  • the transmission channel may be a Bluetooth transmission channel or a Wi-Fi transmission channel. This application does not limit this.
  • the audio data of the mobile phone 100 is delivered to the smart speaker 200 through the transmission channel, and played by the smart speaker 200 .
  • the mobile phone 100 establishes a first transmission channel with the smart speaker 200 through NFC.
  • the smart phone 100 puts audio data into the smart speaker 200 through the Bluetooth channel for playback.
  • the user uses the mobile phone 100 to approach the smart speaker 200 ; in response to the above approach, a window 102 pops up on the interface 101 of the mobile phone 100 .
  • Window 102 includes a "Cancel” button 103 and a "Connect” button 104 . The user can click the "Cancel" button 103 to confirm that the phone and the smart speaker are not to be tapped to project sound.
  • the user can also click the "connect" button 104 to confirm the one-touch projection of the mobile phone and the smart speaker.
  • the smart speaker 200 in response to the user's click operation on the "connect" button 104, the smart speaker 200 establishes a Bluetooth connection with the mobile phone 100, and establishes a Bluetooth channel.
  • the audio data of the mobile phone 100 is put into the smart speaker 200 for playback through the Bluetooth channel.
  • the Bluetooth transport protocol supports a low sample rate and bit depth (representing the dynamic range of the audio) of the transmitted audio stream.
  • AAC advanced audio coding
  • LDAC wireless audio coding technology developed by Sony that allows audio to be transmitted at a speed of up to 990kbit/s through a Bluetooth channel
  • LDAC supports a sampling rate of 96KHz and a bit depth of 24bit.
  • high-quality audio such as high-resolution audio (Hi-Res) and direct stream digital (DSD) will be resampled and resampled during the process of delivering to the smart speaker through the Bluetooth channel. After sampling, the quality of the audio is reduced. In this way, high-quality audio cannot be delivered through the Bluetooth channel.
  • the Bluetooth channel establishment delay is small, and the sound projection response is fast.
  • the mobile phone 100 establishes a second transmission channel with the smart speaker 200 through NFC.
  • the wireless fidelity (Wi-Fi) channel as the second transmission channel as an example
  • the mobile phone 100 puts the audio to the smart speaker 200 through the Wi-Fi channel for playback.
  • the user uses the mobile phone 100 to approach the smart speaker 200; in response to the mobile phone 100 approaching the smart speaker 200, a window 202 pops up on the interface 201 of the mobile phone 100, and the window 202 is used to prompt the user to confirm whether to connect the mobile phone to the smart speaker.
  • Window 202 includes a "Cancel" button 203 and a "Connect” button 204 .
  • the user can click the "Cancel” button 203 to confirm that the phone and the smart speaker are not to be tapped to project sound.
  • the user can also click the "connect” button 204 to confirm the one-touch projection of the mobile phone and the smart speaker.
  • the smart speaker 200 in response to the user's click operation on the "connect" button 204, the smart speaker 200 establishes a Wi-Fi connection with the mobile phone 100, and establishes a Wi-Fi channel.
  • the audio data of the mobile phone 100 is delivered to the smart speaker 200 for playback through the Wi-Fi channel. Through Wi-Fi channel projection, high-quality audio can be transmitted without loss.
  • Wi-Fi Wi-Fi channel scanning
  • wireless network connection wireless network connection
  • DHCP dynamic host configuration protocol
  • TCP transmission control protocol
  • the above-mentioned first transmission channel is not limited to a Bluetooth channel
  • the above-mentioned second transmission channel is not limited to a Wi-Fi channel.
  • the first transmission channel and the second transmission channel may be other short-range wireless communication channels.
  • the establishment of the first transmission channel takes a short time, and the data transmitted through the first transmission channel will be resampled and the resampling rate is low, resulting in loss of a certain amount of data, thereby reducing audio quality.
  • the establishment time of the second transmission channel is longer than the establishment time of the first transmission channel.
  • the data transmitted through the second transmission channel is not resampled, or the resampling sampling rate is high, resulting in no data loss or less data loss , so that the audio quality is not degraded or less degraded.
  • the Bluetooth channel is used as the first transmission channel and the Wi-Fi channel is used as the second transmission channel for exemplary description.
  • Embodiments of the present application provide a sound projection method, a first electronic device, a second electronic device, and a computer-readable storage medium.
  • the first electronic device and the second electronic device discover each other through "touching", and then establish a Bluetooth channel and a Wi-Fi channel synchronously and independently of each other.
  • the establishment of the Bluetooth channel takes less time.
  • the first electronic device starts to project sound.
  • the first electronic device transmits audio data to the second electronic device based on the rapidly established Bluetooth channel.
  • the second electronic device plays the audio data received from the Bluetooth channel.
  • the establishment of the Wi-Fi channel takes longer than the establishment of the Bluetooth channel.
  • the first electronic device transmits audio data to the second electronic device in parallel through the Wi-Fi channel and the Bluetooth channel.
  • the second electronic device switches the audio source for playback, that is, the audio data received from the Bluetooth channel, to the audio data received from the Wi-Fi channel. Since the establishment of the Bluetooth channel takes a short time, after the Bluetooth channel is successfully established, the sound is projected through the Bluetooth channel, which can make the delay of the sound projection smaller. After a period of time (for example, 3 seconds), the establishment of the Wi-Fi channel is completed, and it is switched to project audio through the Wi-Fi channel to ensure high-quality audio playback.
  • both the sound projection response speed and the sound projection quality are taken into consideration to provide users with a better listening experience; after a low delay, the user can hear the audio data, and after a period of time, the user can hear the high-quality audio data. It takes into account low-latency and high-quality audio, providing users with a better one-touch sound projection playback experience.
  • FIG. 3 shows a system architecture to which the sound projection method provided by the embodiment of the present application is applicable.
  • the system includes a first electronic device 100 and a second electronic device 200 .
  • the first electronic device 100 and the second electronic device 200 support the NFC function, the Bluetooth function, and the Wi-Fi function, respectively.
  • the first electronic device 100 and the second electronic device 200 discover each other through "touching", and establish a Bluetooth channel and a Wi-Fi channel. In this way, the first electronic device 100 can deliver audio data to the second electronic device 200 for playback through a Bluetooth channel or a Wi-Fi channel.
  • the first electronic device 100 may be an electronic device supporting NFC, Bluetooth and Wi-Fi, and the electronic device may include portable mobile devices (such as mobile phones, etc.), handheld computers, tablet computers, notebook computers, netbooks, personal computers (personal computers, etc.) computer, PC), smart home devices (such as smart TVs, etc.), personal digital assistants (PDAs), wearable electronic devices (such as smart watches, smart bracelets, etc.), augmented reality (AR) ) ⁇ Virtual reality (virtual reality, VR) equipment, car computer, etc.
  • the above-mentioned electronic device may also be other portable mobile devices, such as a laptop computer (Laptop) and the like. It should also be understood that, in some other embodiments, the above-mentioned electronic device may not be a portable mobile device, but a fixed device.
  • the specific form of the first electronic device 100 is not particularly limited in this embodiment of the present application.
  • the above-mentioned second electronic device 200 may be an electronic device supporting NFC, Bluetooth and Wi-Fi, and the electronic device may include smart home devices (such as smart speakers, smart lights, smart washing machines, smart air conditioners, etc.), wearable devices (such as , smart watches, smart bracelets, etc.), augmented reality (AR) ⁇ virtual reality (virtual reality, VR) devices, car computers, portable mobile devices (such as mobile phones, etc.), handheld computers, tablet computers, laptops, Netbooks, personal computers (PCs), etc.
  • AR ⁇ virtual reality (virtual reality, VR) devices
  • car computers portable mobile devices (such as mobile phones, etc.), handheld computers, tablet computers, laptops, Netbooks, personal computers (PCs), etc.
  • the above-mentioned electronic device may also be other portable mobile devices, such as a laptop computer (Laptop) and the like. It should also be understood that, in some other embodiments, the above-mentioned electronic device may not be a portable mobile device, but a fixed device.
  • FIG. 4 shows a schematic structural diagram of a first electronic device 100 .
  • the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a display screen 140, a mobile communication module 150, a wireless communication module 160, a SIM card interface 170, a power module 180, and the like.
  • the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the first electronic device 100 .
  • the first electronic device 100 may include more or less components than shown, or some components are combined, or some components are separated, or different components are arranged.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • Processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (ISP), a controller, a video Codec, digital signal processor (DSP), and/or neural-network processing unit (NPU), etc.
  • AP application processor
  • modem processor graphics processor
  • ISP image signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • different processing units can be independent components, and can also be integrated in one or more processors.
  • the first electronic device 100 may also include one or more processors 110 .
  • the application processor may run the operating system of the first electronic device 100 for managing hardware and software resources of the first electronic device 100 . For example, managing and configuring memory, prioritizing the supply and demand of system resources, controlling input and output devices, operating networks, managing file systems, managing drivers, etc.
  • the operating system can also be used to provide an operating interface for the user to interact with the system.
  • various types of software can be installed in the operating system, for example, a driver program, an application program (application, App), and the like.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the processor 110 may include one or more interfaces.
  • the interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver (universal asynchronous receiver) /transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, SIM card interface, and/or USB interface, etc.
  • I2C inter-integrated circuit
  • I2S inter-integrated circuit sound
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous receiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM card interface SIM card interface
  • USB interface etc.
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the first electronic device 100 .
  • the first electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the first electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. Such as saving audio, video etc files in external memory card.
  • Internal memory 121 may be used to store one or more computer programs including instructions.
  • the processor 110 may execute the above-mentioned instructions stored in the internal memory 121, thereby causing the first electronic device 100 to execute the methods provided in some embodiments of the present application, as well as various applications and data management.
  • the internal memory 121 may include a code storage area and a data storage area.
  • the first electronic device 100 implements a display function through a GPU, a display screen 140, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 140 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 140 is used to display images, videos, and the like.
  • the display screen 140 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • LED liquid crystal display
  • OLED organic light-emitting diode
  • AMOLED organic light-emitting diode
  • FLED flexible light-emitting diode
  • Miniled MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
  • the first electronic device 100 may include 1 or N display screens 140 , where N is a positive integer greater than 1.
  • the display screen 140 may display a window for prompting the user to confirm whether to perform one-touch sound projection, and receive the user's operation on the interface of the electronic device.
  • the wireless communication function of the first electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, and the like.
  • the mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G etc. applied on the first electronic device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 .
  • the wireless communication module 160 can provide applications on the first electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global Navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication (near field communication, NFC), infrared (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • GNSS global Navigation satellite system
  • frequency modulation frequency modulation, FM
  • NFC near field communication
  • infrared infrared
  • IR infrared
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
  • the wireless communication module 160 is configured to perform a Bluetooth connection and a Wi-Fi connection, establish a transmission channel, and deliver audio data through the transmission channel.
  • the antenna 1 of the first electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the first electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi-zenith) satellite system, QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the SIM card interface 170 is used to connect a SIM card.
  • the power module 180 may be used to supply power to various components included in the first electronic device 100 .
  • the power module 180 may be a battery, such as a rechargeable battery.
  • FIG. 5 shows a schematic structural diagram of a second electronic device 200 .
  • the second electronic device 200 may include a processor 210, an external memory interface 220, an internal memory 221, an audio module 230, a speaker 230A, a microphone 230B, an earphone interface 230C, a wireless communication module 260, a power supply module 280, and the like.
  • the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the second electronic device 200 .
  • the second electronic device 200 may include more or less components than shown, or some components may be combined, or some components may be separated, or different component arrangements.
  • the illustrated components may be implemented in hardware, software or a combination of software and hardware.
  • Processor 210 may include one or more processing units.
  • the processor 210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP) , and/or a neural network processor (NPU), etc.
  • AP application processor
  • GPU graphics processor
  • ISP image signal processor
  • DSP digital signal processor
  • NPU neural network processor
  • different processing units may be independent components, or may be integrated in one or more processors.
  • the second electronic device 200 may also include one or more processors 210 .
  • the controller is the nerve center and command center of the second electronic device 200 .
  • the operation control signal can be generated according to the instruction operation code and the timing signal to complete the control of fetching and executing the instruction.
  • An operating system of the second electronic device 200 may be run on the application processor to manage hardware and software resources of the second electronic device 200 . For example, managing and configuring memory, prioritizing the supply and demand of system resources, controlling input and output devices, operating networks, managing file systems, managing drivers, etc.
  • the operating system can also be used to provide an operating interface for the user to interact with the system.
  • various types of software can be installed in the operating system, for example, a driver program, an application program (application, App), and the like.
  • a memory may also be provided in the processor 210 for storing instructions and data.
  • the memory in processor 210 is cache memory.
  • the memory may hold instructions or data that have just been used or recycled by the processor 210 . If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided, and the waiting time of the processor 210 is reduced, thereby improving the efficiency of the system.
  • the processor 210 may include one or more interfaces. Interfaces may include Inter-Integrated Circuit (I2C) interface, Inter-Integrated Circuit Audio (I2S) interface, Pulse Code Modulation (PCM) interface, Universal Asynchronous Receiver Transmitter (UART) interface, Mobile Industry Processor Interface (MIPI), Universal Input Output (GPIO) interface, SIM card interface, and/or USB interface, etc.
  • I2C Inter-Integrated Circuit
  • I2S Inter-Integrated Circuit Audio
  • PCM Pulse Code Modulation
  • UART Universal Asynchronous Receiver Transmitter
  • MIPI Mobile Industry Processor Interface
  • GPIO Universal Input Output
  • SIM card interface SIM card interface
  • USB interface etc.
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the second electronic device 200 .
  • the second electronic device 200 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the second electronic device 200.
  • the external memory card communicates with the processor 210 through the external memory interface 220 to realize the data storage function. Such as saving audio, video etc files in external memory card.
  • Internal memory 221 may be used to store one or more computer programs including instructions.
  • the processor 210 may execute the above-mentioned instructions stored in the internal memory 221, thereby causing the second electronic device 200 to execute the methods provided in some embodiments of the present application, as well as various applications and data management.
  • the internal memory 221 may include a code storage area and a data storage area.
  • the second electronic device 200 may implement audio functions through an audio module 230, a speaker 230A, a microphone 230B, an earphone interface 230C, an application processor, and the like. Such as audio playback, recording, etc.
  • the audio module 230 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 230 may also be used to encode and decode audio signals. In some embodiments, the audio module 230 may be provided in the processor 210 , or some functional modules of the audio module 230 may be provided in the processor 210 .
  • Speaker 230A also referred to as a "speaker" is used to convert audio electrical signals into sound signals.
  • the speaker 230A is used to convert the received audio electrical signal into a sound signal for output.
  • the microphone 230B also called “microphone” or “microphone” is used to convert sound signals into electrical signals. The user can make a sound by approaching the microphone 230B through the human mouth, and input the sound signal to the microphone 230B.
  • the earphone jack 230C is used to connect wired earphones.
  • the earphone interface 230C may be a USB interface, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the wireless communication function of the second electronic device 200 may be implemented by the antenna and the wireless communication module 260 .
  • the wireless communication module 260 can provide wireless local area network (WLAN) (such as Wi-Fi network), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), short-range wireless network applied on the second electronic device 200 Communication (NFC), Infrared (IR) and other wireless communication solutions.
  • the wireless communication module 260 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 260 receives electromagnetic waves via the antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 210 .
  • the wireless communication module 260 can also receive the signal to be sent from the processor 210, frequency-modulate the signal, amplify the signal, and radiate it into electromagnetic waves through the antenna.
  • the wireless communication module 260 is configured to perform a Bluetooth connection and a Wi-Fi connection, establish a transmission channel, and receive audio data through the transmission channel.
  • the antenna of the second electronic device 200 is coupled with the wireless communication module 260, so that the second electronic device 200 can communicate with the network and other devices through wireless communication technology.
  • Wireless communication technologies may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA) , Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc.
  • GNSS may include Global Positioning Satellite System (GPS), Global Navigation Satellite System (GLONASS), Beidou Satellite Navigation System (BDS), Quasi-Zenith Satellite System (QZSS) and/or Satellite Based Augmentation System (SBAS).
  • GPS Global Positioning Satellite System
  • GLONASS Global Navigation Satellite System
  • BDS Beidou Satellite Navigation System
  • QZSS Quasi-Zenith Satellite System
  • SBAS Satellite Based Augmentation System
  • the power module 280 can be used to supply power to various components included in the second electronic device 200 .
  • the power module 280 may be a battery, such as a rechargeable battery.
  • the first electronic device and the second electronic device can initiate the establishment of a Bluetooth channel and a Wi-Fi channel through NFC through "touching".
  • the establishment of the Bluetooth channel takes a short time and is completed first; the establishment of the Wi-Fi channel takes a long time, and then the establishment is completed.
  • the Bluetooth channel is established first, the first electronic device starts to project audio, and the audio data is released to the second electronic device through the Bluetooth channel.
  • the second electronic device plays the audio data received through the Bluetooth channel.
  • the Wi-Fi channel is subsequently established, and the first electronic device also transmits audio data through the Wi-Fi channel.
  • the establishment of the Bluetooth channel and the establishment of the Wi-Fi channel are independent of each other and are performed synchronously.
  • the first electronic device transmits audio data in parallel and independently of each other through the Bluetooth channel and the Wi-Fi channel.
  • the second electronic device receives audio data through the Bluetooth channel and the Wi-Fi channel, respectively.
  • the audio data received by the second electronic device through the Bluetooth channel is referred to as Bluetooth audio
  • the audio data received through the Wi-Fi channel is referred to as Wi-Fi audio.
  • the first electronic device stops transmitting audio through the Bluetooth channel data.
  • the first electronic device only delivers audio data through the Wi-Fi channel.
  • the first electronic device stops transmitting audio data through the Bluetooth channel, and only delivers audio data through the Wi-Fi channel. That is to say, the sound projection method provided by the embodiment of the present application may not include the process shown in (b) of FIG. 6 .
  • the first electronic device delivers audio data through the Wi-Fi channel, and does not stop transmitting audio data through the Bluetooth channel. That is to say, the sound projection method provided by the embodiment of the present application may not include the process shown in (c) of FIG. 6 .
  • the audio data played by the second electronic device is switched.
  • the second electronic device stops playing the audio data received from the Bluetooth channel, and instead plays the audio data received from the Wi-Fi channel.
  • the establishment of the Bluetooth channel takes a short time, and after the Bluetooth channel is successfully established, sound is projected through the Bluetooth channel, which can make the sound projection delay smaller.
  • the high-quality audio will be resampled and the resampling rate is low during the process of delivering high-quality audio to the smart speaker through the Bluetooth channel, and some data will be lost, thereby reducing the audio quality, resulting in a lower audio effect played by the smart speaker. Difference.
  • the Wi-Fi channel After the Wi-Fi channel is established, it will stop projecting sound through the Bluetooth channel, and switch to projecting sound through the Wi-Fi channel.
  • the smart speaker plays the original audio or audio that is closer to the original audio, which can ensure better playback of the high-quality audio. Effect.
  • the establishment of the Bluetooth channel takes a short time to ensure low latency of audio delivery; in a short time before the Wi-Fi channel is successfully established, the smart speaker has a poor effect of playing audio; but soon Wi-Fi - The Fi channel is successfully established. After the smart speaker plays Wi-Fi audio, it can ensure a better playback effect of high-quality audio; taking into account both low-latency and high-quality audio, it provides users with a better sound projection playback experience.
  • FIGS. 7A-7C show a specific implementation of the sound projection method provided by the embodiment of the present application.
  • the mobile phone 100 includes a first Bluetooth module 710, a first Wi-Fi module 720, and the like.
  • the smart speaker 200 includes a second Bluetooth module 730, a second Wi-Fi module 740, a Bluetooth cache 760, a Wi-Fi cache 770, and the like.
  • An audio player 750 runs on the smart speaker 200 .
  • the mobile phone 100 and the smart speaker 200 can discover each other through NFC through "touch"; the second Bluetooth module 730 of the smart speaker 200 establishes a Bluetooth connection with the first Bluetooth module 710 of the mobile phone 100 and establishes a Bluetooth channel.
  • the second Wi-Fi module 740 of the smart speaker 200 establishes a Wi-Fi connection with the first Wi-Fi module 720 of the mobile phone 100 and establishes a Wi-Fi channel.
  • the mobile phone 100 transmits audio data to the smart speaker 200 through the Bluetooth channel, and the smart speaker 200 resamples the received audio data and saves it to the Bluetooth cache 760 .
  • the audio player 750 acquires audio data from the Bluetooth cache 760 for playback.
  • the Wi-Fi channel is quickly established successfully.
  • the mobile phone 100 transmits audio data to the smart speaker 200 through the Bluetooth channel and the Wi-Fi channel, respectively.
  • the smart speaker 200 resamples the audio data received from the Bluetooth channel (with a lower resampling rate), and saves the resampled audio data to the Bluetooth cache 760 .
  • the smart speaker 200 does not perform over-sampling on the audio data received from the Wi-Fi channel, or performs resampling but with a high resampling rate, and saves it to the Wi-Fi cache 770 .
  • the smart speaker 200 After the smart speaker 200 determines that a preset condition is met (for example, Wi-Fi audio for 40 milliseconds (ms) is stored in the Wi-Fi cache 770 ), it notifies the mobile phone 100 to stop transmitting audio data through the Bluetooth channel. As shown in FIG. 7C , the mobile phone 100 stops transmitting audio data through the Bluetooth channel, and the audio data is only transmitted through the Wi-Fi channel. The smart speaker 200 switches the played audio data from Bluetooth audio to Wi-Fi audio.
  • a preset condition for example, Wi-Fi audio for 40 milliseconds (ms) is stored in the Wi-Fi cache 770 .
  • the sound projection method provided by the embodiment of the present application will be described in detail by taking the first electronic device as a mobile phone and the second electronic device as a smart speaker as an example.
  • the sound projection method provided by the embodiment of the present application includes:
  • both cell phones and smart speakers support NFC.
  • the phone and the smart speaker touch, and the two discover each other through NFC.
  • the Bluetooth and Wi-Fi switches of the phone and smart speaker were turned on respectively before the phone and smart speaker touched each other.
  • the phone and the smart speaker touch each other, discover each other via NFC, and turn on their respective Bluetooth and Wi-Fi switches.
  • the user confirms whether to activate the one-touch sound projection.
  • the user touches the speaker 200 using the mobile phone 100 .
  • the one-touch sound projection connection window 902 pops up on the desktop 901 of the mobile phone 100, and the one-touch sound projection connection window 902 includes prompt information: "click to connect, Bluetooth and WLAN will be automatically turned on for sound projection", and the prompt information is used to prompt the user to confirm the operation. Tone.
  • the one-touch casting connection window 902 also includes a "Cancel" button 903 and a "Connect” button 904 .
  • the user can click the "Cancel” button 903 to confirm not to perform sound projection, and the user can also click the "Connect” button 904 to confirm the sound projection.
  • the mobile phone receives the user's confirmation of the voice casting operation, starts the one-touch voice casting, and executes the next steps. For example, in response to the user's click operation on the "connect” button 904, the mobile phone and the smart speaker activate one-touch sound projection.
  • the mobile phone starts the Wi-Fi hotspot.
  • the Wi-Fi module of the mobile phone turns on the wireless access point (access point, AP) mode, that is, starts the Wi-Fi hotspot.
  • the smart speaker can access the Wi-Fi hotspot of the mobile phone and establish a Wi-Fi connection with the mobile phone.
  • the establishment of a Wi-Fi connection between the smart speaker and the mobile phone is based on WLAN, and the smart speaker is connected to the network provided by the mobile phone.
  • the mobile phone sends Wi-Fi hotspot information and Bluetooth connection information to the smart speaker.
  • Wi-Fi hotspot information is used to establish a Wi-Fi connection between the smart speaker and the mobile phone.
  • the Wi-Fi hotspot information includes at least one of a service set identifier (SSID), a password, a channel identifier, an encryption method, and the like.
  • the Bluetooth connection information is used to establish a Bluetooth connection between the smart speaker and the mobile phone.
  • the Bluetooth connection information includes a media access control (media access control, MAC) address of the mobile phone, and the like.
  • the embodiment of the present application does not limit the execution order of S802 and S803.
  • the mobile phone starts the Wi-Fi hotspot first, and then sends the Wi-Fi hotspot information and Bluetooth connection information to the smart speaker respectively.
  • the mobile phone first sends the Bluetooth connection information to the smart speaker, then activates the Wi-Fi hotspot and sends the Wi-Fi hotspot information to the smart speaker.
  • the mobile phone first starts the Wi-Fi hotspot, then sends the Bluetooth connection information to the smart speaker, and then sends the Wi-Fi hotspot information to the smart speaker. This embodiment of the present application does not limit this.
  • the smart speaker establishes a Bluetooth channel with the mobile phone.
  • the smart speaker after receiving the Wi-Fi hotspot information and the Bluetooth connection information, saves the Wi-Fi hotspot information and the Bluetooth connection information in the NFC module of the smart speaker.
  • the smart speaker can read the saved Wi-Fi hotspot information and Bluetooth connection information from the NFC module.
  • the smart speaker sends a Bluetooth connection request to the mobile phone according to the Bluetooth connection information; the Bluetooth connection request is used to request the establishment of a Bluetooth connection.
  • the smart speaker obtains a MAC address according to the Bluetooth connection information, sends a Bluetooth connection request to the mobile phone corresponding to the MAC address, and requests to establish a Bluetooth connection with the mobile phone.
  • the smart speaker sends a Wi-Fi connection request to the mobile phone according to the Wi-Fi hotspot information; the Wi-Fi connection request is used to request the establishment of a Wi-Fi connection.
  • the Wi-Fi connection request includes at least one of an SSID, a password, a channel identifier, an encryption method, and the like.
  • the mobile phone After the mobile phone receives the Bluetooth connection request, it returns a Bluetooth connection response to the smart speaker.
  • the smart speaker receives a Bluetooth connection response, and the mobile phone and the smart speaker successfully establish a Bluetooth connection.
  • the Bluetooth connection is a Bluetooth low energy (BLE) connection.
  • the Bluetooth channels include a Bluetooth control channel and a Bluetooth data channel.
  • the Bluetooth control channel is used to transmit control signaling; the Bluetooth data channel is used to transmit Bluetooth data.
  • the mobile phone After the mobile phone receives the Wi-Fi connection request, it verifies the information such as the SSID, password, channel identifier, and encryption method in the Wi-Fi connection request. If the verification is passed, the mobile phone returns a Wi-Fi connection response to the smart speaker.
  • the smart speaker receives a Wi-Fi connection response, and the phone and the smart speaker successfully establish a Wi-Fi connection.
  • the Wi-Fi connection is a Wi-Fi peer-to-peer (P2P) connection.
  • the Wi-Fi connection is a wireless access point (access point, AP) plus station (station, STA) mode connection.
  • a Wi-Fi channel is a data transmission channel of KCP (Reliable Transport Layer Automatic Repeat Request Protocol) or a signaling transmission channel of Transmission Control Protocol (TCP) established based on network connection.
  • KCP Reliable Transport Layer Automatic Repeat Request Protocol
  • TCP Transmission Control Protocol
  • S804 and S805 are performed synchronously and independently of each other.
  • the establishment of a Bluetooth channel takes less time. For example, it takes about 1 second (s) from the time when the Bluetooth connection is started to be established to the successful establishment of the Bluetooth channel.
  • Wi-Fi In the process of establishing a Wi-Fi connection, it is necessary to perform Wi-Fi channel scanning, wireless network connection, dynamic host configuration protocol (DHCP) allocation of network protocol addresses, and the establishment of a Wi-Fi connection between the mobile phone and the smart speaker.
  • TCP connection channels, etc. lead to a long time. For example, it takes more than 3 seconds (s) from starting the Wi-Fi connection to the establishment of the Wi-Fi channel.
  • the mobile phone sends audio data to the smart speaker through the Bluetooth channel.
  • the Bluetooth transmission protocol is advanced audio coding (advanced audio coding, AAC) or LDAC or the like. Based on the Bluetooth transmission protocol, high-quality audio in formats such as Hi-Res or DSD will be resampled during Bluetooth transmission.
  • AAC advanced audio coding
  • the Bluetooth transmission protocol is AAC
  • the sampling rate of the Bluetooth audio received by the smart speaker is 44.1KHz
  • the bit depth is 16bit.
  • the Bluetooth transmission protocol is LDAC
  • the sampling rate of the Bluetooth audio received by the smart speaker is 96KHz
  • the bit depth is 24bit.
  • the mobile phone resamples the audio data (for example, using the AAC protocol for transmission, the sampling rate is 44.1KHz, and the bit depth is 16bit), A presentation time stamp (PTS) is added to the data header of each packet of audio data of the sampled audio data, and the PTS is used to indicate the playing time of the packet of audio data.
  • PTS presentation time stamp
  • the audio data of every 10 milliseconds (ms) is resampled as an audio data packet, and PTS is added to the data header of the audio data of the packet.
  • the smart speaker can play the audio data of the package at the time indicated by the PTS according to the PTS of the audio data package.
  • the mobile phone resamples the audio data as one data packet every 10ms of audio.
  • the mobile phone determines to send audio data through the Bluetooth channel, obtain the current system time T 1 (for example, the unit is accurate to milliseconds); package (T 1 +t) as the PTS of the first audio data packet (audio of 0ms to 10ms) to The header of the first audio packet.
  • t> 0; t (for example, in milliseconds) is a preset value, which is determined according to the delay in sending audio data from the mobile phone to the smart speaker.
  • the mobile phone packs (T 1 +t+(w-1)*10ms) as the PTS of the wth audio data packet into the data header of the wth audio data packet.
  • the smart speaker saves the received Bluetooth audio and plays the Bluetooth audio.
  • the smart speaker receives the Bluetooth audio, and plays the corresponding audio data packet at the time indicated by the PTS in each Bluetooth audio data packet.
  • the smart speaker supports audio data with a first sampling rate and a first depth.
  • the smart speaker receives the Bluetooth audio, parses the Bluetooth audio, and obtains each Bluetooth audio data packet.
  • the smart speaker also resamples the audio data received from the Bluetooth channel to PCM audio data with a sampling rate of 96KHz and a bit depth of 32bit; saves the Bluetooth audio data in PCM format.
  • the format in which the audio data is saved may be:
  • PcmInfo represents an audio data packet
  • index is the serial number of the audio data packet
  • pts is the value of the display timestamp PTS of the audio data packet
  • pcmData is used to store audio data
  • 7680 represents the length of the audio data stored in pcmData (ie Audio Packet Length)
  • the maximum value is 7680.
  • the length of the audio data packet is related to the first sampling rate and the first bit depth supported by the smart speaker.
  • the maximum value of 7680 corresponds to the resampling of the 10ms audio data packet at the first sampling rate (96KHz) and the first bit depth (32bit). Understandably, the first sampling rate and/or the first bit depth supported by the smart speaker is different, and the maximum length of the audio data packet is also different.
  • the mobile phone sends audio data to the smart speaker through the Wi-Fi channel.
  • the Wi-Fi channel establishment delay is long, but the audio data is transmitted through the Wi-Fi channel without resampling, which will not reduce the audio quality; or, although resampling is performed, the resampling rate is high, which has a greater impact on the audio quality. Small.
  • the mobile phone After the Wi-Fi channel is successfully established, the mobile phone also sends audio data to the smart speaker through the Wi-Fi channel. In this way, the audio data is sent to the smart speaker through the Wi-Fi channel and the Bluetooth channel respectively.
  • the Wi-Fi channel when the Wi-Fi channel is successfully established, the mobile phone has transmitted n audio data packets to the smart speaker through the Bluetooth channel, starting from the (n+1)th audio data packet, also through the Wi-Fi channel to send.
  • the mobile phone transmits audio data through the Wi-Fi channel
  • PTS is added to the data header of each packet of audio data.
  • the audio data of every 10ms is regarded as an audio data packet
  • PTS is added to the audio data header of the audio data of the packet.
  • the smart speaker can play the audio data of the package at the time indicated by the PTS according to the PTS of the audio data package.
  • the mobile phone determines to transmit audio data through the Wi-Fi channel, it obtains the current system time T 1 (for example, the unit is accurate to milliseconds); the audio data to be sent through the Wi-Fi channel is regarded as a data packet every 10ms of audio frequency.
  • the PTS added during the transmission through the Wi-Fi channel is the same as the PTS added during the transmission through the Bluetooth channel.
  • the smart speaker After the smart speaker receives audio data from the Wi-Fi channel, it saves the Wi-Fi audio data in the smart speaker.
  • the smart speaker supports audio data with a first sampling rate and a first depth. Taking the PCM format audio data with the first sampling rate of 96KHz and the first depth of 32bit supported by the smart speaker as an example, the smart speaker receives the Wi-Fi audio, parses the Wi-Fi audio, and obtains each Wi-Fi audio data packet. The smart speaker also resamples the audio data received from the Wi-Fi channel to PCM audio data with a sampling rate of 96KHz and a bit depth of 32bit; Wi-Fi audio is saved in PCM format.
  • the smart speaker resamples the audio data (Bluetooth audio or Wi-Fi audio) in a PCM format with a sampling rate of 96 KHz and a bit depth of 32 bits. Understandably, smart speakers can also resample audio data in other formats. For example, resampling at a higher sampling rate and bit depth to ensure high audio quality.
  • the smart speaker resamples the Wi-Fi audio and the Bluetooth audio respectively at the same sampling rate and the same bit depth; saves the Wi-Fi audio and the Bluetooth audio in the same format. It is convenient to switch the played audio from the Bluetooth audio to the Wi-Fi audio, according to the parameters in the PCM format audio data packet, to determine the corresponding relationship between the Bluetooth audio data packet and the Wi-Fi audio data packet.
  • the mobile phone stops transmitting audio data through the Bluetooth channel.
  • the smart speaker instructs the mobile phone to stop transmitting audio data through the Bluetooth channel.
  • the smart speaker sends a second message to the mobile phone, where the second message is used to notify the mobile phone to stop transmitting audio data through the Bluetooth channel.
  • the smart speaker determines that audio data is received from the Wi-Fi channel, and sends a second message to the mobile phone; and, for example, the smart speaker caches the Wi-Fi audio for a preset duration (for example, 40 milliseconds (ms)). to send a second message to the phone.
  • a preset duration for example, 40 milliseconds (ms)
  • the smart speaker notifies the mobile phone to stop transmitting audio data through the Bluetooth channel, or the mobile phone notifies the smart speaker to switch the playing audio from Bluetooth audio to Wi-Fi audio, which will cause a delay.
  • the smart speaker caches the preset of Wi-Fi audio. The duration is longer than the message interaction delay, which can ensure the smoothness of playing audio.
  • the mobile phone receives the second message and stops transmitting audio data through the Bluetooth channel.
  • the second message includes indication information, where the indication information is used to indicate the moment to stop transmitting audio data through the Bluetooth channel.
  • the mobile phone receives the second message, obtains the indication information, and stops transmitting audio data through the Bluetooth channel at the moment indicated by the indication information.
  • the mobile phone stops transmitting audio data through the Bluetooth channel according to the second message sent by the smart speaker, which can avoid stopping the transmission of audio data through the Bluetooth channel before switching the source of the played audio data to the audio received through the Wi-Fi channel. Playback freezes caused by transferring audio data.
  • the mobile phone determines that the Wi-Fi channel is successfully established, that is, starts to transmit audio data through the Wi-Fi channel, and stops transmitting audio data through the Bluetooth channel.
  • the smart speaker ensures the smoothness of audio switching, and the implementation on the mobile phone side is simple.
  • the smart speaker switches the played audio from Bluetooth audio to Wi-Fi audio.
  • the smart speaker determines to switch the played audio data to Wi-Fi audio.
  • the smart speaker determines that audio data is received from the Wi-Fi channel, and then determines to switch the played audio data to Wi-Fi audio.
  • the smart speaker determines to cache Wi-Fi audio for a preset duration (for example, 40 milliseconds (ms)), it determines to switch the played audio data to Wi-Fi audio.
  • the mobile phone determines that the smart speaker switches the played audio data to Wi-Fi audio.
  • the mobile phone determines that the Wi-Fi channel is successfully established, it is determined that the smart speaker switches the played audio data to Wi-Fi audio; for another example, the mobile phone receives an instruction message from the smart speaker to stop transmitting audio data through the Bluetooth channel. After (the second message), a first message is sent to the smart speaker to notify the smart speaker to switch the played audio data to Wi-Fi audio. The smart speaker receives the first message and determines to switch the played audio data to Wi-Fi audio.
  • the smart speaker switches the played audio data to Wi-Fi audio at the first moment.
  • the smart speaker determines to switch the played audio data to Wi-Fi audio (for example, when the first message is received; for another example, when it is determined that the Wi-Fi audio with a preset duration is cached)
  • obtain The currently playing Bluetooth audio data packet the PTS (first PTS) of the next Bluetooth audio data packet of the currently playing Bluetooth audio data packet is the first moment.
  • the smart speaker determines the corresponding first Wi-Fi audio data packet according to the first PTS value in the saved Wi-Fi audio data packet.
  • the smart speaker starts playing the first Wi-Fi audio data packet at the first moment, and stops playing the Bluetooth audio data packet.
  • the smart speaker resamples the received Bluetooth audio and Wi-Fi audio into audio data in the same format (such as PCM format), it is possible to determine the corresponding Wi-Fi audio according to the PTS value in the Bluetooth audio data packet.
  • Data packet guarantees seamless switching of played audio data.
  • the smart speaker receives the first message and determines to switch the played audio data to Wi-Fi audio.
  • the smart speaker obtains the currently playing Bluetooth audio data package.
  • the smart speaker searches the Bluetooth cache for the currently playing Bluetooth audio data package according to the current system time. For example, the current system time is 1619686174998 (in milliseconds), and the index of the Bluetooth audio data packet is determined to be 4 according to the PTS value of the Bluetooth audio data packet.
  • the smart speaker obtains the PTS value of the Bluetooth audio data packet whose index is 5 (the next packet of the current Bluetooth audio data packet) is 1619686175008 (1619686174998+10) (unit is millisecond).
  • the smart speaker traverses the saved Wi-Fi audio data packets, and determines that the Wi-Fi audio data packet corresponding to the PTS value of 1619686175008 is the index value of 3 (understandably, the index in the Bluetooth audio data packet and the Wi-Fi audio data packet is value is irrelevant) Wi-Fi audio data packet, that is, the first Wi-Fi audio data packet is obtained.
  • the smart speaker stops playing Bluetooth audio at 1619686175008 (in milliseconds), it starts playing Wi-Fi audio sequentially from the Wi-Fi audio data packet with an index value of 3.
  • the embodiment of the present application does not limit the sequence of execution of S809 and S810.
  • the mobile phone may not stop transmitting audio data through the Bluetooth channel, that is, S809 is not performed.
  • the first electronic device and the second electronic device discover each other through "touching", and start to establish a Bluetooth channel and a Wi-Fi channel.
  • the establishment of the Bluetooth channel takes less time. After the Bluetooth channel is successfully established, the first electronic device starts to project sound.
  • the first electronic device transmits audio data to the second electronic device based on the rapidly established Bluetooth channel, and the second electronic device plays the audio data received from the Bluetooth channel.
  • the establishment of the Wi-Fi channel takes longer than the establishment of the Bluetooth channel.
  • the first electronic device transmits audio data through the Wi-Fi channel and the Bluetooth channel in parallel and independently of each other. After that, the second electronic device switches the played audio data to Wi-Fi audio.
  • the Bluetooth channel Since the establishment of the Bluetooth channel takes a short time, after the Bluetooth channel is successfully established, the audio is projected through the Bluetooth channel (it is understandable that high-quality audio is resampled, and the audio quality will be reduced after resampling, and the playback effect will be poor). Sound delay is low. After a period of time (for example, 3 seconds), the establishment of the Wi-Fi channel is completed, and the second electronic device switches the played audio data to Wi-Fi audio to ensure a better playback effect of high-quality audio.
  • a period of time for example, 3 seconds
  • high-quality audio can be projected in a lossy (larger loss) manner in a short period of time, and after the Wi-Fi channel is established, the audio data to be played can be switched to lossless or low-loss high-quality audio ; Taking into account low latency and high-quality audio, to provide users with a better sound projection playback experience.
  • the embodiment of the present application uses audio delivery as an example for description. It is understandable that the method provided by the embodiments of the present application is not limited to sound projection; the method of the present application may also be applicable to the first electronic device transmitting other types or formats of data (such as video data, etc.) to the second electronic device. That is, this application does not limit the type or format of the delivery data. The delivery of other data is also within the scope of this application.
  • the above-mentioned first electronic device and the second electronic device include corresponding hardware structures and/or software modules for executing each function.
  • the embodiments of the present application can be implemented in hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of the present application.
  • each function module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
  • an embodiment of the present application discloses a first electronic device 1000 , and the first electronic device may be the mobile phone in the foregoing embodiment.
  • the first electronic device 1000 includes: a processing unit 1001 , a storage unit 1002 , a communication unit 1003 and a display unit 1004 .
  • the processing unit 1001 is configured to control and manage the actions of the first electronic device 1000 .
  • the storage unit 1002 is used for storing program codes and data of the first electronic device 1000 .
  • the communication unit 1003 is used to support the communication between the first electronic device 1000 and other electronic devices.
  • the display unit 1004 is used to display the interface of the first electronic device 1000 . For example, a window for prompting the user to confirm whether to perform one-touch sound projection is displayed.
  • the unit modules in the above-mentioned first electronic device 1000 include but are not limited to the above-mentioned processing unit 1001 , storage unit 1002 , communication unit 1003 and display unit 1004 .
  • the first electronic device 1000 may further include a power supply unit and the like.
  • the power supply unit is used to supply power to the first electronic device 1000 .
  • the processing unit 1001 may be a processor or a controller, for example, a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC) ), field programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof.
  • the storage unit 1002 may be a memory.
  • the communication unit 1003 may be a transceiver, a transceiver circuit, or the like.
  • the display unit 1004 may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode, or an active-matrix organic light-emitting diode (active-matrix organic). light emitting diode, AMOLED) and so on.
  • the processing unit 1001 may be a processor (such as the processor 110 shown in FIG. 4 ), the storage unit 1002 may be a memory (such as the internal memory 121 shown in FIG. 4 ), and the communication unit 1003 may be referred to as a communication interface, including wireless communication module (the wireless communication module 160 shown in FIG. 4 ), the display unit 1004 is a display screen (the display screen 140 shown in FIG. 4 , the display screen 140 may be a touch screen, and a display panel and a touch panel may be integrated in the touch screen ).
  • the first electronic device 1000 provided in this embodiment of the present application may be the first electronic device 100 shown in FIG. 4 .
  • the above-mentioned processor, memory, communication interface, display screen, etc. can be connected together, for example, through a bus connection.
  • processors memories, communication interfaces, etc. can be connected together, for example, connected by a bus.
  • an embodiment of the present application discloses a second electronic device 1100 , and the second electronic device 1100 may be the smart speaker in the foregoing embodiment.
  • the second electronic device 1100 includes: a processing unit 1101 , a storage unit 1102 , a communication unit 1103 and a playback unit 1104 .
  • the processing unit 1101 is the control center of the second electronic device, and controls and manages the actions of the second electronic device 1100 .
  • the storage unit 1102 is used for saving program codes and data of the second electronic device 1100 . For example, it can be used to save Bluetooth audio and Wi-Fi audio.
  • the communication unit 1103 is used to support the communication between the second electronic device 1100 and other electronic devices.
  • the playing unit 1104 is configured to play the data buffered in the second electronic device 1100 . For example, for playing Bluetooth audio or Wi-Fi audio.
  • the unit modules in the above-mentioned second electronic device 1100 include but are not limited to the above-mentioned processing unit 1101 , storage unit 1102 , communication unit 1103 and playback unit 1104 .
  • the second electronic device 1100 may further include a power supply unit and the like. The power supply unit is used to supply power to the second electronic device 1100 .
  • the processing unit 1101 may be a processor or a controller, for example, a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC) ), field programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof.
  • the storage unit 1102 may be a memory.
  • the communication unit 1103 may be a transceiver, a transceiver circuit, or the like.
  • the playback unit 1104 may be a speaker.
  • the processing unit 1101 is a processor (the processor 210 shown in FIG. 5 ), the storage unit 1102 may be a memory (the internal memory 221 shown in FIG. 5 ), and the communication unit 1103 may be referred to as a communication interface, including wireless communication module (the wireless communication module 260 shown in FIG. 5 ), and the playback unit 1104 is a speaker (the speaker 230A shown in FIG. 5 ).
  • the second electronic device 1100 provided in this embodiment of the present application may be the second electronic device 200 shown in FIG. 5 .
  • the above-mentioned processors, memories, communication interfaces, speakers, etc. can be connected together, for example, through a bus.
  • Embodiments of the present application further provide a computer-readable storage medium, where computer program codes are stored in the computer-readable storage medium.
  • the processor executes the computer program codes
  • the first electronic device executes the methods in the foregoing embodiments.
  • Embodiments of the present application further provide a computer-readable storage medium, where computer program codes are stored in the computer-readable storage medium, and when the processor executes the computer program codes, the second electronic device executes the methods in the foregoing embodiments.
  • Embodiments of the present application also provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the method in the above-mentioned embodiments.
  • the delivery device 1000, the second electronic device 1100, the computer-readable storage medium, and the computer program product provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved may be as follows: With reference to the beneficial effects in the corresponding methods provided above, details are not repeated here.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be Incorporation may either be integrated into another device, or some features may be omitted, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware, and can also be implemented in the form of software functional units.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, which are stored in a storage medium , including several instructions to make a device (may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a magnetic disk, or an optical disk and other mediums that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Telephone Function (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

La présente demande se rapporte au domaine des terminaux. Sont divulgués un procédé de projection audio, et un support de stockage lisible par ordinateur. Le procédé comprend les étapes suivantes : après qu'un premier dispositif électronique et qu'un second dispositif électronique se rapprochent et se découvrent, le premier dispositif électronique établissant un canal Bluetooth et un canal WiFi avec le second dispositif électronique, le temps consommé pour établir le canal Bluetooth étant relativement court, et après que le canal Bluetooth est établi avec succès, le premier dispositif électronique projette l'audio au moyen du canal Bluetooth, et le temps consommé pour établir le canal WiFi est relativement long, et après que le canal WiFi est établi avec succès, le premier dispositif électronique projette l'audio au moyen du canal WiFi ; et le second dispositif électronique effectuant une commutation des données audio lues vers l'audio reçu au moyen du canal WiFi. Avant qu'un canal WiFi soit établi avec succès, l'audio est projeté au moyen d'un canal Bluetooth, ce qui permet de garantir que l'audio est projeté avec un faible retard. Une fois que le canal WiFi est complètement établi, des données audio reçues du canal WiFi sont lues, ce qui permet de garantir la lecture de données audio de haute qualité ; et le faible retard et l'audio de haute qualité sont tous les deux pris en considération, ce qui permet d'offrir une meilleure projection audio et une meilleure expérience de lecture pour un utilisateur.
PCT/CN2022/084147 2021-04-30 2022-03-30 Procédé de projection audio, et support de stockage lisible par ordinateur WO2022228013A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110485895.2 2021-04-30
CN202110485895.2A CN115278612A (zh) 2021-04-30 2021-04-30 一种投音方法及计算机可读存储介质

Publications (1)

Publication Number Publication Date
WO2022228013A1 true WO2022228013A1 (fr) 2022-11-03

Family

ID=83746086

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/084147 WO2022228013A1 (fr) 2021-04-30 2022-03-30 Procédé de projection audio, et support de stockage lisible par ordinateur

Country Status (2)

Country Link
CN (1) CN115278612A (fr)
WO (1) WO2022228013A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110183614A1 (en) * 2010-01-25 2011-07-28 Kabushiki Kaisha Toshiba Communication terminal
CN103856806A (zh) * 2012-11-28 2014-06-11 腾讯科技（北京）有限公司 视频流切换方法、装置及系统
CN108471638A (zh) * 2018-02-08 2018-08-31 深圳魔耳智能声学科技有限公司 无线耳机控制方法、装置、控制装置及存储介质
US20190394638A1 (en) * 2018-06-21 2019-12-26 Canon Kabushiki Kaisha Communication apparatus communicating with external apparatus, control method for communication apparatus, and recording medium
CN111224693A (zh) * 2019-11-27 2020-06-02 展讯通信（上海）有限公司 用于无线耳机的音频数据传输方法及装置、存储介质、终端
CN111713141A (zh) * 2018-04-04 2020-09-25 华为技术有限公司 一种蓝牙播放方法及电子设备
CN112350981A (zh) * 2019-08-09 2021-02-09 华为技术有限公司 一种切换通信协议的方法、装置和系统

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110183614A1 (en) * 2010-01-25 2011-07-28 Kabushiki Kaisha Toshiba Communication terminal
CN103856806A (zh) * 2012-11-28 2014-06-11 腾讯科技（北京）有限公司 视频流切换方法、装置及系统
CN108471638A (zh) * 2018-02-08 2018-08-31 深圳魔耳智能声学科技有限公司 无线耳机控制方法、装置、控制装置及存储介质
CN111713141A (zh) * 2018-04-04 2020-09-25 华为技术有限公司 一种蓝牙播放方法及电子设备
US20190394638A1 (en) * 2018-06-21 2019-12-26 Canon Kabushiki Kaisha Communication apparatus communicating with external apparatus, control method for communication apparatus, and recording medium
CN112350981A (zh) * 2019-08-09 2021-02-09 华为技术有限公司 一种切换通信协议的方法、装置和系统
CN111224693A (zh) * 2019-11-27 2020-06-02 展讯通信（上海）有限公司 用于无线耳机的音频数据传输方法及装置、存储介质、终端

Also Published As

Publication number Publication date
CN115278612A (zh) 2022-11-01

Similar Documents

Publication Publication Date Title
WO2021004381A1 (fr) Procédé d'affichage de vidéocapture d'écran, et appareil électronique
WO2020098437A1 (fr) Procédé de lecture de données multimédia et dispositif électronique
WO2021013156A1 (fr) Procédé de commutation de bluetooth et dispositif bluetooth
EP3893109B1 (fr) Procédé et dispositif de connexion de dispositifs bluetooth
WO2021017934A1 (fr) Procédé de commande de dispositif et de terminal
WO2022100305A1 (fr) Procédé et appareil d'affichage d'image entre dispositifs, et dispositif électronique
WO2020133183A1 (fr) Dispositif et procédé de synchronisation de données audio
WO2020132839A1 (fr) Procédé et dispositif de transmission de données audio appliqués à une commutation de modes monaural et binaural d'un écouteur tws
WO2021082829A1 (fr) Procédé de connexion bluetooth et appareil associé
WO2021175214A1 (fr) Procédé de commande de connexion d'écran de projection et dispositif électronique
WO2022222754A1 (fr) Procédés de mise en veille et de réveil de liaison wifi, dispositif électronique, et système
WO2022001147A1 (fr) Procédé de positionnement et dispositif électronique
WO2021063189A1 (fr) Procédé et système pour la synchronisation des informations entre plusieurs dispositifs, et dispositif électronique
WO2021104114A1 (fr) Procédé de fourniture de service d'accès à un réseau wi-fi (wireless fidelity), et dispositif électronique
CN112398855A (zh) 应用内容跨设备流转方法与装置、电子设备
WO2022007944A1 (fr) Procédé de commande de dispositif et appareil associé
WO2020124371A1 (fr) Dispositif et procédé d'établissement de canaux de données
WO2022048371A1 (fr) Procédé de lecture audio multidispositif, terminal mobile, dispositif électronique et support de stockage
WO2022143508A1 (fr) Procédé de transmission de données dans un champ proche, dispositif et système
WO2022166618A1 (fr) Procédé de projection d'écran et dispositif électronique
CN114258003A (zh) 音频播放控制方法、系统、设备及存储介质
JP2024516668A (ja) デバイスネットワーキング方法、電子デバイス、及び記憶媒体
WO2022213689A1 (fr) Procédé et dispositif pour une communication vocale entre des dispositifs audio
CN117062256B (zh) 跨设备业务转移的方法、电子设备和系统
WO2019165983A1 (fr) Procédé de commande de transmission bluetooth, système de commande et support d'enregistrement

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22794486

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22794486

Country of ref document: EP

Kind code of ref document: A1