CN109243473B - Audio data communication method and head-mounted equipment - Google Patents

Audio data communication method and head-mounted equipment Download PDF

Info

Publication number
CN109243473B
CN109243473B CN201811261510.9A CN201811261510A CN109243473B CN 109243473 B CN109243473 B CN 109243473B CN 201811261510 A CN201811261510 A CN 201811261510A CN 109243473 B CN109243473 B CN 109243473B
Authority
CN
China
Prior art keywords
audio data
data
signal
channel
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811261510.9A
Other languages
Chinese (zh)
Other versions
CN109243473A (en
Inventor
徐斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zgmicro Nanjing Ltd
Original Assignee
Zgmicro Nanjing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zgmicro Nanjing Ltd filed Critical Zgmicro Nanjing Ltd
Priority to CN201811261510.9A priority Critical patent/CN109243473B/en
Publication of CN109243473A publication Critical patent/CN109243473A/en
Application granted granted Critical
Publication of CN109243473B publication Critical patent/CN109243473B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B11/00Transmission systems employing sonic, ultrasonic or infrasonic waves
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Headphones And Earphones (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The embodiment of the application provides an audio data communication method and a head-mounted device, wherein the method comprises the following steps: receiving and decoding audio data of two channels from an audio source device; recoding the decoded audio data of one sound channel, packaging the recoded audio data into a preset data format, modulating the recoded audio data, and sending the recoded audio data through ultrasonic waves; playing the audio of the other channel. By adopting the scheme provided by the embodiment of the application, the radio transmission of the left and right sound channel audio can be realized while the harm of radio frequency radiation to human health is reduced.

Description

Audio data communication method and head-mounted equipment
Technical Field
The present application relates to the field of audio communication technologies, and in particular, to an audio data communication method and a head-mounted device.
Background
The rapid development of radio frequency wireless communication technologies, such as bluetooth, has made wireless communication a part of people's lives. For example, a bluetooth music headset which takes HFP (Hands-free Profile) and A2DP (Advanced Audio Distribution Profile) as main applications and takes a smart phone as a center brings great convenience to people. The Bluetooth double-wireless stereo music earphone with the left and right sound channels connected through wireless is very popular.
However, the bluetooth rf signals connecting the left and right channels are blocked by the head, and a large transmission power is often required to obtain satisfactory transmission performance. And the large transmit power is harmful to the human brain.
Disclosure of Invention
The embodiment of the application provides an audio data communication method and head-mounted equipment, which are used for reducing harm of radio frequency radiation to human health and simultaneously realizing wireless transmission of left and right channel audio.
According to a first aspect of embodiments of the present application, there is provided an audio data communication method, including: receiving and decoding audio data of two channels from an audio source device; recoding the decoded audio data of one sound channel, packaging the recoded audio data into a preset data format, modulating the recoded audio data, and sending the recoded audio data through ultrasonic waves; audio data of another channel is played.
According to a second aspect of embodiments of the present application, there is provided an audio data communication method, including: receiving an audio signal of one channel transmitted in an ultrasonic manner; demodulating the audio signal, and extracting audio data of one channel from the demodulated audio signal according to a predetermined data format and decoding; and playing the decoded audio data of the one channel synchronously with another channel, wherein the another channel is the channel corresponding to the one channel.
According to a third aspect of embodiments herein, there is provided a head-mounted device comprising: a radio frequency transceiver for receiving audio data of two channels from an audio source device; the microprocessor is used for executing a communication protocol, decoding the audio data of the two sound channels and recoding the audio data of one sound channel; the ultrasonic baseband and the modem are used for recoding the decoded audio data of one sound channel, packaging the recoded audio data into a preset data format and modulating the recoded audio data; an ultrasonic transducer for transmitting a predetermined data format by ultrasonic waves; and the loudspeaker is used for playing the audio data of the other channel.
By adopting the audio data communication method and the head-mounted equipment provided by the embodiment of the application, after the master earphone receives and decodes the audio data of the two sound channels from the audio source equipment; recoding the decoded audio data of one sound channel, packaging the recoded audio data into a preset data format, modulating the recoded audio data, and sending the recoded audio data to a slave earphone through ultrasonic waves; thereby realizing the wireless connection of the left and right sound channels through ultrasonic waves. People confirm through long-time medical application that ultrasonic waves can easily penetrate through the brain and propagate between the left ear and the right ear, low power consumption is needed, and the ultrasonic waves hardly have negative effects on human bodies, so that radiation of radio frequency to the brain is greatly reduced.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 shows a schematic view of an implementation scenario according to a first embodiment of the present application;
fig. 2 shows a flow chart of an audio data communication method according to a first embodiment of the application;
fig. 3 is a schematic diagram illustrating a frame format of a data frame of ultrasonic communication according to a first embodiment of the present application;
FIG. 4 is a diagram illustrating a data frame timing diagram of an ultrasound communication according to a first embodiment of the present application;
fig. 5 is a schematic data structure diagram illustrating a packet header in a data frame of ultrasonic communication according to a first embodiment of the present application;
fig. 6 shows a flow chart of an audio data communication method according to a second embodiment of the present application;
fig. 7 shows a schematic structural diagram of a headset according to a third embodiment of the present application;
fig. 8 shows a schematic structural diagram of a head-mounted device according to a fourth embodiment of the present application;
fig. 9 shows a schematic structural diagram of an audio data communication system according to a fifth embodiment of the present application;
fig. 10 shows a schematic structural diagram of a master earphone and a slave earphone according to a sixth embodiment of the present application;
fig. 11 shows a schematic structure of an ultrasonic baseband and a modem using QPSK modulation;
FIG. 12 shows a mapping diagram of QPSK modulation in the ultrasonic baseband and modem architecture as shown in FIG. 11;
fig. 13 is a time domain waveform diagram of a root roll-off cosine filter used by the digital pulse shaping and digital filter in the ultrasonic baseband and modem architecture diagram of fig. 11.
Detailed Description
In the process of implementing the application, the inventor finds that the bluetooth double-wireless stereo music earphone with the left channel and the right channel connected in a wireless manner is more popular with people, and meanwhile, the bluetooth radio frequency signals connected with the left channel and the right channel are blocked by the head, so that the satisfactory transmission performance can be obtained by often needing large transmitting power.
Especially outdoors, because of the spaciousness of the surroundings, very large transmission power is required to obtain satisfactory transmission performance. However, the inventor has found that the 2.4GHz band of bluetooth is also a microwave oven band. It is known that 2.4GHz electromagnetic waves radiated from a microwave oven resonate with water molecules to heat food, and even dehydrate and carbonize protein. According to medical research, if the brain intensively absorbs electromagnetic radiation in a frequency band of 2.4GHz for a long time, the brain is slightly heated and becomes dizzy, and the DNA of individual cells can be dehydrated seriously to generate cancer or cerebroma.
Therefore, the inventor thinks that the way of connecting the left and right channels by bluetooth radio frequency signals in the prior art causes harm to human health.
In order to solve the above problem, an embodiment of the present application provides an audio data communication method and a head-mounted device, where after a master device receives and decodes audio data of two channels from an audio source device; recoding the decoded audio data of one sound channel, packaging the recoded audio data into a preset data format, modulating the recoded audio data, and sending the recoded audio data to slave equipment through ultrasonic waves; thus, the wireless connection of the left and right sound channels is realized through ultrasonic waves. People confirm through long-time medical application that ultrasonic waves can easily penetrate through the brain and propagate between the left ear and the right ear, low power consumption is needed, and the ultrasonic waves hardly have negative effects on human bodies, so that radiation of radio frequency to the brain is greatly reduced.
In short, the headset device in the embodiment of the present application may include a master earphone and a slave earphone, where the master earphone may establish a wireless connection with the audio source device through radio frequency wireless communication, and receive stereo audio data including a left channel and a right channel, for example, music data, and then re-encode one of the monaural music data and forward the encoded data to the slave earphone through ultrasonic wireless communication, thereby implementing a dual wireless stereo function.
In order to make the technical solutions and advantages of the embodiments of the present application more apparent, the following further detailed description of the exemplary embodiments of the present application with reference to the accompanying drawings makes it clear that the described embodiments are only a part of the embodiments of the present application, and are not exhaustive of all embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
In particular implementations, the master device and the slave device may be a headset device such as a headset. For illustrative purposes, in the embodiments of the present application, a detailed description will be made with a master earphone and a slave earphone. Those skilled in the art will appreciate that other head-mounted devices are within the scope of the embodiments of the present application.
Fig. 1 shows a schematic implementation scenario according to a first embodiment of the present application.
As shown in fig. 1, a communication system 10 according to a first embodiment of the present application includes: audio source device 100, master earpiece 200, slave earpiece 300. In specific implementation, the main earphone can be wirelessly connected with audio source equipment such as a smart phone or a tablet computer through radio frequency wireless communication, and receives stereo music wirelessly transmitted by the audio source equipment through radio frequency. After the stereo music is decoded by the master earphone, one path of the stereo music is stored in the local for playing, and the other path of the stereo music is recoded and then transmitted to the slave earphone through ultrasonic wireless communication.
In a specific implementation, the master earphone shown in fig. 1 may be a left channel earphone or a right channel earphone, and the slave earphone corresponds to the right channel earphone or the left channel earphone.
In particular implementations, the master and slave headsets may be different headsets each performing only respective functions. Namely, the master earphone only has the function of receiving the two-channel audio data from the audio source equipment, recoding one path of single-channel music data through ultrasonic wireless communication and forwarding the recoded single-channel music data to the slave earphone; and the slave earphone only has the functions of receiving ultrasonic waves from the master earphone and decoding and resynchronizing the playing.
In another embodiment, the master earphone and the slave earphone may be earphones having both functions of receiving and transmitting ultrasonic waves. The master earphone and the slave earphone respectively have the functions of receiving the two-channel audio data from the audio source equipment, recoding one path of single-channel music data through ultrasonic wireless communication and then forwarding the recoded single-channel music data to the other earphone, receiving ultrasonic waves from the other earphone, decoding and then synchronously playing. It should be understood that "master" and "slave" at this time are relative concepts, and the positions of the master earphone and the slave earphone can be interchanged in different scenarios. For example, in a certain scenario, the left earphone may be used as the master earphone and the right earphone as the slave earphone; in another scenario, the right earphone may be used as the master earphone, and the left earphone may be used as the slave earphone. It will be appreciated that when one of the two earphones is referred to as the "master earphone", the other is referred to as the "slave earphone" accordingly.
Specifically, the master earphone may be determined in various ways, for example, an earphone that is first connected to the audio source device may be used as the master earphone, and a later connected earphone may be used as the slave earphone; the master and slave earpieces may also be determined by user selection or setting on the audio source device, all without limitation.
Example one
Fig. 2 shows a flowchart of an audio data communication method performed by the master earphone side according to a first embodiment of the present application.
It should be understood that the primary earphone of the first embodiment of the present application is used as a transmitting end in communication.
As shown in fig. 2, the audio data communication method performed by the master earphone side according to the first embodiment of the present application includes:
s201, audio data of two channels are received and decoded from an audio source device.
In a specific implementation, the audio source device may be an audio source device such as a smartphone or a tablet computer. The two channels may be a left channel and a right channel.
And S202, recoding the decoded audio data of one channel, packaging the recoded audio data into a preset data format, modulating the recoded audio data, and sending the recoded audio data through ultrasonic waves.
In practical implementation, the predetermined data format may be a frame format as shown in fig. 3, where the frame format includes: a preamble unit, a synchronous word unit, a packet header, a data load unit and a cyclic redundancy CRC check unit. Specifically, the preamble unit carries fields for implementing automatic gain control, symbol and frequency synchronization; the synchronous word unit carries fields used for frame synchronization; the packet header is used for transmitting the sequence number of the data packet and the length of the data load; the data load unit carries audio coding data; the CRC check unit carries fields for implementing packet error detection.
In a specific implementation, the recoding of the decoded audio data of one channel into a predetermined data format and modulation, and the transmitting by ultrasonic waves may specifically include: re-encoding the decoded audio data of one channel; performing CRC on the data load and the packet header of the audio data; performing whitening on the CRC-checked signal; error correction coding is carried out on the whitened signal; inserting a preamble into the error correction coded signal; inserting a sync word into the error correction encoded signal; modulating the signal into which the preamble and the sync word are inserted; performing digital pulse shaping and oversampling on the modulated signal; modulating the digitally pulse shaped and oversampled signal on a digital carrier; converting the modulated signal into an analog signal through digital-to-analog conversion; performing power amplification on the analog signal; performing band-pass filtering on the power-amplified signal; the ultrasonic waves are converted into ultrasonic waves to be transmitted.
In specific implementation, the ultrasonic modulation method may adopt any one of the modulation methods in the prior art, such as amplitude modulation, phase modulation, frequency modulation, and OFDM.
In specific implementation, a data packet encapsulated into a predetermined data format may be sent by using ultrasonic waves in a fixed frame interval manner, where the length of the data packet is determined by the coding rate, the ultrasonic bandwidth, the modulation method, and the like, and only needs to be smaller than the fixed frame interval. Specifically, a data frame timing diagram of the ultrasonic communication may be as shown in fig. 4.
Specifically, the data structure of the packet header may include a sequence number (SEQN) field, a LENGTH of payload data (LENGTH) field, and a cyclic check field, as shown in fig. 5.
Specifically, the ultrasonic modulation mode of the ultrasonic baseband and the modem may adopt QPSK modulation, the audio may adopt Opus coding, the rate of coding the monaural audio data is 50kbps, the rate of coding the audio data in the 10ms frame interval is 500bits, the rate of coding the data adopting 1/2 error correction coding is 1000bits, and the modulation is 500 QPSK symbols. Specifically, the preamble unit may adopt the following sequence: 01 1001 1001 1001 1001 1001 10, modulated into 16 QPSK symbols. The sync word unit may take the following sequence: 10 10 11 00 11 11 00 00 00 11 10 10 10 10, modulated into 16 QPSK symbols. The packet Header contains a 4-bit sequence number (SESN N), a 12-bit payload data LENGTH (LENGTH) and a 16-bit cyclic Check (HEC: header Error Check), and the total of 32bits are modulated into 16 QPSK symbols. The CRC check unit is 24bits, the data after the 1/2 error correcting code is adopted is 48bits, and the data is modulated into 24 QPSK symbols. Thus, the packet in fig. 4 contains a total of 572 QPSK symbols.
In a specific implementation, the ultrasonic wave with the center frequency of 80kHz can be used for communication, the bandwidth is 100kHz, namely the effective bandwidth of the signal is from 30kHz to 130kHz, and the maximum transmission rate can reach 200kbps. At this time, the QPSK symbol rate is 100kHz, and the symbol length is 10us; thus, in the packet structure shown in fig. 3, the length of the preamble sequence, the sync word and the header are all 160us, the data payload is 5000us, the crc length is 240us, and the total packet length is 5720us.
In order to combat the random delay problem caused by the unreliable radio frequency wireless communication channel, in the implementation, before the transmission by the ultrasonic wave, the method may further include: a predetermined number of data frames are buffered.
That is, after buffering certain data, the master earphone transmits re-encoded monaural data to the slave earphone through ultrasonic waves. Specifically, the predetermined number may be 6 frames, 8 frames, 10 frames, or the like.
And S203, playing the audio data of the other channel.
In a specific implementation, in order to ensure that the left and right channels played by the master earphone and the slave earphone are synchronized, after the synchronization word unit of the first data frame is transmitted and delayed by a first predetermined time length, the audio of the other channel corresponding to the first data frame may be played.
That is, the master headphone starts playing audio data of another channel from the beginning after delaying for a predetermined length of time with respect to the time point at which the synchronization word unit transmitting the first data frame ends.
Specifically, the first predetermined time period may be determined according to a size of the buffered data from the earphone and an ultrasonic transmission delay. In practical implementation, the size of the data buffered by the slave earphone can also be preset, the transmission rate of the ultrasonic wave in the human body is 1500m/s, and the delay of the ultrasonic wave from the master earphone to the slave earphone is about 150us. For example, when the size of the data buffered from the headset is 6 frames, the duration of the 6 frame data frame is 60ms, and the first predetermined time length is 60ms +150us.
In a specific implementation, the one channel may be a left channel or a right channel; accordingly, the other channel is a right channel and a left channel. Specifically, when the main headphone is a right channel headphone, the one channel is a left channel, and the other channel is a right channel; when the main headphone is a left channel headphone, the one channel is a right channel and the other channel is a left channel. When the two earphones are not left or right, one sound channel can be randomly selected to be sent and the other sound channel can be played. It should be understood by those skilled in the art that the above embodiments are all within the scope of the present application.
By adopting the audio data communication method in the embodiment of the application, after the main earphone receives and decodes the audio data of the two sound channels from the audio source equipment; recoding the decoded audio data of one sound channel, packaging the recoded audio data into a preset data format, modulating the recoded audio data, and sending the recoded audio data to a slave earphone through ultrasonic waves; thereby realizing the wireless connection of the left and right sound channels through ultrasonic waves. People confirm through long-time medical application that ultrasonic waves can easily penetrate through the brain and propagate between the left ear and the right ear, low power consumption is needed, and the ultrasonic waves hardly have negative effects on human bodies, so that radiation of radio frequency to the brain is greatly reduced.
Example two
Fig. 6 shows a flowchart of an audio data communication method performed from the headphone side according to the second embodiment of the present application.
As shown in fig. 6, the audio data communication method performed from the headphone side according to the second embodiment of the present application includes:
s601 receives an audio signal of one channel transmitted by an ultrasonic method.
S602, demodulating the audio signal, and extracting and decoding audio data of one channel from the demodulated audio signal according to a predetermined data format.
It should be understood that the slave earphone in the second embodiment of the present application is used as a receiving end in communication. Therefore, the data format adopted by the earphone is consistent with the data format of the main earphone in the first embodiment, and the implementation of the predetermined data format can be referred to the relevant description in the first embodiment of the present application, and repeated details are not repeated.
In an implementation, demodulating the audio signal may specifically include: performing band-pass filtering on the electric signal converted by the ultrasonic wave; performing low noise amplification on the band pass filtered signal; converting the signal after low-noise amplification into a digital signal; demodulating the digital signal into a digital baseband signal; performing digital filtering and downsampling on the digital baseband signal; performing signal detection, automatic gain control, sampling and frequency synchronization on the signals output by the digital filtering and down-sampling module; performing synchronous word detection to obtain the initial position of data demodulation; performing deviation compensation on the signal output by the digital filtering and down-sampling module; performing demodulation according to the demodulated start position; performing error correction coding on the demodulated signal; performing de-whitening on the signal on which the error correction encoding is performed; performing a CRC check on the de-whitened signal, and outputting CRC-checked audio data.
S603, playing the decoded audio data of the one channel in synchronization with another channel, where the another channel is a channel corresponding to the one channel.
In an embodiment, to ensure that the left and right channels played by the master and slave earphones are synchronized, the slave earphone may play the audio of the one channel from the first data frame after decoding the sync word unit of the first data frame and delaying for a second predetermined time length, where the second predetermined time length is smaller than the first predetermined time length by a predetermined size, and the first predetermined time length is a delayed play time of the audio data of the other channel.
Specifically, the slave earphone may play the monaural audio from the beginning with the time point when the sync word of the data packet is received as shown in fig. 3 as the time reference and after delaying for a second predetermined time length, and with the time point when the sync word completely matches as the starting point.
Specifically, the second predetermined time period may be determined according to the size of the data buffered from the headset. In practical implementation, the size of the data buffered from the earphone may be preset. Specifically, the size of the data buffered from the headphone may be set in advance according to an empirical value of a time period required for the data packet to undergo decoding and audio post-processing.
For example, when the size of the data buffered from the headphone is 6 frames, the duration of the 6-frame data frame is 60ms, and the second predetermined time length is 60ms. That is, after receiving data from the earphone, the data starts to be played after buffering 6 frames.
In combination with the first predetermined time length that the master earphone delays before playing in the first embodiment of the present application, the second predetermined time length that the slave earphone delays = the first predetermined time length — the delay that the ultrasonic wave propagates from the master earphone to the slave earphone.
In practical implementation, the clock skew between the master earphone and the slave earphone can cause audio playing delay skew, and the accumulation of delay skew can cause synchronization loss.
In particular implementation, the clock frequency of the transmitting device transmitting the audio data of the one channel can be determined according to the synchronous word unit; upon determining that there is a clock deviation from the sending device, the playback clock is adjusted.
That is, when the information in the received sync word unit indicates that the slave earphone clock is faster than the master earphone clock, the audio playback clock is slowed down. Otherwise, the audio playing clock is adjusted fast. Therefore, the slave earphone can adjust the audio playing clock of the slave earphone by tracking the synchronization deviation information of the synchronous words so as to avoid the synchronization loss caused by the accumulation of the clock deviation between the master earphone and the slave earphone.
In specific implementation, if signal detection or synchronization fails from the earphone side, a Packet Loss Compensation (PLC) technology is started to compensate Packet Loss information; if the CRC detection fails, processing is performed according to the error data packet.
The audio data communication method in the embodiment of the application is adopted to receive the audio data of one sound channel sent in an ultrasonic mode; decoding the audio data of the one channel using a predetermined data format; and synchronously playing with the audio data of the other sound channel; thus, the wireless connection of the left and right sound channels is realized through ultrasonic waves. People confirm through long-time medical application that ultrasonic waves can easily penetrate through the brain and propagate between the left ear and the right ear, low power consumption is needed, and the ultrasonic waves hardly have negative effects on human bodies, so that radiation of radio frequency to the brain is greatly reduced.
Based on the same inventive concept, the embodiment of the present application further provides a head-mounted device, and as the principle of solving the problem of the head-mounted device is similar to the method provided in the first embodiment of the present application, reference may be made to the implementation of the method for implementing the head-mounted device, and repeated details are not described herein.
EXAMPLE III
Fig. 7 shows a schematic structural diagram of a headset according to a third embodiment of the present application.
As shown in fig. 7, the headset 700 according to the third embodiment of the present application includes at least: a radio frequency transceiver 701 for receiving audio data of two channels from an audio source device; a microprocessor 702, configured to execute a communication protocol, decode the audio data of the two channels, and re-encode one of the two channels of audio; an ultrasonic baseband and modem 703, configured to re-encode the decoded audio data of one channel, encapsulate the encoded audio data into a predetermined data format, and modulate the encoded audio data; an ultrasonic transducer 704 for transmitting the predetermined data format by ultrasonic waves; the speaker 705 is used for playing audio data of another channel.
In a specific implementation, the predetermined data format may be a frame format, where the frame format includes: a preamble unit, a synchronous word unit, a packet header, a data load unit and a cyclic redundancy CRC unit.
In a specific implementation, the ultrasonic transducer may be specifically configured to: the predetermined data format is transmitted by ultrasound in a fixed frame interval.
In one embodiment, the fixed frame interval may be 10ms, the preamble unit is 32bits, the sync word unit is 32bits, the header is 32bits, the data payload unit is 500bits, and the CRC check unit is 24 bits.
In specific implementation, the ultrasonic baseband and modem specifically includes: the CRC module is used for carrying out CRC on the audio data load and the packet header which are recoded by the microprocessor; a whitening module to perform whitening on the CRC-checked signal; error correction coding for error correction coding the whitened signal; a preamble insertion module for inserting a preamble into the error correction coded signal; a sync word insertion module for inserting a sync word into the error correction coded signal; the modulation module is used for modulating the signal into which the preamble and the synchronous word are inserted; a digital pulse shaping and oversampling module for performing digital pulse shaping and oversampling on the modulated signal; the digital carrier modulation module is used for modulating the signal subjected to digital pulse forming and oversampling on a digital carrier; the digital-to-analog conversion module is used for converting the modulated signal into an analog signal through digital-to-analog conversion; the power amplifier is used for performing power amplification on the analog signal; and the band-pass filter is used for performing band-pass filtering on the signal subjected to power amplification and outputting the signal to the ultrasonic transducer.
In specific implementation, the head-mounted device according to the third embodiment of the present application further includes: a memory for buffering a predetermined number of data frames.
In particular implementation, the speaker may be further configured to: after transmitting the synchronous word unit of the first data frame and delaying for a first preset time length, playing the audio of another sound channel corresponding to the first data frame.
With the head-mounted device in the embodiment of the present application, after audio data of two channels are received and decoded from an audio source device; recoding the decoded audio data of one sound channel, packaging the recoded audio data into a preset data format, modulating the recoded audio data, and sending the recoded audio data through ultrasonic waves; thereby realizing the wireless connection of the left and right sound channels through ultrasonic waves. After long-time medical application, people confirm that the ultrasonic waves can easily penetrate through the brain and are transmitted between the left ear and the right ear, low power consumption is needed, and the ultrasonic waves hardly have negative effects on a human body, so that radiation of radio frequency to the brain is greatly reduced.
Based on the same inventive concept, the embodiment of the present application further provides a head-mounted device, and as the principle of the head-mounted device for solving the problem is similar to the method provided in the second embodiment of the present application, the implementation of the head-mounted device may refer to the implementation of the method, and repeated details are not repeated.
Example four
Fig. 8 shows a schematic structural diagram of a headset according to a fourth embodiment of the present application.
As shown in fig. 8, a head-mounted device 800 according to the fourth embodiment of the present application includes: an ultrasonic transducer 801 for receiving audio data of one channel transmitted in an ultrasonic manner; an ultrasonic baseband and modem 802 for demodulating the audio signal; a microprocessor 803 for extracting audio data of one channel from the demodulated audio signal and decoding; a speaker 804 for playing the decoded audio data of the one channel in synchronization with another channel, wherein the another channel is a channel corresponding to the first channel.
In a specific implementation, the predetermined data format may be a frame format, and the frame format includes: a preamble unit, a synchronous word unit, a packet header, a data load unit and a cyclic redundancy CRC unit.
In an implementation, the ultrasonic baseband and modem may include: a band pass filter BPF for band pass filtering the electric signal converted by the ultrasonic transducer; a low noise amplifier for performing low noise amplification on the band-pass filtered signal; the analog-to-digital conversion module is used for converting the signal amplified by the low noise into a digital signal; the digital carrier demodulation module is used for demodulating the digital signal into a digital baseband signal; a digital filtering and downsampling module for performing digital filtering and downsampling on the digital baseband signal; the signal detection, automatic gain control and sampling and frequency synchronization module is used for performing signal detection, automatic gain control and sampling and frequency synchronization on the signal output by the digital filtering and downsampling module; the synchronous word detection module is used for executing synchronous word detection to obtain the initial position of data demodulation; the deviation compensation module is used for performing deviation compensation on the signal output by the digital filtering and down-sampling module; a demodulation module for performing demodulation according to the demodulated start position; an error correction coding module for performing error correction coding on the demodulated signal; a de-whitening module for performing de-whitening on the signal after error correction coding; and the CRC check module is used for performing CRC check on the de-whitened signal and outputting the audio data subjected to the CRC check.
In particular implementation, the speaker may be specifically configured to: after the ultrasonic baseband and the modem decode to the synchronous word unit of the first data frame and delay a second preset time length, the audio frequency of the sound channel is played from the first data frame; the second predetermined time length is smaller than the first predetermined time length by a predetermined size, and the first predetermined time length is a delayed playing time of the audio data of the other channel.
In specific implementation, the head-mounted device according to the fourth embodiment of the present application may further include: a microprocessor for determining a clock frequency of a transmitting device transmitting the audio data of the one channel based on the sync word unit; upon determining that there is a clock deviation from the sending device, the playback clock is adjusted.
The head-mounted equipment in the embodiment of the application is adopted to receive the audio data of one sound channel transmitted in an ultrasonic mode; decoding the audio data of the one channel using a predetermined data format; and synchronously playing with the audio data of the other sound channel; thereby realizing the wireless connection of the left and right sound channels through ultrasonic waves. After long-time medical application, people confirm that the ultrasonic waves can easily penetrate through the brain and are transmitted between the left ear and the right ear, low power consumption is needed, and the ultrasonic waves hardly have negative effects on a human body, so that radiation of radio frequency to the brain is greatly reduced.
Based on the same inventive concept, the embodiment of the present application further provides an audio data communication system, and as the principle of solving the problem of the system is similar to the methods provided in the first and second embodiments of the present application, the implementation of the system can refer to the implementation of the method, and repeated details are not repeated.
EXAMPLE five
Fig. 9 is a schematic structural diagram of an audio data communication system according to a fifth embodiment of the present application.
As shown in fig. 9, the audio data communication system 900 according to the fifth embodiment of the present application includes: a primary earphone 700; and a slave headset 800.
In specific implementation, reference may be made to implementation of the headset 700 in the third embodiment of the present application for implementation of the main headset 700, and repeated descriptions are omitted.
In specific implementation, reference may be made to implementation of the headset 800 in the fourth embodiment of the present application from implementation of the headset 800, and repeated descriptions are omitted.
By adopting the audio data communication system in the embodiment of the application, after the master earphone receives and decodes the audio data of the two sound channels from the audio source device; recoding the decoded audio data of one sound channel, packaging the recoded audio data into a preset data format, modulating the recoded audio data, and sending the recoded audio data to a slave earphone through ultrasonic waves; receiving audio data of one channel transmitted in an ultrasonic manner from the earphone; decoding the audio data of the one channel using a predetermined data format; and synchronously playing with the audio data in the main earphone; thereby realizing the wireless connection of the left and right sound channels through ultrasonic waves. People confirm through long-time medical application that ultrasonic waves can easily penetrate through the brain and propagate between the left ear and the right ear, low power consumption is needed, and the ultrasonic waves hardly have negative effects on human bodies, so that radiation of radio frequency to the brain is greatly reduced.
In order to make those skilled in the art better understand the present application, a specific implementation scenario will be taken as an example to describe the embodiments of the present application in detail.
EXAMPLE six
According to the sixth implementation scenario of the sixth embodiment of the present application, referring to the implementation scenario shown in fig. 1, the main earphone is wirelessly connected to an audio source device such as a smart phone or a tablet computer through radio frequency wireless communication, and receives stereo music wirelessly transmitted by the audio source device through radio frequency. After the stereo music is decoded by the master earphone, one path of the stereo music is stored in the local for playing, and the other path of the stereo music is recoded and then transmitted to the slave earphone through ultrasonic wireless communication.
In the embodiment of the present application, the master earphone and the slave earphone include identical functional modules, and the structural diagrams of the master earphone and the slave earphone are shown in fig. 10. Specifically, the master earphone and the slave earphone according to the sixth embodiment of the present application include an antenna 1001, a radio frequency transceiver 1002, a baseband processor 1003, a microprocessor and memory 1004, a speaker 1005, an ultrasonic baseband and modem 1006, and an ultrasonic transducer 1007.
The antenna is used for receiving and transmitting radio frequency signals, and the radio frequency transceiver is used for demodulating the radio frequency signals received from the antenna into digital baseband signals and sending the digital baseband signals to the baseband processor for further processing; or the digital baseband signal of the baseband processor is modulated into a radio frequency signal to be sent to the antenna. The microprocessor is used for executing radio frequency communication protocols and application programs, including coding and decoding of audio source data and the like. The memory is used for storing code or data. The speaker is used to change the decoded music data into sound to be played.
The ultrasonic baseband and the modem are used for processing the recoded audio data into data packets suitable for ultrasonic transmission, modulating the data packets on a carrier wave and then transmitting the data packets to the ultrasonic converter. Or, the carrier wave modulation signal is received from the ultrasonic transducer, demodulated into a baseband signal, and the audio data is extracted and sent to the microprocessor for decoding. The ultrasonic transducer is used to convert an electric signal into an ultrasonic signal or convert an ultrasonic signal into an analog electric signal.
In specific implementation, the master earphone receives the radio frequency wireless stereo music sent by the audio source device through the antenna, the radio frequency transceiver and the baseband processor in fig. 10, and plays one path of the stereo music decoded by the microprocessor through the speaker. The microprocessor recodes the other path of music data, and then the other path of music data is converted into ultrasonic waves through the ultrasonic baseband, the modem and the ultrasonic transducer and transmitted to the slave earphone.
The slave earphone can receive the monaural data wirelessly transmitted by the ultrasonic wave of the master earphone only through the ultrasonic wave baseband and the modem and the ultrasonic wave converter. And the mono music decoded by the microprocessor is played through the loudspeaker. The other modules are not working from the headset.
In the embodiment of the present application, the ultrasonic modulation mode of the ultrasonic baseband and the modem adopts QPSK modulation.
Fig. 11 shows a schematic structure of an ultrasonic baseband and a modem using QPSK modulation.
As shown in fig. 11, the audio data payload and the packet header re-encoded by the microprocessor are sequentially subjected to CRC check, whitening, error correction coding, QPSK modulation, digital pulse shaping and oversampling, then modulated on a digital carrier, then converted into an analog signal through digital-to-analog conversion, amplified by a power amplifier, and finally subjected to Band Pass Filtering (BPF). The signals after band-pass filtering are sent to an ultrasonic transducer to be changed into ultrasonic waves for transmission. During receiving, the ultrasonic transducer converts the ultrasonic signal into an electric signal, and then the electric signal is filtered by a band-pass filter (BPF), amplified by a low-noise amplifier, converted into a digital signal by an analog-to-digital converter and demodulated into a digital baseband signal by a digital carrier demodulator. Then, it is digitally filtered and downsampled. After signal detection, automatic gain control and sampling and frequency synchronization, the initial position of data demodulation is obtained through synchronous word detection. Then, offset compensation, QPSK demodulation, error correction decoding, de-whitening and CRC check are sequentially performed. And finally, sending the data subjected to CRC to a microprocessor for audio decoding. Wherein, the deviation compensation refers to the compensation of frequency deviation and sampling deviation. The frequency deviation is obtained by frequency synchronization and frequency deviation tracking, and the sampling deviation is obtained by sampling deviation tracking.
Fig. 12 shows a mapping diagram of QPSK modulation in the ultrasonic baseband and modem structure diagram shown in fig. 11.
Fig. 13 is a time domain waveform diagram of a root-roll-off cosine filter (square-root-raised cosine filter) used for the digital pulse shaping and digital filter in the structure diagram of the ultrasonic baseband and modem shown in fig. 11. As shown in fig. 13, the oversampling rate is 32, i.e., the sampling rate is 3.2MHz. The sampling rate for both digital to analog conversion and analog to digital conversion is 3.2MHz.
By adopting the audio data communication system in the embodiment of the application, after the master earphone receives and decodes the audio data of the two sound channels from the audio source device; recoding the decoded audio data of one sound channel, packaging the recoded audio data into a preset data format, modulating the recoded audio data, and sending the recoded audio data to a slave earphone through ultrasonic waves; receiving audio data of one channel transmitted in an ultrasonic manner from the earphone; decoding the audio data of the one channel using a predetermined data format; and synchronously playing with the audio data in the main earphone; thereby realizing the wireless connection of the left and right sound channels through ultrasonic waves. After long-time medical application, people confirm that the ultrasonic waves can easily penetrate through the brain and are transmitted between the left ear and the right ear, low power consumption is needed, and the ultrasonic waves hardly have negative effects on a human body, so that radiation of radio frequency to the brain is greatly reduced.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims (11)

1. An audio data communication method, comprising:
the master earpiece receives and decodes audio data of the two channels from the audio source device;
the master earphone recodes the decoded audio data of one sound channel and packages the recoded audio data into a preset data format, modulates the recoded audio data and sends the recoded audio data to the slave earphone through ultrasonic waves; wherein the predetermined data format is a frame format, and the frame format comprises a synchronization word unit;
the master earphone starts to play audio data of another sound channel from the beginning after delaying for a first preset time length by taking the time point of the end of the synchronous word unit for sending the first data frame as a reference; wherein the first predetermined time length is determined according to the size of the buffered data from the earphone and the transmission delay of the ultrasonic wave in the human body.
2. The method of claim 1, wherein the frame format further comprises: a preamble unit, a packet header, a data load unit and a cyclic redundancy CRC check unit.
3. The method according to claim 2, characterized in that the transmission by ultrasound comprises in particular:
the transmission is by ultrasound with a fixed frame interval.
4. The method of claim 3, wherein the step of re-encoding the decoded audio data of one channel into a predetermined data format, modulating the encoded audio data and transmitting the encoded audio data via ultrasonic waves comprises:
re-encoding the decoded audio data of one channel;
performing CRC on the data load and the packet header of the audio data;
performing whitening on the CRC-checked signal;
error correction coding is carried out on the whitened signal;
inserting a preamble into the error correction coded signal;
inserting a sync word into the error correction encoded signal;
modulating the signal into which the preamble and the sync word are inserted;
performing digital pulse shaping and oversampling on the modulated signal;
modulating the digitally pulse shaped and oversampled signal on a digital carrier;
converting the modulated signal into an analog signal through digital-to-analog conversion;
performing power amplification on the analog signal;
performing band-pass filtering on the power-amplified signal;
the conversion is ultrasonic transmission.
5. The method of claim 4, further comprising, prior to transmitting by ultrasound:
a predetermined number of data frames are buffered.
6. An audio data communication method, comprising:
receiving an audio signal of one sound channel transmitted by the main earphone in an ultrasonic mode from the earphone;
the slave earphone demodulates the audio signal, extracts and decodes audio data of one channel from the demodulated audio signal according to a predetermined data format,
the slave headphone plays the decoded audio data of the one channel in synchronization with another channel, wherein the another channel is a channel corresponding to the one channel;
wherein the slave headphone playing the decoded audio data of the one channel in synchronization with the other channel includes: after the slave earphone decodes the synchronous word unit of the first data frame and delays for a second preset time length, the slave earphone starts to play the audio of the channel from the first data frame; wherein the second predetermined time length is determined according to the size of the buffered data from the earphone, the second predetermined time length is equal to a first predetermined time length minus a transmission delay of the ultrasonic wave in the human body, and the first predetermined time length is a delay playing time of the audio data of the other channel.
7. The method of claim 6, wherein the predetermined data format is a frame format, the frame format comprising: a preamble unit, a synchronous word unit, a packet header, a data load unit and a cyclic redundancy CRC check unit.
8. The method of claim 7, wherein demodulating the audio signal comprises:
performing band-pass filtering on the electric signal converted by the ultrasonic wave;
performing low noise amplification on the band pass filtered signal;
converting the signal after low-noise amplification into a digital signal;
demodulating the digital signal into a digital baseband signal;
digitally filtering and downsampling the digital baseband signal;
performing signal detection, automatic gain control, sampling and frequency synchronization on the signals output by the digital filtering and down-sampling module; performing synchronous word detection to obtain the initial position of data demodulation; performing deviation compensation on the signal output by the digital filtering and down-sampling module;
performing demodulation according to the demodulated start position;
performing error correction coding on the demodulated signal;
performing de-whitening on the signal on which the error correction encoding is performed;
performing a CRC check on the de-whitened signal, and outputting CRC-checked audio data.
9. The method of claim 8, wherein playing the decoded audio data of the one channel in synchronization with the other channel comprises:
after the synchronous word unit of the first data frame is decoded and a second preset time length is delayed, the audio of the one sound channel is played from the first data frame; the second predetermined time length is smaller than a first predetermined time length by a predetermined size, and the first predetermined time length is a delayed playing time of the audio data of the other channel.
10. The method of claim 9, further comprising:
determining a clock frequency of a transmitting device transmitting the audio data of the one channel according to the synchronous word unit;
adjusting a playback clock upon determining that a clock offset exists from the sending device.
11. A headset, wherein the headset is a primary earpiece of a pair of earpieces, the headset comprising:
a radio frequency transceiver for receiving audio data of two channels from an audio source device;
the microprocessor is used for executing a communication protocol, decoding the audio data of the two sound channels and recoding one channel of audio;
the ultrasonic baseband and modem is used for recoding the decoded audio data of one sound channel, packaging the recoded audio data into a preset data format and modulating the recoded audio data; wherein the predetermined data format is a frame format, and the frame format includes a synchronization word unit;
an ultrasonic transducer for transmitting the predetermined data format to a slave earphone of the pair of earphones by ultrasonic waves;
a speaker for starting to play audio data of another channel from the beginning after delaying a first predetermined time length with reference to a time point at which a sync word unit for transmitting a first data frame ends; wherein the first predetermined time length is determined according to the size of the buffered data from the earphone and the transmission delay of the ultrasonic wave in the human body.
CN201811261510.9A 2018-10-26 2018-10-26 Audio data communication method and head-mounted equipment Active CN109243473B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811261510.9A CN109243473B (en) 2018-10-26 2018-10-26 Audio data communication method and head-mounted equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811261510.9A CN109243473B (en) 2018-10-26 2018-10-26 Audio data communication method and head-mounted equipment

Publications (2)

Publication Number Publication Date
CN109243473A CN109243473A (en) 2019-01-18
CN109243473B true CN109243473B (en) 2022-10-21

Family

ID=65078744

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811261510.9A Active CN109243473B (en) 2018-10-26 2018-10-26 Audio data communication method and head-mounted equipment

Country Status (1)

Country Link
CN (1) CN109243473B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112218197B (en) * 2019-07-12 2023-03-21 达发科技股份有限公司 Audio compensation method and wireless audio output device using same
CN113015057A (en) * 2021-03-16 2021-06-22 歌尔科技有限公司 Earphone and earphone system
WO2022241791A1 (en) * 2021-05-21 2022-11-24 华为技术有限公司 Short-range wireless communication method and related device

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8854985B2 (en) * 2010-12-31 2014-10-07 Yossef TSFATY System and method for using ultrasonic communication
CN106209130B (en) * 2016-07-26 2019-01-04 维沃移动通信有限公司 A kind of wireless headset and the method using wireless headset output audio data
CN107205192B (en) * 2017-07-28 2019-10-11 广州黑格智能科技有限公司 A kind of audio frequency playing method of ears wireless headset and ears wireless headset
CN207070285U (en) * 2017-08-28 2018-03-02 深圳传音通讯有限公司 Wireless headset and its control system based on ultrasonic wave
CN108540144A (en) * 2018-03-08 2018-09-14 恒玄科技(上海)有限公司 The one drag two bluetooth headset that a kind of high-quality, low-power consumption play

Also Published As

Publication number Publication date
CN109243473A (en) 2019-01-18

Similar Documents

Publication Publication Date Title
JP5762950B2 (en) Signal synchronization for multiple data syncs
CN109243473B (en) Audio data communication method and head-mounted equipment
CN109412624B (en) Audio data communication system and head-mounted equipment
US9813815B2 (en) Method of wireless transmission of digital audio
EP3343782B1 (en) A wireless communication device for communicating with multiple external devices via a wireless communicaiton unit
CN107333339A (en) Audio data transmission method and double wireless headsets between a kind of pair of wireless headset
US20230344535A1 (en) Robust broadcast via relayed retransmission
EP2947803B1 (en) A new method of wireless transmission of digital audio
US20230224078A1 (en) Robust retransmission topologies using error correction
JP4933311B2 (en) Transmitting apparatus for transmitting streaming data input from external device by OFDM modulation and control method thereof
US10455312B1 (en) Acoustic transducer as a near-field magnetic induction coil
KR20150130894A (en) Method and apparatus for communicating audio data
US10778479B1 (en) Systems and methods for wireless transmission of audio information
CN104956601A (en) A transceiver for a hearing aid and a method for operating such as transceiver
JP3865287B2 (en) Judgment feedback type equalization method and transmitter / receiver
US11503416B2 (en) Low-latency communication protocol for binaural applications
CN217883813U (en) Bluetooth earphone system
CN114079895B (en) Audio packet loss data receiving circuit, method, audio playing device and system
JP2008153736A (en) Stereo wireless headphone system and stereo wireless headphone
JP6570823B2 (en) Data transfer system, and wireless microphone and receiver constituting the system
WO2011046297A3 (en) Sound transmitting and receiving apparatus and transmitting and receiving method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant