CN111031437B - Wireless earphone assembly and communication method thereof - Google Patents

Wireless earphone assembly and communication method thereof Download PDF

Info

Publication number
CN111031437B
CN111031437B CN201911371559.4A CN201911371559A CN111031437B CN 111031437 B CN111031437 B CN 111031437B CN 201911371559 A CN201911371559 A CN 201911371559A CN 111031437 B CN111031437 B CN 111031437B
Authority
CN
China
Prior art keywords
earphone
audio data
headset
equipment
nack
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911371559.4A
Other languages
Chinese (zh)
Other versions
CN111031437A (en
Inventor
童伟峰
张亮
罗飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Heng Xuan Technology Beijing Co ltd
Original Assignee
Heng Xuan Technology Beijing Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Heng Xuan Technology Beijing Co ltd filed Critical Heng Xuan Technology Beijing Co ltd
Priority to CN201911371559.4A priority Critical patent/CN111031437B/en
Publication of CN111031437A publication Critical patent/CN111031437A/en
Application granted granted Critical
Publication of CN111031437B publication Critical patent/CN111031437B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1091Details not provided for in groups H04R1/1008 - H04R1/1083
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L5/00Arrangements affording multiple use of the transmission path
    • H04L5/003Arrangements for allocating sub-channels of the transmission path
    • H04L5/0053Allocation of signaling, i.e. of overhead other than pilot signals
    • H04L5/0055Physical resource allocation for ACK/NACK
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

The present disclosure relates to a wireless headset assembly and a communication method thereof, including a first headset and a second headset capable of wireless communication with each other, the first headset transmitting an indication packet to the second headset, the indication packet indicating a reception condition of audio data transmitted from another device by the first headset; the second earphone receives the indication packet sent by the first earphone and transmits ACK/NACK to the other equipment according to the indication packet and the receiving condition of the second earphone on the audio data; wherein when at least one of the first and second headsets does not correctly receive the audio data, the second headset sends a NACK to the other device instructing the other device to retransmit the audio data; when at least one of the first earphone and the second earphone correctly receives the audio data after the other equipment retransmits the audio data for M times, the second earphone sends ACK to the other equipment to indicate the other equipment not to retransmit the audio data any more; otherwise, the second earphone sends NACK to the other equipment to instruct the other equipment to continue retransmitting; wherein M is not less than 1 and is a natural number. The invention can realize low time delay.

Description

Wireless earphone assembly and communication method thereof
Technical Field
The present disclosure relates to a headset and a communication method thereof, and more particularly, to a wireless headset assembly and a communication method thereof.
Background
With the social progress and the improvement of the living standard of people, the earphone becomes an indispensable living article for people. Traditional wired earphones are connected with intelligent equipment (such as a smart phone, a notebook computer, a tablet computer and the like) through wires, so that the actions of a wearer can be limited, and the traditional wired earphones are very inconvenient in sports occasions. Meanwhile, the winding and pulling of the earphone cord, as well as the stethoscope effect, all affect the user experience. The common Bluetooth headset cancels the connection between the headset and the intelligent device, but the connection still exists between the left ear and the right ear. True wireless stereo headphones are produced at the same time.
However, the current true wireless bluetooth headset cannot easily realize low-latency playing.
Disclosure of Invention
The embodiment of the disclosure provides a wireless headset assembly and a communication method thereof, which are used for solving the problem that a true wireless Bluetooth headset in the prior art is not easy to realize low delay.
According to a first aspect of the present disclosure, there is provided a wireless headset assembly including a first headset and a second headset capable of wireless communication with each other, the first headset transmitting an indication packet to the second headset, the indication packet indicating a reception condition of audio data transmitted from another device by the first headset; the second earphone receives the indication packet sent by the first earphone and transmits ACK/NACK to the other equipment according to the indication packet and the receiving condition of the second earphone on the audio data; wherein when at least one of the first and second headsets does not correctly receive the audio data, the second headset sends a NACK to the other device instructing the other device to retransmit the audio data; when at least one of the first earphone and the second earphone correctly receives the audio data after the other equipment retransmits the audio data for M times, the second earphone sends ACK to the other equipment to indicate the other equipment not to retransmit the audio data any more; otherwise, the second earphone sends NACK to the other equipment to instruct the other equipment to continue retransmitting; wherein M is not less than 1 and is a natural number.
According to a second aspect of the present disclosure, there is provided a wireless headset assembly including a first headset and a second headset connected wirelessly, wherein when a received signal strength indicator value of a wireless signal transmitted by another device received by one of the first headset and the second headset is greater than a set first threshold, and when the received signal strength indicator value of the wireless signal transmitted by the other headset received by the one of the first headset and the second headset is less than a set second threshold or the wireless signal of the other headset is not received within a predetermined time, the one of the first headset and the second headset transmits ACK/NACK to the other device according to a reception condition of the wireless signal by the one of the first headset and the second headset.
According to a third aspect of the present disclosure, there is provided a communication method of a wireless headset assembly including a first headset and a second headset capable of wireless communication with each other, the method comprising: the first earphone sends an indication packet to the second earphone, wherein the indication packet is used for indicating the receiving condition of the first earphone on the audio data sent by another equipment; the second earphone receives the indication packet sent by the first earphone and transmits ACK/NACK to the other equipment according to the indication packet and the receiving condition of the second earphone on the audio data; wherein when at least one of the first and second headsets does not correctly receive the audio data, the second headset sends a NACK to the other device instructing the other device to retransmit the audio data; when at least one of the first earphone and the second earphone correctly receives the audio data after the other equipment retransmits the audio data for M times, the second earphone sends ACK to the other equipment to indicate the other equipment not to retransmit the audio data any more; otherwise, the second earphone sends NACK to the other equipment to instruct the other equipment to continue retransmitting; wherein M is not less than 1 and is a natural number.
The wireless earphone component and the communication method thereof disclosed by the embodiment of the invention can realize that two earphones can simultaneously receive audio from another device on the premise that the other device only senses one earphone, thereby reducing time delay and realizing synchronous playing of the earphones; and when one of the two earphones can not be used continuously due to various reasons, the normal use of the other earphone can not be interfered, so that the other earphone does not interrupt the audio reception and is not blocked, and the low delay is realized.
Drawings
In the drawings, which are not necessarily drawn to scale, like reference numerals may describe similar components in different views. Like reference numerals having letter suffixes or different letter suffixes may represent different instances of similar components. The drawings illustrate various embodiments generally by way of example and not by way of limitation, and together with the description and claims serve to explain the disclosed embodiments. The same reference numbers will be used throughout the drawings to refer to the same or like parts, where appropriate. Such embodiments are illustrative, and are not intended to be exhaustive or exclusive embodiments of the present apparatus or method.
Fig. 1 shows a schematic diagram of the communication connections between the various headsets of a wireless headset assembly and with another device according to an embodiment of the disclosure;
fig. 2 is a schematic flow chart illustrating communication transmission between a wireless headset assembly and another device according to an embodiment of the present invention;
fig. 3 illustrates a timing diagram for data communication by a wireless headset assembly according to an embodiment of the disclosure;
fig. 4(a) shows a schematic structural diagram of a bluetooth physical frame according to an embodiment of the present disclosure;
fig. 4(b) shows a schematic structural diagram of a bluetooth physical frame according to another embodiment of the present disclosure;
fig. 5 shows a diagram of a synchronization mechanism of individual headsets with another device in a headset assembly according to an embodiment of the disclosure;
fig. 6 shows a flowchart of a method of determining a bluetooth clock count value (hereinafter also referred to as bluetooth clock count value 1) at the moment of receiving the audio data information for each headset according to an embodiment of the present disclosure;
fig. 7 shows a schematic diagram of a synchronized playback system in which each of the headphones in the headphone assembly play back received audio data information in synchronization, in accordance with an embodiment of the disclosure;
FIG. 8 shows a flow chart for each of the headset assemblies to play the received audio data information synchronously;
fig. 9 shows a flow diagram of sample rate conversion by the resampling module according to an embodiment of the disclosure.
Detailed Description
For a better understanding of the technical aspects of the present disclosure, reference is made to the following detailed description taken in conjunction with the accompanying drawings. Embodiments of the present disclosure are described in further detail below with reference to the figures and the detailed description, but the present disclosure is not limited thereto. The order in which the various steps described herein are described as examples should not be construed as a limitation if there is no requirement for a context relationship between each other, and one skilled in the art would know that sequential adjustments may be made without destroying the logical relationship between each other, rendering the overall process impractical.
Fig. 1 shows a schematic diagram of communication connections between the respective headsets of a wireless headset assembly and with another device according to an embodiment of the disclosure. As shown in fig. 1, a communication system 100 established by a wireless headset assembly with another device comprises the other device 101, a first headset 102 and a second headset 103. Wherein the other device 101 may be various portable smart terminals including, but not limited to, a cell phone, a tablet, a wearable smart device, and the like. The first headset 102 establishes a first communication connection 104 with the further device 101, the first headset 102 also establishing a second communication connection 106 with the second headset 103. The first headset 102 is able to transmit the relevant communication parameters to the second headset 103, so that the second headset 103 listens to the first communication connection with the relevant communication parameters; the relevant communication parameters may be transmitted directly to the second earpiece 103 or via a relay device, which may be any one or a combination of a charging box, another device 101, a wired circuit, etc. to the second earpiece 103. In some embodiments, the relevant communication parameters include, but are not limited to, a communication connection address of the other device 101, encryption parameter information of the communication connection, etc., such that the second earpiece 103 need not perform pairing and establishment of the communication connection, but may masquerade as the first earpiece 102 to listen and receive signals transmitted by the other device 101 via the first communication connection 104. The communication connection includes but is not limited to bluetooth, WIFI, radio frequency, wired transmission, etc. By listening to the first communication connection 104 by the second earpiece 103 without repeating the establishment of the first communication connection 104 and without forwarding all audio data received by the first earpiece 102 from the other device 101 to the second earpiece 103, the information transmission between the other device 101 and the two earpieces 102 and 103 can be realized more efficiently, and the time difference of the information received by the first earpiece 102 and the second earpiece 103 can be reduced, thereby improving the latency and the synchronization thereof.
After the communication connection is established, the other device 101 may transmit audio data to the first headset 102, and the second headset 103 may also receive the audio data transmitted by the other device 101 based on the listening state, and in response to a receiving condition of the audio data transmitted by the other device 101 by the first headset 102 and the second headset 103, the second headset 103 may transmit a transmission response packet, which may be ACK/NACK information, to the other device 101.
In some embodiments, the successful reception or not of audio data may be determined by the first earpiece 102 transmitting information related to audio data received from the further device 101 to the second earpiece 103 via the second communication connection 106. The information related to the audio data may include an indication packet, which indicates the receiving condition of the first earphone 102 for the audio data in a direct or indirect manner.
First, the indication packet may include indication information indicating that the first headset 102 has successfully received or has not successfully received the audio data from the other device 101, and the second headset 103 transmits ACK/NACK information to the other device 101 based on the indication information and its own reception status of the audio data after receiving the indication packet.
Second, the indication packet may include an error correction code packet (also referred to as an ECC packet) containing an error correction code obtained by encoding the audio data received by the first headphone 102 but not the audio data; only in case of successfully receiving the audio data, the first earphone 102 encodes the audio data, so that the first earphone 102 sends an ECC packet to the second earphone 103, which itself indicates that the audio data was successfully received, and at this time, when the second earphone 103 receives the ECC packet transmitted by the first earphone 102, it sends ACK/NACK information to the other device 101 in combination with its own receiving status of the audio data. By transmitting the ECC packet instead of the audio data, the amount of data transmission between the two headphones can be significantly reduced, thereby further increasing the reliability of data transmission.
In the second situation of the embodiment of the present invention, if the second earphone 103 receives the ECC packet sent by the first earphone 102, it may be considered that only the signal that the first earphone 102 correctly receives the audio data is received, but the second earphone 103 does not perform any processing (for example, encoding and decoding, etc.) on the ECC packet, but sends ACK/NACK to the other equipment 101 according to the receiving condition of the audio data sent by itself to the other equipment 101, so that not only the data transmission amount between the two earphones is reduced, but also the reliability of data transmission is increased.
In this embodiment of the present invention, when one or both of the first earphone 102 and the second earphone 103 do not correctly receive the audio data, the second earphone 103 sends NACK to the other device 101, instructing the other device 101 to retransmit the audio data.
It should be noted that, in the embodiment of the present invention, the indication packet may also be sent to the first headset by the second headset, and at this time, the first headset may send ACK/NACK to the other device 101 according to the receiving condition of the two headsets on the audio data.
For consistency of description, the following embodiments of the present invention all use the first headset 102 to send the indication packet to the second headset 103 as an example for illustration, and those skilled in the art will understand that the communication method disclosed in the following embodiments is also applicable to the implementation in which the second headset 103 sends the indication packet to the first headset 102 and the first headset 102 sends ACK/NACK to the other device 101.
Fig. 2 is a schematic flow chart illustrating communication transmission between a wireless headset assembly and another device according to an embodiment of the present invention.
In step S10, after establishing the communication connection as shown in fig. 1, the other device 101 transmits audio data to the first earphone 102, the first earphone 102 receives the audio data, and the second earphone 103 can also obtain the audio data transmitted by the other device 101 based on its listening status. The second headset 103 receives an indication packet from the first headset 102 via the second communication 106, the indication packet containing information indicating whether the first headset 102 correctly received the audio data sent by the other device 101. For example, if the first earphone 102 correctly receives the audio data sent by the other device 101, it may write information about whether the audio data is correct in a certain field of the bluetooth physical frame, for example, write "1" in a certain field or directly send an ECC packet, and the second earphone 103 receives the field information of the ECC packet or "1", and then the first earphone is considered to correctly receive the audio data sent by the other device 101. If the first earphone 102 does not correctly receive the audio data sent by the other device 101, a "0" may be written in a certain field of the bluetooth physical frame, and the second earphone 103 receives the field information containing the "0", it is considered that the first earphone 102 does not correctly receive the audio data sent by the other device 101.
In step S20, the second headset 103 transmits ACK/NACK to the other device 101 according to the received indication packet sent by the first headset 102 and the reception status of the audio data by itself. In this embodiment, the second headset 103 sends an ACK to the other device 101 when both the first headset 102 and the second headset 103 are correctly receiving, and when at least one of the first headset 102 and the second headset 103 is not correctly receiving, the second headset 103 sends a NACK to the other device 101 instructing the other device 101 to retransmit the audio data.
In a specific implementation, as shown in fig. 2, step S20 includes:
step S201, the second earphone 103 determines whether the first earphone 102 and the second earphone 103 both correctly receive the audio data according to the received indication packet sent by the first earphone 102 and by combining the receiving status of the second earphone to the audio data;
in step 202, if the first earphone 102 and the second earphone 103 both receive the audio data packet correctly, step 203 is entered, and the second earphone 103 sends an ACK to the other device 101 to indicate that the other device 101 does not need to retransmit the audio data.
If at least one of the first earpiece 102 and the second earpiece 103 does not receive correctly (either one or both earpieces do not receive correctly), step 204, step 205 is entered where the second earpiece 103 sends a NACK to the other device 101 instructing the other device 101 to retransmit the audio data.
In some embodiments, after the second headset 103 sends NACK to the other device 101, indicating that the other device 101 retransmits, step S30 is entered, and when at least one of the first headset 102 and the second headset 103 correctly receives the audio data after the other device 101 retransmits M times, the second headset 103 sends ACK packet to the other device 101, indicating that the other device 101 does not retransmit any more; otherwise, the second headset 103 sends a NACK packet to the other device 101, instructing the other device 101 to continue retransmitting. Wherein M is not less than 1 and is a natural number.
In step S30 of this embodiment, if the two earphones are not all correctly received after the other device 101 retransmits multiple times, in order to ensure low latency, the second earphone 103 sends an ACK packet to the other device 101 to instruct the other device 101 to stop retransmitting the current audio data, but send the next frame of audio data, so that low latency of data transmission can be ensured, audio reception is achieved without intervals, and jamming does not occur.
In a specific implementation, as shown in fig. 2, step S30 includes:
in step S301, after the other device 101 retransmits M times, the first earphone 102 and the second earphone 103 both receive the audio data packet correctly, and then step S302 is entered, and the second earphone 103 sends ACK to the other device 101 to indicate that the other device 101 does not retransmit any more. Wherein M is not less than 1 and is a natural number.
Step S303, when the other device 101 retransmits M times, and one of the first earphone 102 and the second earphone 103 does not correctly receive the audio data packet, then step S304 is performed, and the second earphone 103 sends an ACK to the other device 101 to indicate that the other device 101 does not retransmit any more, and the correctly received earphone forwards the audio data packet to the earphone that did not correctly receive the audio data packet. In some embodiments, if the second earphone 103 does not correctly receive the audio data after the other device 101 retransmits M times, the first earphone 102 correctly receives the audio data, and the indication packet sent by the first earphone 102 to the second earphone 103 is an ECC packet, at this time, the first earphone 102 may not need to forward correct audio data to the second earphone 103 any more, and only needs the second earphone 103 to decode the ECC packet to obtain correct audio data. This implementation may further reduce the amount of data transfer between the two headsets, thereby further increasing the reliability of the data transfer.
Step S305, when the other device 101 retransmits M times, neither the first earphone 102 nor the second earphone 103 correctly receives the audio data packet, then step S306 is entered, and the second earphone 103 sends NACK to the other device 101, instructing the other device 101 to retransmit M times, where M is greater than or equal to 1 and is a natural number.
In step S307, after the other device continues retransmitting for m times, one of the first earphone 102 and the second earphone 103 correctly receives the audio data packet, and the other earphone does not correctly receive the audio data packet, at this time, step S308 is entered, the second earphone 103 sends an ACK to the other device 101 to indicate that the other device 101 does not retransmit, and the earphone that correctly receives the audio data packet forwards the audio data packet to the earphone that does not correctly receive. In some embodiments, if the second headset 103 does not correctly receive the audio data after the other device 101 continues to retransmit for M times M1 times, the first headset 102 correctly receives the audio data, and the indication packet sent by the first headset 102 to the second headset 103 is an ECC packet, at this time, the first headset 102 may not need to forward the correct audio data to the second headset 103 any more, and only needs the second headset 103 to decode the ECC packet to obtain the correct audio data. This implementation may further reduce the amount of data transfer between the two headsets, thereby further increasing the reliability of the data transfer.
In step S309, after the other device continues retransmitting for m times, the first earphone 102 and the second earphone 103 still do not receive the audio data correctly, at this time, step S310 is entered, the second earphone 103 sends ACK to the other device 101 to indicate that the other device 101 does not retransmit, and the audio data information of the two earphones is recovered by using the data loss concealment technique. During specific implementation, each earphone can obtain the power spectrum of the correctly received audio data packet by using autocorrelation of the audio data packet, estimate the power spectrum of the missing audio by using the power spectrums of the audio signals of the previous frames, and estimate the current audio signal by using a Levinson-Durbin recursive algorithm.
In the implementation of the above steps, it should be noted that, when it is necessary to determine whether the first earphone 102 and the second earphone 103 correctly receive the audio data in each step, the second earphone 103 determines whether the first earphone 102 correctly receives the audio data according to the indication packet sent by the first earphone 102, that is, the first earphone 102 sends an indication packet to the second earphone 103 once every time the other device 101 retransmits.
In conjunction with fig. 2, the implementation of steps S10-S30 above is directed to the transmission and reception of the same audio packet, and when another device receives the ACK from the second headphone in steps 302, 304, 308, and 310, it will transmit the next audio packet in the next clock cycle.
In some embodiments, if the first earphone 102 repeatedly receives the audio data sent by the other device 101 for P times within a period of time, where P is a natural number and P > M + M, the first earphone 102 directly sends ACK/NACK to the other device 101 according to its own reception condition of the audio data, and no more indication packet is sent to the second earphone 103. In this embodiment, if one of the earphones fails and the other earphone repeatedly receives the audio data retransmitted by the other equipment, the other earphone sends ACK/NACK to the other equipment according to the condition of the other earphone, so as to reduce the time delay.
In some embodiments, if the second earphone 103 does not receive the bluetooth Signal transmitted by the first earphone 102 for a period of time, or the RSSI value (Received Signal Strength Indication) of the bluetooth Signal Received from the first earphone 102 is smaller than a certain set first threshold value, and the RSSI value of the bluetooth Signal Received by the second earphone 103 and transmitted by the other device 101 is larger than a certain set second threshold value, the second earphone 103 directly transmits ACK/NACK to the other device 101 according to the reception of the audio data by itself. That is, if the second headphone 103 receives the audio data correctly in this case, an ACK is transmitted to the other device 101 indicating that the other device 101 is not retransmitting any more, and if the second headphone 103 does not receive the audio data correctly, a NACK is transmitted to the other device 101 indicating that the other device 101 retransmits the audio data. As can be understood by those skilled in the art, since the second earphone 103 may also send an indication packet to the first earphone 102, and the first earphone 102 sends ACK/NACK to the other device 101, if the first earphone 102 does not receive the bluetooth signal sent by the second earphone 103 within a period of time, or the RSSI value of the received bluetooth signal from the second earphone 103 is smaller than a certain set first threshold, and the RSSI value of the bluetooth signal sent by the first earphone 102 to the other device 101 is greater than a certain set second threshold, the first earphone 102 directly sends ACK/NACK to the other device 101 according to the receiving condition of the audio data by itself.
In some embodiments, in order to ensure synchronous playing of the first earphone 102 and the second earphone 103 while achieving low latency of audio data transmission, the indication packet sent by the first earphone 102 to the second earphone 103 further includes synchronous playing information, where the synchronous playing information is used to enable the first earphone 102 and the second earphone 103 to play the audio data synchronously. And, the synchronous playing information is integrated in the indication packet and transmitted together, so that the transmission quantity can be effectively reduced, and the transmission efficiency is improved.
Fig. 3 shows a timing diagram of communication transmission by the wireless headset assembly according to the embodiment of the disclosure, and as shown in fig. 3, the other device 101 transmits audio data information in the first period 302 (i.e. time 301 to time 303) of the nth frame. The first earphone 102 and the second earphone 103 receive audio data information transmitted by the other device 101 in the first period 302 of the nth frame. During a second time period 308 within the N +1 th communication frame, a reply packet is transmitted by the second headset 103 to the further device 101 via the first communication connection 104. Wherein the transmission response packet is a response packet containing ACK/NACK; transmitting ACK information to the other device 101 indicates that the first earphone 102 and the second earphone 103 both successfully receive the audio data information, and the earphone component can perform synchronous playing of the audio data; transmitting the NACK information to the other device 101 indicates that the other device 101 is required to retransmit the audio data information. The above-mentioned process of sending the transmission acknowledgement packet (ACK/NACK) occurs in the second time period 308 (i.e. time 307 to time 309) in the N +1 th communication frame, and the other device 101 receives the transmission acknowledgement packet, as shown in fig. 3.
In connection with fig. 2, the process of the first earpiece 102 sending the indication packet to the second earpiece 103 via the second communication connection 106 occurs during a third time period, which may include the transition time period, in addition to the first time period 302 and the second time period 308 within the nth communication frame and the N +1 th communication frame. As shown in fig. 3, the third time period may be after the first time period 302 in the nth communication frame, i.e., 304 is the transition time period (time 303 to 305) and 306 is the third time period (time 305 to 307). In some embodiments, the third time period may also be located at time period 310 (time instants 309-311) after the second time period 308 within the N +1 th communication frame, which includes the transition time period and the third time period. In some embodiments, the sending of audio data to the headset assembly by the other device 101 may be implemented in the first time period 302, the transmission of an indication packet (including indication information indicating whether the audio data is correctly received by the first headset 102 and not including synchronized playback information) from the first headset 102 to the second headset 103 in the third time period 306, the sending of a transmission acknowledgement packet (ACK/NACK) from the second headset 102 to the other device 101 in the second time period 308, and the transmission of synchronized playback information between the headsets in the third time period 310, such that the transmission processes implemented in the time periods 302, 306, 308, and 310 are independent and do not interfere with each other. In other embodiments, it is also possible to implement the other device 101 to send audio data to the headset assembly in the first time period 302, implement the first headset 102 to transmit an indication packet (the indication packet includes synchronized playing information) to the second headset 103 in the third time period 306, and implement the second headset 102 to send an acknowledgement packet (ACK/NACK) to the other device 101 in the second time period 308, so that the transmission processes implemented in the time periods 302, 306, and 308 are also independent and do not interfere with each other.
Wherein during the third time period, synchronized playback information is transmitted between the first 102 and second 103 headsets via the second communication connection 106 so that the respective headsets play back audio data information synchronously, and the second communication connection 106 and the first communication connection 104 are independent of each other. In a third time period other than the first time period 302 and the second time period 308 within the nth communication frame and the N +1 th communication frame, the first headset 102 may transmit synchronized playback information for synchronously playing back audio data received from the other device 101 to the second headset. Therefore, based on the synchronized playing information, the first earphone 102 and the second earphone 103 can realize accurate synchronized playing of audio data, and perform transmission of the synchronized playing information in a third time period independent of the first time period and the second time period, and the transmission does not interfere with bluetooth transmission between the earphones and the smart device, thereby ensuring the stability of the communication connection shown in fig. 1. In some embodiments, taking the communication connection as a bluetooth connection as an example, the synchronized playing information may be: the Bluetooth clock count value of the earphone sending the synchronous playing information at the moment of receiving the audio data information (the moment of receiving the audio data information by the earphone refers to the moment of receiving the Bluetooth physical frame by the Bluetooth physical layer) and the Bluetooth clock count value of the trigger moment read by Direct Memory Access (DMA); or the bluetooth clock count value when the playing clock of the earphone sending the synchronous playing information is periodically triggered, and the ordinal number of the audio data before resampling, etc.
In some embodiments, the indication packet transmitted in the third time period includes synchronous playing information in addition to the information indicating the receiving condition of the audio data packet by the first earphone in a direct or indirect manner. The synchronous playing information is integrated in the indication packet to be transmitted together, so that the transmission quantity can be effectively reduced, and the transmission efficiency is improved. The process of merging the indication packet and synchronizing the broadcast information based on the bluetooth connection will be described with reference to fig. 4(a) and 4 (b).
Fig. 4(a) shows a structural diagram of a bluetooth physical frame according to an embodiment of the present disclosure, and fig. 4(b) shows a structural diagram of a bluetooth physical frame according to another embodiment of the present disclosure. There are two data transfer rates for bluetooth transmission, one being the base rate and the other being the enhanced rate. Packet format of basic rate as shown in fig. 4(a), a bluetooth physical frame includes 3 fields, in the direction from least significant bit to most significant bit, respectively, an access code 401, a header 402, and a payload 403, where: access code 401 is a flag for picoet, used for timing synchronization, offset compensation, paging, and inquiry; the packet header 402 contains information for bluetooth link control; the payload 403 carries payload information, which in this disclosure may be bluetooth audio data. The technical term "audio data packet" used herein may mean that the payload 403 corresponds to audio data after the access code 401, the packet header 402, and the like are removed from the bluetooth physical frame. The packet format of the enhanced rate is as shown in fig. 4(b), and the bluetooth physical frame includes 6 fields, which are, in the direction from the least significant bit to the most significant bit, an access code 404, a header 405, a guard interval 406, a sync 407, an enhanced rate payload 408, and a packet tail 409, respectively, where the access code 404, the header 405, and the enhanced rate payload 408 are similar to the access code 401, the header 402, and the payload 403, and are not described herein again. The guard interval 406 represents the interval time between the header 405 and the sync 407; the sync 407 contains a synchronization sequence, typically used for differential phase shift keying modulation; the packet tail 409 takes different settings for different modulation schemes. In some embodiments, for synchronized data, at the end of payload 403 and enhanced rate payload 408, there may also be, for example, 16 bits for cyclic redundancy check.
In some embodiments, the synchronized playback information may be integrated into an indication packet transmitted from the first headset 102 to the second headset 103, so that the valid information of the indication packet and the synchronized playback information may be placed in the payload 403 or the enhanced rate payload 408 for transmission, and thus the indication packet and the synchronized playback information packet may be combined into one packet (bluetooth physical frame) to share the access code 401 or 404, the packet header 402 or 405, and so on, thereby effectively simplifying the structure of the bluetooth physical frame, significantly reducing the overall transmission amount (e.g., information in the access code and the packet header), reducing the switching time between multiple bluetooth physical frames, reducing the control complexity, reducing the mutual interference between two packets, and further increasing the data transmission efficiency. In some embodiments, the receiver of the indication packet starts receiving before the sending time of the indication packet, which can improve the accuracy of the reception to avoid missing the reception.
In addition, the error correction code included in the ECC packet described herein is an error correction code for the audio data in the payload 403 and the enhanced rate payload 408, and may adopt various encoding modes, including but not limited to Reed Solomon (RS) encoding, BCH (Bose, Ray-Chaudhuri, and Hocquenghem) encoding, and the like. In some embodiments, the ECC packets are multiplexed with bluetooth protocols at layers above the physical layer, such as the bluetooth medium access control (mac) layer, the bluetooth host control interface layer, etc., a 2Mb/s symbol rate may be used at the physical layer, and the modulation scheme may be Quadrature Phase Shift Keying (QPSK) or Gaussian Frequency Shift Keying (GFSK). The Bluetooth physical layer can adopt a symbol rate of 1Mb/s, and the ECC packet adopts a higher symbol rate, so that more error correction bits can be transmitted and the error correction capability can be better.
In some embodiments, the communication connection may be selected from any one of the group consisting of classic bluetooth, bluetooth low energy audio. Bluetooth low energy audio and bluetooth low energy are different communication modes from each other. The low-power Bluetooth audio is an improvement on the low-power Bluetooth, supports a synchronization feature under the condition of low-power Bluetooth communication, and can transmit audio on a synchronization channel of the low-power Bluetooth; and the common bluetooth low energy audio communication mode cannot realize the functions.
Fig. 5 shows a diagram of a synchronization mechanism of each headset with another device in a wireless headset assembly according to an embodiment of the disclosure. As shown in fig. 5, each earphone in the earphone assembly, i.e. the first earphone 102 or the second earphone 103, may receive a radio frequency signal from another device (not shown) by using a radio frequency front end 501, sample the received radio frequency signal by using an analog-to-digital converter 502 to obtain a digital signal, and process by using a synchronization and demodulation module 503 to obtain a bluetooth clock count value of 1. The phase locked loop 505 receives as its input the reference clock from the synchronization and demodulation module 503, or in another embodiment, the reference clock of a crystal or crystal oscillator may be used as an input to the phase locked loop 505. The phase locked loop 505 is used to adjust the crystal oscillation frequency of the bluetooth chip of the corresponding headset so that the headset can have the same frequency in the clock frequency as the other device 101. The radio frequency carrier fed by the phase locked loop 505 may be fed to the radio frequency front end 501 and down-converted via the frequency divider 504 to derive the analog-to-digital sampling clock for the analog-to-digital converter 502.
Fig. 6 shows a flowchart of a method of determining a bluetooth clock count value (hereinafter also referred to as bluetooth clock count value 1) at the moment of receiving the audio data information for each headset according to an embodiment of the present disclosure. As shown in fig. 6, in step 601, each earphone in the earphone assembly accumulates the number of bluetooth clock cycles in the time interval of receiving the audio data information to obtain an accumulated value. In the single slot mode, each headset receives a bluetooth signal from another device 101 every 1.25 ms; in the multislot mode, each headset receives bluetooth signals from another device 101 every multiple of 1.25ms (e.g., without limitation, 2.5ms, 3.75ms, etc.). Let the time interval for the headset to receive the bluetooth signal of the other device 101 be T1, and accumulate the number of bluetooth clock cycles in T1 to obtain an accumulated value. In step 602, a bluetooth clock difference between two adjacent bluetooth receptions of corresponding data is determined. The difference between the bluetooth clocks at the relevant time of the two bluetooth reception synchronization before and after is determined based on the synchronization and demodulation module 503. In step 603, the accumulated value is modified based on the determined bluetooth clock difference value to obtain a bluetooth clock count value at the time of receiving the audio data information. And correcting the accumulated value based on the difference value to finally obtain the Bluetooth clock count value 1. For the first earphone 102 and the second earphone 103 in the earphone assembly, there are a first earphone 102 bluetooth clock count value 1 and a second earphone 103 bluetooth clock count value 1, respectively, and since the two earphones receive the same bluetooth air signal from the other device 101, the bluetooth clock count values 1 acquired by the first earphone 102 and the second earphone 103 are exactly the same at corresponding times by using the method of the process 600.
Fig. 7 shows a schematic diagram of a synchronized playback system in which each of the headphones in the headphone assembly play back received audio data information in synchronization, according to an embodiment of the disclosure. As shown in fig. 7, the synchronized playback system 700 includes: an audio buffer 701, a DMA fetch module 702, a resampling module 703, a codec (codec) module 704, and a speaker 705.
Fig. 8 shows a flow chart of the synchronized playback of received audio data information by each of the headphones in the headphone assembly. The following describes the synchronous playing process in detail with reference to fig. 7 and 8.
The synchronous playing process 800 begins with step 801, where the audio data information is buffered and decompressed; the audio buffer 701 buffers the received audio data, and decompresses the audio signal corresponding to the received bluetooth signal after receiving the bluetooth signal using the bluetooth clock. The sampling rate of the decompressed audio data is generally 44.1KHz/s, 48KHz/s, 96KHz/s, 192 KHz/s; the playback clock may be divided by the crystal clock, for example, in some embodiments, the crystal clock has a nominal frequency of 26MHz/s, and the playback clock is 50.078125KHz/s obtained by dividing the crystal clock by 512 times. In step 802, the DMA fetch module 702 is triggered (a DMA trigger signal is sent out to trigger) to perform DMA read on the buffered and decompressed audio data via the resampling module 703; based on the DMA trigger signal, the DMA fetch module 702 reads DMA, and reads a fixed amount of audio data each time the DMA fetch module triggers, where the DMA fetch clock is a bluetooth clock, thereby ensuring that the DMA reads a fixed amount of audio data each time, and the DMA parameters do not need to be reconfigured each time, thereby reducing the overhead of configuring the DMA by software. DMA reads fixed decompressed audio data are triggered by the resampling module, which triggers DMA reads when new data is needed for resampling. In step 803, the audio data read by the DMA is resampled to convert the audio data from the sampling rate of the bluetooth clock to the sampling rate of the playback clock; the resampling module 703 resamples the audio data based on the bluetooth clock to determine the sampling rate of the playback clock. The resampling module realizes that the audio data is converted into the clock frequency corresponding to the playing clock from the original sampling rate (for example, 44.1KHz/s, 48KHz/s, 96KHz/s and 192KHz/s, which are determined by the received Bluetooth signals). Then, in step 804, the resampled audio data is sent to the speaker through codec processing with the play clock; the codec module 704 performs encoding and decoding processing on the audio data based on the playback clock, and then supplies the audio data to the speaker 705, and the audio data is played back by the speaker 705 in synchronization.
The sampling rate conversion ratio of the resampling module 703 is calculated in the following manner: decompressed audio sample rate/playback clock frequency, e.g., 44.1/50.078125 (decompressed audio sample rate of 44.1KHz/s and playback clock frequency of 50.078125 KHz/s). However, the transform ratio is a nominal value, and there may be a slight deviation in the actual value, e.g., within 100ppm, regardless of the decompressed audio sample rate or the playing clock frequency. This deviation will often result in too much or too little data in the audio buffer 701, i.e. too much or too little data before resampling in the resampling module 703, which on the one hand will change the delay from receiving bluetooth data to playing, and on the other hand will cause the data in the audio buffer 701 to overflow or not be available. For each headphone in the headphone set, the rate of sample rate conversion may be fine-varied depending on how much audio data is in the audio buffer 701, thereby varying the DMA read timing such that the amount of audio data in the audio buffer 701 remains relatively constant. And defining the Bluetooth clock value corresponding to the DMA reading time as a Bluetooth clock count value 2.
Fig. 9 shows a flowchart of the resampling module performing sample rate conversion based on the synchronized playing information according to an embodiment of the present disclosure, where the synchronized playing information is: and the earphone sending the synchronous playing information has a Bluetooth clock count value at the moment of receiving the audio data information and a Bluetooth clock count value at the triggering moment of DMA reading. The process 900 starts in step 901, and the earphone receiving the synchronization information obtains the bluetooth clock count value 1 of the earphone sending the synchronization playing information at the time of receiving the audio data information and the bluetooth clock count value 2 of the earphone sending the synchronization playing information at the triggering time of DMA reading. In step 902, the bluetooth clock count value 1 of the headset itself at the moment of receiving the audio data information and the bluetooth clock count value 2 at the triggering moment of DMA reading are determined. In step 903, the sampling rate conversion ratio of the headphone resampling operation is adjusted so that the difference between the bluetooth clock count value 2 of the headphone itself at the DMA read trigger time and the bluetooth clock count value 1 at the audio data information receiving time is equal to the difference between the bluetooth clock count value 2 of the headphone sending the synchronized playing information at the DMA read trigger time and the bluetooth clock count value 1 at the audio data information receiving time. In one embodiment, the first earpiece 102 is scaled according to the sampling rate such that the audio data in its audio buffer 701 remains relatively constant. The first earpiece 102 may transmit its bluetooth clock count value 1, bluetooth clock count value 2 to the second earpiece 103; the first earphone 102 can also transmit the sequence of the audio data read by the DMA corresponding to the bluetooth clock count value 2 to the second earphone 103; the sequence may also be counted by the first earphone 102 and the second earphone 103, respectively. The second earphone 103 adjusts the sampling rate conversion ratio of the resampling module according to the bluetooth clock count value 1 and the bluetooth clock count value 2 of the first earphone 102, and the bluetooth clock count value 1 and the bluetooth clock count value 2 of the second earphone 103 itself, so that the difference between the bluetooth clock count value 2 of the second earphone 103 itself at the triggering time of DMA reading and the bluetooth clock count value 1 at the time of receiving the audio data information is equal to the difference between the bluetooth clock count value 2 of the earphone sending the synchronized playing information at the triggering time of DMA reading and the bluetooth clock count value 1 at the time of receiving the audio data information; thereby realizing the accurate playing synchronization of the two earphones. The precision of synchronous playing realized based on the method can reach the microsecond level of the precision of the Bluetooth clock, and synchronous playing information transmitted among the earphones of the earphone assembly can be transmitted once every N DMA (direct memory access) trigger moments, so that the transmitted data volume is reduced.
In some embodiments, the synchronized playback information may also be: and the Bluetooth clock count value when the playing clock of the earphone sending the synchronous playing information is periodically triggered and the ordinal number of the audio data before resampling. At a certain trigger time when the playing clock is triggered periodically, the first earphone 102 records the count value of the bluetooth clock at the certain trigger time and the ordinal number of the audio data before resampling; and sends it as synchronized playback information to the second headset 103 via the second communication connection 106. The second headphone 103 determines the count value of the bluetooth clock when the playing clock of the second headphone is periodically triggered, and adjusts the resampling module according to the ordinal number of the received audio data before resampling, which is operated by the current resampling module 703 of the first headphone 102 that sends synchronous playing information, so that each headphone of the headphone assembly can realize accurate synchronous playing. The precision of synchronous playing can reach the microsecond level of the precision of a Bluetooth clock, and synchronous playing information transmitted among the earphones of the earphone assembly can be transmitted once every N DMA (direct memory access) trigger moments, so that the transmitted data volume is reduced.
In the embodiment of the invention, the Bluetooth clock and the playing clock can be two independent clocks, and the frequency and the phase can be different. The bluetooth clocks at various places in this document may not be the same clock, but may be the same source clock, that is, the bluetooth clocks are obtained by dividing the same clock by integer, and have integral multiple relation in frequency and are aligned in phase.
The wireless earphone component and the communication method thereof disclosed by the embodiment of the invention can realize low time delay of audio data transmission and playing and can realize synchronous playing of each earphone; and when one of the two earphones can not be used continuously due to various reasons, the normal use of the other earphone can not be interfered, so that the other earphone does not receive audio at intervals and is not blocked, and low delay is realized.
The embodiment of the invention also discloses a wireless earphone component, which comprises a first earphone and a second earphone which can wirelessly communicate with each other, when the RSSI of the wireless signal of the other device received by one of the first earphone and the second earphone is larger than a set first threshold value, and when the RSSI of the wireless signal of one earphone received by the other earphone is smaller than a set second threshold value or the wireless signal of one earphone is not received, the one earphone sends the ACK/NACK packet to the other device according to the receiving condition of the one earphone per se on the audio data packet.
Referring to fig. 1, after establishing the communication connection as shown in fig. 1, the other device 101 transmits audio data to the first headset 102, the first headset 102 receives the audio data, and the second headset 103 can also acquire the audio data transmitted by the other device 101 based on its listening status. In one embodiment, if the RSSI of the first earphone 102 receiving the wireless signal of the other device 101 is greater than the set first threshold, and the RSSI of the first earphone 102 receiving the wireless signal of the second earphone 103 is less than the set second threshold or the wireless signal of the second earphone 103 is not received, the first earphone 102 directly sends ACK/NACK to the other device 101 according to its own receiving condition. Similarly, if the RSSI of the second earphone 103 receiving the wireless signal of the other device 101 is greater than the set first threshold, and the RSSI of the second earphone 103 receiving the wireless signal of the first earphone 102 is less than the set second threshold or the wireless signal of the first earphone 102 is not received, the second earphone 103 directly sends ACK/NACK to the other device 101 according to its own reception condition.
In the earphone assembly and the communication method thereof, when one earphone can not be used continuously due to some reason (such as no power, charging box being put in or failure), the normal use of the other earphone can not be interfered, so that the other earphone can not receive audio at intervals and can not be blocked.
The embodiment of the invention also discloses a communication method of the wireless earphone assembly, the wireless earphone assembly comprises a first earphone and a second earphone which can wirelessly communicate with each other, and the method comprises the following steps: the first earphone sends an indication packet to the second earphone, wherein the indication packet is used for indicating the receiving condition of the first earphone on the audio data sent by another equipment; the second earphone receives the indication packet sent by the first earphone and transmits ACK packet/NACK to the other equipment according to the indication packet and the receiving condition of the second earphone on the audio data; wherein when at least one of the first and second headsets does not correctly receive the audio data, the second headset sends a NACK to the other device instructing the other device to retransmit the audio data; when at least one of the first earphone and the second earphone correctly receives the audio data after the other equipment retransmits the audio data for M times, the second earphone sends ACK to the other equipment to indicate the other equipment not to retransmit the audio data any more; otherwise, the second earphone sends NACK to the other equipment to instruct the other equipment to continue retransmitting; wherein M is not less than 1 and is a natural number.
In some embodiments, when one of the first and second headsets does not correctly receive the audio data after the other device retransmits M times, the second headset sends an ACK to the other device indicating that the other device does not retransmit any more, and the headset that correctly received the audio data forwards the audio data to the headset that did not correctly receive the audio data.
In some embodiments, when the audio data is not correctly received by both the first and second headsets after the other device retransmits M times, the second headset sends a NACK to the other device instructing the other device to continue retransmitting; when one of the first earphone and the second earphone correctly receives the audio data after the other equipment continues retransmitting for m times, the second earphone sends ACK to the other equipment to indicate that the other equipment does not retransmit any more, and the earphone which correctly receives the audio data forwards the audio data to the earphone which does not correctly receive the audio data.
In some embodiments, when the audio data is not correctly received by both the first and second headsets after the other device retransmits M times, the second headset sends a NACK to the other device instructing the other device to continue retransmitting; and when the audio data is not correctly received by the first earphone and the second earphone after the other equipment continuously retransmits for m times, the second earphone sends ACK to the other equipment to indicate the other equipment not to retransmit any more, and the audio data is recovered by using a data loss concealment technology.
In some embodiments, recovering the audio data using the data loss concealment technique comprises: the power spectrum of the correctly received audio data is obtained by utilizing the autocorrelation of the audio data, the power spectrum of the missing audio is estimated by utilizing the power spectrums of the audio signals of the previous frames, and then the current audio signal is estimated by utilizing a Levinson-Durbin recursive algorithm.
In some embodiments, if the first headset repeatedly receives the audio data sent by the other device for P times within a period of time, where P is a natural number and P > M + M, the first headset sends ACK/NACK to the other device directly according to the reception of the audio data by itself, and does not send any indication packet to the second headset.
In some embodiments, if the second headset does not receive the wireless signal sent by the first headset within a period of time, or the received signal strength indicating value of the wireless signal received from the first headset is smaller than a set first threshold, and the received signal strength indicating value of the wireless signal received by the second headset and sent by the other device is larger than a set second threshold, the second headset sends ACK/NACK to the other device directly according to the receiving condition of the second headset on the audio data.
The wireless headset assembly and the communication method thereof disclosed by the embodiment of the invention can realize that two headsets can simultaneously receive audio from another device on the premise that the other device only senses one headset, thereby reducing time delay relative to a forwarding mode. The so-called forwarding mode is to use one earphone to receive the audio of another device and then forward the audio signal to another earphone. In the forwarding mode, in order to ensure reliable audio transmission between the two earphones, an additional audio buffer is added, so that when a channel between the two earphones is temporarily poor, audio playing can still be uninterrupted, and jamming does not occur.
According to the wireless earphone assembly and the communication method thereof disclosed by the embodiment of the invention, when the signal between one earphone and another device is temporarily poor, and the earphone does not correctly receive the audio signal from the other device for multiple times, the audio signal can be obtained from the other earphone, so that the audio transmission is more reliable, and the time delay is lower. And in case that the two earphones receive the audio packet for a plurality of times and do not receive the audio packet correctly, the audio packet is discarded, and the packet is compensated by using a compensation technology. So that the other device can transmit the next audio packet, thereby ensuring low latency.
Moreover, although exemplary embodiments have been described herein, the scope thereof includes any and all embodiments based on the disclosure with equivalent elements, modifications, omissions, combinations (e.g., of various embodiments across), adaptations or alterations. The elements of the claims are to be interpreted broadly based on the language employed in the claims and not limited to examples described in the present specification or during the prosecution of the application, which examples are to be construed as non-exclusive. It is intended, therefore, that the specification and examples be considered as exemplary only, with a true scope and spirit being indicated by the following claims and their full scope of equivalents.
The above description is intended to be illustrative and not restrictive. For example, the above-described examples (or one or more versions thereof) may be used in combination with each other. For example, other embodiments may be used by those of ordinary skill in the art upon reading the above description. In addition, in the foregoing detailed description, various features may be grouped together to streamline the disclosure. This should not be interpreted as an intention that a disclosed feature not claimed is essential to any claim. Rather, inventive subject matter may lie in less than all features of a particular disclosed embodiment. Thus, the following claims are hereby incorporated into the detailed description as examples or embodiments, with each claim standing on its own as a separate embodiment, and it is contemplated that these embodiments may be combined with each other in various combinations or permutations. The scope of the invention should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.

Claims (15)

1. A wireless headset assembly comprising a first headset and a second headset capable of wireless communication with each other,
the first earphone sends an indication packet to the second earphone, wherein the indication packet is used for indicating the receiving condition of the first earphone on the audio data sent by another equipment;
the second earphone receives the indication packet sent by the first earphone and transmits ACK/NACK to the other equipment according to the indication packet and the receiving condition of the second earphone on the audio data;
wherein when at least one of the first and second headsets does not correctly receive the audio data, the second headset sends a NACK to the other device instructing the other device to retransmit the audio data;
when at least one of the first earphone and the second earphone correctly receives the audio data after the other equipment retransmits the audio data for M times, the second earphone sends ACK to the other equipment to indicate the other equipment not to retransmit the audio data any more; otherwise, the second earphone sends NACK to the other device, instructing the other device to continue retransmitting, and when the audio data is not correctly received by both the first earphone and the second earphone after the other device continues retransmitting for m times, the second earphone sends ACK to the other device, instructing the other device not to retransmit any more, and recovering the audio data by using a data loss concealment technique;
wherein M and M are natural numbers and are more than or equal to 1.
2. The wireless headset assembly of claim 1, wherein when one of the first and second headsets does not properly receive the audio data after the other device retransmits M times, the second headset sends an ACK to the other device indicating that the other device is no longer retransmitting and the headset that properly received the audio data forwards the audio data to the headset that did not properly receive the audio data.
3. The wireless headset assembly of claim 1, wherein when the audio data is not properly received by both the first and second headsets after the other device retransmits M times, the second headset sends a NACK to the other device instructing the other device to continue retransmitting;
when one of the first earphone and the second earphone correctly receives the audio data after the other equipment continues retransmitting for m times, the second earphone sends ACK to the other equipment to indicate that the other equipment does not retransmit any more, and the earphone which correctly receives the audio data forwards the audio data to the earphone which does not correctly receive the audio data.
4. The wireless headset assembly of claim 1, wherein recovering the audio data using the data loss concealment technique comprises: the power spectrum of the correctly received audio data is obtained by utilizing the autocorrelation of the audio data, the power spectrum of the missing audio is estimated by utilizing the power spectrums of the audio signals of the previous frames, and then the current audio signal is estimated by utilizing a Levinson-Durbin recursive algorithm.
5. A wireless headset assembly according to any of claims 1-4, wherein if the first headset repeatedly receives audio data sent by the other device for P times within a period of time, where P is a natural number and P > M + M, the first headset sends ACK/NACK to the other device directly from its own reception of the audio data and no further indication packet is sent to the second headset.
6. The wireless headset assembly of any one of claims 1-4, wherein if the second headset does not receive the wireless signal from the first headset within a period of time, or the received signal strength indicator of the wireless signal from the first headset is smaller than a first threshold, and the received signal strength indicator of the wireless signal received by the second headset from the other device is larger than a second threshold, the second headset sends ACK/NACK to the other device directly according to its own reception of the audio data.
7. The wireless headset assembly of any of claims 1-4, wherein the indication packet sent by the first headset to the second headset further comprises synchronized playback information;
and the synchronous playing information is used for enabling the first earphone and the second earphone to synchronously play the audio data packet.
8. The wireless headset assembly of claim 7, wherein the first and second headsets are configured to:
receiving, by the first earpiece via a first communication connection, audio data packets from the other device and listening, by the second earpiece, for the audio data packets from the other device within a first time period within an nth communication frame, N being a natural number;
transmitting, by the second headset to the other device via the first communication connection, the ACK/NACK within an N +1 th communication frame;
wherein, in a third time period except the first time period and the second time period in the nth communication frame and the (N + 1) th communication frame, the first earphone transmits an indication packet including the synchronized playing information to the second earphone via a second communication connection, so that each earphone plays the audio data packet synchronously, and the second communication connection and the first communication connection are independent of each other.
9. The wireless headset assembly of claim 7, wherein the synchronized playback information comprises:
the Bluetooth clock count value of the first earphone at the moment of receiving the audio data packet and the Bluetooth clock count value of the first earphone at the triggering moment of direct memory access reading; or
And the Bluetooth clock count value when the playing clock of the first earphone is periodically triggered and the ordinal number of the audio data information before resampling.
10. The wireless headset assembly of claim 8,
the third time period is after the first time period in the Nth communication frame, and a transition time period is arranged between the third time period and the Nth communication frame; or
The third time period is after the second time period within the (N + 1) th communication frame with a transition time period therebetween.
11. A method of communicating for a wireless headset assembly including a first headset and a second headset that are capable of wireless communication with each other, the method comprising:
the first earphone sends an indication packet to the second earphone, wherein the indication packet is used for indicating the receiving condition of the first earphone on the audio data sent by another equipment;
the second earphone receives the indication packet sent by the first earphone and transmits ACK/NACK to the other equipment according to the indication packet and the receiving condition of the second earphone on the audio data;
wherein when at least one of the first and second headsets does not correctly receive the audio data, the second headset sends a NACK to the other device instructing the other device to retransmit the audio data;
when at least one of the first earphone and the second earphone correctly receives the audio data after the other equipment retransmits the audio data for M times, the second earphone sends ACK to the other equipment to indicate the other equipment not to retransmit the audio data any more; otherwise, the second earphone sends NACK to the other device, instructing the other device to continue retransmitting, and when the audio data is not correctly received by both the first earphone and the second earphone after the other device continues retransmitting for m times, the second earphone sends ACK to the other device, instructing the other device not to retransmit any more, and recovering the audio data by using a data loss concealment technique;
wherein M and M are natural numbers and are more than or equal to 1.
12. The method of claim 11, wherein when one of the first and second earphones does not correctly receive the audio data after the other device retransmits M times, the second earphone transmits an ACK to the other device indicating that the other device does not retransmit any more, and the earphone that correctly received the audio data forwards the audio data to the earphone that did not correctly receive the audio data.
13. The communication method of the wireless headset assembly according to claim 11, wherein when the audio data is not correctly received by both the first headset and the second headset after the another device retransmits M times, the second headset transmits NACK to the another device instructing the another device to continue the retransmission;
when one of the first earphone and the second earphone correctly receives the audio data after the other equipment continues retransmitting for m times, the second earphone sends ACK to the other equipment to indicate that the other equipment does not retransmit any more, and the earphone which correctly receives the audio data forwards the audio data to the earphone which does not correctly receive the audio data.
14. The communication method of the wireless headset assembly according to any one of claims 11 to 13, wherein if the first headset repeatedly receives the audio data transmitted from the other device for P times within a period of time, where P is a natural number and P > M + M, the first headset transmits ACK/NACK to the other device directly according to its own reception of the audio data, and does not transmit any indication packet to the second headset.
15. The method of communicating via a wireless headset assembly according to any one of claims 11 to 13, wherein if the second headset does not receive the wireless signal from the first headset within a period of time, or the received signal strength indicator value of the wireless signal received from the first headset is smaller than a first threshold, and the received signal strength indicator value of the wireless signal received by the second headset from the other device is larger than a second threshold, the second headset transmits ACK/NACK to the other device directly according to its own reception of audio data.
CN201911371559.4A 2019-12-27 2019-12-27 Wireless earphone assembly and communication method thereof Active CN111031437B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911371559.4A CN111031437B (en) 2019-12-27 2019-12-27 Wireless earphone assembly and communication method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911371559.4A CN111031437B (en) 2019-12-27 2019-12-27 Wireless earphone assembly and communication method thereof

Publications (2)

Publication Number Publication Date
CN111031437A CN111031437A (en) 2020-04-17
CN111031437B true CN111031437B (en) 2021-05-28

Family

ID=70214054

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911371559.4A Active CN111031437B (en) 2019-12-27 2019-12-27 Wireless earphone assembly and communication method thereof

Country Status (1)

Country Link
CN (1) CN111031437B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111770428B (en) * 2020-06-24 2021-12-07 杭州国芯科技股份有限公司 Monitoring method of wireless equipment
CN111526506B (en) * 2020-07-01 2020-10-02 恒玄科技(北京)有限公司 Charging box and method for wireless communication and audio playing kit
US11375574B2 (en) * 2020-08-11 2022-06-28 Qualcomm Incorporated Latency reduction
WO2022047612A1 (en) 2020-09-01 2022-03-10 深圳市中科蓝讯科技股份有限公司 Wireless device communication method, wireless device, and computer readable storage medium
CN112153513B (en) * 2020-09-24 2023-03-24 恒玄科技(上海)股份有限公司 Wireless earphone for wireless communication, wireless communication method and medium
CN112423198B (en) * 2021-01-22 2021-04-27 成都市安比科技有限公司 Audio system data synchronization method and audio component
CN113259803B (en) * 2021-05-13 2022-10-18 恒玄科技(上海)股份有限公司 Wireless earphone assembly and signal processing method thereof
CN113490268A (en) * 2021-06-28 2021-10-08 泰凌微电子(上海)股份有限公司 Audio data wireless transmission method and system
CN114079900B (en) * 2021-07-22 2024-04-05 珠海市杰理科技股份有限公司 Bluetooth packet loss data receiving and transmitting method, circuit, audio playing device and system
CN113872729B (en) 2021-09-24 2022-03-25 上海物骐微电子有限公司 Audio data communication method and wireless audio system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108337074A (en) * 2018-06-22 2018-07-27 恒玄科技(上海)有限公司 The bluetooth headset wireless communications method of high reliability
CN109561419A (en) * 2019-02-19 2019-04-02 恒玄科技(上海)有限公司 The ears wireless headset of high reliability and communication means for ears wireless headset
CN109660971A (en) * 2018-12-05 2019-04-19 恒玄科技(上海)有限公司 Wireless headset and communication means for wireless headset
CN109905925A (en) * 2019-05-10 2019-06-18 恒玄科技(上海)有限公司 The communication means of wireless device component and wireless device component

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8867340B2 (en) * 2005-12-21 2014-10-21 Alcatel Lucent Discarded packet indicator
US9949205B2 (en) * 2012-05-26 2018-04-17 Qualcomm Incorporated Smart battery wear leveling for audio devices
US9986468B2 (en) * 2016-03-18 2018-05-29 Futurewei Technologies, Inc. Remove TCP deadlock caused by wireless device cross technology handover
US10348370B2 (en) * 2017-08-02 2019-07-09 Nxp B.V. Wireless device communication
CN107404340A (en) * 2017-08-29 2017-11-28 广东欧珀移动通信有限公司 Transmission method, device, terminal and the storage medium of Bluetooth audio frequency data

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108337074A (en) * 2018-06-22 2018-07-27 恒玄科技(上海)有限公司 The bluetooth headset wireless communications method of high reliability
CN109660971A (en) * 2018-12-05 2019-04-19 恒玄科技(上海)有限公司 Wireless headset and communication means for wireless headset
CN109561419A (en) * 2019-02-19 2019-04-02 恒玄科技(上海)有限公司 The ears wireless headset of high reliability and communication means for ears wireless headset
CN109905925A (en) * 2019-05-10 2019-06-18 恒玄科技(上海)有限公司 The communication means of wireless device component and wireless device component

Also Published As

Publication number Publication date
CN111031437A (en) 2020-04-17

Similar Documents

Publication Publication Date Title
CN111031437B (en) Wireless earphone assembly and communication method thereof
CN109660971B (en) Wireless earphone and communication method for wireless earphone
CN110769347B (en) Synchronous playing method of earphone assembly and earphone assembly
US10932043B2 (en) Wireless audio system and method for wirelessly communicating audio information using the same
US10798477B2 (en) Wireless audio system and method for wirelessly communicating audio information using the same
CN109561419B (en) The ears wireless headset of high reliability and communication means for ears wireless headset
US10244307B1 (en) Communication of wireless headphones
US10271152B1 (en) Synchronization of wireless headphones
US10432773B1 (en) Wireless audio transceivers
CN110290412B (en) A kind of audio sync playback method, device and loudspeaker apparatus, wireless headset
CN110312237B (en) Wireless earphone and communication method of wireless earphone
US10412481B1 (en) Operation mode switch of wireless headphones
US20190104424A1 (en) Ultra-low latency audio over bluetooth
WO2019129748A1 (en) Wireless stereo headset with diversity
CN111142665B (en) Stereo processing method and system for earphone assembly and earphone assembly
US10944154B1 (en) Wireless audio system and method for wirelessly communicating audio information using the same
WO2021217723A1 (en) Systems and methods for wireless transmission of audio information
US20230179902A1 (en) Communication method applied to binaural wireless headset, and apparatus
WO2021205235A1 (en) Low latency bluetooth earbuds
US11956084B2 (en) Wireless stereo headset with bidirectional diversity
JP7215427B2 (en) Wireless LAN communication device, wireless LAN communication method and wireless LAN communication program
US10778479B1 (en) Systems and methods for wireless transmission of audio information
CN114747165A (en) Data sending method and device applied to Bluetooth communication
US20180367243A1 (en) Devices and method for wirelessly broadcasting media packets
TWI710225B (en) Controller of wireless bluetooth device and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant