WO2022199319A1

WO2022199319A1 - Audio output method and apparatus, computer device, and storage medium

Info

Publication number: WO2022199319A1
Application number: PCT/CN2022/077878
Authority: WO
Inventors: 张莉; 周依鸽; 过一
Original assignee: 深圳市欢太科技有限公司; Oppo广东移动通信有限公司
Priority date: 2021-03-24
Filing date: 2022-02-25
Publication date: 2022-09-29
Also published as: CN112925503A

Abstract

The present application relates to the technical field of computers, and discloses an audio output method and apparatus, a computer device, and a storage medium. The method comprises: detecting whether an impact event occurs between two earphones; if yes, detecting whether at least two audios from different sources are being played; and if yes, outputting a first audio to one of the earphones, and outputting a second audio to the other earphone. The technical solution provided by embodiments of the present application can improve the audio output flexibility.

Description

Audio output method, device, computer equipment and storage medium

technical field

The present application relates to the field of computer technology, and in particular, to an audio output method, apparatus, computer device, and storage medium.

Background technique

At present, many users are accustomed to using earphones to listen to the audio output from the terminal device. In practical applications, the terminal device may need to output multiple audio sources with different audio sources at the same time. For example, the terminal device can open the music playing APP and the video playing APP at the same time. In this case, the terminal device needs to output the audio from the music playing APP and the audio from the video playing APP at the same time.

In the related art, a terminal device can mix and process multiple audios from different audio sources that it needs to output simultaneously, and output the mixed audio obtained by the mixing process to an earphone, so that the mixed audio can be played by the earphone.

However, this way of outputting mixed audio in the prior art is less flexible.

SUMMARY OF THE INVENTION

Based on this, the embodiments of the present application provide an audio output method, apparatus, computer device, and storage medium, which can improve the flexibility of audio output.

In a first aspect, an audio output method is provided, the method comprising:

Detect whether a mutual collision event occurs between two earphones that have established a communication connection with the terminal device; if a mutual collision event occurs between the two earphones, detect whether the terminal device is playing at least two audios from different audio sources; if The terminal device is playing at least two audios from different audio sources, then outputs the first audio of the at least two audios to one of the two earphones, and outputs the second audio of the at least two audios to one of the two earphones. output to the other of the two headphones.

In a second aspect, an audio output method is provided for use in a first earphone, the method comprising:

Generate collision detection information, and send the collision detection information to a terminal device that has established a communication connection with the first earphone. The collision detection information is used to characterize the characteristics of the collision event that occurs in the first earphone, and the collision detection information is used. For the terminal device to determine whether a mutual collision event occurs between the first earphone and the second earphone that has established a communication connection with the terminal device based on the impact detection information; receive and play the first audio output from the terminal device, the first An audio is output by the terminal device after determining that the first earphone and the second earphone collide with each other, and the terminal device is playing at least two audios from different audio sources, and the first audio is the at least one audio Part of the audio of the two audios.

In a third aspect, an audio output device is provided, the device comprising:

a first detection module for detecting whether a collision event occurs between two earphones that have established a communication connection with the terminal device;

a second detection module, configured to detect whether the terminal device is playing at least two audios from different audio sources when a mutual collision event occurs between the two earphones;

The output module is configured to output the first audio of the at least two audios to one of the two earphones when the terminal device is playing at least two audios from different audio sources, and output the at least two audios to one of the two earphones. A second audio of the two audios is output to the other of the two earphones.

In a fourth aspect, an audio output device is provided for use in the first earphone, the device comprising:

A generation module is used to generate impact detection information;

A sending module is used to send the impact detection information to a terminal device that has established a communication connection with the first earphone, the impact detection information is used to characterize the characteristics of the impact event that occurs in the first earphone, and the impact detection information is used for for the terminal device to determine, based on the impact detection information, whether a mutual impact event occurs between the first earphone and the second earphone that has established a communication connection with the terminal device;

A receiving module, configured to receive and play the first audio output from the terminal device, where the first audio is the event that the terminal device determines that the first earphone and the second earphone collide with each other, and the terminal device is playing After at least two audios from different audio sources are output, the first audio is a part of the at least two audios.

In a fifth aspect, a computer device is provided, comprising a processor and a memory, a computer program is stored in the memory, and the processor implements the audio output method described in the first aspect and the second aspect when the processor executes the computer program .

In a sixth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, implements the audio output method according to the first aspect and the second aspect.

The beneficial effects brought by the technical solutions provided in the embodiments of the present application include at least:

By detecting whether a mutual collision event occurs between two earphones that have established a communication connection with the terminal device, and in the case of a mutual collision event between the two earphones, it is detected whether the terminal device is playing at least two audio sources from different sources. Audio, when the terminal device is playing at least two audios from different audio sources, outputs the first audio of the at least two audios to one of the two earphones, and outputs the at least two audios to one of the two earphones. The second audio is output to the other one of the two earphones, so that the user can listen to the first audio based on the one earphone that has established a communication connection with the terminal device, and can listen to the first audio based on the second earphone that has established a communication connection with the terminal device. By listening to the second audio, the user can be provided with a flexible audio listening mode, so that the user can clearly listen to the audio from different audio sources based on different headphones, thereby improving the flexibility of the audio output.

Description of drawings

FIG. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application;

2 is a flowchart of an audio output method provided by an embodiment of the present application;

3 is a flowchart of an exemplary technical process for detecting whether a mutual collision event occurs between two earphones that have established a communication connection with a terminal device according to an embodiment of the present application;

4 is a flowchart of an audio output method provided by an embodiment of the present application;

FIG. 5 is a flowchart of an audio output method provided by an embodiment of the present application

6 is a block diagram of an audio output device provided by an embodiment of the present application;

FIG. 7 is a block diagram of an audio output device according to an embodiment of the present application

FIG. 8 is a block diagram of a terminal device provided by an embodiment of the present application;

FIG. 9 is a block diagram of an earphone according to an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

Currently, the terminal device can establish a communication connection with the headset through wired or wireless communication, and the communication device can output audio to the headset based on the established communication connection, so as to be played by the headset.

In addition, in practical applications, the terminal device may need to output audio from multiple different audio sources at the same time. For example, the terminal device can open the music player APP and the video player APP at the same time. In this case, the terminal device needs to output the audio from the music player at the same time. The audio of the app and the audio from the video playback app.

In the related art, the terminal device can mix and process multiple audios from different audio sources that it needs to output at the same time, and output the mixed audio obtained by the mixing process to the earphone, so that the mixed audio can be played by the earphone. When listening to the mixed audio with headphones, you can hear the audio content of different audio sources at the same time.

However, the manner of outputting mixed audio in the prior art may cause the user to be unable to hear the audio of each audio source clearly, and cannot satisfy the user's requirement to listen to the audio of each audio source separately, so the flexibility is low. In view of this, the embodiments of the present application provide an audio output method, which can improve the flexibility of audio output.

Next, the implementation environment involved in the audio output method provided by the embodiment of the present application will be described.

As shown in FIG. 1 , the implementation environment may include a terminal device 101 and two earphones 102, and the two earphones 102 may belong to the same pair of earphones. For example, one of the two earphones 102 is a left earphone, and the two earphones 102 The other one of the earphones 102 is a right earphone, and in an optional embodiment of the present application, the two earphones 102 may be TWS earphones.

In this embodiment of the present application, each headset 102 establishes a communication connection with the terminal device 101. Optionally, the headset 102 may establish a communication connection with the terminal device 101 in a wired manner, or may establish a communication connection with the terminal device 101 in a wireless manner. A communication connection is established, wherein the wireless manner may be a short-range communication manner, for example, Bluetooth, WIFI, Zigbee, etc., which is not specifically limited in this embodiment of the present application.

The terminal device 101 in the embodiment of the present application may be an electronic device with an audio output function, such as a smart phone, a tablet computer, a desktop computer, a notebook computer, a music player, a television, a wearable device, and the like.

Please refer to FIG. 2 , which shows a flowchart of an audio output method provided by an embodiment of the present application. The audio output method may be applied to the terminal device shown in FIG. 1 . As shown in Figure 2, the audio output method may include the following steps:

Step 201: The terminal device detects whether a mutual collision event occurs between two earphones that have established a communication connection with itself.

Wherein, in the embodiment of the present application, the mutual collision event refers to an event in which physical contact occurs between the two earphones, and the physical contact may include extrusion, relative sliding after contact, or separation after collision.

Step 202: If a mutual collision event occurs between the two earphones, the terminal device detects whether it is playing at least two audios from different audio sources.

The audio source refers to the audio source. For example, the audio source can be an application program, and the application program can be a system program or a third-party application program. For example, the system program can be a phone program, and the third-party application program can be an audio program. Player or video player, etc.

Step 203: If the terminal device is playing at least two audios from different audio sources, the terminal device outputs the first audio of the at least two audios to one of the two earphones, and the at least two audios The second audio in the earphone is output to the other earphone of the two earphones.

In this embodiment of the present application, if it is detected that the two earphones collide with each other, the terminal device can perform streaming processing on at least two audios from different audio sources that it is playing, that is, the terminal device can control the One of the earphones that has established a communication connection with itself plays a part of the audio (the first audio) in the at least two audios, and can control the other earphone that has established a communication connection with itself to play another part of the audio (the first audio) in the at least two audios. second audio).

For example, the terminal device can establish a communication connection with the left earphone and the right earphone in the TWS earphone respectively. If the terminal device detects that the left earphone and the right earphone collide with each other, the terminal device can One channel of audio (for example, this channel of audio can be the audio from the music player APP) is output to the left ear earphone, and the other channel of audio that is being played (for example, this channel of audio can be the audio from the video player APP) is output to the Right ear headphone.

In this embodiment, by detecting whether a mutual collision event occurs between two earphones that have established a communication connection with the terminal device, and when a mutual collision event occurs between the two earphones, it is detected whether the terminal device is playing the At least two audios from different audio sources, when the terminal device is playing at least two audios from different audio sources, output the first audio of the at least two audios to one of the two earphones, The second audio of the at least two audios is output to the other one of the two earphones, so that the user can listen to the first audio based on the one earphone that has established a communication connection with the terminal device, and can listen to the first audio based on the one earphone that has established a communication connection with the terminal device. By listening to the second audio through the second earphone connected in communication, a flexible audio listening mode can be provided for the user, so that the user can clearly listen to the audio from different audio sources based on different earphones, so that the flexibility of the audio output can be improved.

Please refer to FIG. 3 , which is an exemplary technical process for detecting whether a mutual collision event occurs between two earphones that have established a communication connection with a terminal device provided by an embodiment of the application. As shown in FIG. 3 , the technical process Include the following steps:

Step 301: The terminal device receives the impact detection information reported by each earphone that has established a communication connection with itself.

The impact detection information reported by the earphone is used to characterize the characteristics of the impact event that occurs in the earphone. For example, the feature may be the impact time, the energy value of the ambient sound collected by the earphone when the impact event occurs, and the value of the ambient sound collected by the earphone when the impact event occurs. Sound characteristics of ambient sound and/or motion state information of headphones, etc.

In this embodiment of the present application, the impact detection information may be data measured by the earphone through a sensing element provided in itself.

In an optional embodiment of the present application, after receiving the impact detection information reported by each earphone, the terminal device may determine whether a preset type of impact event occurs for each earphone according to the impact detection information reported by each earphone. If a predetermined type of impact event does not occur for a certain earphone, the terminal device can determine that there is no mutual impact event between the two earphones. If the terminal device determines that each of the two earphones has a predetermined type of impact event , the terminal device can, in the subsequent steps, detect whether a mutual collision event occurs between the two earphones according to the collision detection information reported by each earphone.

Wherein, in the embodiment of the present application, a preset type of impact event may be pre-agreed with the user, and the characteristics of the preset type of impact event are similar to the characteristics of impact events such as unintentional bumps that may occur in earphones in daily life. The difference is greater than the preset difference threshold.

For example, a preset type of impact event may refer to an event in which the headset and other objects continuously make physical contact multiple times within a preset time period. For another example, a preset type of impact event may refer to an event in which the headset and a specific material (for example, An event in which an object of plastic) continuously makes multiple physical contacts within a preset period of time. For another example, a preset type of impact event may refer to the continuous multiple contact between the headset and other objects within a preset period of time. The intensity is greater than the preset strength. A physical contact event with a threshold value, for another example, a preset type of impact event may refer to the physical contact between the earphone and an object of a specific material (eg, plastic) for multiple consecutive times within a preset time period with a contact intensity greater than a preset intensity threshold value. event.

The embodiment of the present application does not specifically limit the preset type of impact event, as long as it is significantly different from the impact event similar to unintentional impact that may occur in the earphones in daily life.

Because in an optional embodiment of the present application, the terminal device first determines whether a preset type of impact event occurs in the earphones, and in the case where a preset type of impact event occurs in each earphone, the terminal device determines based on the impact detection information reported by each earphone. Whether there is a collision event between the two earphones, and the pre-set type of collision event is quite different from the accidental collision that may occur in the earphones in daily life. Therefore, it can effectively filter out the daily impact of the earphones The negative impact of collision events such as unintentional bumps that may occur in life on the judgment of the terminal equipment, so as to avoid misjudgment of the terminal equipment.

It should be pointed out that, in practical applications, after the earphone generates the impact detection information, it can detect whether the impact detection information satisfies the reporting condition, wherein the reporting condition may be set according to the characteristics of the impact event of a preset type, After detecting that the collision detection information meets the reporting conditions, the earphone can report the collision detection information to the terminal device, so that the earphone can preliminarily filter the collision detection information obtained by itself based on the reporting conditions, so as to avoid the obvious impossible to characterize the prediction. The impact detection information of the type of impact event is reported to the terminal device, so that the calculation amount of the terminal device can be reduced.

According to the different contents of the collision detection information reported by the earphones, the embodiments of the present application provide the following four methods for detecting whether a predetermined type of collision event occurs in the earphones. Below, the embodiments of the present application will describe the four methods one by one. .

The first way: the impact detection information includes the ambient sound picked up by the earphone when the impact event occurs. In practical applications, the earphone may be provided with a sound pickup element, for example, the sound pickup element may be a microphone. The ambient sound is picked up based on the sound pickup element, and the picked up ambient sound is sent to the terminal device as impact detection information.

As mentioned above, optionally, after the earphone picks up the ambient sound when the impact event occurs, it can detect whether the ambient sound meets the reporting conditions, and after the ambient sound meets the reporting conditions, send the ambient sound as impact detection information to the terminal device.

After receiving the ambient sound picked up when the impact event occurs and reported by each earphone, for each earphone, the terminal device can detect whether the sound feature of the ambient sound reported by the earphone is consistent with the preset sound feature, wherein the preset sound feature Refers to the sound characteristics of the impact sound generated by a preset type of impact event. If the sound characteristics of the ambient sound reported by the headset are consistent with the preset sound characteristics, the terminal device can determine that the headset has a preset type of impact event. In this case, the terminal device can use the collision detection information reported by each earphone based on the subsequent steps to determine whether a mutual collision event occurs between the two earphones. If the sound characteristics of the ambient sound reported by the earphones are inconsistent with the preset sound characteristics, Then the terminal device can determine that the earphone does not have a preset type of impact event. In this case, the terminal device can determine that there is no mutual impact event between the two earphones.

It should be pointed out that, in this embodiment of the present application, consistent can be understood as the same or similar, where similar means that the difference is smaller than the preset difference threshold. For example, the sound characteristics of the ambient sound are consistent with the preset sound characteristics. The sound feature of the ambient sound is the same as the preset sound feature, or the difference between the sound feature of the ambient sound and the preset sound feature is smaller than the preset gap threshold. In the following embodiments of the present application, there is also a description of "consistent", and the meaning thereof is the same as that here, and will not be repeated in the following embodiments of the present application.

In an optional embodiment of the present application, the terminal device can detect the number of times that the ambient sound reported by the earphone has an energy peak within a preset time period and whether the interval is the same as the number of times that the energy peak occurs within the preset time period indicated by the preset sound feature and the intervals are the same. If they are the same, the terminal device can determine that a preset type of impact event occurs on the earphone. If they are inconsistent, the terminal device can determine that the earphone does not have a preset type of impact event.

In an optional embodiment of the present application, the terminal device can detect whether the magnitude of the energy peak value of the ambient sound reported by the earphone is consistent with the energy peak value indicated by the preset sound feature. If the impact event of the preset type is not consistent, the terminal device can determine that the earphone does not have the impact event of the preset type.

In an optional embodiment of the present application, the terminal device can detect whether the magnitude of the frequency of the ambient sound reported by the headset is consistent with the magnitude of the frequency indicated by the preset sound feature, and if so, the terminal device can determine that the headset has a preset type If they are inconsistent, the terminal device can determine that the earphone does not have a preset type of impact event.

The second way: the impact detection information includes the motion state information of the headset, where the motion state information can be acceleration information, rotation angle information, etc. The sensing element may be, for example, an accelerometer, a gyroscope, etc. The headset may detect motion state information of the headset based on the motion detection sensing element, and send the detected motion state information to the terminal device as impact detection information.

Similarly to the above, in an optional embodiment of the present application, after acquiring the motion state information, the earphone can detect whether the motion state information satisfies the reporting condition, and after the motion state information satisfies the reporting condition, The motion state information is sent to the terminal device as impact detection information.

After receiving the motion state information reported by each earphone, for each earphone, the terminal device can detect whether the motion state information reported by the earphone is consistent with the preset impact motion state information, wherein the preset impact motion state information is a preset type If the motion state information reported by the earphone is consistent with the preset impact motion state information, the terminal device can determine that the earphone has a preset type of impact event. In this case, the terminal The device can use the impact detection information reported by each earphone based on the subsequent steps to determine whether a mutual impact event occurs between the two earphones. If the motion state information reported by the earphones is inconsistent with the preset impact motion state information, the terminal device can determine the earphones. A collision event of a preset type does not occur, and in this case, the terminal device may determine that a collision event does not occur between the two earphones.

In an optional embodiment of the present application, the terminal device can determine the acceleration change of the earphone within a preset time period according to the acceleration information reported by the earphone, and the terminal device can detect the acceleration change of the earphone and the information indicated by the preset impact motion state information. Whether the acceleration changes are consistent, if so, the terminal device can determine that a preset type of impact event occurs on the earphone; if not, the terminal device can determine that the earphone does not have a preset type of impact event.

In an optional embodiment of the present application, the terminal device can determine the posture change of the earphone within a preset time period according to the rotation angle information reported by the earphone, and the terminal device can detect the posture change of the earphone and the information indicated by the preset impact motion state information. Whether the posture changes are consistent, if so, the terminal device can determine that a preset type of impact event occurs on the earphone; if not, the terminal device can determine that the earphone does not have a preset type of impact event.

The third way: the impact detection information may include both the ambient sound picked up by the earphone when the impact event occurs and the motion state information of the earphone.

In this case, for each earphone, the terminal device can detect whether the sound characteristics of the ambient sound reported by the earphone are consistent with the preset sound characteristics, and can detect whether the motion state information reported by the earphone is consistent with the preset impact motion state information , if the sound characteristics of the ambient sound reported by the headset are consistent with the preset sound characteristics, and the motion state information reported by the headset is consistent with the preset impact motion state information, the terminal device can determine that a preset type of impact event occurs on the headset On the contrary, if the sound characteristics of the ambient sound reported by the earphone are inconsistent with the preset sound characteristics, or the motion state information reported by the earphone is inconsistent with the preset impact motion state information, the terminal device can determine that the earphone does not have the preset type. impact event.

In the third manner, the terminal device can jointly determine whether the earphone has a preset type of impact event based on multiple dimensions, so the accuracy of the determination is high.

The fourth way: In an optional embodiment of the present application, the earphone can determine whether a preset type of impact event has occurred to itself based on the data measured by the sensing element set in the headset, and after determining that a preset type of impact event has occurred in itself After a type of impact event, the impact detection information is generated, wherein the impact detection information is used to indicate that a preset type of impact event occurs in the earphone.

Then, for the terminal device, for each earphone, if the terminal device receives the impact detection information reported by the earphone, the terminal device can determine that the earphone has a preset type of impact event.

Step 302: The terminal device detects whether a mutual collision event occurs between the two earphones according to the collision detection information reported by each earphone.

In an optional embodiment of the present application, the terminal device may detect whether the impact events occurring in the respective earphones are correlated according to the impact detection information reported by each earphone. Then, the terminal device can determine that a mutual collision event occurs between the two earphones, and if the collision events that occur in the respective earphones are not correlated, the terminal can determine that a mutual collision event does not occur between the two earphones.

Wherein, in an optional embodiment of the present application, the fact that the respective impact events of each earphone are correlated may mean that the difference between the characteristics of the respective impact events of each earphone is smaller than a preset difference threshold.

The embodiments of the present application provide two exemplary manners for detecting whether the impact events generated by the respective earphones are related, and the following embodiments of the present application will describe the two manners one by one.

The first way: the terminal device determines the impact time of the impact event of each earphone according to the impact detection information reported by each earphone. If the difference between the impact time of the two earphones when the impact event occurs is within the preset time gap It can be determined that the impact events that occur respectively between the two earphones are correlated, and then the terminal device can determine that a mutual impact event occurs between the two earphones.

In an optional embodiment of the present application, the terminal device may use the time when each earphone reports the impact detection information as the impact time of the impact event of each earphone. In an optional embodiment of the present application, if the impact detection information includes ambient sound, the terminal device may also use the time when the energy peak in the ambient sound reported by each earphone appears as the impact time of the impact event of each earphone. In an optional embodiment of the present application, the impact detection information may also carry a timestamp when the earphone generated the impact detection information, and the terminal device may use the time indicated by the timestamp as the impact time of the earphone impact event.

The second way: when the impact detection information includes the ambient sound picked up by the earphones when the impact event occurs, the terminal device can obtain the energy value of the ambient sound reported by each earphone. Within the range of the preset energy gap, the terminal device may determine that the impact events of the two earphones are correlated, and then the terminal device may determine that a mutual impact event occurs between the two earphones.

Please refer to FIG. 4 , which shows a flowchart of an audio output method provided by an embodiment of the present application. The audio output method can be applied to any earphone shown in FIG. 1 . For the convenience of description, the following is unified Called the first earphone. As shown in Figure 4, the audio output method may include the following steps:

Step 401: The first earphone generates collision detection information, and sends the generated collision detection information to a terminal device that has established a communication connection with the first earphone.

Wherein, the impact detection information is used to characterize the characteristics of the impact event that occurs with the first earphone, and the impact detection information is used for the terminal device to determine, based on the impact detection information, the first earphone and the second earphone that has established a communication connection with the terminal device. whether there is a collision between them.

Step 402: The first earphone receives and plays the first audio output from the terminal device.

The first audio is output by the terminal device after determining that the first earphone and the second earphone collide with each other, and the terminal device is playing at least two audios from different audio sources, and the first audio is the Part of at least two audios.

As mentioned above, in some possible cases, the earphone can determine whether a preset type of impact event has occurred based on the data measured by the sensing element set in the earphone. After the collision event, the collision detection information can be generated and reported to the terminal device, wherein the collision detection information is used to indicate that a preset type of collision event has occurred in the earphone. After receiving the collision detection information, the terminal device can determine to report the collision. A pre-set type of impact event occurred on the headset monitoring the event.

Similar to the above-mentioned terminal device detecting whether a preset type of impact event occurs to the earphone, the first earphone can detect whether a preset type of impact event occurs in itself based on the following three exemplary manners.

The first way: the first earphone detects whether the sound characteristics of the ambient sound picked up when the impact event occurs are consistent with the preset sound characteristics; if the sound characteristics of the ambient sound picked up when the impact event occurs are consistent with the preset sound characteristics, then The first earphone generates impact detection information.

The second method: the first earphone detects whether its own motion state information is consistent with the preset impact motion state information; if the motion state information of the first earphone is consistent with the preset impact motion state information, the first earphone generates impact detection information.

The third method: the first earphone detects whether the sound characteristics of the ambient sound picked up when the impact event occurs is consistent with the preset sound characteristics, and detects whether its own motion state information is consistent with the preset impact motion state information. If the sound feature of the ambient sound picked up when it occurs is consistent with the preset sound feature, and the motion state information of the first earphone is consistent with the preset impact motion state information, the first earphone generates impact detection information.

Please refer to FIG. 5 , which shows a flowchart of an audio output method provided by an embodiment of the present application, and the audio output method can be applied to the implementation environment shown in FIG. 1 . As shown in Figure 5, the audio output method may include the following steps:

Step 501: The earphone generates collision detection information, and sends the generated collision detection information to a terminal device that has established a communication connection with the earphone.

Step 502: The terminal device determines whether the two earphones collide with each other based on the received impact detection information sent by each of the two earphones that have established a communication connection with itself.

Step 503: If a collision event occurs between the two earphones, the terminal device detects whether it is playing at least two audios from different audio sources.

Step 504: If the terminal device is playing at least two audios from different audio sources, the terminal device outputs the first audio of the at least two audios to one of the two headphones, and the at least two audios The second audio output of the two headphones is output to the other of the two headphones.

Step 505: The headset receives the audio output from the terminal device, and plays the received audio.

Please refer to FIG. 6 , which shows a block diagram of an audio output apparatus 600 provided by an embodiment of the present application. The audio output apparatus 600 may be configured in a terminal device. As shown in FIG. 6 , the audio output device 600 may include: a first detection module 601 , a second detection module 602 and an output module 603 .

Wherein, the first detection module 601 is used to detect whether a mutual collision event occurs between two earphones that have established a communication connection with the terminal device.

The second detection module 602 is configured to detect whether the terminal device is playing at least two audios from different audio sources when a mutual collision event occurs between the two earphones.

The output module 603 is configured to output the first audio of the at least two audios to one of the two earphones when the terminal device is playing at least two audios from different audio sources, and output the first audio of the at least two audios to one of the two earphones. A second audio of the at least two audios is output to the other of the two earphones.

In one embodiment, the first detection module 601 is specifically configured to: receive impact detection information reported by each earphone, where the impact detection information is used to characterize the characteristics of the impact event that occurs in the earphone; according to the impact detection information reported by each earphone Collision detection information, to detect whether a mutual collision event occurs between the two earphones.

In one embodiment, the first detection module 601 is specifically configured to: determine the impact time of the impact event of each earphone according to the impact detection information reported by each earphone; if the two earphones have the impact of the impact event If the time gap is within the preset time gap range, it is determined that a collision event occurs between the two earphones.

In one embodiment, the impact detection information includes ambient sounds collected by the earphones when the impact event occurs, and the first detection module 601 is specifically configured to: according to the impact detection information reported by the earphones, determine whether the earphones are impacted The energy value of the ambient sound collected at the time of the event; if the difference between the energy values of the ambient sound collected by the two earphones when the collision event occurs is within the preset energy difference range, it is determined that the two earphones collide with each other event.

In one embodiment, the impact detection information includes the ambient sound collected by the earphone when the impact event occurs, and the first detection module 601 is specifically configured to: for each earphone, detect the sound feature and prediction of the ambient sound reported by the earphone. Set whether the sound characteristics are consistent; if the sound characteristics of the ambient sound reported by the earphones are inconsistent with the preset sound characteristics, it is determined that there is no collision event between the two earphones.

In one embodiment, the impact detection information includes motion state information of the earphone, and the first detection module 601 is specifically configured to: for each earphone, detect whether the motion state information reported by the earphone is consistent with the preset impact motion state information ; if the motion state information reported by the earphones is inconsistent with the preset impact motion state information, it is determined that there is no mutual collision event between the two earphones.

The audio output device provided by the embodiments of the present application can implement the above method embodiments, and the implementation principles and technical effects thereof are similar, and details are not described herein again.

For specific limitations on the audio output device, reference may be made to the limitations on the audio output method above, which will not be repeated here. Each module in the above-mentioned audio output device may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in or independent of the processor of the terminal device in the form of hardware, or may be stored in the memory of the terminal device in the form of software, so that the processor can call and execute operations corresponding to the above modules.

Please refer to FIG. 7 , which shows a block diagram of an audio output apparatus 700 provided by an embodiment of the present application. The audio output apparatus 700 may be configured in a first earphone. As shown in FIG. 7 , the audio output apparatus 700 may include: a generating module 701 , a sending module 702 and a receiving module 703 .

Wherein, the generating module 701 is used to generate collision detection information.

The sending module 702 is configured to send the impact detection information to a terminal device that has established a communication connection with the first earphone, the impact detection information is used to characterize the characteristics of the impact event that occurs in the first earphone, and the impact detection information It is used for the terminal device to determine, based on the impact detection information, whether a mutual impact event occurs between the first earphone and the second earphone that has established a communication connection with the terminal device.

The receiving module 703 is configured to receive and play the first audio output from the terminal device, where the first audio is the event that the terminal device determines that a collision occurs between the first earphone and the second earphone, and the terminal device determines that a collision occurs between the first earphone and the second earphone. The first audio is output after playing at least two audios from different audio sources, and the first audio is a part of the at least two audios.

In one embodiment, the generating module 701 is specifically configured to: detect whether the sound characteristics of the ambient sound collected by the first earphone when the impact event occurs are consistent with the preset sound characteristics; if the first earphone occurs when the impact event occurs If the sound characteristics of the ambient sound collected at the time are consistent with the preset sound characteristics, the collision detection information is generated.

In one embodiment, the generating module 701 is specifically configured to: detect whether the motion state information of the first earphone is consistent with the preset impact motion state information; if the motion state information of the first earphone is consistent with the preset impact motion If the status information is consistent, the collision detection information is generated.

For specific limitations on the audio output device, reference may be made to the limitations on the audio output method above, which will not be repeated here. Each module in the above-mentioned audio output device may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in or independent of the processor of the earphone in the form of hardware, or may be stored in the memory of the earphone in the form of software, so that the processor can call and execute operations corresponding to the above modules.

FIG. 8 is a schematic diagram of an internal structure of a terminal device in an embodiment. As shown in FIG. 8 , the terminal device includes a processor and a memory connected through a system bus. Among them, the processor is used to provide computing and control capabilities to support the operation of the entire terminal equipment. The memory may include non-volatile storage media and internal memory. The nonvolatile storage medium stores an operating system and a computer program. The computer program can be executed by the processor to implement an audio output method provided by the above embodiments. The internal memory provides a cached execution environment for the operating system and computer programs in the non-volatile storage medium.

Those skilled in the art can understand that the structure shown in FIG. 8 is only a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the terminal equipment to which the solution of the present application is applied. Include more or fewer components than shown in the figures, or combine certain components, or have a different arrangement of components.

FIG. 9 is a schematic diagram of the internal structure of an earphone in one embodiment. As shown in Figure 9, the headset includes a processor and memory connected through a system bus. Among them, the processor is used to provide computing and control capabilities to support the operation of the entire headset. The memory may include non-volatile storage media and internal memory. The nonvolatile storage medium stores an operating system and a computer program. The computer program can be executed by the processor to implement an audio output method provided by the above embodiments. The internal memory provides a cached execution environment for the operating system and computer programs in the non-volatile storage medium.

In addition, the earphone may further include an audio playing element, a sound pickup element, and a motion state monitoring element, wherein the motion state monitoring element may be an accelerometer, a gyroscope, and the like.

Those skilled in the art can understand that the structure shown in FIG. 9 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the earphone to which the solution of the present application is applied. More or fewer components are shown in the figures, either in combination or with different arrangements of components.

In one embodiment of the present application, a terminal device is provided, the terminal device includes a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when executing the computer program:

In an embodiment of the present application, the processor also implements the following steps when executing the computer program: receiving impact detection information reported by each earphone, where the impact detection information is used to characterize the characteristics of the impact event that occurs in the earphone; the collision detection information, to detect whether a mutual collision event occurs between the two earphones.

In an embodiment of the present application, when the processor executes the computer program, the following steps are also implemented: according to the impact detection information reported by each earphone, determine the impact time of the impact event of each earphone; if the two earphones have the impact event If the difference of the impact time is within the range of the preset time difference, it is determined that a mutual impact event occurs between the two earphones.

In an embodiment of the present application, the impact detection information includes ambient sounds collected by the earphones when the impact event occurs, and the processor also implements the following steps when executing the computer program: according to the impact detection information reported by each earphone, determine whether each earphone is in The energy value of the ambient sound collected when the impact event occurs; if the difference between the energy values of the ambient sound collected by the two earphones when the impact event occurs is within the preset energy gap, it is determined that the two earphones have occurred between the two earphones. collision event.

In one embodiment of the present application, the impact detection information includes ambient sounds collected by the earphones when the impact event occurs, and the processor also implements the following steps when executing the computer program: for each earphone, detecting the sound characteristics of the ambient sounds reported by the earphones Whether it is consistent with the preset sound feature; if the sound feature of the ambient sound reported by the earphone is inconsistent with the preset sound feature, it is determined that there is no collision event between the two earphones.

In an embodiment of the present application, the impact detection information includes motion state information of the earphone, and the processor also implements the following steps when executing the computer program: for each earphone, detecting the motion state information reported by the earphone and the preset impact motion state information Whether it is consistent; if the motion state information reported by the earphones is inconsistent with the preset impact motion state information, it is determined that there is no mutual impact event between the two earphones.

The implementation principle and technical effect of the terminal device provided by the embodiments of the present application are similar to those of the foregoing method embodiments, and details are not described herein again.

In one embodiment of the present application, an earphone is provided, the earphone includes a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when executing the computer program:

In an embodiment of the present application, the processor further implements the following steps when executing the computer program: detecting whether the sound characteristics of the ambient sound collected by the first earphone when the impact event occurs is consistent with the preset sound characteristics; The sound feature of the ambient sound collected when the impact event occurs is consistent with the preset sound feature, and the impact detection information is generated.

In an embodiment of the present application, the processor also implements the following steps when executing the computer program: detecting whether the motion state information of the first earphone is consistent with the preset impact motion state information; if the motion state information of the first earphone is consistent with the If the preset impact motion state information is consistent, the impact detection information is generated.

The implementation principle and technical effect of the earphone provided by the embodiment of the present application are similar to those of the foregoing method embodiment, and details are not described herein again.

In an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

In an embodiment of the present application, when the computer program is executed by the processor, the following steps are further implemented: receiving impact detection information reported by each earphone, where the impact detection information is used to characterize the characteristics of the impact event occurring in the earphone; according to each earphone The reported collision detection information detects whether a mutual collision event occurs between the two earphones.

In an embodiment of the present application, when the computer program is executed by the processor, the following steps are also implemented: according to the impact detection information reported by each earphone, determine the impact time of the impact event of each earphone; if the two earphones collide If the difference between the impact times of the events is within the range of the preset time difference, it is determined that a mutual impact event occurs between the two earphones.

In an embodiment of the present application, the impact detection information includes ambient sounds collected by the earphones when the impact event occurs, and when the computer program is executed by the processor, the following steps are also implemented: determine each earphone according to the impact detection information reported by each earphone. The energy value of the ambient sound collected when the impact event occurs; if the difference between the energy values of the ambient sound collected by the two earphones when the impact event occurs is within the range of the preset energy gap, determine the difference between the two earphones. A collision event occurred.

In an embodiment of the present application, the impact detection information includes ambient sound collected by the earphone when the impact event occurs, and the computer program is executed by the processor to further implement the following steps: for each earphone, detect the sound of the ambient sound reported by the earphone Whether the feature is consistent with the preset sound feature; if the sound feature of the ambient sound reported by the earphone is inconsistent with the preset sound feature, it is determined that there is no collision event between the two earphones.

In one embodiment of the present application, the impact detection information includes motion state information of the earphones, and the computer program also implements the following steps when executed by the processor: for each earphone, detecting the motion state information reported by the earphones and the preset impact motion state Whether the information is consistent; if the motion state information reported by the earphones is inconsistent with the preset impact motion state information, it is determined that there is no mutual collision event between the two earphones.

The implementation principle and technical effect of the computer-readable storage medium provided in this embodiment are similar to those of the foregoing method embodiments, and details are not described herein again.

In an embodiment of the present application, when the computer program is executed by the processor, the following steps are further implemented: detecting whether the sound characteristics of the ambient sound collected by the first earphone when the impact event occurs is consistent with the preset sound characteristics; The impact detection information is generated when the sound feature of the ambient sound collected by the earphone when the impact event occurs is consistent with the preset sound feature.

In an embodiment of the present application, when the computer program is executed by the processor, the following steps are further implemented: detecting whether the motion state information of the first earphone is consistent with the preset impact motion state information; If the preset impact motion state information is consistent, the impact detection information is generated.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage In the medium, when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other medium used in the various embodiments provided in this application may include non-volatile and/or volatile memory. Nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in M forms such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Road (SyMchliMk) DRAM (SLDRAM), memory bus (RaMbus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

The technical features of the above-described embodiments can be combined arbitrarily. For the sake of brevity, all possible combinations of the technical features in the above-described embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be regarded as the scope described in this specification.

The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are relatively specific and detailed, but should not be construed as a limitation on the scope of the patent application. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims

An audio output method, wherein the method comprises:

Detect whether there is a mutual collision event between the two earphones that have established a communication connection with the terminal device;

If a mutual collision event occurs between the two earphones, detecting whether the terminal device is playing at least two audios from different audio sources;

If the terminal device is playing at least two audios from different audio sources, output the first audio of the at least two audios to one of the two earphones, and output the at least two audios to one of the two earphones. The second audio in the earphone is output to the other earphone of the two earphones.
The method according to claim 1, wherein the detecting whether a mutual collision event occurs between two earphones that have established a communication connection with the terminal device comprises:

Receive the impact detection information reported by each of the earphones, where the impact detection information is used to characterize the characteristics of the impact event that occurs in the earphone;

According to the collision detection information reported by each of the earphones, it is detected whether a mutual collision event occurs between the two earphones.
The method according to claim 2, wherein the detecting whether a mutual collision event occurs between the two earphones according to the collision detection information reported by each of the earphones comprises:

According to the impact detection information reported by each of the earphones, determine the impact time of the impact event of each of the earphones;

If the difference between the collision times of the two earphones when the collision event occurs is within a preset time difference range, it is determined that a mutual collision event occurs between the two earphones.
The method according to claim 3, wherein the impact time is the time when the earphone reports the impact detection information; or,

In the case where the impact detection information includes ambient sound collected by the earphone when the impact event occurs, the impact time is the time when the energy peak in the ambient sound appears; or,

In a case where the impact detection information carries a timestamp at which the earphone generated the impact detection information, the impact time is the time indicated by the timestamp.
The method according to claim 2, wherein the impact detection information includes ambient sounds collected by earphones when an impact event occurs, and the two earphones are detected according to the impact detection information reported by each earphone. Whether there is a collision event between them, including:

According to the impact detection information reported by each of the earphones, determine the energy value of the ambient sound collected by each of the earphones when an impact event occurs;

If the difference between the energy values of the ambient sounds collected by the two earphones when the collision event occurs is within a preset energy difference range, it is determined that a mutual collision event occurs between the two earphones.
The method according to claim 2, wherein the impact detection information includes ambient sounds collected by earphones when an impact event occurs, and the two earphones are detected according to the impact detection information reported by each earphone. Whether there is a collision event between them, including:

For each of the earphones, detect whether the sound characteristics of the ambient sound reported by the earphones are consistent with the preset sound characteristics; if the sound characteristics of the ambient sound reported by the earphones are inconsistent with the preset sound characteristics, determine whether the two There was no collision between the headphones.
The method according to claim 6, wherein the detecting whether the sound feature of the ambient sound reported by the earphone is consistent with the preset sound feature comprises:

Detecting whether the number of times and the interval of energy peaks in the ambient sound reported by the earphone are consistent with the number of times and intervals of energy peaks in the first preset time period indicated by the preset sound feature .
The method according to claim 6, wherein the detecting whether the sound feature of the ambient sound reported by the earphone is consistent with the preset sound feature comprises:

It is detected whether the magnitude of the energy peak of the ambient sound reported by the earphone is consistent with the magnitude of the energy peak indicated by the preset sound feature.
The method according to claim 6, wherein the detecting whether the sound feature of the ambient sound reported by the earphone is consistent with the preset sound feature comprises:

It is detected whether the magnitude of the frequency of the ambient sound reported by the earphone is consistent with the magnitude of the frequency indicated by the preset sound feature.
The method according to claim 2, wherein the collision detection information includes motion state information of the earphones, and the collision detection information reported by each earphone is used to detect whether the two earphones interact with each other. Impact events, including:

For each of the earphones, it is detected whether the motion state information reported by the earphones is consistent with the preset impact motion state information; if the motion state information reported by the earphones is inconsistent with the preset impact motion state information, it is determined that the two There was no collision between the headphones.
The method according to claim 10, wherein, the motion state information includes acceleration information, and whether the motion state information reported by the detection earphone is consistent with the preset impact motion state information, including:

Determine, according to the acceleration information reported by the earphone, the acceleration change of the earphone within the second preset time period;

It is detected whether the acceleration change of the earphone is consistent with the acceleration change indicated by the preset impact motion state information.
The method according to claim 10, wherein the motion state information includes rotation angle information, and the detecting whether the motion state information reported by the earphone is consistent with the preset impact motion state information includes:

Determine, according to the rotation angle information reported by the earphone, the posture change of the earphone within the third preset time period;

It is detected whether the posture change of the earphone is consistent with the posture change indicated by the preset impact motion state information.
An audio output method, wherein, used in a first earphone, the method includes:

Generate collision detection information, and send the collision detection information to a terminal device that has established a communication connection with the first earphone, where the collision detection information is used to characterize the characteristics of the collision event that occurred in the first earphone, so The collision detection information is used for the terminal device to determine, based on the collision detection information, whether a mutual collision event occurs between the first earphone and the second earphone that has established a communication connection with the terminal device;

Receive and play the first audio output from the terminal device, where the first audio is the event that the terminal device determines that the first earphone and the second earphone collide with each other, and the terminal device is The first audio is output after playing at least two audios from different audio sources, and the first audio is a part of the at least two audios.
The method of claim 13, wherein said generating impact detection information comprises:

Detecting whether the sound feature of the ambient sound collected by the first earphone when the impact event occurs is consistent with the preset sound feature;

If the sound feature of the ambient sound collected by the first earphone when the impact event occurs is consistent with the preset sound feature, the impact detection information is generated.
The method of claim 13, wherein said generating impact detection information comprises:

Detecting whether the motion state information of the first earphone is consistent with the preset impact motion state information;

If the motion state information of the first earphone is consistent with the preset impact motion state information, the impact detection information is generated.
The method of claim 13, wherein said generating impact detection information comprises:

Detecting whether the sound feature of the ambient sound collected by the first earphone when the impact event occurs is consistent with the preset sound feature;

Detecting whether the motion state information of the first earphone is consistent with the preset impact motion state information;

If the sound characteristics of the ambient sound collected by the first earphone when the impact event occurs are consistent with the preset sound characteristics, and the motion state information of the first earphone is consistent with the preset impact motion state information, then The impact detection information is generated.
An audio output device, wherein the device comprises:

a first detection module for detecting whether a collision event occurs between two earphones that have established a communication connection with the terminal device;

a second detection module, configured to detect whether the terminal device is playing at least two audios from different audio sources when a mutual collision event occurs between the two earphones;

an output module, configured to output a first audio of the at least two audios to one of the two earphones when the terminal device is playing at least two audios from different audio sources, A second audio of the at least two audios is output to the other of the two earphones.
An audio output device, used in a first earphone, the device comprising:

A generation module is used to generate impact detection information;

a sending module, configured to send the impact detection information to a terminal device that has established a communication connection with the first earphone, the impact detection information is used to characterize the characteristics of the impact event that occurs in the first earphone, the The collision detection information is used for the terminal device to determine, based on the collision detection information, whether a mutual collision event occurs between the first earphone and the second earphone that has established a communication connection with the terminal device;

a receiving module, configured to receive and play the first audio output from the terminal device, where the first audio is the event that the terminal device determines that the first earphone and the second earphone collide with each other, and, The first audio is output after the terminal device is playing at least two audios from different audio sources, and the first audio is a part of the at least two audios.
A computer device, comprising a processor and a memory, wherein a computer program is stored in the memory, and the processor implements the audio output method according to any one of claims 1 to 16 when the processor executes the computer program.
A computer-readable storage medium, wherein a computer program is stored thereon, and when the computer program is executed by a processor, the audio output method according to any one of claims 1 to 16 is implemented.