CN112616106B

CN112616106B - Automatic switching method of earphone conversation audio, computer readable storage medium and electronic system

Info

Publication number: CN112616106B
Application number: CN202011330763.4A
Authority: CN
Inventors: 陈洪太; 吴长凤; 闫荣辉
Original assignee: Guangdong Spark Technology Co ltd
Current assignee: Guangdong Spark Technology Co ltd
Priority date: 2020-11-24
Filing date: 2020-11-24
Publication date: 2022-11-18
Anticipated expiration: 2040-11-24
Also published as: CN112616106A

Abstract

The invention relates to an automatic switching method of earphone conversation audio, a computer readable storage medium and an electronic system. The method comprises the following steps of initializing and distributing an audio playing place to the earphone after the earphone and the terminal establish a communication link, and detecting the current wearing state of the earphone: if the user is in an effective wearing state, the position switching action of the audio playing place is not carried out, and the switching process is directly ended; if the mobile terminal is in an invalid wearing state or a non-wearing state, switching the audio playing place to the terminal when the mobile terminal is in the incoming call state or the call state; if the wearing state cannot be judged, whether the current terminal is close to the ear of a person or not is detected, if yes, the audio playing place is switched to the terminal when the terminal is in the incoming call state or the call state, and if not, the switching process is ended. The automatic switching method of the earphone conversation audio frequency can realize the automatic switching of the audio frequency when a call is made or the conversation is made, so that the audio frequency playing is automatic, convenient and fast, and the operation of a user is convenient.

Description

Automatic switching method of earphone conversation audio, computer readable storage medium and electronic system

Technical Field

The invention relates to the field of earphones, in particular to an automatic earphone call audio switching method, a computer readable storage medium and an electronic system.

Background

In recent years, the development of bluetooth headsets is rapid, and especially, new types of TWS and new functional characteristics such as ANC/health detection are matched with the traditional bluetooth audio communication function, so that the bluetooth headsets rapidly occupy the market, and various air pods bluetooth headsets are widely seen in China.

One of the main pain points of use of current bluetooth headsets is: when a user is in a call or a call, if the user wants to use the call function of the mobile phone (the microphone of a part of bluetooth earphones has poor noise elimination and sound pickup functions), the user has to open the mobile phone and manually click on a call interface or manually switch through the keys of the earphones, which is quite inconvenient.

Disclosure of Invention

The invention provides an automatic switching method of earphone conversation audio, a computer readable storage medium and an electronic system, aiming at overcoming the defects in the prior art.

Therefore, an automatic switching method of earphone communication audio is provided,

after a communication link is established between the earphone and the terminal, an audio playing place is initially distributed to the earphone;

further comprising detecting the current wearing state of the earphone:

if the user is in an effective wearing state, the position switching action of the audio playing place is not carried out, and the switching process is directly ended;

if the mobile terminal is in an invalid wearing state or a non-wearing state, switching an audio playing place to the terminal when the mobile terminal is in a call state or a call state;

if the wearing state cannot be judged, whether the current terminal is close to the ear of a person or not is detected, if yes, the audio playing place is switched to the terminal when the terminal is in the incoming call state or the call state, and if not, the switching process is ended.

Preferably, the detecting whether the current terminal is close to the ear further comprises: whether the terminal is close to the ear of a person or not is judged based on action detection and skin approach induction.

Preferably, the detecting whether the current terminal is close to the ear further includes: and triggering a specific action by the terminal to serve as a starting condition, sensing that the terminal is close to the skin to confirm, and judging that the terminal is close to the ears of people according to a confirmation result.

Preferably, the specific action is a hand-raising action.

Preferably, the hand-lifting recognition is realized by a three-axis accelerometer based on a gesture sensing algorithm.

Preferably, the confirmation action is valid only within a set time after the terminal triggers the specific action.

Preferably, the terminal is a mobile phone, and establishes a wireless communication link with the headset through SPP bluetooth or BLE.

Preferably, the execution flow of the method further comprises:

s1, after a communication link is established between the earphone and the terminal, an audio playing place is distributed to the earphone by default;

s2, the terminal sends an instruction to inquire whether the earphone has a wearing detection function or not, if so, the step S3 is executed, otherwise, the step S5 is executed in a skipping way;

s3, the earphone acquires wearing detection data in real time, whether the current earphone is in an effective wearing state or not is detected according to the wearing detection data, if the earphone is worn effectively, position switching action of an audio playing place is not carried out, the switching process is directly finished, and if the earphone is worn inefficiently or is not worn, the step S4 is executed;

s4, detecting whether the current terminal is in an incoming call state or a call state, if so, switching an audio playing place to the terminal, and otherwise, ending the switching process;

s5, if the terminal detects that the hand-lifting action is effective, the terminal takes the hand-lifting action as a starting condition to execute the step S6 for confirmation, otherwise, the switching process is ended;

and S6, detecting whether the terminal is close to the skin, if so, executing the step S4 to carry out switching, and otherwise, ending the switching process.

Also provides an electronic system, wherein the electronic system comprises a terminal and an earphone which are communicated with each other through Bluetooth,

the terminal, the headset each comprise a controller, and a memory arranged to store computer executable instructions,

the earphone also comprises a wearing detection module communicated with the controller in the earphone, the wearing detection module is used for detecting the wearing state of the earphone,

the terminal also comprises an action detection module and a proximity induction module which are communicated with the controller in the terminal, wherein the action detection module is used for identifying specific actions, the proximity induction module is used for identifying the condition that the terminal is close to the skin,

the computer executable instructions, when executed, cause the respective controller to perform the method described above.

A computer readable storage medium is also provided, wherein the computer readable storage medium stores one or more programs which, when executed by a controller, implement the method described above.

The automatic switching method of the earphone conversation audio can realize the automatic switching of the audio during the incoming call or the conversation, so that the audio playing is automatic and convenient, and can be automatically matched to be suitable for the current use scene of the user, thereby facilitating the operation of the user.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

FIG. 1 shows an internal schematic view of the earphone end of the present invention;

FIG. 2 shows an internal schematic view of the handset end of the present invention;

FIG. 3 is a flow chart illustrating automatic switching of headset call audio when the headset end has a wear detection function according to the present invention;

FIG. 4 is a flow chart illustrating automatic switching of headset talk audio when the headset end does not have a wear detection function in accordance with the present invention;

FIG. 5 shows a schematic of the architecture of the electronic system of the present invention;

fig. 6 shows a schematic structural diagram of a computer-readable storage medium of the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

As shown in fig. 1, the earphone of this embodiment includes a first MCU algorithm processing unit, and a wearing detection module and a first bluetooth module that are in communication connection with the first MCU algorithm processing unit.

The wearing detection module adopts a conventional wearing detection mode of the earphone, such as an infrared photoelectric mode, a capacitance mode and a three-axis accelerometer azimuth detection mode, and is used for judging whether the current earphone is in a wearing state.

As shown in fig. 2, the mobile phone of this embodiment includes a second MCU algorithm processing unit, and a motion detection module, a second bluetooth module, and an approach sensing module, which are in communication connection with the second MCU algorithm processing unit.

The approach sensing module mainly judges whether the mobile phone is close to the skin, and hardware implementation can be a photoelectric or capacitive sensor.

The motion detection module mainly realizes hand raising recognition based on a gesture sensing algorithm through a three-axis accelerometer, the motion detection module is matched with the approach sensing module for use, whether the mobile phone is close to the ear of a person is judged, specifically, after the second MCU algorithm processing unit recognizes a specific motion (such as hand raising) through the motion detection module as starting, if the second MCU algorithm processing unit can wait for the approach sensing module to output a mobile phone close skin instruction as confirmation within a set time period, the mobile phone is judged to be close to the ear of the person, if the second MCU algorithm processing unit cannot wait for the instruction or overtime, the second MCU algorithm processing unit judges that the mobile phone is touched by mistake, so that the motion detection and approach sensing are matched, the mistake touch probability of conversation audio switching is reduced to the maximum extent, for example, when the mobile phone is played, the mobile phone is actively lifted, or a finger and a palm touch an induction area of the mobile phone carelessly, the audio switching of the mobile phone cannot be triggered to initiate the motion, and the motion scene recognition that the mobile phone is close to the ear can be realized.

The first Bluetooth module and the second Bluetooth module are used for realizing wireless data transmission between the earphone and the mobile phone.

The first MCU algorithm processing unit and the second MCU algorithm processing unit are respectively used as logic controllers of the earphone and the mobile phone.

The method for automatically switching headset conversation audio according to this embodiment is edited into computer-executable instructions and forms one or more programs, the headset and the mobile phone have memories arranged to store the computer-executable instructions, the one or more programs are stored in a computer-readable storage medium of the memories, the one or more programs are triggered to start execution after the mobile phone establishes a wireless communication link with the headset through SPP bluetooth or BLE, and when executed by the controller, the control flow shown in fig. 3 and 4 is implemented, including the following steps executed sequentially:

s1, in initialization, audio playing places are distributed to earphone ends by default;

s2, the mobile phone end sends a command to inquire whether the earphone end has a wearing detection function, if yes, the step S3 is executed, otherwise, the step S5 is executed by skipping;

s3, the earphone end acquires wearing detection data in real time through the wearing detection module, detects whether the earphone end is in an effective wearing state or not according to the wearing detection data, does not perform position switching action of an audio playing place if the earphone end is effectively worn, directly ends a switching flow, and executes the step S4 if the earphone end is not worn or worn;

s4, detecting whether the current mobile phone end is in an incoming call state or a call state, if so, switching an audio playing place to the mobile phone end to complete switching, and otherwise, ending a switching flow;

s5, as the wearing state of the earphone end cannot be judged, scene recognition can be carried out only by means of the mobile phone end, the mobile phone end acquires data in real time through the action detection module and the approach induction module, and if the hand-raising action of the mobile phone end is detected to be effective, the condition is taken as a starting condition, the step S6 is executed for confirmation, and otherwise, the switching process is ended;

and S6, detecting whether the mobile phone end is close to the skin, if so, determining that the mobile phone end is close to the ear of the person, executing the step S4 to switch, and otherwise, ending the switching process.

The automatic switching method for the earphone conversation audio frequency can realize the automatic switching of the audio frequency during incoming call or conversation, so that the audio frequency playing is automatic and convenient, and can be automatically matched to be suitable for the current use scene of a user, thereby facilitating the operation of the user.

It should be noted that:

scene recognition of the mobile phone end is detected, for example only, in practical application, sensor data inside the mobile phone can be acquired through a customized mobile phone system or an APP integrated with a special authority, algorithm design is carried out, motion recognition of the mobile phone end close to human ears is completed, after motion recognition is successful, the motion is actively notified to the mobile phone system, or a far-end earphone is notified in an SPP Bluetooth or BLE mode.

In this embodiment, the mobile phone may be replaced by another terminal such as a computer or a tablet, and the communication mode between the mobile phone end and the earphone end may be another communication mode, which is not limited to bluetooth communication.

The method of the present embodiment may be implemented by a method that is converted into program steps and apparatuses that can be stored in a computer storage medium and invoked and executed by a controller.

The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose devices may also be used with the teachings herein. The required structure for constructing an arrangement of this type will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore, may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments.

The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website, or provided on a carrier signal, or provided in any other form.

For example, FIG. 5 shows a schematic diagram of an electronic system, according to one embodiment of the invention. The electronic system conventionally comprises a processor 61 and a memory 62 arranged to store computer executable instructions (program code). The memory 62 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. The memory 62 has a storage space 63 storing program code 64 for performing any of the method steps in the embodiments. For example, the storage space 63 for the program code may comprise respective program codes 64 for implementing respective steps in the above method. The program code can be read from and written to one or more computer program products. These computer program products comprise a program code carrier such as a hard disk, a Compact Disc (CD), a memory card or a floppy disk. Such a computer program product is typically a computer readable storage medium such as described in fig. 6. The computer readable storage medium may have memory segments, memory spaces, etc. arranged similarly to the memory 62 in the electronic system of fig. 5. The program code may be compressed, for example, in a suitable form. In general, the memory unit stores program code 71 for performing the steps of the method according to the invention, i.e. program code readable by a processor such as 61, which when run by an electronic system causes the electronic system to perform the steps of the method described above.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Claims

1. The method for automatically switching the earphone call audio is characterized in that the execution flow of the method comprises the following steps:

s1, after a communication link is established between the earphone and the terminal, the audio playing place is distributed to the earphone by default;

and S6, detecting whether the terminal is close to the skin, if so, executing the step S4 to carry out switching, and if not, ending the switching process.

2. The method of claim 1, wherein the hand-up recognition is accomplished by a three-axis accelerometer based on a gesture-sensing algorithm.

3. The method of claim 1, wherein the detecting whether the terminal is proximate to the skin is only valid for a set time after the terminal triggers the hand-raising action.

4. The method according to claim 1, wherein the terminal is a mobile phone and the wireless communication link is established with the headset through SPP Bluetooth or BLE.

5. A computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, characterized in that: the one or more programs, when executed by the controller, implement the method of any of claims 1-4.

6. An electronic system, wherein the electronic system comprises a terminal and an earphone which are mutually communicated by Bluetooth,

the terminal also comprises an action detection module and a proximity induction module, wherein the action detection module is communicated with the controller in the terminal and is used for identifying specific actions, the proximity induction module is used for identifying the condition that the terminal is close to the skin,

the method is characterized in that:

the computer-executable instructions, when executed, cause the respective controller to perform the method of any of claims 1-4.