CN117135254B

CN117135254B - Voice call method and electronic equipment

Info

Publication number: CN117135254B
Application number: CN202310370236.3A
Authority: CN
Inventors: 李丹阳; 周秦
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2023-03-28
Filing date: 2023-03-28
Publication date: 2024-06-14
Anticipated expiration: 2043-03-28
Also published as: CN117135254A

Abstract

The embodiment of the application is applicable to the technical field of voice communication, and provides a voice communication method and electronic equipment.

Description

Voice call method and electronic equipment

Technical Field

The present application relates to the field of voice communication technology, and more particularly, to a method and an electronic device for voice communication.

Background

During a voice call through an electronic device, a user often has poor call quality due to an abnormal microphone (e.g., a blocked microphone).

Currently, a plurality of microphones are usually disposed on an electronic device, and when one microphone (for example, a main microphone) is abnormal, the electronic device generally adopts a preset algorithm to determine the current state of the electronic device, so as to determine whether the sound receiving hole of the main microphone is blocked. In the event that the sound receiving hole of the main microphone is blocked, the microphone responsible for collecting the audio signal is switched from the main microphone to the other microphones (for example, the auxiliary microphone). However, a preset algorithm is adopted to judge the current state of the electronic equipment, so that a long time is usually required for determining whether the main microphone is blocked, the electronic equipment is in a state with poor conversation quality for a long time, and the user experience is affected.

Based on this, how to avoid the electronic device being in a state of poor call quality for a long time becomes a problem to be solved urgently.

Disclosure of Invention

The application provides a voice call method which can avoid the situation that the electronic equipment is in a state of poor call quality for a long time.

In a first aspect, a method for voice call is provided, where the method is applied to an electronic device, the electronic device includes a plurality of microphones, the plurality of microphones includes a first microphone and a second microphone, and the first microphone is a microphone that the electronic device collects an audio signal at a current moment, and the method includes:

When the electronic equipment is in a voice call state, acquiring a first audio signal, wherein the first audio signal is an audio signal acquired by a first microphone;

If the volume value of the first audio signal is smaller than the first threshold value, acquiring a second audio signal, wherein the second audio signal is an audio signal acquired by a second microphone;

The third audio signal is output based on the first audio signal and the second audio signal.

The voice call method provided by the embodiment of the application is applied to electronic equipment, the electronic equipment comprises a plurality of microphones, the plurality of microphones comprise a first microphone and a second microphone, the first microphone is a microphone for acquiring audio signals at the current moment of the electronic equipment, when the electronic equipment is in a voice call state, the first audio signals are acquired, the first audio signals are the audio signals acquired by the first microphone, if the volume value of the first audio signals is smaller than a first threshold value, the second audio signals are acquired, the second audio signals are the audio signals acquired by the second microphone, the third audio signals are output based on the first audio signals and the second audio signals, and thus the state of the first microphone can be judged simply based on the volume value of the first audio signals acquired by the first microphone, and under the condition that the volume value of the first audio signals is smaller than the first threshold value, the third audio signals acquired by the first microphone and the second audio signals acquired by the second microphone are used as the audio signals used in the voice call. In general, the sound quality of the first audio signal is better than that of the second audio signal, and if the first audio signal is detected to be abnormal, the first microphone may be abnormal, but a preset algorithm is required to determine whether the first microphone is abnormal or not to make a judgment, and a period of time is usually required for the judgment, so that during the period of time, the state of the first microphone is uncertain. If the first microphone is not abnormal, the second audio signal is directly used to influence the tone quality; if the first microphone is abnormal, the second audio signal should be used. Since the state of the first microphone is uncertain during this time, the third audio signal is used in order to balance the two cases. Because the third audio signal merges the audio signal collected by the first microphone and the audio signal collected by the second microphone, when the first microphone is abnormal, the third audio signal is equivalent to the second audio signal; when the first microphone is not abnormal or in a critical state, the call quality of the third audio signal is better than that of the first audio signal and the second audio signal. That is, when the first microphone is abnormal, the third audio signal with better call quality is adopted as the audio signal when the electronic device performs voice call, compared with the first audio signal collected by the first microphone, or the first microphone is directly switched to the second microphone, and compared with the second audio signal collected by the second microphone, the voice call quality can be improved, and the user experience is improved. Further, as the voice call method provided by the embodiment of the application simply judges the state of the first microphone based on the volume value of the first audio signal acquired by the first microphone, compared with the state of the first microphone determined directly by adopting the preset algorithm, the voice call method provided by the embodiment of the application can react to the abnormality of the first microphone more quickly, so that sufficient time is reserved for detecting the preset algorithm, the robustness of the algorithm is improved, the electronic equipment is prevented from being in a state with poor call quality in the time of microphone blocking judgment, and the user experience is improved.

With reference to the first aspect, in certain implementation manners of the first aspect, after the outputting of the third audio signal based on the first audio signal and the second audio signal, the method further includes: determining whether the first microphone is in a first state by adopting a preset algorithm, wherein the first state comprises that a sound receiving hole of the first microphone is blocked; and if the first microphone is in the first state and the duration of the first microphone in the first state is greater than the second threshold value, outputting a second audio signal.

According to the voice call method provided by the embodiment of the application, when the electronic equipment performs voice call, the first audio signal is obtained, and the third audio signal is output based on the first audio signal and the second audio signal under the condition that the volume value of the first audio signal is smaller than the first threshold value, further after the third audio signal is output, a preset algorithm is adopted to determine whether the first microphone is in the first state, and when the first microphone is in the first state and the duration of the first state is larger than the duration threshold value, the second audio signal is output, which is equivalent to that when the first microphone is in the abnormal state, the third audio signal is output based on the first audio signal and the second audio signal, and on the basis of the third audio signal is output, whether the first microphone is in the first state or not is determined by adopting a preset algorithm, namely whether the radio hole of the first microphone is blocked or not is determined, and when the radio hole of the first microphone is blocked longer (longer than the duration threshold value), the microphone for acquiring the audio signal is switched from the first microphone to the second microphone when the first microphone is in the first state, the voice call is performed, the voice call quality is prevented from being continuously acquired, and the voice call quality is improved, and the voice call experience is continued.

With reference to the first aspect, in certain implementations of the first aspect, the method further includes: and if the first microphone is in the first state and the duration of the first microphone in the first state is less than or equal to the second threshold value, outputting a third audio signal.

According to the voice call method provided by the embodiment of the application, when the electronic equipment performs voice call, a first audio signal is obtained, and under the condition that the volume value of the first audio signal is smaller than a first threshold value, a third audio signal is output based on the first audio signal and the second audio signal, further after the third audio signal is output, a preset algorithm is adopted to determine whether the first microphone is in a first state, when the first microphone is in the first state and the duration of the first state is larger than a duration threshold value, a second audio signal is output, which is equivalent to that when the first microphone is in an abnormal state, a third audio signal is output based on the first audio signal and the second audio signal, on the basis of outputting the third audio signal, whether the first microphone is in the first state is determined by adopting a preset algorithm, namely, whether the radio hole of the first microphone is blocked or not is determined, and when the radio hole of the first microphone is blocked is shorter (smaller than or equal to the duration threshold value), the third microphone is still used as the microphone for collecting the audio signal when the electronic equipment performs voice call. By adopting the voice call method provided by the embodiment of the application, if the first microphone is misjudged as the microphone blocking state by the preset algorithm, the third audio signal obtained by fusing the first audio signal and the second audio signal is used, so that the change of tone quality caused by using the second audio signal after misjudgment can be avoided. The implementation mechanism of the method can correct misjudgment reserved time for a preset algorithm, so that the switching of microphone equipment caused by misjudgment is avoided, and the user experience is influenced; meanwhile, if the duration of the microphone blocking is shorter, frequent switching of the microphone equipment can be avoided by the method. The voice communication quality is improved, and the user experience is improved.

With reference to the first aspect, in some implementations of the first aspect, outputting the third audio signal based on the first audio signal and the second audio signal includes: and outputting the third audio signal based on the first audio signal and the second audio signal if the volume value of the second audio signal is larger than the third threshold value.

According to the voice call method provided by the embodiment of the application, under the condition that the volume value of the first audio signal is smaller than the first threshold value, namely under the condition that the first microphone possibly has abnormality, the electronic device further obtains the volume value of the second audio signal collected by the second microphone, then under the condition that the volume value of the second audio signal is larger than the third threshold value, namely under the condition that the second microphone is not abnormal, the third audio signal output by the electronic device is obtained based on the first audio signal and the second audio signal, and because the second audio signal is collected under the condition that the second microphone is in an abnormal state, the second audio signal is a normal audio signal, so that the call quality of the third audio signal obtained based on the first audio signal and the second audio signal is superior to the call quality of the first audio signal, the condition that the quality of the third audio signal obtained based on the abnormal second audio signal is poor is avoided, and the user experience is improved.

With reference to the first aspect, in some implementations of the first aspect, outputting the third audio signal based on the first audio signal and the second audio signal includes: the first audio signal and the second audio signal are fused to obtain a third audio signal; and outputting the third audio signal.

According to the voice call method provided by the embodiment of the application, the electronic equipment firstly acquires the first audio signal acquired by the first microphone, and performs fusion processing on the first audio signal and the second audio signal under the condition that the volume value of the first audio signal is smaller than the first threshold value to obtain the third audio signal, and then outputs the third audio signal, wherein if the volume value of the first audio signal is smaller than the first threshold value, the first microphone is indicated to be abnormal, the switching method of the audio data provided by the embodiment of the application is equivalent to that when the first microphone is abnormal, the second audio signal acquired by the second microphone and the first audio signal acquired by the first microphone are subjected to fusion processing to obtain the third audio signal, and then the third audio signal is output.

With reference to the first aspect, in some implementation manners of the first aspect, performing fusion processing on the first audio signal and the second audio signal to obtain a third audio signal, where the fusion processing includes: acquiring first power and second power of a first audio signal, wherein the first power refers to signal power when the volume value of the first audio signal is larger than or equal to a first threshold value at a historical moment, and the second power refers to signal power when the volume value of the first audio signal is smaller than the first threshold value at a current moment; acquiring a first gain of the second audio signal, wherein the first gain refers to the gain of the second audio signal at the current moment; and obtaining a third audio signal according to the first power, the second power and the first gain, the first audio signal and the second audio signal.

With reference to the first aspect, in certain implementations of the first aspect, the number of second microphones is a plurality.

In a second aspect, there is provided an apparatus for voice telephony, comprising means for performing any of the methods of the first aspect. The device can be a server, terminal equipment or a chip in the terminal equipment. The apparatus may include an acquisition unit and a processing unit.

When the apparatus is a terminal device, the processing unit may be a processor, and the acquiring unit may be a communication interface; the terminal device may further comprise a memory for storing computer program code which, when executed by the processor, causes the terminal device to perform any of the methods of the first aspect.

When the device is a chip in the terminal device, the processing unit may be a processing unit inside the chip, and the input unit may be an output interface, a pin, a circuit, or the like; the chip may also include memory, which may be memory within the chip (e.g., registers, caches, etc.), or memory external to the chip (e.g., read-only memory, random access memory, etc.); the memory is for storing computer program code which, when executed by the processor, causes the chip to perform any of the methods of the first aspect.

In one possible implementation, the memory is used to store computer program code; a processor executing the computer program code stored in the memory, the processor, when executed, configured to perform: when the electronic equipment is in a voice call state, acquiring a first audio signal, wherein the first audio signal is an audio signal acquired by a first microphone; if the volume value of the first audio signal is smaller than the first threshold value, acquiring a second audio signal, wherein the second audio signal is an audio signal acquired by a second microphone; the third audio signal is output based on the first audio signal and the second audio signal.

In a third aspect, there is provided a computer readable storage medium storing computer program code which, when run by a voice-enabled apparatus, causes the voice-enabled apparatus to perform the method of any one of the first aspects.

In a fourth aspect, there is provided a computer program product comprising: computer program code which, when run by a device for voice telephony, causes the device for voice telephony to perform any of the device methods of the first aspect.

The voice call method provided by the embodiment of the application is applied to electronic equipment, the electronic equipment comprises a plurality of microphones, the microphones comprise a first microphone and a second microphone, the first microphone is a microphone for collecting audio signals at the current moment of the electronic equipment, when the electronic equipment is in a voice call state, the first audio signal is obtained, the first audio signal is the audio signal collected by the first microphone, if the volume value of the first audio signal is smaller than a first threshold value, the second audio signal is obtained, the second audio signal is the audio signal collected by the second microphone, the third audio signal is based on the first audio signal and the second audio signal, the state of the first microphone is judged based on the volume value of the first audio signal collected by the first microphone, and under the condition that the volume value of the first audio signal is smaller than the first threshold value, the third audio signal obtained by using the first audio signal collected by the first microphone and the second audio signal collected by the second microphone is used as the audio signal in voice call, and the audio signal is better than the voice call quality, namely, compared with the first microphone is collected by the first microphone, the voice call quality is better than the first microphone is collected by the first microphone, compared with the first microphone is better than the voice call quality is better, compared with the first microphone is collected by the first microphone, the voice call quality is better than the first microphone is better than the voice call signal is collected by the first microphone, compared with the first microphone is better than the voice call quality is better than the microphone is collected by the microphone through the first microphone, because the voice call method provided by the embodiment of the application simply judges the state of the first microphone based on the volume value of the first audio signal acquired by the first microphone, compared with the state of the first microphone determined directly by adopting the preset algorithm, the voice call method provided by the embodiment of the application can react to the abnormality of the first microphone more quickly, so that sufficient time is reserved for detecting the preset algorithm, the robustness of the algorithm is improved, the electronic equipment is prevented from being in a state with poor call quality for a longer time, and the user experience is improved.

Drawings

FIG. 1 is a schematic diagram of a hardware system suitable for use in an electronic device of the present application;

FIG. 2 is a schematic diagram of a software system suitable for use with the electronic device of the present application;

Fig. 3 is a schematic diagram of an application scenario provided in an embodiment of the present application;

fig. 4 is a flow chart of a voice call method according to an embodiment of the present application;

fig. 5 is a flowchart of another voice call method according to an embodiment of the present application;

fig. 6 is a flowchart of another voice call method according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a voice call apparatus according to the present application;

fig. 8 is a schematic diagram of an electronic device for voice call according to the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. Wherein, in the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may represent a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" means two or more than two.

The terms "first," "second," "third," and the like, are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first", "a second", or a third "may explicitly or implicitly include one or more such feature.

At present, a plurality of microphones are generally disposed in an electronic device. When a user performs a voice call, the mouth of the user is close to a microphone below the electronic device, so the microphone is generally used as a main microphone to collect audio signals when the user performs the voice call. Other microphones in the electronic equipment are used as auxiliary microphones and can be used for collecting environmental noise and determining current environmental information of the electronic equipment. It should be appreciated that the primary microphone acts as a microphone for collecting audio data in a voice call, and its tone and quality are generally better than those of the secondary microphone.

During the use of the electronic device, the user may inadvertently plug the receiving hole of the main microphone with a finger or clothes, which may result in a deterioration of the quality of the audio signal. When the output audio signal of the electronic device is degraded, the electronic device generally adopts a preset microphone blocking algorithm to determine whether the audio signal is degraded due to the blocking of the radio hole of the main microphone. However, a preset microphone blocking algorithm is adopted to determine whether the audio signal is poor due to the fact that the microphone receiving hole of the main microphone is blocked, and a long time is usually required, and during the time, the quality of the audio signal of the main microphone is still poor, so that the user experience is poor. In addition, the preset wheat blocking algorithm has the probability of misjudgment, namely the condition that the radio hole of the main wheat is not blocked is determined as the condition that the radio hole of the main wheat is blocked by mistake, and in the condition, the electronic equipment can switch the main wheat to the auxiliary wheat based on the output result of the algorithm. However, the timbre and tone quality of the paramount are often poor, which also affects the user experience. Further, in one possible case, the duration of the situation that the user blocks the microphone is short, for example, the finger touches the sound receiving hole of the main microphone by mistake, so that the sound receiving hole of the main microphone is blocked for 1 second, in this case, if the microphone is directly switched, the user experience is poor.

In view of the above, the method for voice call provided in the embodiment of the present application is applied to an electronic device, where the electronic device includes a plurality of microphones, the plurality of microphones include a first microphone and a second microphone, the first microphone is a microphone that collects audio signals at a current time of the electronic device, when the electronic device is in a voice call state, the first audio signal is obtained, the first audio signal is an audio signal collected by the first microphone, if a volume value of the first audio signal is smaller than a first threshold value, a second audio signal is obtained, the second audio signal is an audio signal collected by the second microphone, based on the first audio signal and the second audio signal, a third audio signal is output, so that a state of the first microphone can be determined based on a volume value of the first audio signal collected by the first microphone, and in case that the volume value of the first audio signal is smaller than the first threshold value, the first audio signal collected by the first microphone and the second audio signal collected by the second microphone are used as a third audio signal collected by the first microphone, and the voice call quality is better than that the first microphone is collected by the first microphone, when the first microphone is used as a voice call signal, compared with the first microphone, the voice call quality is better than that the first microphone is collected by the first microphone, and the first microphone is better than the voice call signal is collected by the first microphone, and user experience is improved. Further, since the voice call method provided by the embodiment of the application simply judges the state of the first microphone based on the volume value of the first audio signal collected by the first microphone, compared with the state of the first microphone determined directly by adopting the preset algorithm, the voice call method provided by the embodiment of the application can react to the abnormality of the first microphone more quickly, so that sufficient time is reserved for the preset algorithm to perform the microphone blocking detection, the situation that the electronic equipment is in a state with poor call quality for a longer time is avoided, and the user experience is improved.

The voice call method provided by the embodiment of the application can be applied to electronic equipment. Optionally, the electronic device includes a terminal device, which may also be referred to as a terminal (terminal), a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), and so on. The terminal device may be a mobile phone, a smart television, a wearable device, a tablet (Pad), a computer with wireless transceiving function, a Virtual Reality (VR) terminal device, an augmented reality (augmented reality, AR) terminal device, a wireless terminal in industrial control (industrial control), a wireless terminal in unmanned driving (self-driving), a wireless terminal in teleoperation (remote medical surgery), a wireless terminal in smart grid (SMART GRID), a wireless terminal in transportation security (transportation safety), a wireless terminal in smart city (SMART CITY), a wireless terminal in smart home (smart home), or the like. The embodiment of the application does not limit the specific technology and the specific equipment form adopted by the terminal equipment.

By way of example, fig. 1 shows a schematic diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (IMAGE SIGNAL processor, ISP), a controller, a memory, a video codec, a digital signal processor (DIGITAL SIGNAL processor, DSP), a baseband processor, and/or a neural Network Processor (NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural hub and a command center of the electronic device 100, among others. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-INTEGRATED CIRCUIT, I2C) interface, an integrated circuit built-in audio (inter-INTEGRATED CIRCUIT SOUND, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The I2S interface may be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface, to implement a function of answering a call through the bluetooth headset.

PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface to implement a function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through a UART interface, to implement a function of playing music through a bluetooth headset.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transfer data between the electronic device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices, etc.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and is not meant to limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also employ different interfacing manners in the above embodiments, or a combination of multiple interfacing manners.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The electronic device 100 may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 100 may listen to music, or to hands-free conversations, through the speaker 170A.

A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When electronic device 100 is answering a telephone call or voice message, voice may be received by placing receiver 170B in close proximity to the human ear.

Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 170C through the mouth, inputting a sound signal to the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four, or more microphones 170C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording functions, etc.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be a USB interface 130 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

It should be noted that any of the electronic devices mentioned in the embodiments of the present application may include more or fewer modules in the electronic device 100.

The software system of the electronic device 100 may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the application, taking an Android system with a layered architecture as an example, a software structure of the electronic device 100 is illustrated.

Fig. 2 is a software configuration block diagram of the electronic device 100 according to the embodiment of the present application.

The layered architecture of the electronic device 100 divides the software into several layers, each with a distinct role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun rows (Android runtime) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 2, the application package may include applications for cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for the application of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is used to provide the communication functions of the electronic device 100. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

Android run time includes a core library and virtual machines. Android runtime is responsible for scheduling and management of the android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio video encoding formats, such as: MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The kernel layer at least comprises a display driver, a camera driver, an audio driver, a sensor driver, a Wi-Fi driver and the like.

It should be noted that, the electronic device according to the embodiment of the present application may include more or fewer modules in the electronic device.

The application scenario provided by the embodiment of the application is described below with reference to the accompanying drawings.

Fig. 3 is an application scenario diagram of a method for voice call provided in an embodiment of the present application, where, as shown in (a) in fig. 3, an electronic device 100 includes a first microphone 110 and a second microphone 120, and the first microphone 110 is disposed below the electronic device 100. When a user uses the electronic device 100 to conduct a voice call, the first microphone 110 serves as a main microphone to collect audio data, so that the electronic device 100 outputs based on the audio data collected by the first microphone 110. The second microphone 120 may be used to collect ambient noise and determine current environmental information for the electronic device 100. In one possible case, as shown in (b) of fig. 3, when the user performs a voice call using the electronic device 100, the user's clothing shields the first microphone 110, affecting the call quality of the electronic device 100. Or the user's finger obscures the first microphone 110 (not shown), affecting the quality of the conversation of the electronic device 100.

It should be understood that the foregoing is illustrative of an application scenario, and is not intended to limit the application scenario of the present application in any way.

The following describes the method for voice call according to the embodiment of the present application in detail with reference to fig. 4 to 6.

Fig. 4 is a schematic flow chart of a method for voice communication, which is provided by an embodiment of the present application, the method is applied in an electronic device, the electronic device includes a plurality of microphones, the plurality of microphones includes a main microphone and a sub microphone, the main microphone is a microphone for the electronic device to collect an audio signal at a current moment, and the tone quality of the main microphone is better than that of the sub microphone, as shown in fig. 4, the method includes:

s101, when the electronic equipment is in a voice call state, a first audio signal is acquired.

The first audio signal may refer to an audio signal collected by the main microphone (corresponding to the first microphone) during a voice call.

It should be appreciated that when an electronic device (e.g., a mobile phone) is engaged in a voice call, an audio signal (i.e., a first audio signal) of a user may be collected by the host. Then, the electronic device may process the audio signal collected by the host microphone and send the processed audio signal to the opposite device (for example, the opposite mobile phone) through the antenna.

S102, determining whether the volume value of the first audio signal is smaller than a first volume threshold.

The electronic equipment can calculate according to the gain of the audio signal collected by the main microphone to obtain the sound volume value of the first audio signal.

In one possible case, when an abnormality occurs in the main microphone, for example, the user's finger holds the sound receiving hole of the main microphone, or the user's collar covers the sound receiving hole of the main microphone, the volume value of the audio signal (i.e., the first audio signal) collected by the main microphone is generally reduced. However, the volume value of the audio signal collected by the main microphone is not reduced due to the blockage of the sound receiving hole of the main microphone.

If the volume value indicated by the first volume information is smaller than the first volume threshold (corresponding to the first threshold), S103 is executed.

The first volume threshold may be a threshold obtained based on experience of the user, or may be a threshold obtained based on a volume value corresponding to the historical first audio signal by the electronic device, which is not limited in the embodiment of the present application.

For example, before the mobile phone leaves the factory, the user determines that the sound volume value that can be clearly identified by the opposite-end user is XdB through multiple experiments, so that the XdB can be used as the first sound volume threshold.

Illustratively, when the user uses the mobile phone to make a call, the average volume value of the audio signal of the mobile phone for voice call at the historical time is YdB, and (Y-1) dB is taken as the first volume threshold.

It will be appreciated that when the volume value of the master microphone is less than the first volume threshold, an abnormality is indicated to the master microphone, but it is uncertain whether the sound receiving hole of the master microphone is blocked. In this case, if the microphone for collecting the audio signal is directly switched from the main microphone to the sub microphone, there may be a case where the sound receiving hole of the main microphone is not blocked, but the sub microphone with poor sound quality is used to replace the main microphone, resulting in poor user experience. Therefore, when the volume value of the main microphone is smaller than the first volume threshold, the microphone for collecting the audio signal is not switched from the main microphone to the auxiliary microphone, so that further judgment can be performed. For example, the method steps shown in S103 to S106 are performed.

If the volume value indicated by the first volume information is greater than or equal to the first threshold value, S107 is performed.

S103, acquiring a second audio signal.

The second audio signal may be an audio signal collected by a secondary microphone (corresponding to the second microphone) during the voice call.

Similar to acquiring the volume value of the first audio signal acquired by the primary microphone, the electronic device may calculate according to the gain of the second audio signal to acquire the volume value of the secondary microphone.

S104, determining whether the volume value of the second audio signal is larger than a second volume threshold.

If the volume value of the second audio signal collected by the auxiliary wheat is too small, the auxiliary wheat is indicated to be abnormal. And if the volume value of the second audio signal collected by the auxiliary microphone is larger than the second volume threshold value, indicating that the auxiliary microphone is abnormal. Therefore, before the accessory is required to collect the audio signal in the voice call, it is required to determine whether the accessory is normal. For example, whether the secondary microphone is normal may be determined by determining whether the volume value of the second audio signal is greater than a second volume threshold (corresponding to a third threshold), typically when the volume value of the second audio signal is greater than the second volume threshold.

If the volume value of the second audio signal is greater than the second volume threshold, S105 is performed.

If the volume value of the second audio signal is less than or equal to the second volume threshold, S107 is performed.

The second volume threshold may be the same as or different from the first volume threshold, which is not limited in the embodiment of the present application.

The second volume threshold may be a threshold obtained based on experience of the user, or may be a threshold obtained based on a volume value corresponding to the historical second audio signal by the electronic device, which is not limited in the embodiment of the present application.

If the volume value of the second audio signal is larger than the second volume threshold value, the fact that the secondary microphone is normal can be indicated, the secondary microphone can be used as a microphone for collecting audio signals in voice communication, or the audio signals collected by the secondary microphone and the audio signals collected by the primary microphone can be fused, and a new audio signal is obtained.

For example, S105 "fusion processing of the first audio signal and the second audio signal to obtain a third audio signal" may be performed.

If the volume value of the second audio signal is smaller than or equal to the second volume threshold value, the fact that the auxiliary microphone is abnormal is indicated, the auxiliary microphone cannot be used as a microphone for collecting voice communication, and the audio signal collected by the auxiliary microphone cannot be fused with the audio signal collected by the main microphone, so that a new audio signal is obtained. Then the "output first audio signal" needs to be performed S107, i.e. the microphone that keeps the master microphone collecting audio signals in the voice call is not switched to the slave microphone.

The first volume threshold and the second volume threshold may be the same threshold or different thresholds, which is not limited by the embodiment of the present application.

S105, carrying out fusion processing on the first audio signal and the second audio signal to obtain a third audio signal.

Wherein, S105 "the first audio signal and the second audio signal are fused to obtain the third audio signal" one possible implementation method includes:

S1051, acquiring a first power and a second power of the first audio signal.

The first power refers to signal power when the volume value of the first audio signal is greater than or equal to a first volume threshold at the historical moment, and the second power refers to signal power when the volume value of the first audio signal is smaller than the first volume threshold at the current moment.

It should be understood that the first power is the signal power of the first audio signal when the volume value is greater than or equal to the first volume threshold, that is, the audio signal collected by the main microphone can normally perform voice call at the historical moment, and the call quality can meet the user requirement. Therefore, the history time refers to the time when the host microphone can normally perform voice call.

The second power is the signal power of the first audio signal at the current moment when the volume value of the first audio signal is smaller than the first volume threshold, that is, the audio signal collected by the main microphone at the current moment cannot normally perform voice call, and the call quality cannot meet the requirements of users.

The electronic device may store the signal power of the first audio signal at the historical moment and then read the stored signal power of the first audio signal at the historical moment to obtain the first power. Similarly, when the volume value of the first audio signal at the current moment is smaller than the first volume threshold, the electronic device can read the signal power of the first audio signal at the current moment to obtain the second power.

S1052, the first gain of the second audio signal is acquired.

Wherein the first gain refers to the gain of the second audio signal at the current time.

Optionally, in the electronic device, the number of the secondary microphones (i.e. the second microphones) is plural. Correspondingly, the number of first gains is also plural.

For example, the first gain may be obtained according to a first formula, where the first formula includes:

Wherein Gain _i represents the first Gain of the ith secondary microphone, pri _dB represents the power of the primary microphone audio signal during normal conversation, i.e. the first power, And the power of the ith secondary microphone audio signal in normal call is represented.

S1053, obtaining a third audio signal according to the first power, the second power, the first gain, the first audio signal and the second audio signal.

The fused third audio signal may be obtained according to a second formula, where the second formula includes:

Wherein S _out represents the third audio signal after fusion, S _pri represents the first audio signal, S _{aux_i} represents the gain-compensated audio signal of the ith secondary microphone, Representing the fusion scaling factor of the first audio signal,/>And (3) representing the sum of the fusion proportionality coefficients of the n secondary microphone audio signals, wherein FusionCof _i refers to the fusion proportionality coefficient of the ith secondary microphone audio signal.

Wherein S _{aux_i} may be obtained by a third formula, where the third formula includes:

Wherein S _{aux_i} represents the Gain-compensated audio signal of the ith secondary microphone, S' _{aux_i} represents the original audio signal of the ith secondary microphone, gain_add _i represents the Gain compensation coefficient of the ith secondary microphone, gain _i represents the first Gain of the ith secondary microphone, and k represents the frequency bin number.

The gain_add _i may be obtained by a fourth formula, where the fourth formula includes:

Wherein PRIENERGY denotes a first power, curEnergy denotes a second power, gain_add _i denotes a gain compensation coefficient of the ith secondary microphone.

S106, outputting a third audio signal.

It should be appreciated that the quality of the first audio signal is better than the second audio signal, and if an anomaly is detected in the first audio signal, the host microphone may be anomalous, but determining whether the host microphone is anomalous requires a predetermined algorithm to make a determination, which typically requires a period of time, during which the state of the host microphone is uncertain. If the main microphone is not abnormal, the second audio signal collected by the auxiliary microphone can influence the tone quality; if the primary microphone is abnormal, the secondary audio signal collected by the secondary microphone should be used. Because the state of the main microphone is uncertain in the period of time, in order to balance the two conditions, a third audio signal obtained by fusing a first audio signal acquired by the main microphone and a second audio signal acquired by the auxiliary microphone can be used. When the main microphone is abnormal, the third audio signal is equivalent to the second audio signal; when the main microphone is not abnormal or in a critical state, the communication quality of the third audio signal is better than that of the first audio signal and the second audio signal.

According to the voice call method provided by the embodiment of the application, the electronic equipment firstly acquires the first audio signal acquired by the first microphone, obtains the third audio signal based on the first audio signal and the second audio signal under the condition that the volume value of the first audio signal is smaller than the first threshold value, and then outputs the third audio signal, wherein if the volume value of the first audio signal is smaller than the first threshold value, the first microphone is indicated to be abnormal, and the switching method of the audio data provided by the embodiment of the application is equivalent to the method that when the first microphone is abnormal, the third audio signal is obtained based on the second audio signal acquired by the second microphone and the first audio signal acquired by the first microphone, and then the third audio signal is output, and because the third audio signal is the audio signal acquired by the first microphone and the audio signal acquired by the second microphone which are fused, when the first microphone is abnormal, the third audio signal is equivalent to the second audio signal; when the first microphone is not abnormal or is in a critical state, the call quality of the third audio signal is superior to that of the first audio signal and the second audio signal, that is, when the first microphone is abnormal, the third audio signal with better call quality is adopted as the audio signal when the electronic equipment performs voice call, compared with the first audio signal collected by the first microphone, or the first microphone is directly switched to the second microphone, and compared with the second audio signal collected by the second microphone, the user experience can be improved.

S107, outputting the first audio signal.

According to the voice call method provided by the embodiment of the application, the electronic equipment firstly acquires the first audio signal of the first microphone, further acquires the volume value of the second audio signal acquired by the second microphone under the condition that the volume value of the first audio signal is smaller than the first threshold value, and then keeps the first audio signal acquired by the first microphone as the audio signal when the electronic equipment performs voice call under the condition that the volume value of the second audio signal is smaller than or equal to the third threshold value, namely under the condition that the second microphone is abnormal, so that the condition that the first microphone is replaced by the abnormal second microphone is avoided, the condition that the audio signal is acquired by the abnormal second microphone as the microphone in voice call is avoided, the condition that the call quality is poor is caused, and the user experience is improved.

After the fused audio signal is used as the audio signal when the electronic equipment performs voice call, the electronic equipment can further determine whether the radio hole of the main microphone is blocked, and then determine whether to keep the main microphone as the microphone for collecting the audio signal when the electronic equipment performs voice call or switch to the auxiliary microphone based on the state of the main microphone, and use the auxiliary microphone as the microphone for collecting the audio signal when the electronic equipment performs voice call. This is explained in detail below by way of the embodiment shown in fig. 5.

Fig. 5 is a flow chart of a method for voice call provided in another embodiment of the present application, where the method is applied in an electronic device, the electronic device includes a plurality of microphones, the plurality of microphones includes a main microphone and a sub microphone, the main microphone is a microphone for the electronic device to collect an audio signal at a current moment, and a sound quality of the main microphone is better than a sound quality of the sub microphone, as shown in fig. 5, and the method includes:

s201, when the electronic equipment is in a voice call state, a first audio signal is acquired.

The first audio signal is an audio signal collected by a main microphone (corresponding to a first microphone) during voice communication.

S202, determining whether the volume value of the first audio signal is smaller than a first volume threshold.

The sound volume value of the first audio signal can be obtained through the gain of the audio signal collected by the main microphone.

If the volume value of the first audio signal is smaller than the first volume threshold, S203 is performed.

If the volume value of the first audio signal is greater than or equal to the first volume threshold, S210 is performed.

S203, acquiring a second audio signal.

Similar to acquiring the volume value of the first audio signal acquired by the primary microphone, the electronic device may acquire the volume value of the secondary microphone according to the gain of the second audio signal.

S204, determining whether the volume value of the second audio signal is larger than a second volume threshold.

If the volume value of the second audio signal is greater than the second volume threshold, S205 is performed. Wherein the second volume threshold corresponds to a third threshold.

If the volume value of the second audio signal is less than or equal to the second volume threshold, S210 is performed.

S205, performing fusion processing on the first audio signal and the second audio signal to obtain a third audio signal.

The process and the beneficial effects of the fusion processing of the first audio signal and the second audio signal refer to the step methods shown in S1051 to S1053, which are not described herein again.

S206, outputting a third audio signal.

S207, determining whether the main wheat is in the first state by adopting a preset algorithm.

The first state may include a state in which the sound receiving hole of the main microphone is blocked.

Optionally, the first state may further include a state in which the microphone noise of the main microphone is higher than a threshold value.

For example, the preset algorithm may refer to an algorithm that takes a parameter of the main microphone as an input and outputs that a radio hole of the main microphone is blocked or not blocked, and the preset algorithm may also be referred to as a microphone blocking algorithm.

The preset algorithm may also be an algorithm that takes a parameter of the main microphone as an input and outputs a noise value of the main microphone, and the preset algorithm may also be referred to as a noise detection algorithm.

It should be appreciated that in embodiments of the present application, the third audio signal is used until the master status is determined to be complete. And taking the fused audio signal (namely, the third audio signal) as the audio signal when the electronic equipment performs voice call in a period taking the moment of the main microphone determined to be in the first state as a starting point and the length of the main microphone as the duration threshold value. The third audio signal is used as the audio signal when the electronic device performs voice call in the period from when the main microphone is found to be abnormal to when the main microphone is confirmed to be in the first state by the preset algorithm, and from when the main microphone is judged to be in the first state as the starting point and when the length is the duration threshold.

If the master is in the first state, S208 is performed.

S208, determining whether the duration of the primary wheat in the first state is greater than a duration threshold,

Wherein the duration threshold corresponds to the second threshold. If the duration of the primary microphone in the first state is greater than the duration threshold, S209 is executed.

The following description will take the case that the sound receiving hole of the first microphone is blocked.

If the sound receiving hole of the main microphone is blocked, and the time length of the blocked sound receiving hole of the main microphone is greater than the time length threshold, in this case, the microphone for collecting the audio signal when the electronic device performs the voice call can be switched to the second microphone, namely the auxiliary microphone, and the audio signal collected by the second microphone is used as the audio signal adopted when the electronic device performs the voice call.

If the main microphone is in the first state and the duration of the main microphone in the first state is less than or equal to the duration threshold, the third audio signal is continuously output, that is, the execution of S206 is continuously performed.

If the sound receiving hole of the main microphone is blocked, and the time length of the blocked sound receiving hole of the main microphone is smaller than or equal to the time length threshold, the abnormal state of the main microphone is indicated, but the duration of the abnormal state is shorter. In this case, without switching the main microphone to the sub microphone, the third audio signal is used as a microphone for the electronic device to collect the audio signal when the voice call is made.

It should be appreciated that, in the process of determining whether the host microphone is in the first state by using the preset algorithm, the electronic device still uses the third audio signal as the audio signal used for performing the voice call.

If the host wheat is not in the first state, S210 is performed.

If the sound receiving hole of the main microphone is not blocked, the main microphone is not in the first state, and the sound volume value of the first audio signal is smaller than the first sound volume threshold value and is not caused by the blocking of the sound receiving hole of the main microphone. In this case, the main microphone can be kept as a microphone for the electronic device to collect an audio signal when the electronic device is making a voice call, without switching from the main microphone to the sub microphone.

According to the voice call method provided by the embodiment of the application, when the electronic equipment performs voice call, the first audio signal is obtained, and the third audio signal is output based on the first audio signal and the second audio signal under the condition that the volume value of the first audio signal is smaller than the first threshold value, further after the third audio signal is output, a preset algorithm is adopted to determine whether the first microphone is in the first state, and when the first microphone is not in the first state, the first audio signal is output, which is equivalent to the fact that when the first microphone is determined not to be in the first state, the first microphone is kept as the microphone of the electronic equipment for collecting the audio signal when the electronic equipment performs voice call, and the first microphone with better sound quality is kept to be used as the microphone of the audio signal in the voice call, so that the voice call quality is improved, and the user experience is improved.

S209, outputting a second audio signal.

Since the third audio signal is output based on the first audio signal and the second audio signal upon determining that the volume value of the first audio signal is less than the first volume threshold. Therefore, when the first microphone is in the first state and the duration of the first microphone in the first state is greater than the duration threshold, the second audio signal is output, which is equivalent to switching the audio signal used in the voice call process from the third audio signal to the second audio signal.

S210, outputting a first audio signal.

It should be appreciated that when the volume value of the first audio signal is greater than or equal to the first volume threshold, the first audio signal is normal, and thus continues to use the first microphone as the microphone for capturing audio signals in a voice call. When the volume value of the second audio signal is less than or equal to the second volume threshold value, the second audio signal is abnormal, so that the abnormal second audio signal cannot be used for replacing the first audio signal, and the first microphone should be used as a microphone for collecting the audio signal in the voice call. When the main microphone is not in the first state, the main microphone is indicated to be normal, so that the first microphone is continuously used as a microphone for collecting audio signals in the voice call, namely, the first audio signal is output.

According to the voice call method provided by the embodiment of the application, when the electronic equipment performs voice call, the first audio signal is obtained, and under the condition that the volume value of the first audio signal is smaller than the first threshold value, the third audio signal is output based on the first audio signal and the second audio signal, further after the third audio signal is output, a preset algorithm is adopted to determine whether the first microphone is in the first state, and when the first microphone is in the first state and the duration of the first state is greater than the duration threshold value, the second audio signal is output, which is equivalent to that when the first microphone is in an abnormal state, the third audio signal is output based on the first audio signal and the second audio signal, and on the basis of the third audio signal is output, whether the first microphone is in the first state or not is determined by adopting a preset algorithm, namely, when the radio hole of the first microphone is blocked is shorter (smaller than or equal to the duration threshold value), the third microphone is still used as the audio signal when the first microphone is in the first state, the second microphone is still used as the audio signal when the electronic equipment is in the first state, the voice call quality is not acquired, and the voice call quality is not directly poor when the second microphone is used as the voice call is acquired, and the voice call quality is improved.

Fig. 6 is a flowchart of another method for voice communication according to an embodiment of the present application, where the method is applied in an electronic device, and the electronic device includes a plurality of microphones, where the plurality of microphones includes a first microphone and a second microphone, and the first microphone is a microphone of the electronic device for collecting an audio signal at a current moment, as shown in fig. 6, and the method includes:

S301, when the electronic equipment is in a voice call state, a first audio signal is acquired, wherein the first audio signal is an audio signal acquired by a first microphone.

S302, if the volume value of the first audio signal is smaller than a first threshold value, acquiring a second audio signal, wherein the second audio signal is an audio signal acquired by a second microphone.

S303, outputting a third audio signal based on the first audio signal and the second audio signal.

The voice call method provided by the embodiment of the application is applied to the electronic equipment, the electronic equipment comprises a plurality of microphones, the plurality of microphones comprise a first microphone and a second microphone, the first microphone is a microphone for acquiring audio signals at the current moment of the electronic equipment, when the electronic equipment is in a voice call state, the first audio signals are acquired, the first audio signals are the audio signals acquired by the first microphone, if the volume value of the first audio signals is smaller than a first threshold value, the second audio signals are acquired, the second audio signals are the audio signals acquired by the second microphone, the third audio signals are output based on the first audio signals and the second audio signals, so that the state of the first microphone can be judged simply based on the volume value of the first audio signals acquired by the first microphone, and under the condition that the volume value of the first audio signal is smaller than a first threshold value, using a third audio signal obtained by the first audio signal collected by the first microphone and the second audio signal collected by the second microphone as an audio signal used in voice communication. In general, the sound quality of the first audio signal is better than that of the second audio signal, and if the first audio signal is detected to be abnormal, the first microphone may be abnormal, but a preset algorithm is required to determine whether the first microphone is abnormal or not to make a judgment, and a period of time is usually required for the judgment, so that during the period of time, the state of the first microphone is uncertain. If the first microphone is not abnormal, the second audio signal is directly used to influence the tone quality; if the first microphone is abnormal, the second audio signal should be used. Since the state of the first microphone is uncertain during this time, the third audio signal is used in order to balance the two cases. Because the third audio signal merges the audio signal collected by the first microphone and the audio signal collected by the second microphone, when the first microphone is abnormal, the third audio signal is equivalent to the second audio signal; when the first microphone is not abnormal or is in a critical state, the call quality of the third audio signal is superior to that of the first audio signal and the second audio signal, that is, when the first microphone is abnormal, the third audio signal with better call quality is adopted as the audio signal when the electronic equipment performs voice call, compared with the first audio signal collected by the first microphone, the first microphone is kept to be directly switched to the second microphone, and compared with the second audio signal collected by the second microphone, the voice call quality can be improved, and the user experience is improved. Further, since the method for voice communication provided by the embodiment of the application simply judges the state of the first microphone based on the volume value of the first audio signal collected by the first microphone, compared with the method for voice communication which adopts the preset algorithm to determine the state of the first microphone, the method for voice communication provided by the embodiment of the application can react to the abnormality of the first microphone more quickly, so that sufficient time is reserved for detecting the preset algorithm, the robustness of the algorithm is improved, and the electronic equipment is prevented from being in a state with poor communication quality for a longer time. According to the voice call method provided by the embodiment of the application, on the basis of outputting the third audio signal, whether the first microphone is in the first state is further determined by adopting a preset algorithm, namely whether the radio hole of the first microphone is abnormal, and when the abnormal duration of the first microphone is shorter (less than or equal to the duration threshold), the third microphone is still used as the microphone for collecting the audio signal when the electronic equipment performs voice call. By adopting the voice call method provided by the embodiment of the application, under the condition that the first microphone is misjudged to be in the microphone blocking state by the preset algorithm, the third audio signal obtained by fusing the first audio signal and the second audio signal is used, so that the change of tone quality caused by using the second audio signal after misjudgment can be avoided. By adopting the voice call method provided by the embodiment of the application, the error judgment reserved time can be corrected for the preset algorithm, so that the microphone equipment switching caused by error judgment is avoided, and the user experience is influenced; meanwhile, if the abnormal duration of the microphone is shorter, frequent switching of microphone equipment can be avoided, the second microphone with poor tone quality is prevented from being used as a microphone for collecting audio signals when a voice call is conducted, voice call quality is improved, and user experience is improved.

It should be understood that, although the steps in the flowcharts in the above embodiments are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least a portion of the steps in the flowcharts may include a plurality of sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order in which the sub-steps or stages are performed is not necessarily sequential, and may be performed in turn or alternately with at least a portion of the sub-steps or stages of other steps or other steps.

It will be appreciated that in order to achieve the above-described functionality, the electronic device comprises corresponding hardware and/or software modules that perform the respective functionality. The present application can be implemented in hardware or a combination of hardware and computer software, in conjunction with the example algorithm steps described in connection with the embodiments disclosed herein. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application in conjunction with the embodiments, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The embodiment of the application can divide the functional modules of the electronic device according to the method example, for example, each functional module can be divided corresponding to each function, and two or more functions can be integrated in one module. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation. It should be noted that, in the embodiment of the present application, the names of the modules are schematic, and the names of the modules are not limited in practical implementation.

Fig. 7 is a schematic structural diagram of a voice call device according to an embodiment of the present application.

It should be appreciated that the apparatus 600 for voice call may perform the method for voice call shown in fig. 4 to 6; the apparatus 600 for voice call includes: an acquisition unit 610 and a processing unit 620.

The acquiring unit 610 is configured to acquire a first audio signal when the electronic device is in a voice call state, where the first audio signal is an audio signal acquired by a first microphone;

The obtaining unit 610 is configured to obtain a second audio signal if the volume value of the first audio signal is smaller than a first threshold, where the second audio signal is an audio signal collected by a second microphone;

the processing unit 620 is configured to output a third audio signal based on the first audio signal and the second audio signal.

In one embodiment, the processing unit 620 is configured to determine, using a preset algorithm, whether the first microphone is in a first state, where the first state includes that the sound receiving hole of the first microphone is blocked; and if the first microphone is in the first state and the duration of the first microphone in the first state is greater than the second threshold value, outputting a second audio signal.

In one embodiment, if the first microphone is in the first state and the duration of the first microphone in the first state is less than or equal to the second threshold, the processing unit 620 is configured to output the third audio signal.

In one embodiment, if the volume value of the second audio signal is greater than the third threshold, the processing unit 620 is configured to output the third audio signal based on the first audio signal and the second audio signal.

In one embodiment, the processing unit 620 is configured to perform fusion processing on the first audio signal and the second audio signal to obtain a third audio signal; and outputting the third audio signal.

In one embodiment, the processing unit 620 is configured to obtain a first power and a second power of the first audio signal, where the first power is a signal power when the volume value of the first audio signal at the historical time is greater than or equal to the first threshold, and the second power is a signal power when the volume value of the first audio signal at the current time is less than the first threshold; acquiring a first gain of the second audio signal, wherein the first gain refers to the gain of the second audio signal at the current moment; and obtaining a third audio signal according to the first power, the second power and the first gain, the first audio signal and the second audio signal.

In one embodiment, the number of second microphones is a plurality.

The voice call device provided in this embodiment is used for executing the voice call method in the foregoing embodiment, and the technical principle and the technical effect are similar, and are not repeated here.

The above-mentioned apparatus 600 for voice call is embodied in the form of a functional unit. The term "unit" herein may be implemented in software and/or hardware, without specific limitation.

For example, a "unit" may be a software program, a hardware circuit or a combination of both that implements the functions described above. The hardware circuitry may include Application Specific Integrated Circuits (ASICs), electronic circuits, processors (e.g., shared, proprietary, or group processors, etc.) and memory for executing one or more software or firmware programs, merged logic circuits, and/or other suitable components that support the described functions.

Thus, the elements of the examples described in the embodiments of the present application can be implemented in electronic hardware, or in a combination of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

Fig. 8 shows a schematic structural diagram of an electronic device provided by the application. The dashed line in fig. 8 indicates that the unit or the module is optional. The electronic device 700 may be used to implement the method of voice telephony described in the method embodiments above.

The electronic device 700 includes one or more processors 701, which one or more processors 701 may support the method of the electronic device 700 to implement the voice call in the method embodiments. The processor 701 may be a general-purpose processor or a special-purpose processor. For example, the processor 701 may be a central processing unit (central processing unit, CPU), a digital signal processor (DIGITAL SIGNAL processor, DSP), an Application Specific Integrated Circuit (ASIC), a field programmable gate array (field programmable GATE ARRAY, FPGA), or other programmable logic device such as discrete gates, transistor logic, or discrete hardware components.

The processor 701 may be used to control the electronic device 700, execute a software program, and process data of the software program. The electronic device 700 may further comprise a communication unit 705 for enabling input (reception) and output (transmission) of signals.

For example, the electronic device 700 may be a chip, the communication unit 705 may be an input and/or output circuit of the chip, or the communication unit 705 may be a communication interface of the chip, which may be an integral part of a terminal device or other electronic device.

For another example, the electronic device 700 may be a terminal device, the communication unit 705 may be a transceiver of the terminal device, or the communication unit 705 may be a transceiver circuit of the terminal device.

The electronic device 700 may include one or more memories 702 having a program 704 stored thereon, the program 704 being executable by the processor 701 to generate instructions 703 such that the processor 701 performs the impedance matching method described in the above method embodiments according to the instructions 703.

Optionally, the memory 702 may also have data stored therein. Alternatively, processor 701 may also read data stored in memory 702, which may be stored at the same memory address as program 704, or which may be stored at a different memory address than program 704.

The processor 701 and the memory 702 may be provided separately or may be integrated together; for example, integrated on a System On Chip (SOC) of the terminal device.

Illustratively, the memory 702 may be used to store a related program 704 of the method of voice call provided in the embodiment of the present application, and the processor 701 may be used to invoke the related program 704 of the method of voice call stored in the memory 702 when conducting the voice call, to perform the method of voice call of the embodiment of the present application; comprising the following steps: when the electronic equipment is in a voice call state, acquiring a first audio signal, wherein the first audio signal is an audio signal acquired by a first microphone; if the volume value of the first audio signal is smaller than the first threshold value, acquiring a second audio signal, wherein the second audio signal is an audio signal acquired by a second microphone; the third audio signal is output based on the first audio signal and the second audio signal.

The present application also provides a computer program product which, when executed by the processor 701, implements the method of voice call according to any of the method embodiments of the present application.

The computer program product may be stored in the memory 702, for example, the program 704, and the program 704 is finally converted into an executable object file capable of being executed by the processor 701 through preprocessing, compiling, assembling, and linking.

The application also provides a computer readable storage medium having stored thereon a computer program which when executed by a computer implements the method of voice call according to any of the method embodiments of the application. The computer program may be a high-level language program or an executable object program.

Such as memory 702. The memory 702 may be volatile memory or nonvolatile memory, or the memory 702 may include both volatile and nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an erasable programmable ROM (erasable PROM), an electrically erasable programmable EPROM (EEPROM), or a flash memory. The volatile memory may be random access memory (random access memory, RAM) which acts as external cache memory. By way of example, and not limitation, many forms of RAM are available, such as static random access memory (STATIC RAM, SRAM), dynamic random access memory (DYNAMIC RAM, DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate synchronous dynamic random access memory (double DATA RATE SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (ENHANCED SDRAM, ESDRAM), synchronous link dynamic random access memory (SYNCHLINK DRAM, SLDRAM), and direct memory bus random access memory (direct rambus RAM, DR RAM).

In the present application, "at least one" means one or more, and "a plurality" means two or more. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b, or c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or plural.

It should be understood that, in various embodiments of the present application, the sequence numbers of the foregoing processes do not mean the order of execution, and the order of execution of the processes should be determined by the functions and internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present application.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative; for example, the division of the units is only one logic function division, and other division modes can be adopted in actual implementation; for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.

The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for voice communication, the method being applied to an electronic device, the electronic device including a plurality of microphones, the plurality of microphones including a first microphone and a second microphone, the first microphone being a microphone of the electronic device that collects an audio signal at a current time, the method comprising:

When the electronic equipment is in a voice call state, a first audio signal is acquired, wherein the first audio signal is an audio signal acquired by the first microphone;

If the volume value of the first audio signal is smaller than a first threshold value, acquiring a second audio signal, wherein the second audio signal is an audio signal acquired by the second microphone;

Outputting a third audio signal based on the first audio signal and the second audio signal;

The outputting a third audio signal based on the first audio signal and the second audio signal, comprising:

Acquiring first power and second power of the first audio signal, wherein the first power refers to signal power when the volume value of the first audio signal is larger than or equal to the first threshold value at historical moment, and the second power refers to signal power when the volume value of the first audio signal is smaller than the first threshold value at current moment;

Acquiring a first gain of the second audio signal, wherein the first gain refers to the gain of the second audio signal at the current moment;

Obtaining the third audio signal according to the first power, the second power, the first gain, the first audio signal, the second audio signal and a second formula;

Outputting the third audio signal;

The second formula includes:

；

Wherein, Representing the third audio signal,/>Representing the first audio signal,/>Representing the i-th secondary microphone gain-compensated audio signal,/>Representing a fusion scaling factor of said first audio signal,/>Representing the sum of the fusion scaling coefficients of n secondary audio signals, wherein/>Refers to the fusion proportionality coefficient of the ith subsidiary microphone audio signal;

Wherein, The third formula includes:

；

Wherein, Representing the i-th secondary microphone gain-compensated audio signal,/>Representing the original audio signal of the ith secondary microphone,/>Represents the gain compensation coefficient of the ith subsidiary wheat,/>The first gain of the ith subsidiary wheat is represented, and k represents the frequency point serial number;

Wherein, the fourth formula is used for obtaining The fourth formula includes:

；

Wherein, Representing the first power,/>Representing the second power,/>The gain compensation coefficient of the ith secondary microphone is represented.

2. The method of claim 1, wherein after outputting a third audio signal based on the first audio signal and the second audio signal, the method further comprises:

Determining whether the first microphone is in a first state or not by adopting a preset algorithm, wherein the first state comprises that a radio hole of the first microphone is blocked;

And if the first microphone is in the first state and the duration of the first microphone in the first state is greater than a second threshold value, outputting the second audio signal.

3. The method according to claim 2, wherein the method further comprises:

And if the first microphone is in the first state and the duration of the first microphone in the first state is less than or equal to the second threshold value, outputting the third audio signal.

4. A method according to any one of claims 1 to 3, wherein said outputting a third audio signal based on said first audio signal and said second audio signal comprises:

and outputting a third audio signal based on the first audio signal and the second audio signal if the volume value of the second audio signal is larger than a third threshold value.

5. A method according to any one of claims 1 to 3, wherein the number of second microphones is a plurality.

6. An apparatus for a voice call, the apparatus comprising a processor and a memory, the memory for storing a computer program, the processor for invoking and running the computer program from the memory, causing the apparatus to perform the method of any of claims 1 to 5.

7. A chip comprising a processor which, when executing instructions, performs the method of any one of claims 1 to 5.

8. An electronic device comprising a processor for coupling with a memory and reading instructions in the memory and, in accordance with the instructions, causing the electronic device to perform the method of any one of claims 1 to 5.

9. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program, which when executed by a processor causes the processor to perform the method of any of claims 1 to 5.