CN105848061B - Control method and electronic equipment - Google Patents
Control method and electronic equipment Download PDFInfo
- Publication number
- CN105848061B CN105848061B CN201610195658.1A CN201610195658A CN105848061B CN 105848061 B CN105848061 B CN 105848061B CN 201610195658 A CN201610195658 A CN 201610195658A CN 105848061 B CN105848061 B CN 105848061B
- Authority
- CN
- China
- Prior art keywords
- audio
- signal
- acquisition device
- condition
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/027—Spatial or constructional arrangements of microphones, e.g. in dummy heads
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
Abstract
The embodiment of the invention discloses a control method, which comprises the following steps: triggering at least one first audio acquisition device of at least two audio acquisition devices arranged on the electronic equipment to enter an audio acquisition state; the audio adjusting parameters corresponding to each of the at least two audio acquisition devices are different from each other; acquiring at least one first audio signal corresponding to the environment where the at least one first audio acquisition device is located by utilizing the at least one first audio acquisition device; audio processing is performed using a second audio signal of the at least one first audio signal. The embodiment of the invention also discloses the electronic equipment.
Description
Technical Field
The present invention relates to control technologies, and in particular, to a control method and an electronic device.
Background
In a speech recognition system, when a user has a large range of variation in distance from a Microphone (MIC) array, inappropriate audio conditioning of the MIC array reduces the recognition rate of speech signals; for example, when the user is close to the user and/or the volume is large, if the voice signal output by the user is processed by using a large audio amplification amplitude, problems such as overflow, voice clipping and the like occur, so that the recognition rate of the voice signal is reduced; further, when the user is far away and/or the volume is small, if the voice signal output by the user is processed by using a small audio amplification amplitude, the problem of extremely small voice volume may occur, and the recognition rate of the voice signal may also be reduced. Therefore, how to set the audio adjustment parameters of the MIC array and improve the recognition rate of the speech signal becomes an urgent problem to be solved.
Disclosure of Invention
In order to solve the existing technical problem, embodiments of the present invention provide a control method and an electronic device.
The technical scheme of the embodiment of the invention is realized as follows: the embodiment of the invention provides a control method, which comprises the following steps:
triggering at least one first audio acquisition device of at least two audio acquisition devices arranged on the electronic equipment to enter an audio acquisition state; the audio adjusting parameters corresponding to each of the at least two audio acquisition devices are different from each other;
acquiring at least one first audio signal corresponding to the environment where the at least one first audio acquisition device is located by utilizing the at least one first audio acquisition device;
audio processing is performed using a second audio signal of the at least one first audio signal.
An embodiment of the present invention further provides an electronic device, including:
at least two audio acquisition devices for acquiring audio signals; the audio adjusting parameters corresponding to each of the at least two audio acquisition devices are different from each other;
the processor is used for triggering at least one first audio acquisition device of the at least two audio acquisition devices to enter an audio acquisition state;
the system comprises at least one first audio acquisition device, at least one second audio acquisition device and a control device, wherein the at least one first audio acquisition device is used for acquiring at least one first audio signal corresponding to the environment where the at least one first audio acquisition device is located;
correspondingly, the processor is further configured to perform audio processing using a second audio signal of the at least one first audio signal.
According to the control method and the electronic equipment provided by the embodiment of the invention, the at least two audio acquisition devices are arranged in the electronic equipment, so that the audio adjustment parameters corresponding to each of the at least two audio acquisition devices are different from each other, when at least one first audio acquisition device of the at least two audio acquisition devices is used for acquiring a first audio signal, a second audio signal can be determined from the acquired at least one first audio signal, and then the second audio signal is used for audio processing, so that a foundation is laid for solving the problem that the voice recognition rate is reduced due to the fact that the audio adjustment parameters of the existing audio acquisition devices are not matched with the audio signals.
Drawings
FIG. 1 is a first schematic flow chart illustrating an implementation of a control method according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating an exemplary application scenario of an embodiment of the present invention;
FIG. 3 is a schematic diagram of a second implementation flow of the control method according to the embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
So that the manner in which the features and aspects of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings.
Example one
FIG. 1 is a first schematic flow chart illustrating an implementation of a control method according to an embodiment of the present invention; as shown in fig. 1, the method includes:
step 101: triggering at least one first audio acquisition device of at least two audio acquisition devices arranged on the electronic equipment to enter an audio acquisition state; the audio adjusting parameters corresponding to each of the at least two audio acquisition devices are different from each other;
in this embodiment, the electronic device may specifically be an intelligent device such as a television, a personal computer, and a robot. Further, the at least two audio collecting devices disposed on the electronic device may be specifically MIC arrays. The MIC array contains at least one MIC. In a specific application scenario, the at least two MIC arrays are in wired or wireless connection with an electronic device; further, when the at least two MIC arrays are wirelessly connected with the electronic device, the embodiment of the present invention can be applied to a home voice input and output scenario, that is, a MIC array is set in each room; as shown in fig. 2, the electronic device described in this embodiment may specifically be a television, wherein 4 MIC arrays are provided in the television, and each MIC array is provided in a room, so that, for user voices at different distances and different volumes, the electronic device can acquire the voices, the audio acquisition range of the electronic device is increased, user experience is enriched, and user experience is also improved. Further, in another specific application scenario, the electronic device may also be specifically a personal computer, such as a notebook computer, and at this time, the notebook computer may be connected to at least two MIC arrays in a wired or wireless manner, so as to achieve the purpose of increasing the audio acquisition range of the notebook computer.
In this embodiment, the audio adjustment parameter may specifically be an audio amplification parameter, for example, the audio adjustment parameter is a gain corresponding to the audio acquisition device, and is used to adjust an amplification factor of the acquired audio signal.
In a specific embodiment, when the electronic device is provided with N audio capturing devices, where N is a positive integer greater than or equal to 2, the electronic device may set a gain corresponding to a first audio capturing device of the N audio capturing devices to a1, a gain corresponding to a second audio capturing device to a2, and so on, and set a gain corresponding to aN nth audio capturing device to aN a, where a series { a1, a 2.,. ann } composed of a1, a2, …, aN is aN arithmetic series, that is, a gain difference between two adjacent audio capturing devices is a fixed value; therefore, for audio signals with different distances and different volumes, the electronic equipment can acquire effective signals, and the audio acquisition range of the electronic equipment is enlarged to the maximum extent.
Step 102: acquiring at least one first audio signal corresponding to the environment where the at least one first audio acquisition device is located by utilizing the at least one first audio acquisition device;
step 103: audio processing is performed using a second audio signal of the at least one first audio signal.
That is to say, the electronic device selects one second audio signal from the at least one collected first audio signal as a normal voice signal to be processed, and then uses the normal voice signal for subsequent voice recognition, so that a foundation is laid for improving the voice recognition rate.
In practical applications, step 101 triggers at least one first audio capturing device of at least two audio capturing devices set in the electronic device to enter an audio capturing state, which includes the following three modes:
in the first mode, according to a preset rule, at least one first audio acquisition device is selected from at least two audio acquisition devices set in the electronic equipment, and the at least one first audio acquisition device is triggered to perform an audio acquisition state. In practical application, the preset rule can be set arbitrarily according to the actual requirement of the user.
The second method comprises the following steps:
step 101A: triggering the electronic equipment to detect whether audio signals meeting second audio conditions exist in the environment where at least two audio acquisition devices arranged by the electronic equipment are located; here, the second audio condition may be set based on the sensitivity of the audio capturing device, that is, not all audio signals in the environment can trigger the audio capturing device to capture audio, but only audio signals satisfying a certain condition can trigger the audio capturing device to capture audio.
Step 101B: when the audio signals meeting the second audio condition exist, detecting the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition;
in an embodiment, the step 101A may specifically be: the electronic equipment triggers at least two audio acquisition devices arranged by the electronic equipment to enter a detection state; correspondingly, the at least two audio acquisition devices detect whether audio signals meeting second audio conditions exist in the environment where the two audio acquisition devices are located in the detection state; further, when two at least audio acquisition devices determine that there is the audio signal who satisfies the second audio frequency condition, detect self and satisfy the distance between the audio signal of second audio frequency condition, that is to say, electronic equipment need not the intervention of other distance acquisition devices, just can be through two at least audio acquisition devices that self set up range. Specifically, the step of measuring the distance by using the at least two audio acquisition devices includes:
the at least two audio acquisition devices acquire self corresponding position information, such as coordinates and the like, and obtain at least two pieces of position information;
recording the time when the at least two audio acquisition devices receive the audio signals meeting the second audio condition;
and determining the distance between the at least two audio acquisition devices and the audio signal meeting the second audio condition based on the position information corresponding to the at least two audio acquisition devices and the recorded time.
It should be noted that the manner of using the audio capturing device to measure the distance can be implemented only by providing three or more audio capturing devices in the electronic device. When the electronic equipment is only provided with two audio acquisition devices, the electronic equipment can realize the purpose of distance measurement only by means of other devices, for example, distance measurement is realized by means of a distance acquisition device and the like. Or, the electronic device directly utilizes a distance acquisition device, such as a camera, an infrared device, a sound wave device and the like, to measure the distance.
Step 101C: selecting at least one first audio acquisition device from the at least two audio acquisition devices based on the distance between the at least two audio acquisition devices and the audio signal satisfying a second audio condition; for example, at least one first audio acquisition device which is closer to the audio signal is selected to enter an audio acquisition state, and a foundation is laid for improving the recognition rate of the voice signal.
Step 101D: triggering the at least one first audio acquisition device to enter an audio acquisition state.
The third method comprises the following steps:
step 101A: triggering the electronic equipment to detect whether audio signals meeting second audio conditions exist in the environment where at least two audio acquisition devices arranged by the electronic equipment are located; here, the second audio condition may be set based on the sensitivity of the audio capturing device, that is, not all audio signals in the environment can trigger the audio capturing device to capture audio, but only audio signals satisfying a certain condition can trigger the audio capturing device to capture audio.
Step 101B: when the audio signals meeting the second audio condition exist, detecting the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition; in practical applications, the at least two audio acquisition devices may be used for direct distance measurement, for example, the distance measurement method using the at least two audio acquisition devices in the method two is not described herein again; alternatively, a distance acquisition device, such as a camera, infrared, acoustic, etc., may be used to measure the distance.
Step 101C 1: detecting audio characteristics of the audio signals meeting the second audio condition relative to the at least two audio acquisition devices; here, the audio feature may specifically characterize the volume.
Here, the executing subject of step 101C1 may be specifically the two audio capturing devices; that is, the two audio capture devices detect the audio characteristics of the audio signal satisfying the second audio condition relative to itself.
Those skilled in the art will appreciate that the order of execution of step 101B and step 101C1 may be reversed.
Step 101C 2: selecting at least one first audio acquisition device from the at least two audio acquisition devices based on the audio characteristics of the audio signal meeting the second audio condition relative to the at least two audio acquisition devices and the distance between the at least two audio acquisition devices and the audio signal meeting the second audio condition; in practical application, the reference factor selected from the at least one first audio acquisition device may include not only a distance between the audio acquisition device and an audio signal, but also a volume of the audio signal; specifically, as shown in fig. 2, the electronic apparatus is provided with 4 MIC arrays, respectively, MIC array 1 to MIC array 4; at this time, when the distances between the MIC array 1 and the MIC array 2 and the audio signals are the same, and the volume of the audio signals is smaller than that of both the MIC array 1 and the MIC array 2, a device with a larger gain can be selected from the MIC array 1 and the MIC array 2 as a finally determined first audio acquisition device; therefore, a foundation is laid for further improving the recognition rate of the voice signal.
Step 101D: triggering the at least one first audio acquisition device to enter an audio acquisition state.
In practical application, one of the three triggering modes can be selected and executed according to actual requirements.
According to the method provided by the embodiment of the invention, the at least two audio acquisition devices are arranged in the electronic equipment, so that the audio adjustment parameters corresponding to each audio acquisition device in the at least two audio acquisition devices are different from each other, when at least one first audio acquisition device in the at least two audio acquisition devices is used for acquiring a first audio signal, a second audio signal can be determined in the acquired at least one first audio signal, and then the second audio signal is used for carrying out audio processing, so that a foundation is laid for solving the problem that the voice recognition rate is reduced due to the fact that the audio adjustment parameters of the existing audio acquisition devices are not matched with the audio signals.
Example two
FIG. 3 is a schematic diagram of a second implementation flow of the control method according to the embodiment of the present invention; as shown in fig. 3, the method includes:
step 301: triggering at least one first audio acquisition device of at least two audio acquisition devices arranged on the electronic equipment to enter an audio acquisition state; the audio adjusting parameters corresponding to each of the at least two audio acquisition devices are different from each other;
in this embodiment, the electronic device may specifically be an intelligent device such as a television, a personal computer, and a robot. Further, the at least two audio collecting devices disposed on the electronic device may be specifically MIC arrays. The MIC array contains at least one MIC. In a specific application scenario, the at least two MIC arrays are in wired or wireless connection with an electronic device; further, when the at least two MIC arrays are wirelessly connected with the electronic device, the embodiment of the present invention can be applied to a home voice input and output scenario, that is, a MIC array is set in each room; as shown in fig. 2, the electronic device described in this embodiment may specifically be a television, wherein 4 MIC arrays are provided in the television, and each MIC array is provided in a room, so that, for user voices at different distances and different volumes, the electronic device can acquire the voices, the audio acquisition range of the electronic device is increased, user experience is enriched, and user experience is also improved. Further, in another specific application scenario, the electronic device may also be specifically a personal computer, such as a notebook computer, and at this time, the notebook computer may be connected to at least two MIC arrays in a wired or wireless manner, so as to achieve the purpose of increasing the audio acquisition range of the notebook computer.
In this embodiment, the audio adjustment parameter may specifically be an audio amplification parameter, for example, the audio adjustment parameter is a gain corresponding to the audio acquisition device, and is used to adjust an amplification factor of the acquired audio signal.
In a specific embodiment, when the electronic device is provided with N audio capturing devices, where N is a positive integer greater than or equal to 2, the electronic device may set a gain corresponding to a first audio capturing device of the N audio capturing devices to a1, a gain corresponding to a second audio capturing device to a2, and so on, and set a gain corresponding to aN nth audio capturing device to aN a, where a series { a1, a 2.,. ann } composed of a1, a2, …, aN is aN arithmetic series, that is, a gain difference between two adjacent audio capturing devices is a fixed value; therefore, for audio signals with different distances and different volumes, the electronic equipment can acquire effective signals, and the audio acquisition range of the electronic equipment is enlarged to the maximum extent.
Step 302: acquiring at least one first audio signal corresponding to the environment where the at least one first audio acquisition device is located by utilizing the at least one first audio acquisition device;
step 303: performing signal processing on the at least one first audio signal to obtain at least one third audio signal;
in this embodiment, after the first audio signal that the environment that first audio acquisition device gathered oneself corresponds, directly handle the audio signal who gathers, and then obtain the third audio signal. Specifically, the audio adjustment parameter specifically represents an audio amplification parameter; correspondingly, step 303 may specifically be:
and correspondingly performing signal amplification processing on the first audio signal acquired by the at least one first audio acquisition device based on the audio amplification parameter of the at least one first audio acquisition device to obtain at least one third audio signal. That is to say, after the first audio acquisition device acquires the first audio signal corresponding to the environment where the first audio acquisition device is located, the first audio signal acquired by the first audio acquisition device is subjected to signal amplification processing based on the audio amplification parameter, such as gain, corresponding to the first audio acquisition device, so as to obtain a third audio signal; and the electronic equipment is further convenient to select the second audio signal meeting the first audio condition from the obtained at least one third audio signal. Here, the first audio condition may specifically include that both the audio quality and the audio energy satisfy corresponding conditions; that is, the electronic device evaluates the obtained at least one third audio signal, directly removes the collected third audio signal with unqualified audio quality and signal energy lower than a threshold value, only reserves the third audio signal meeting the first audio condition, treats the third audio signal meeting the first audio condition as a second audio signal, treats the second audio signal as a normal voice signal, and processes the second audio signal for subsequent voice recognition, thereby laying a foundation for improving the audio recognition rate.
Step 304: selecting a second audio signal satisfying a first audio condition from the at least one third audio signal;
step 305: and performing audio processing by using the second audio signal.
In practical applications, step 301 triggers at least one first audio capturing device of at least two audio capturing devices set in the electronic device to enter an audio capturing state, which includes the following three modes:
in the first mode, according to a preset rule, at least one first audio acquisition device is selected from at least two audio acquisition devices set in the electronic equipment, and the at least one first audio acquisition device is triggered to perform an audio acquisition state. In practical application, the preset rule can be set arbitrarily according to the actual requirement of the user.
The second method comprises the following steps:
step 301A: triggering the electronic equipment to detect whether audio signals meeting second audio conditions exist in the environment where at least two audio acquisition devices arranged by the electronic equipment are located; here, the second audio condition may be set based on the sensitivity of the audio capturing device, that is, not all audio signals in the environment can trigger the audio capturing device to capture audio, but only audio signals satisfying a certain condition can trigger the audio capturing device to capture audio.
Step 301B: when the audio signals meeting the second audio condition exist, detecting the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition;
in an embodiment, the step 301A may specifically be: the electronic equipment triggers at least two audio acquisition devices arranged by the electronic equipment to enter a detection state; correspondingly, the at least two audio acquisition devices detect whether audio signals meeting second audio conditions exist in the environment where the two audio acquisition devices are located in the detection state; further, when two at least audio acquisition devices determine that there is the audio signal who satisfies the second audio frequency condition, detect self and satisfy the distance between the audio signal of second audio frequency condition, that is to say, electronic equipment need not the intervention of other distance acquisition devices, just can be through two at least audio acquisition devices that self set up range. Specifically, the step of measuring the distance by using the at least two audio acquisition devices includes:
the at least two audio acquisition devices acquire self corresponding position information, such as coordinates and the like, and obtain at least two pieces of position information;
recording the time when the at least two audio acquisition devices receive the audio signals meeting the second audio condition;
and determining the distance between the at least two audio acquisition devices and the audio signal meeting the second audio condition based on the position information corresponding to the at least two audio acquisition devices and the recorded time.
It should be noted that the manner of using the audio capturing device to measure the distance can be implemented only by providing three or more audio capturing devices in the electronic device. When the electronic equipment is only provided with two audio acquisition devices, the electronic equipment can realize the purpose of distance measurement only by means of other devices, for example, distance measurement is realized by means of a distance acquisition device and the like. Or, the electronic device directly utilizes a distance acquisition device, such as a camera, an infrared device, a sound wave device and the like, to measure the distance.
Step 301C: selecting at least one first audio acquisition device from the at least two audio acquisition devices based on the distance between the at least two audio acquisition devices and the audio signal satisfying a second audio condition; for example, at least one first audio acquisition device which is closer to the audio signal is selected to enter an audio acquisition state, and a foundation is laid for improving the recognition rate of the voice signal.
Step 301D: triggering the at least one first audio acquisition device to enter an audio acquisition state.
The third method comprises the following steps:
step 301A: triggering the electronic equipment to detect whether audio signals meeting second audio conditions exist in the environment where at least two audio acquisition devices arranged by the electronic equipment are located; here, the second audio condition may be set based on the sensitivity of the audio capturing device, that is, not all audio signals in the environment can trigger the audio capturing device to capture audio, but only audio signals satisfying a certain condition can trigger the audio capturing device to capture audio.
Step 301B: when the audio signals meeting the second audio condition exist, detecting the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition; in practical applications, the at least two audio acquisition devices may be used for direct distance measurement, for example, the distance measurement method using the at least two audio acquisition devices in the method two is not described herein again; alternatively, a distance acquisition device, such as a camera, infrared, acoustic, etc., may be used to measure the distance.
Step 301C 1: detecting audio characteristics of the audio signals meeting the second audio condition relative to the at least two audio acquisition devices; here, the audio feature may specifically characterize the volume.
Here, the execution subject of step 301C1 may be specifically the two audio capture devices; that is, the two audio capture devices detect the audio characteristics of the audio signal satisfying the second audio condition relative to itself.
Those skilled in the art will appreciate that the order of execution of step 301B and step 301C1 may be reversed.
Step 301C 2: selecting at least one first audio acquisition device from the at least two audio acquisition devices based on the audio characteristics of the audio signal meeting the second audio condition relative to the at least two audio acquisition devices and the distance between the at least two audio acquisition devices and the audio signal meeting the second audio condition; in practical application, the reference factor selected from the at least one first audio acquisition device may include not only a distance between the audio acquisition device and an audio signal, but also a volume of the audio signal; specifically, as shown in fig. 2, the electronic apparatus is provided with 4 MIC arrays, respectively, MIC array 1 to MIC array 4; at this time, when the distances between the MIC array 1 and the MIC array 2 and the audio signals are the same, and the volume of the audio signals is smaller than that of both the MIC array 1 and the MIC array 2, a device with a larger gain can be selected from the MIC array 1 and the MIC array 2 as a finally determined first audio acquisition device; therefore, a foundation is laid for further improving the recognition rate of the voice signal.
Step 301D: triggering the at least one first audio acquisition device to enter an audio acquisition state.
In practical application, one of the three triggering modes can be selected and executed according to actual requirements.
According to the method provided by the embodiment of the invention, the at least two audio acquisition devices are arranged in the electronic equipment, so that the audio adjustment parameters corresponding to each audio acquisition device in the at least two audio acquisition devices are different from each other, when at least one first audio acquisition device in the at least two audio acquisition devices is used for acquiring a first audio signal, a second audio signal can be determined in the acquired at least one first audio signal, and then the second audio signal is used for carrying out audio processing, so that a foundation is laid for solving the problem that the voice recognition rate is reduced due to the fact that the audio adjustment parameters of the existing audio acquisition devices are not matched with the audio signals.
Here, since the audio adjustment parameters corresponding to each audio acquisition device are different from each other in the embodiment of the present invention, the electronic device can select at least one first audio acquisition device that is matched with the audio signal in distance and audio characteristics according to the characteristics of the audio signal, and perform audio acquisition by using the selected at least one first audio acquisition device to obtain at least one first audio acquisition; here, a process of selecting at least one first audio capturing device, that is, a process of selecting an audio adjustment parameter that matches the audio signal to the greatest extent; that is to say, the selected audio adjustment parameter, for example, the gain, corresponding to the at least one first audio acquisition device is also matched with the acquired at least one first audio signal, so that, based on the gain, the at least one first audio signal is correspondingly adjusted to obtain at least one third audio signal, and then a second audio signal meeting the first audio condition is selected from the at least one third audio signal, and the second audio signal is used as an audio signal for subsequent audio identification, thereby laying a foundation for maximally improving the audio identification rate; meanwhile, a foundation is laid for improving the user experience and enriching the user experience.
EXAMPLE III
Based on the method as described in the first embodiment or the second embodiment, in a specific embodiment, the audio adjustment parameter corresponding to each of the at least two audio capturing devices is fixed, that is, each audio capturing device corresponds to a unique audio adjustment parameter; at this time, when at least one first audio acquisition device is selected, the matching degree of the audio adjustment parameter corresponding to each audio acquisition device and the audio signal meeting the second audio condition needs to be judged, and then the audio signal with the largest matching degree is taken as the selected at least one first audio acquisition device; for example, after the distance between each audio acquisition device and the audio signal meeting the second audio condition is determined, at least one first audio acquisition device is selected based on the distance and the audio adjustment parameter corresponding to the audio acquisition device; or after the distance between each audio acquisition device and the audio signal meeting the second audio condition is determined and the audio characteristics of the audio signal meeting the second audio condition relative to each audio acquisition device are determined, at least one first audio acquisition device is selected based on the distance, the audio characteristics and the audio adjustment parameters corresponding to the audio acquisition devices, so that the audio adjustment parameters and the audio signal can be matched maximally, and a foundation is laid for maximally improving the audio recognition rate.
In another specific embodiment, the audio adjusting parameter corresponding to each of the at least two audio acquiring devices is adjustable; however, the audio adjusting parameters corresponding to each audio acquisition device have different adjusting effects, and each audio acquisition device corresponds to a unique audio adjusting range; that is, each audio capture device is unique to the electronic device and cannot be replaced by other audio capture devices; at this time, in order to ensure that the problem of poor voice consistency caused by adjustment of audio adjustment parameters, such as adjustment of gain, does not occur in a section of audio signal acquisition process, in practical application, in a section of audio signal acquisition process, the electronic device does not adjust the audio adjustment parameters, but adjusts the audio adjustment parameters before acquiring the audio signals; for example, after determining the distance between each audio acquisition device and the audio signal satisfying the second audio condition and selecting at least one first audio acquisition device based on the distance, determining whether to adjust the audio adjustment parameter corresponding to the at least one first audio acquisition device based on the distance and/or the audio characteristic of the audio signal satisfying the second audio condition; when the adjustment is determined, adjusting the audio adjustment parameters corresponding to the at least one first audio acquisition device, so that the adjusted audio adjustment parameters are matched with the distance and the audio characteristics of the audio signals meeting the second audio condition; or when the distance between each audio acquisition device and the audio signal meeting the second audio condition is determined, determining the audio characteristics of the audio signal meeting the second audio condition relative to each audio acquisition device, selecting at least one first audio acquisition device based on the distance and the audio characteristics, determining whether to adjust the audio adjustment parameter corresponding to the at least one first audio acquisition device based on the distance and/or the audio characteristics of the audio signal meeting the second audio condition, and when the adjustment is determined, adjusting the audio adjustment parameter corresponding to the at least one first audio acquisition device to enable the adjusted audio adjustment parameter to be matched with the distance and the audio characteristics of the audio signal meeting the second audio condition; therefore, the audio adjusting parameters and the audio signals can be matched maximally, and a foundation is laid for maximally improving the audio recognition rate.
Furthermore, in practical application, the audio adjusting parameter can be adjusted according to the variation degree of the first audio signal; specifically, the electronic device detects whether an audio change characteristic of a first audio signal acquired by the at least one first audio acquisition device meets an audio change condition; for example, the volume increase of the first audio signal is detected, and it is determined that the previous audio signal is ended and the next audio signal is not started yet, at this time, it is determined that the audio change condition is satisfied; further, when an audio change condition is met, the audio adjustment parameter of the at least one first audio acquisition device is adjusted based on the audio change characteristic of the first audio signal acquired by the at least one first audio acquisition device, so that the adjusted audio adjustment parameter of the at least one first audio acquisition device is matched with the audio change characteristic of the first audio signal acquired by the at least one first audio acquisition device. For example, when the volume is increased, the gain is turned down; when the volume is small, the gain is turned up. Therefore, the method disclosed by the embodiment of the invention is suitable for life scenes, and can ensure the audio recognition rate to the maximum extent, thereby improving the user experience.
Example four
To implement the methods described in the first to third embodiments, an embodiment of the present invention provides an electronic device, as shown in fig. 4, including:
at least two audio acquisition devices 41 for acquiring audio signals; the audio adjusting parameters corresponding to each of the at least two audio acquisition devices are different from each other;
a processor 42 for triggering at least one first audio capturing device of the at least two audio capturing devices to enter an audio capturing state;
the system comprises at least one first audio acquisition device, at least one second audio acquisition device and a control device, wherein the at least one first audio acquisition device is used for acquiring at least one first audio signal corresponding to the environment where the at least one first audio acquisition device is located;
correspondingly, the processor is further configured to perform audio processing using a second audio signal of the at least one first audio signal.
In this embodiment, the at least one first audio acquisition device is further configured to perform signal processing on the at least one first audio signal to obtain at least one third audio signal;
correspondingly, the processor is further configured to select a second audio signal satisfying the first audio condition from the at least one third audio signal, and perform audio processing using the second audio signal.
In this embodiment, the audio adjustment parameter specifically represents an audio amplification parameter; in a corresponding manner, the first and second electrodes are,
the at least one first audio acquisition device is further configured to perform signal amplification processing on the acquired first audio signal based on the audio amplification parameter corresponding to the first audio acquisition device, so as to obtain at least one third audio signal.
In this embodiment, the processor is further configured to select at least one first audio acquisition device from the at least two audio acquisition devices according to a preset rule, and trigger the at least one first audio acquisition device to perform an audio acquisition state.
In this embodiment, the processor is further configured to:
triggering the electronic equipment to detect whether audio signals meeting second audio conditions exist in the environment where at least two audio acquisition devices arranged by the electronic equipment are located;
when the audio signals meeting the second audio condition exist, detecting the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition;
selecting at least one first audio acquisition device from the at least two audio acquisition devices based on the distance between the at least two audio acquisition devices and the audio signal satisfying a second audio condition;
triggering the at least one first audio acquisition device to enter an audio acquisition state.
In this embodiment, the processor is further configured to detect an audio feature of the audio signal satisfying the second audio condition with respect to the at least two audio capturing devices; and the audio acquisition device is further used for selecting at least one first audio acquisition device from the at least two audio acquisition devices based on the audio characteristics of the audio signals meeting the second audio condition relative to the at least two audio acquisition devices and the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition.
In this embodiment, the processor is further configured to detect whether an audio change characteristic of the first audio signal acquired by the at least one first audio acquisition device satisfies an audio change condition; when the audio change condition is met, adjusting the audio adjustment parameter of the at least one first audio acquisition device based on the audio change characteristic of the first audio signal acquired by the at least one first audio acquisition device, so that the adjusted audio adjustment parameter of the at least one first audio acquisition device is matched with the audio change characteristic of the first audio signal acquired by the at least one first audio acquisition device.
In a specific embodiment, the electronic device may directly utilize the two audio acquisition devices to perform ranging; specifically, the processor is further configured to trigger the at least two audio acquisition devices to enter a detection state; correspondingly, the at least two audio acquisition devices are also used for detecting whether audio signals meeting second audio conditions exist in the environment where the at least two audio acquisition devices are located when the at least two audio acquisition devices are in the detection state, and detecting the distance between the at least two audio acquisition devices and the audio signals meeting the second audio conditions when the audio signals meeting the second audio conditions exist; and then, based on the distance between the at least two audio acquisition devices and the audio signal meeting a second audio condition, selecting at least one first audio acquisition device from the at least two audio acquisition devices through the processor so as to trigger the at least one first audio acquisition device to enter an audio acquisition state.
Further, the at least two audio acquisition devices are also used for detecting the audio characteristics of the audio signals meeting the second audio condition relative to the at least two audio acquisition devices; correspondingly, the processor is further configured to select at least one first audio acquisition device from the at least two audio acquisition devices based on the audio characteristics of the audio signal satisfying the second audio condition relative to the at least two audio acquisition devices and the distance between the at least two audio acquisition devices and the audio signal satisfying the second audio condition, so as to trigger the at least one first audio acquisition device to enter an audio acquisition state.
In another specific embodiment, the electronic device further comprises a distance acquisition device; at this time, the processor is further configured to trigger the distance acquisition device to enter a detection state when it is determined that an audio signal satisfying a second audio condition exists; correspondingly, the distance acquisition devices are used for detecting the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition, and then the electronic equipment controls the processor to select at least one first audio acquisition device from the at least two audio acquisition devices based on the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition so as to trigger the at least one first audio acquisition device to enter an audio acquisition state.
Those skilled in the art should understand that the functions of each processing unit in the electronic device according to the embodiment of the present invention can be understood by referring to the description of the foregoing control method, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a mobile storage device, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a mobile storage device, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (6)
1. A control method, comprising:
detecting that audio signals meeting a second audio condition exist in the environment where at least two audio acquisition devices arranged in the electronic equipment are located; based on the matching degree of the audio adjusting parameters corresponding to each audio acquisition device and the audio signals meeting the second audio conditions, taking the audio acquisition device with the maximum matching degree as at least one selected first audio acquisition device; wherein the second audio condition is based on a sensitivity setting of an audio capture device;
triggering at least one first audio acquisition device of the at least two audio acquisition devices to enter an audio acquisition state; the audio adjusting parameters corresponding to each of the at least two audio acquisition devices are different from each other; the audio adjusting parameters comprise gains corresponding to the audio acquisition devices and are used for adjusting the amplification factor of the acquired audio signals;
acquiring at least one first audio signal corresponding to the environment where the at least one first audio acquisition device is located by utilizing the at least one first audio acquisition device;
selecting a second audio signal from the at least one collected and processed first audio signal, and performing audio processing by using the second audio signal;
wherein, the matching degree of the audio adjusting parameter corresponding to each audio collecting device and the audio signal meeting the second audio condition is based on, and the audio collecting device with the maximum matching degree is taken as at least one selected first audio collecting device, which specifically comprises:
when the audio signals meeting the second audio condition exist, detecting the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition;
detecting audio characteristics of the audio signals meeting the second audio condition relative to the at least two audio acquisition devices;
and selecting at least one first audio acquisition device from the at least two audio acquisition devices based on the audio characteristics of the audio signal meeting the second audio condition relative to the at least two audio acquisition devices and the distance between the at least two audio acquisition devices and the audio signal meeting the second audio condition.
2. The method of claim 1, wherein selecting a second audio signal from the at least one first audio signal collected and processed, and performing audio processing using the second audio signal comprises:
performing signal processing on the at least one first audio signal to obtain at least one third audio signal;
selecting a second audio signal satisfying a first audio condition from the at least one third audio signal;
and performing audio processing by using the second audio signal.
3. The method of claim 2,
the signal processing of the at least one first audio signal to obtain at least one third audio signal includes:
and correspondingly performing signal amplification processing on the first audio signal acquired by the at least one first audio acquisition device based on the audio amplification parameter of the at least one first audio acquisition device to obtain at least one third audio signal.
4. The method of claim 1, further comprising:
detecting whether the audio change characteristics of the first audio signals collected by the at least one first audio collecting device meet audio change conditions or not;
when the audio change condition is met, adjusting the audio adjustment parameter of the at least one first audio acquisition device based on the audio change characteristic of the first audio signal acquired by the at least one first audio acquisition device, so that the adjusted audio adjustment parameter of the at least one first audio acquisition device is matched with the audio change characteristic of the first audio signal acquired by the at least one first audio acquisition device.
5. An electronic device, comprising:
at least two audio acquisition devices for acquiring audio signals; the audio adjusting parameters corresponding to each of the at least two audio acquisition devices are different from each other; the audio adjusting parameters comprise gains corresponding to the audio acquisition devices and are used for adjusting the amplification factor of the acquired audio signals;
the processor is used for triggering the electronic equipment to detect that audio signals meeting second audio conditions exist in the environment where the at least two set audio acquisition devices are located; based on the matching degree of the audio adjusting parameters corresponding to each audio acquisition device and the audio signals meeting the second audio conditions, taking the audio acquisition device with the maximum matching degree as at least one selected first audio acquisition device; triggering at least one first audio acquisition device of the at least two audio acquisition devices to enter an audio acquisition state; wherein the second audio condition is based on a sensitivity setting of an audio capture device;
the system comprises at least one first audio acquisition device, at least one second audio acquisition device and a control device, wherein the at least one first audio acquisition device is used for acquiring at least one first audio signal corresponding to the environment where the at least one first audio acquisition device is located;
correspondingly, the processor is further configured to select a second audio signal from the at least one collected and processed first audio signal, and perform audio processing by using the second audio signal;
the processor is specifically configured to: when determining that the audio signals meeting the second audio condition exist, detecting the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition;
the at least two audio acquisition devices are further used for detecting the audio characteristics of the audio signals meeting the second audio condition relative to the at least two audio acquisition devices;
correspondingly, the processor is further configured to select at least one first audio capture device from the at least two audio capture devices based on the audio features of the audio signal satisfying the second audio condition relative to the at least two audio capture devices and the distance between the at least two audio capture devices and the audio signal satisfying the second audio condition.
6. The electronic device of claim 5, further comprising
A distance acquisition device; wherein the content of the first and second substances,
the processor is further used for triggering the distance acquisition device to enter a detection state when the audio signal meeting the second audio condition is determined to exist;
the distance acquisition device is used for detecting the distance between the at least two audio acquisition devices and the audio signals meeting the second audio condition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610195658.1A CN105848061B (en) | 2016-03-30 | 2016-03-30 | Control method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610195658.1A CN105848061B (en) | 2016-03-30 | 2016-03-30 | Control method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105848061A CN105848061A (en) | 2016-08-10 |
| CN105848061B true CN105848061B (en) | 2021-04-13 |
Family
ID=56596439
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610195658.1A Active CN105848061B (en) | 2016-03-30 | 2016-03-30 | Control method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105848061B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106448693B (en) * | 2016-09-05 | 2019-11-29 | 华为技术有限公司 | A kind of audio signal processing method and device |
| CN107452398B (en) * | 2017-08-09 | 2021-03-16 | 深圳创维数字技术有限公司 | Echo acquisition method, electronic device and computer readable storage medium |
| CN109327749A (en) * | 2018-08-16 | 2019-02-12 | 深圳市派虎科技有限公司 | Microphone and its control method and noise-reduction method |
| CN109712626B (en) * | 2019-03-04 | 2021-04-30 | 腾讯科技（深圳）有限公司 | Voice data processing method and device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| SU940321A1 (en) * | 1980-12-29 | 1982-06-30 | Предприятие П/Я Г-4974 | Method and apparatus for determining sound intensity of individual source |
| CN102498709A (en) * | 2009-05-14 | 2012-06-13 | 鹦鹉股份有限公司 | Method for selecting one of two or more microphones for a speech-processing system such as a hands-free telephone device operating in a noisy environment |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4266148B2 (en) * | 2003-09-30 | 2009-05-20 | 株式会社東芝 | Electronics |
| US20050238181A1 (en) * | 2003-11-27 | 2005-10-27 | Sigvard Nilsson | Hearing protector |
| US20060067540A1 (en) * | 2004-09-28 | 2006-03-30 | Gao Xiao M | Method for signal nonlinear distortion detection and adaptive gain control |
| US8175291B2 (en) * | 2007-12-19 | 2012-05-08 | Qualcomm Incorporated | Systems, methods, and apparatus for multi-microphone based speech enhancement |
| US8411880B2 (en) * | 2008-01-29 | 2013-04-02 | Qualcomm Incorporated | Sound quality by intelligently selecting between signals from a plurality of microphones |
| CN101370322A (en) * | 2008-09-12 | 2009-02-18 | 深圳华为通信技术有限公司 | Microphone gain control method and communication equipment |
| US20110058676A1 (en) * | 2009-09-07 | 2011-03-10 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for dereverberation of multichannel signal |
| US9635460B2 (en) * | 2011-08-18 | 2017-04-25 | Knowles Electronics, Llc | Sensitivity adjustment apparatus and method for MEMS devices |
| CN103928025B (en) * | 2014-04-08 | 2017-06-27 | 华为技术有限公司 | The method and mobile terminal of a kind of speech recognition |
| CN104066036A (en) * | 2014-06-19 | 2014-09-24 | 华为技术有限公司 | Pick-up device and method |
| CN104219390A (en) * | 2014-09-17 | 2014-12-17 | 深圳市中兴移动通信有限公司 | Mobile terminal and sound recording method and device thereof |
-
2016
- 2016-03-30 CN CN201610195658.1A patent/CN105848061B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| SU940321A1 (en) * | 1980-12-29 | 1982-06-30 | Предприятие П/Я Г-4974 | Method and apparatus for determining sound intensity of individual source |
| CN102498709A (en) * | 2009-05-14 | 2012-06-13 | 鹦鹉股份有限公司 | Method for selecting one of two or more microphones for a speech-processing system such as a hands-free telephone device operating in a noisy environment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105848061A (en) | 2016-08-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105848061B (en) | Control method and electronic equipment | |
| CN110970057B (en) | Sound processing method, device and equipment | |
| US20210330229A1 (en) | Method and device for attention training, and computer readable storage medium | |
| US11605372B2 (en) | Time-based frequency tuning of analog-to-information feature extraction | |
| CN106782544A (en) | Interactive voice equipment and its output intent | |
| JP6588098B2 (en) | Method and apparatus for controlling headset noise reduction | |
| CN109151634A (en) | Wireless headset method for controlling volume, wireless headset and mobile terminal | |
| CN107395873B (en) | Volume adjusting method, device, storage medium and terminal | |
| CN109192214B (en) | Voice number taking method, storage medium and robot | |
| CN110519450B (en) | Ultrasonic processing method, ultrasonic processing device, electronic device, and computer-readable medium | |
| CN110364156A (en) | Voice interactive method, system, terminal and readable storage medium storing program for executing | |
| CN113676592B (en) | Recording method, recording device, electronic equipment and computer readable medium | |
| US11620995B2 (en) | Voice interaction processing method and apparatus | |
| WO2019015418A1 (en) | Unlocking control method and related product | |
| CN107450882B (en) | Method and device for adjusting sound loudness and storage medium | |
| CN113949955A (en) | Noise reduction processing method and device, electronic equipment, earphone and storage medium | |
| CN106708461B (en) | Information processing method and electronic equipment | |
| CN113709629A (en) | Frequency response parameter adjusting method, device, equipment and storage medium | |
| US20180003818A1 (en) | Method and apparatus for space status detection based on acoustic chirp signals | |
| CN104464746A (en) | Voice filtering method and device and electron equipment | |
| CN114979921A (en) | Earphone sound leakage detection method and device and Bluetooth earphone | |
| CN105244037B (en) | Audio signal processing method and device | |
| EP4084002B1 (en) | Information processing method, electronic equipment, storage medium, and computer program product | |
| CN104038611A (en) | Device and method for adjusting volume according to environment | |
| CN218162834U (en) | Sound box system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |