CN110827845B - Recording method, device, equipment and storage medium - Google Patents
Recording method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN110827845B CN110827845B CN201911128555.3A CN201911128555A CN110827845B CN 110827845 B CN110827845 B CN 110827845B CN 201911128555 A CN201911128555 A CN 201911128555A CN 110827845 B CN110827845 B CN 110827845B
- Authority
- CN
- China
- Prior art keywords
- signal
- sound
- main
- audio acquisition
- auxiliary
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000005236 sound signal Effects 0.000 claims abstract description 175
- 238000001228 spectrum Methods 0.000 claims abstract description 40
- 230000009467 reduction Effects 0.000 claims abstract description 37
- 238000010183 spectrum analysis Methods 0.000 claims description 38
- 238000004590 computer program Methods 0.000 claims description 16
- 230000008569 process Effects 0.000 claims description 14
- 238000004458 analytical method Methods 0.000 claims description 8
- 230000000875 corresponding effect Effects 0.000 abstract 1
- 230000006870 function Effects 0.000 description 27
- 102000008482 12E7 Antigen Human genes 0.000 description 15
- 108010020567 12E7 Antigen Proteins 0.000 description 15
- 101000893549 Homo sapiens Growth/differentiation factor 15 Proteins 0.000 description 15
- 101000692878 Homo sapiens Regulator of MON1-CCZ1 complex Proteins 0.000 description 15
- 102100026436 Regulator of MON1-CCZ1 complex Human genes 0.000 description 15
- 238000010586 diagram Methods 0.000 description 7
- 241001347978 Major minor Species 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000004913 activation Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000009977 dual effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 230000002618 waking effect Effects 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0232—Processing in the frequency domain
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The embodiment of the invention discloses a recording method, a recording device, recording equipment and a recording medium. Wherein the method is performed by at least two audio capture devices, comprising: acquiring a collected first sound signal, and determining the first sound signal as a main sound source according to a preset standard; carrying out spectrum comparison on a second sound signal acquired by each of at least two audio acquisition devices and a main sound source, and determining a main signal in the second sound signal; and determining a main audio acquisition device and an auxiliary audio acquisition device of the at least two audio acquisition devices according to the sound parameters of the main signal in the second sound signal in each audio acquisition device, recording sound by adopting the main audio acquisition device, and performing noise reduction by adopting the auxiliary audio acquisition device. The main sound source is determined, the voice is compared with the main sound source to obtain the main signal, and the main-side relation of the audio acquisition equipment is determined, so that the corresponding effect is exerted, and the accuracy of judging the main signal and the recording definition are improved.
Description
Technical Field
The present invention relates to signal processing technologies, and in particular, to a recording method, an apparatus, a device, and a storage medium.
Background
Recording and videotaping are gradually known by consumers as a necessary function of modern mobile terminals. However, in the process of recording audio and video, many noises are usually accompanied, and clear sound cannot be transmitted.
Currently, for the recording function of a mobile terminal, a method of a single audio acquisition device or a method of a dual audio acquisition device are generally adopted for recording. The single audio acquisition equipment has a single sound channel when recording, and records the voice and the background sound simultaneously; the dual-audio acquisition equipment can reduce noise during recording, but the main audio acquisition equipment and the auxiliary audio acquisition equipment are already appointed before recording, the appointed main audio acquisition equipment carries out transmission, and the auxiliary audio acquisition equipment carries out noise reduction.
The equipment of the single audio acquisition equipment cannot distinguish the dual channels and cannot perform noise reduction; the main and auxiliary audio acquisition equipment in the dual-audio acquisition equipment is specified, when a user records a sound, the main and auxiliary audio acquisition equipment is far away, when the auxiliary audio acquisition equipment is close, only background sound is recorded, the voice of the user is removed as noise, the noise reduction effect is poor, the judgment on a main signal is inaccurate, and the recording definition is low.
Disclosure of Invention
The embodiment of the invention provides a recording method, a device, equipment and a storage medium, which are used for confirming a main signal according to a frequency spectrum during recording, confirming main and auxiliary audio acquisition equipment according to sound parameters, and respectively carrying out recording and denoising by the main and auxiliary audio acquisition equipment, thereby achieving the effect of accurately judging the main signal and improving the recording definition.
In one embodiment, an embodiment of the present invention provides a recording method, which is performed by at least two audio acquisition devices, and includes:
acquiring a collected first sound signal, and determining the first sound signal as a main sound source according to a preset standard;
carrying out spectrum comparison on a second sound signal acquired by any one of at least two audio acquisition devices and the main sound source, and determining a main signal and an auxiliary signal in the second sound signal;
and determining a main audio acquisition device and an auxiliary audio acquisition device of at least two audio acquisition devices according to the sound parameters of the main signal in each audio acquisition device in the second sound signal, recording the sound of the main signal by adopting the main audio acquisition device, and performing noise reduction processing on the auxiliary signal by adopting the auxiliary audio acquisition device.
Optionally, the acquiring a first collected sound signal, and determining the first sound signal as a main sound source according to a preset standard includes:
acquiring preset voice awakening instruction content;
determining whether a first sound signal acquired by any one of at least two audio acquisition devices is matched with the voice wake-up instruction content;
and if so, determining the first sound signal as a main sound source.
Optionally, performing spectrum comparison on a second sound signal acquired by any one of the at least two audio acquisition devices and the main sound source, and determining a main signal and an auxiliary signal in the second sound signal, includes:
carrying out spectrum analysis on the main sound source, and recording the frequency amplitude;
and carrying out spectrum analysis on a second sound signal acquired by any one of at least two audio acquisition devices, comparing an analysis result of the second sound signal with the frequency amplitude, determining that the sound information of which the similarity with the frequency amplitude accords with a set threshold value is a main signal in the second sound signal, and determining that the sound information of which the similarity with the frequency amplitude does not accord with the set threshold value is an auxiliary signal in the second sound signal.
Optionally, the sound parameter includes an amplitude parameter; correspondingly, according to the sound parameter of the main signal in each audio acquisition device in the second sound signal, main audio acquisition device and auxiliary audio acquisition device in at least two audio acquisition devices are determined, the main audio acquisition device is adopted to record the sound of the main signal, and the auxiliary audio acquisition device is adopted to perform noise reduction processing on the auxiliary signal, including:
according to the amplitude parameter of the main signal in the second sound signal in each audio acquisition device, determining the audio acquisition device which acquires the amplitude parameter of the main signal in the second sound signal and accords with a preset rule as a main audio acquisition device, and determining the audio acquisition device which does not accord with the preset rule as an auxiliary audio acquisition device;
the main audio acquisition equipment is adopted to record the sound of the main signal, the auxiliary audio acquisition equipment is adopted to perform noise reduction processing on the auxiliary signal, the main signal is corrected through the auxiliary signal to obtain a corrected signal, and the corrected signal is used as a recording signal.
Optionally, after the main audio collecting device is used for recording sound and the auxiliary audio collecting device is used for performing noise reduction processing, the method further includes:
if the amplitude parameter of the main signal in the sound information collected by the auxiliary audio collecting device accords with a preset rule and the amplitude parameter of the main signal in the sound information collected by the main audio collecting device does not accord with the preset rule in the sound recording process, determining the main audio collecting device from the original auxiliary audio collecting device and switching the original main audio collecting device into the auxiliary audio collecting device.
Optionally, the modifying the main signal by the auxiliary signal to obtain a modified signal, and using the modified signal as a recording signal includes:
according to the auxiliary signal collected by the auxiliary audio acquisition equipment, carrying out phase reversal processing on the sound phase of the auxiliary signal to obtain a phase reversal signal of the auxiliary signal;
and offsetting a second sound signal in the main audio acquisition equipment according to the inverted signal of the auxiliary audio acquisition equipment to obtain the correction signal.
In an embodiment, an embodiment of the present invention further provides a recording apparatus configured to include at least two audio capturing devices, where the apparatus includes:
the main sound source determining module is used for acquiring the acquired first sound signal and determining the first sound signal as a main sound source according to a preset standard;
the main signal determining module is used for carrying out spectrum comparison on a second sound signal acquired by each of at least two audio acquisition devices and the main sound source and determining a main signal and an auxiliary signal in the second sound signal;
and the audio acquisition equipment determining module is used for determining main audio acquisition equipment and auxiliary audio acquisition equipment in at least two audio acquisition equipment according to the sound parameters of the main signal in the second sound signal in each audio acquisition equipment, recording the sound of the main signal by adopting the main audio acquisition equipment, and performing noise reduction processing on the auxiliary signal by adopting the auxiliary audio acquisition equipment.
Optionally, the dominant sound source determining module is specifically configured to:
acquiring preset voice awakening instruction content;
determining whether a first sound signal acquired by any one of at least two audio acquisition devices is matched with the voice wake-up instruction content;
and if so, determining the first sound signal as a main sound source.
Optionally, the main signal determining module is specifically configured to:
carrying out spectrum analysis on the main sound source, and recording the frequency amplitude;
and carrying out spectrum analysis on a second sound signal acquired by each of at least two audio acquisition devices, comparing an analysis result of the second sound signal with the frequency amplitude, determining that the sound information of which the similarity with the frequency amplitude accords with a set threshold is a main signal in the second sound signal, and determining that the sound information of which the similarity with the frequency amplitude does not accord with the set threshold is an auxiliary signal in the second sound signal.
In an embodiment, an embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the computer program to implement the recording method according to any embodiment of the present invention.
In one embodiment, the embodiment of the present invention further provides a storage medium containing computer-executable instructions, which are used for executing the sound recording method according to any embodiment of the present invention when executed by a computer processor.
According to the embodiment of the invention, the recording function is started by detecting whether the voice awakening instruction is consistent with the preset instruction, and the sound with the successfully started recording function is used as the main sound source. In the recording process, sound consistent with the frequency spectrum of the main sound source is recorded. And determining the main audio acquisition equipment and the auxiliary audio acquisition equipment according to the distance between the sound and the audio acquisition equipment, and carrying out voice transmission by the main audio acquisition equipment and denoising by the auxiliary audio acquisition equipment. The main and auxiliary audio acquisition equipment is confirmed according to the sound parameters, the problem of unclear recording caused by fixation of the main and auxiliary audio acquisition equipment is solved, the recording content is accurately judged, and the recording quality is improved.
Drawings
FIG. 1 is a flowchart illustrating a recording method according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a recording method according to a second embodiment of the present invention;
FIG. 3 is a flowchart illustrating a recording method according to a second embodiment of the present invention;
fig. 4 is a block diagram of a recording apparatus according to a second embodiment of the present invention;
fig. 5 is a block diagram of a recording apparatus according to a third embodiment of the present invention;
fig. 6 is a schematic structural diagram of a computer device in the fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a schematic flow chart of a recording method according to an embodiment of the present invention, which is applicable to recording, and the method can be executed by a recording apparatus. As shown in fig. 1, the method specifically includes the following steps:
s110, acquiring the collected first sound signal, and determining the first sound signal as a main sound source according to a preset standard.
Wherein, a user or other equipment capable of making sound sends out a first sound signal, and the first sound signal can be used for waking up the recording function of the equipment. The computer device obtains a first sound signal collected by any audio collecting device, wherein the computer device can be a mobile phone, a computer, a smart watch and other terminal devices, and the audio collecting device can be a microphone and other devices. And comparing the first sound signal with a voice instruction of a user-preset wake-up recording function according to a preset standard, wherein the content of the voice instruction of the user-preset wake-up recording function is a comparison object, and the preset standard is that the content of the first sound signal is completely matched with the content of the comparison object. Determining whether the first sound signal is matched with the comparison object, and if so, determining the first sound signal as a main sound source; and if not, re-acquiring a new first sound signal to wake up the recording function. The audio acquisition equipment can be two or more than two, and the main sound source is sound for successfully awakening the recording function. For example, the recording function is awakened by the twilight and the twilight, and if the recording function is awakened only by the twilight successfully, the twilight sound is the main sound source.
In this embodiment, optionally, the acquiring a first collected sound signal, and determining the first sound signal as a main sound source according to a preset standard includes: acquiring preset voice awakening instruction content; determining whether a first sound signal acquired by any one of at least two audio acquisition devices is matched with the voice wake-up instruction content; and if so, determining the first sound signal as a main sound source.
Specifically, a user may preset a voice wake-up instruction before recording, and when any audio acquisition device acquires a first sound signal, the computer device acquires the content of the preset voice wake-up instruction, compares the content of the first sound signal with the content of the voice wake-up instruction, and determines whether the content of the first sound signal matches the content of the voice wake-up instruction. If the first sound signal is matched with the second sound signal, the recording function is successfully awakened, the first sound signal is determined to be the main sound source, the first sound signal is stored by the computer equipment, and a loudspeaker sends a voice prompt of successful awakening. If not, the loudspeaker sends out a voice prompt of awakening failure, and acquires the first voice information again. For example, the preset voice wake-up instruction is "turn on the recorder", the collected first sound signal is "start recording", and the content of the voice wake-up instruction is inconsistent with the content of the first sound signal, so that the recording function cannot be turned on, and at this time, the speaker emits a prompt sound of "wake-up failure". The voice recording device has the advantages that the voice recording function can be prevented from being opened when a user speaks, privacy of the user can be protected, and random use of the device can be limited.
S120, performing spectrum comparison on a second sound signal acquired by any one of the at least two audio acquisition devices and the main sound source, and determining a main signal and an auxiliary signal in the second sound signal.
After the recording function is turned on, the user can start recording. The computer device acquires the second sound signal acquired by any audio acquisition device, performs spectrum comparison on the second sound signal and the main sound source, and determines whether the spectrum of the second sound signal is consistent with the spectrum of the main sound source. If the sound consistent with the frequency spectrum of the main sound source exists in the second sound signal, recording the sound consistent with the frequency spectrum of the main sound source in the second sound signal as a main signal; if there is a sound that does not match the spectrum of the main sound source in the second sound signal, the sound is rejected as a noise as an auxiliary signal. For example, one device has two audio capture devices, where sound consistent with the main sound source spectrum exists in the second sound signal captured by any one of the audio capture devices, and then it may be determined that sound consistent with the main sound source spectrum in the second sound signal captured by any one of the audio capture devices is the recorded target sound.
In this embodiment, optionally, performing spectrum comparison on the second sound signal acquired by any one of the at least two audio acquisition devices and the main sound source, and determining the main signal in the second sound signal includes: carrying out spectrum analysis on the main sound source, and recording the frequency amplitude; and carrying out spectrum analysis on a second sound signal acquired by any one of at least two audio acquisition devices, comparing an analysis result of the second sound signal with a frequency amplitude, determining that sound information with the similarity to the frequency amplitude meeting a set threshold is a main signal in the second sound signal, and determining that sound information with the similarity to the frequency amplitude not meeting the set threshold is an auxiliary signal in the second sound signal.
Specifically, after the computer device determines the main sound source, the computer device performs spectrum analysis on the main sound source, performs spectrum recording on the analyzed frequency amplitude, and takes the spectrum of the main sound source as a standard for judging the main signal. The spectral error threshold of the second sound signal and the main sound source may be preset, after the computer device obtains the second sound signal acquired by any audio acquisition device, the computer device performs spectral analysis on the sound in the second sound signal, and compares the result of the spectral analysis on the sound in the second sound signal with the result of the spectral analysis on the main sound source, where the result of the spectral analysis on the sound in the second sound signal may be a sound frequency amplitude in the second sound signal. And if the similarity between the frequency spectrum analysis result of the sound in the second sound signal and the frequency amplitude of the main sound source is within the preset frequency spectrum error threshold range, taking the sound as a main signal in the second sound signal, and taking the sound with the similarity between the frequency spectrum analysis result of the sound in the second sound signal and the frequency amplitude of the main sound source out of the preset frequency spectrum error threshold range as an auxiliary signal, namely the noise. For example, the spectral error threshold may be that the difference between the peak frequencies is less than or equal to 2Hz, and in the result of the spectral analysis of the main sound source, the peak frequency is 50Hz, and in the second sound signal, there are sound with a peak frequency of 51Hz and sound with a peak frequency of 10Hz, then the sound with a peak frequency of 51Hz is the main signal, and the sound with a peak frequency of 10Hz is noise. The beneficial effect who sets up like this lies in can distinguishing useful information and noise in the recording process, improves the accuracy of judging and the definition of recording the main signal.
S130, according to sound parameters of a main signal in the second sound signal in each audio acquisition device, determining a main audio acquisition device and an auxiliary audio acquisition device in at least two audio acquisition devices, recording the sound of the main signal by using the main audio acquisition device, and performing noise reduction processing on the auxiliary signal by using the auxiliary audio acquisition device.
After the main signal in the second sound signal is determined, the main audio acquisition device and the auxiliary audio acquisition device in the at least two audio acquisition devices are determined according to the sound parameters of the main signal in the second sound signal in each audio acquisition device and a preset rule. The sound parameter can be an amplitude parameter, the preset rule can be the amplitude, the main audio acquisition equipment is responsible for recording and transmitting sound, and the auxiliary audio acquisition equipment is responsible for noise reduction.
In this embodiment, optionally, determining a main audio collecting device and an auxiliary audio collecting device of the at least two audio collecting devices according to a sound parameter of a main signal in the second sound signal in each audio collecting device, where the main audio collecting device is used to record sound, and the auxiliary audio collecting device is used to perform noise reduction processing, including: according to the amplitude parameter of the main signal in the second sound signal in each audio acquisition device, determining the audio acquisition device which acquires the amplitude parameter of the main signal in the second sound signal and accords with a preset rule as a main audio acquisition device, and determining the audio acquisition device which does not accord with the preset rule as an auxiliary audio acquisition device; the method comprises the steps of recording sound of a main signal by adopting a main audio acquisition device, carrying out noise reduction processing on an auxiliary signal by adopting an auxiliary audio acquisition device, correcting the main signal through the auxiliary signal to obtain a corrected signal, and taking the corrected signal as a recording signal.
Specifically, the preset rule may be that the amplitude parameter of the main signal collected by each audio acquisition device is compared, the audio acquisition device with the larger amplitude parameter is defined as the main audio acquisition device, and the audio acquisition device with the smaller amplitude parameter is defined as the auxiliary audio acquisition device. And recording sound by adopting a main audio acquisition device, and performing noise reduction treatment by adopting an auxiliary audio acquisition device. The primary audio collecting device may be one, and the secondary audio collecting device may be plural. For example, the upper end and the lower end of the device are respectively distributed with an audio acquisition device, when a user is close to the upper end audio acquisition device during recording, the amplitude parameter of the main signal received by the upper end audio acquisition device is larger, the main signal received by the lower end audio acquisition device is not clear relative to the upper end audio acquisition device, and the existing noise is more. Therefore, the upper end audio acquisition equipment is main audio acquisition equipment for recording and transmitting voice, and the lower end audio acquisition equipment is auxiliary audio acquisition equipment for reducing noise. The main signal may be corrected by an auxiliary signal in the auxiliary audio collecting device, the sound in the main audio collecting device is removed from the auxiliary signal to obtain a corrected signal, and the corrected signal is recorded as sound information closest to the main signal. The beneficial effects that set up like this lie in can confirming main audio acquisition equipment and vice audio acquisition equipment according to the actual conditions when the user recorded, avoid fixed main vice audio acquisition equipment to cause the unclear problem of recording, improved the recording quality.
Optionally, according to the auxiliary signal collected by the auxiliary audio acquisition device, performing inverse processing on the sound phase of the auxiliary signal to obtain an inverse signal of the auxiliary signal; and offsetting the second sound signal in the main audio acquisition equipment according to the inverted signal of the auxiliary audio acquisition equipment to obtain a correction signal.
Specifically, a signal processing circuit can be utilized, environmental noise is sampled by a secondary audio acquisition device, sound phase inversion processing is carried out, an inverted signal is generated in the earphone to eliminate noise, and the obtained correction signal is a recording signal close to the main signal, so that the noise is removed during recording, and the recording definition is improved. The method for correcting the second sound signal can also be that the sound phase of each auxiliary signal is sequentially subtracted from the second sound signal, and the obtained correction signal is the main signal to be recorded; alternatively, the corrected signal obtained by adding the phases of the respective subsidiary signals to determine the average phase of the subsidiary signals and subtracting the average phase of the subsidiary signals from the second sound signal may be recorded as the main signal.
And the computer equipment receives the main signal sent by the main and auxiliary audio acquisition equipment according to the judgment of the main and auxiliary audio acquisition equipment, and performs noise reduction and recording storage of the double audio acquisition equipment. After the recording is finished each time, the computer equipment automatically clears the recorded main sound source, and a new main sound source is saved again when the next recording is finished, so that the flexibility of judging the main signal is improved. It should be noted that the spectral analysis method and the noise reduction method are not particularly limited in this embodiment.
According to the technical scheme, the main sound source is determined, the frequency spectrum of the main sound source is analyzed, the sound to be recorded really during recording is determined, the functions of different audio acquisition devices are determined through sound parameters in different audio acquisition devices, the main audio acquisition devices record the sound, and the auxiliary audio acquisition devices remove noise. The problem of among the prior art fixed major-minor audio acquisition equipment cause the recording unclear is solved, the accuracy and the recording quality of judging the main signal have been improved.
Example two
Fig. 2 is a schematic flow chart of a recording method according to a second embodiment of the present invention, which is further optimized based on the above-mentioned embodiments. As shown in fig. 2, the method specifically includes the following steps:
s210, acquiring the collected first sound signal, and determining the first sound signal as a main sound source according to a preset standard.
The voice awakening instruction is preset, if the content of the first sound signal acquired by the computer equipment is matched with the content of the voice awakening instruction, the recording function is started, and the first sound signal is a main sound source. The main sound source provides a judgment standard for the sound to be recorded in the subsequent recording process.
S220, performing spectrum comparison on a second sound signal acquired by any one of at least two audio acquisition devices and the main sound source, and determining a main signal and an auxiliary signal in the second sound signal.
The second sound signal may have a plurality of sounds, the sound consistent with the main sound source frequency spectrum is a main signal, and the rest of the sounds are auxiliary signals, that is, the noise information of the interference.
And S230, determining a main audio acquisition device and an auxiliary audio acquisition device of the at least two audio acquisition devices according to the sound parameters of the main signal in each audio acquisition device in the second sound signal, recording the sound of the main signal by using the main audio acquisition device, and performing noise reduction processing on the auxiliary signal by using the auxiliary audio acquisition device.
When the recording is started, according to the difference of sound parameters in different audio acquisition devices, a main audio acquisition device suitable for recording and a secondary audio acquisition device suitable for denoising are determined. For example, a first audio acquisition device and a second audio acquisition device are arranged on the device, the judgment rule of the main audio acquisition device and the auxiliary audio acquisition device is preset to be the amplitude parameter, the main audio acquisition device with large amplitude is used, and the auxiliary audio acquisition device with small amplitude is used. And if the amplitude of the sound collected by the first audio collecting device is larger than that of the sound collected by the second audio collecting device, determining that the first audio collecting device is a main audio collecting device and the second audio collecting device is an auxiliary audio collecting device.
S240, if the amplitude parameter of the main signal in the sound information collected by the auxiliary audio collecting device accords with a preset rule and the amplitude parameter of the main signal in the sound information collected by the main audio collecting device does not accord with the preset rule in the sound recording process, determining the main audio collecting device from the original auxiliary audio collecting device and switching the original main audio collecting device into the auxiliary audio collecting device.
The time interval for calculating the sound parameters is preset, and the sound parameters in different audio acquisition devices are determined according to the preset time interval in the sound recording process. For example, the time interval for calculating the sound parameter is preset to be 1 second, and the sound parameter of the main signal in each audio capture device is calculated every 1 second.
If the sound parameters of the main signals in the sound information collected by the original auxiliary audio collecting equipment are calculated to accord with preset rules, and the sound parameters of the main signals in the sound information collected by the main audio collecting equipment do not accord with the preset rules, the main audio collecting equipment and the auxiliary audio collecting equipment are switched, the main audio collecting equipment is determined from the original auxiliary audio collecting equipment, and the original main audio collecting equipment is switched into the auxiliary audio collecting equipment. For example, a first audio acquisition device and a second audio acquisition device are arranged on the device, when recording starts, a user is close to the first audio acquisition device, the amplitude of a main signal in the first audio acquisition device is larger than that of a main signal in the second audio acquisition device, and then the first audio acquisition device is determined to be the main audio acquisition device, and the second audio acquisition device is determined to be the auxiliary audio acquisition device. In the recording process, a user moves, the distance from the second audio acquisition equipment is close, when the computer equipment calculates the sound parameters of the main signals in different audio acquisition equipment at regular time, the sound parameters of the main signals in the second audio acquisition equipment are found to be larger than the sound parameters of the main signals in the first audio acquisition equipment, the main audio acquisition equipment and the auxiliary audio acquisition equipment are switched, the first audio acquisition equipment is switched into the auxiliary audio acquisition equipment from the main audio acquisition equipment, and the second audio acquisition equipment is switched into the main audio acquisition equipment from the auxiliary audio acquisition equipment. The beneficial effect who sets up like this lies in can switching major-minor audio acquisition equipment in real time, guarantees that the main signal in the major-minor audio acquisition equipment is clear than the main signal in the vice audio acquisition equipment all the time, has improved the recording quality, realizes major-minor audio acquisition equipment's dynamic switch.
In the above embodiments, there is a preferred embodiment to implement dynamic switching of dual MICs (microphones), and fig. 3 is a flowchart of a recording method in the second embodiment of the present invention. As shown in fig. 3, the method specifically includes the following steps:
1a, 2 a: the input unit transmits a voice wake-up signal (e.g., "turn on 'recorder'") to the MIC1 unit and the MIC2 unit.
1b, 2 b: and the MIC1 unit and the MIC2 unit transmit the collected voice wake-up signal to the voice wake-up unit.
3a, 3 b: the voice awakening unit transmits the identified voice awakening signal and an instruction signal for activating the recording and video recording function to the loudspeaker unit, and the loudspeaker unit feeds the result back to the input unit (if the activation is successful, the loudspeaker feeds back the activation to be successful; and if the activation is failed, the loudspeaker feeds back the activation to be failed).
If the awakening fails, returning to 1a and 2a to perform the awakening process again; if the awakening is successful, the following flow is entered.
1c, 2 c: the voice wake-up unit synchronously transmits the voice wake-up signal to the spectrum analysis unit, and the spectrum analysis unit performs spectrum analysis on the sound (main sound source) of the voice wake-up signal and memorizes the spectrum of the main sound source.
4a, 5 a: the input unit transmits the recording signals to the MIC1 unit and the MIC2 unit.
4b, 5 b: the MIC1 unit and the MIC2 unit transmit the collected signals to the spectrum analysis unit, and the spectrum analysis unit compares the frequency spectrums of the two signals with the frequency spectrum of the main sound source signal.
4c, 5 c: the spectrum analysis unit transmits partial signals (marked as S1 and S2) of the two signals which are similar to the memory spectrum comparison of the main sound source to the signal amplitude comparison unit, and the rest interference sound sources are eliminated.
6 a: the signal amplitude comparison unit compares the amplitudes of the S1 and S2 signals transmitted by the spectrum analysis unit, the signal amplitude comparison unit takes the larger amplitude as the transmission MIC (microphone), namely the main MIC, and the signal amplitude comparison unit takes the smaller amplitude as the noise reduction MIC, namely the auxiliary MIC, and transmits the result information to the audio processing unit for memorizing.
7a, 8 a: and the MIC1 unit and the MIC2 unit transmit the recording signals to the audio processing unit, and the audio processing unit performs double-MIC noise reduction on MIC1 signals and MIC2 signals according to the main and auxiliary MIC judgment information transmitted in the 6 a.
9 a: and storing the signal subjected to noise reduction in a recording storage unit.
In the preferred embodiment, the sound information sent by the input unit is synchronously received by the two MICs, the part of the sound information matched with the main sound source frequency spectrum is determined, the main MIC and the auxiliary MIC are determined according to the sound amplitude received by each MIC in the recording process, and dual MIC noise reduction is performed, so that real-time determination of the main MIC and the auxiliary MIC and dynamic switching of the main MIC and the auxiliary MIC are realized.
Fig. 4 is a block diagram of a recording apparatus according to a second embodiment of the present invention. As shown in fig. 4, the apparatus specifically includes: the device comprises an input unit, an MIC1 unit, an MIC2 unit, a voice awakening unit, a spectrum analysis unit, a signal amplitude comparison unit, an audio processing unit, a recording storage unit and a loudspeaker unit. The arrows connecting the lines of each cell indicate the uplink and downlink relationship of data transmission between the cells.
The input unit, the MIC1 unit, the MIC2 unit and the voice wake-up unit can form an uplink wake-up unit for waking up the recording function of the computer equipment. The input unit is connected with the MIC1 unit and the MIC2 unit, is used for sending out sound signals and can be a person or other equipment capable of sending out sound. And the MIC1 unit and the MIC2 unit are connected with the voice wake-up unit, the spectrum analysis unit and the audio processing unit and are used for finishing the acquisition of sound signals. The voice awakening unit is connected with the MIC1 unit, the MIC2 unit, the spectrum analysis unit and the loudspeaker unit and is used for completing record function awakening and feeding back awakening results to the loudspeaker unit.
The spectrum analysis unit, the signal amplitude comparison unit and the audio processing unit can form an uplink noise reduction unit for determining a recording signal to be recorded and distinguishing a main MIC and an auxiliary MIC for recording and noise reduction. The frequency spectrum analysis unit is connected with the MIC1 unit, the MIC2 unit, the voice awakening unit, the signal amplitude comparison unit and the audio processing unit and is used for carrying out frequency analysis on the main sound source, carrying out frequency spectrum memory on the result, comparing the frequency spectrum of the subsequent recorded sound source with the frequency spectrum of the main sound source and transmitting part of signals which are similar to the frequency spectrum of the main sound source in the subsequent sound source to the signal amplitude comparison unit. The signal amplitude comparison unit is connected with the spectrum analysis unit and the audio processing unit to complete comparison of subsequent signal amplitudes, so that which MIC is used as a transmission MIC and which MIC is used as a noise reduction MIC. The audio processing unit is connected with the MIC1 unit, the MIC2 unit, the signal amplitude comparison unit, the spectrum analysis unit and the recording storage unit and is used for receiving recording signals in the MIC1 unit and the MIC2 unit according to the judgment result of the main MIC and the auxiliary MIC to finish noise reduction of double MICs.
The voice awakening unit, the loudspeaker unit and the recording storage unit can form a downlink feedback unit for voice playing and storage. The voice awakening unit is connected with the MIC1 unit, the MIC2 unit, the spectrum analysis unit and the loudspeaker unit and is used for receiving sound information transmitted by the microphone, determining whether the recording function is started or not and transmitting the awakening result to the loudspeaker unit. The loudspeaker unit is connected with the voice awakening unit and used for receiving the awakening feedback signal sent by the voice awakening unit and playing an awakening result. The recording storage unit is connected with the audio processing unit and is used for storing the main signal.
According to the embodiment of the invention, the calculation time interval of the sound parameters is preset, so that the computer equipment can calculate the sound parameters of the main signals in different audio acquisition equipment at regular time, and when the main signals in the auxiliary audio acquisition equipment are clearer than the main audio acquisition equipment, the main and auxiliary audio acquisition equipment are switched in time, thereby solving the problem of unclear recording caused by fixing the main and auxiliary audio acquisition equipment, realizing the dynamic switching of the main and auxiliary audio acquisition equipment and improving the recording quality.
EXAMPLE III
Fig. 5 is a block diagram of a recording apparatus according to a third embodiment of the present invention, which is capable of executing the recording method according to any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. As shown in fig. 5, the apparatus specifically includes:
the dominant sound source determining module 501 is configured to acquire the collected first sound signal, and determine the first sound signal as a dominant sound source according to a preset standard.
The main signal determining module 502 is configured to perform spectrum comparison between a second sound signal acquired by any one of the at least two audio acquisition devices and the main sound source, and determine a main signal and an auxiliary signal in the second sound signal.
The audio collecting device determining module 503 is configured to determine a main audio collecting device and an auxiliary audio collecting device of the at least two audio collecting devices according to a sound parameter of a main signal in the second sound signal in each audio collecting device, record a sound of the main signal by using the main audio collecting device, and perform noise reduction processing on the auxiliary signal by using the auxiliary audio collecting device.
Optionally, the dominant sound source determining module 501 is specifically configured to:
acquiring preset voice awakening instruction content;
determining whether a first sound signal acquired by any one of at least two audio acquisition devices is matched with the voice wake-up instruction content;
and if so, determining the first sound signal as a main sound source.
Optionally, the main signal determining module 502 is specifically configured to:
carrying out spectrum analysis on the main sound source, and recording the frequency amplitude;
and carrying out spectrum analysis on a second sound signal acquired by any one of at least two audio acquisition devices, comparing an analysis result of the second sound signal with a frequency amplitude, determining that sound information with the similarity to the frequency amplitude meeting a set threshold is a main signal in the second sound signal, and determining that sound information with the similarity to the frequency amplitude not meeting the set threshold is an auxiliary signal in the second sound signal.
Optionally, the sound parameter comprises an amplitude parameter;
correspondingly, the audio acquisition device determining module 503 is specifically configured to:
according to the amplitude parameter of the main signal in the second sound signal in each audio acquisition device, determining the audio acquisition device which acquires the amplitude parameter of the main signal in the second sound signal and accords with a preset rule as a main audio acquisition device, and determining the audio acquisition device which does not accord with the preset rule as an auxiliary audio acquisition device;
and adopting a main audio acquisition device to record sound, adopting an auxiliary audio acquisition device to perform noise reduction processing, correcting the main signal through an auxiliary signal to obtain a corrected signal, and taking the corrected signal as a recording signal.
Optionally, the apparatus further comprises:
and the audio acquisition equipment switching module is used for determining the main audio acquisition equipment from the original auxiliary audio acquisition equipment and switching the original main audio acquisition equipment into the auxiliary audio acquisition equipment if the amplitude parameter of the main signal in the sound information acquired by the auxiliary audio acquisition equipment conforms to a preset rule and the amplitude parameter of the main signal in the sound information acquired by the main audio acquisition equipment does not conform to the preset rule in the sound recording process.
Optionally, the audio acquisition device determining module 503 is further specifically configured to:
according to the auxiliary signal collected by the auxiliary audio acquisition equipment, carrying out phase reversal processing on the sound phase of the auxiliary signal to obtain a phase reversal signal of the auxiliary signal;
and offsetting the second sound signal in the main audio acquisition equipment according to the inverted signal of the auxiliary audio acquisition equipment to obtain a correction signal.
The embodiment of the invention determines the sound to be really recorded from the second sound signal by determining the main sound source, analyzing and storing the frequency spectrum of the main sound source, determines the functions of different audio acquisition equipment through the difference of sound parameters in the audio acquisition equipment, records the sound by the main audio acquisition equipment and removes the noise by the auxiliary audio acquisition equipment. The problem of unclear recording caused by fixing the main and auxiliary audio acquisition equipment in the equipment is solved, and the accuracy of judging the main signal and the recording quality are improved.
Example four
Fig. 6 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention. FIG. 6 illustrates a block diagram of an exemplary computer device 600 suitable for use in implementing embodiments of the invention. The computer device 600 shown in fig. 6 is only an example and should not bring any limitations to the function and scope of use of the embodiments of the present invention.
As shown in fig. 6, computer device 600 is in the form of a general purpose computing device. The components of computer device 600 may include, but are not limited to: one or more processors or processing units 601, a system memory 602, and a bus 603 that couples various system components including the system memory 602 and the processing unit 601.
The system memory 602 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)604 and/or cache memory 605. The computer device 600 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 606 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 6, commonly referred to as a "hard drive"). Although not shown in FIG. 6, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 603 by one or more data media interfaces. Memory 602 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 608 having a set (at least one) of program modules 607 may be stored, for example, in memory 602, such program modules 607 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. The program modules 607 generally perform the functions and/or methods of the described embodiments of the invention.
The computer device 600 may also communicate with one or more external devices 609 (e.g., keyboard, pointing device, display 610, etc.), with one or more devices that enable a user to interact with the computer device 600, and/or with any devices (e.g., network card, modem, etc.) that enable the computer device 600 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 611. Moreover, the computer device 600 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet) via the network adapter 612. As shown, a network adapter 612 communicates with the other modules of the computer device 600 via the bus 603. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the computer device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 601 executes various functional applications and data processing by running the program stored in the system memory 602, for example, implementing the recording method provided by the embodiment of the present invention, including:
acquiring a collected first sound signal, and determining the first sound signal as a main sound source according to a preset standard;
carrying out spectrum comparison on a second sound signal acquired by any one of at least two audio acquisition devices and a main sound source, and determining a main signal in the second sound signal;
and determining a main audio acquisition device and an auxiliary audio acquisition device of the at least two audio acquisition devices according to the sound parameters of the main signal in each audio acquisition device in the second sound signal, recording the sound of the main signal by adopting the main audio acquisition device, and performing noise reduction processing on the auxiliary signal by adopting the auxiliary audio acquisition device.
In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring preset voice awakening instruction content; determining whether a first sound signal acquired by any one of at least two audio acquisition devices is matched with the voice wake-up instruction content; and if so, determining the first sound signal as a main sound source.
In one embodiment, the processor, when executing the computer program, further performs the steps of: carrying out spectrum analysis on the main sound source, and recording the frequency amplitude; and carrying out spectrum analysis on a second sound signal acquired by any one of at least two audio acquisition devices, comparing an analysis result of the second sound signal with a frequency amplitude, determining that sound information with the similarity to the frequency amplitude meeting a set threshold is a main signal in the second sound signal, and determining that sound information with the similarity to the frequency amplitude not meeting the set threshold is an auxiliary signal in the second sound signal.
In one embodiment, the processor, when executing the computer program, further performs the steps of: according to the amplitude parameter of the main signal in the second sound signal in each audio acquisition device, determining the audio acquisition device which acquires the amplitude parameter of the main signal in the second sound signal and accords with a preset rule as a main audio acquisition device, and determining the audio acquisition device which does not accord with the preset rule as an auxiliary audio acquisition device; the method comprises the steps of recording sound of a main signal by adopting a main audio acquisition device, carrying out noise reduction processing on an auxiliary signal by adopting an auxiliary audio acquisition device, correcting the main signal through the auxiliary signal to obtain a corrected signal, and taking the corrected signal as a recording signal.
In one embodiment, the processor, when executing the computer program, further performs the steps of: if the amplitude parameter of the main signal in the sound information collected by the auxiliary audio collecting device accords with a preset rule and the amplitude parameter of the main signal in the sound information collected by the main audio collecting device does not accord with the preset rule in the sound recording process, determining the main audio collecting device from the original auxiliary audio collecting device and switching the original main audio collecting device into the auxiliary audio collecting device.
In one embodiment, the processor, when executing the computer program, further performs the steps of: according to the auxiliary signal collected by the auxiliary audio acquisition equipment, carrying out phase reversal processing on the sound phase of the auxiliary signal to obtain a phase reversal signal of the auxiliary signal; and offsetting the second sound signal in the main audio acquisition equipment according to the inverted signal of the auxiliary audio acquisition equipment to obtain a correction signal.
According to the technical scheme, the main sound source is determined, the frequency spectrum of the main sound source is analyzed, the sound to be recorded really during recording is determined, the functions of different audio acquisition devices are determined through sound parameters in different audio acquisition devices, the main audio acquisition devices record the sound, and the auxiliary audio acquisition devices remove noise. The problem of among the prior art fixed major-minor audio acquisition equipment cause the recording unclear is solved, the accuracy and the recording quality of judging the main signal have been improved.
EXAMPLE five
The fifth embodiment of the present invention further provides a storage medium containing computer-executable instructions, where a computer program is stored on the storage medium, and when the computer program is executed by a processor, the recording method provided in the fifth embodiment of the present invention is implemented, where the recording method includes: acquiring a collected first sound signal, and determining the first sound signal as a main sound source according to a preset standard; carrying out spectrum comparison on a second sound signal acquired by any one of at least two audio acquisition devices and a main sound source, and determining a main signal and an auxiliary signal in the second sound signal; and determining a main audio acquisition device and an auxiliary audio acquisition device of the at least two audio acquisition devices according to the sound parameters of the main signal in each audio acquisition device in the second sound signal, recording the sound of the main signal by adopting the main audio acquisition device, and performing noise reduction processing on the auxiliary signal by adopting the auxiliary audio acquisition device.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring a collected first sound signal, determining the first sound signal as a main sound source according to a preset standard, and comprising the following steps of: acquiring preset voice awakening instruction content; determining whether a first sound signal acquired by any one of at least two audio acquisition devices is matched with the voice wake-up instruction content; and if so, determining the first sound signal as a main sound source.
In one embodiment, the computer program when executed by the processor further performs the steps of: carrying out spectrum analysis on the main sound source, and recording the frequency amplitude; and carrying out spectrum analysis on a second sound signal acquired by any one of at least two audio acquisition devices, comparing an analysis result of the second sound signal with a frequency amplitude, determining that sound information with the similarity to the frequency amplitude meeting a set threshold is a main signal in the second sound signal, and determining that sound information with the similarity to the frequency amplitude not meeting the set threshold is an auxiliary signal in the second sound signal.
In one embodiment, the computer program when executed by the processor further performs the steps of: according to the amplitude parameter of the main signal in the second sound signal in each audio acquisition device, determining the audio acquisition device which acquires the amplitude parameter of the main signal in the second sound signal and accords with a preset rule as a main audio acquisition device, and determining the audio acquisition device which does not accord with the preset rule as an auxiliary audio acquisition device; the method comprises the steps of recording sound of a main signal by adopting a main audio acquisition device, carrying out noise reduction processing on an auxiliary signal by adopting an auxiliary audio acquisition device, correcting the main signal through the auxiliary signal to obtain a corrected signal, and taking the corrected signal as a recording signal. After the sound that adopts main audio acquisition equipment to carry out the main signal is recorded and the noise reduction who adopts vice audio acquisition equipment to carry out the auxiliary signal is handled, still include:
in one embodiment, the computer program when executed by the processor further performs the steps of: if the amplitude parameter of the main signal in the sound information collected by the auxiliary audio collecting device accords with a preset rule and the amplitude parameter of the main signal in the sound information collected by the main audio collecting device does not accord with the preset rule in the sound recording process, determining the main audio collecting device from the original auxiliary audio collecting device and switching the original main audio collecting device into the auxiliary audio collecting device.
In one embodiment, the computer program when executed by the processor further performs the steps of: according to the auxiliary signal collected by the auxiliary audio acquisition equipment, carrying out phase reversal processing on the sound phase of the auxiliary signal to obtain a phase reversal signal of the auxiliary signal; and offsetting the second sound signal in the main audio acquisition equipment according to the inverted signal of the auxiliary audio acquisition equipment to obtain a correction signal.
According to the technical scheme, the main sound source is determined, the frequency spectrum of the main sound source is analyzed, the sound to be recorded really during recording is determined, the functions of different audio acquisition devices are determined through sound parameters in different audio acquisition devices, the main audio acquisition devices record the sound, and the auxiliary audio acquisition devices remove noise. The problem of among the prior art fixed major-minor audio acquisition equipment cause the recording unclear is solved, the accuracy and the recording quality of judging the main signal have been improved.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or computer device. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (8)
1. A method of recording sound, the method being performed by a recording device comprising at least two audio capture devices, the method comprising:
acquiring a collected first sound signal, and determining the first sound signal as a main sound source according to a preset standard;
carrying out spectrum comparison on a second sound signal acquired by any one of at least two audio acquisition devices and the main sound source, and determining a main signal and an auxiliary signal in the second sound signal;
determining a main audio acquisition device and an auxiliary audio acquisition device of at least two audio acquisition devices according to the sound parameters of a main signal in a second sound signal in each audio acquisition device, recording the sound of the main signal by using the main audio acquisition device, and performing noise reduction processing on the auxiliary signal by using the auxiliary audio acquisition device;
the method includes the steps of acquiring a collected first sound signal, determining the first sound signal as a main sound source according to a preset standard, and including:
acquiring preset voice awakening instruction content;
determining whether a first sound signal acquired by any one of at least two audio acquisition devices is matched with the voice wake-up instruction content;
and if so, determining the first sound signal as a main sound source.
2. The method of claim 1, wherein the spectrally comparing the second sound signal captured by any one of the at least two audio capture devices with the primary sound source to determine the primary signal and the secondary signal in the second sound signal comprises:
carrying out spectrum analysis on the main sound source, and recording the frequency amplitude;
and carrying out spectrum analysis on a second sound signal acquired by any one of at least two audio acquisition devices, comparing an analysis result of the second sound signal with the frequency amplitude, determining that the sound information of which the similarity with the frequency amplitude accords with a set threshold value is a main signal in the second sound signal, and determining that the sound information of which the similarity with the frequency amplitude does not accord with the set threshold value is an auxiliary signal in the second sound signal.
3. The method of claim 1, wherein the sound parameters comprise amplitude parameters; correspondingly, according to the sound parameter of the main signal in each audio acquisition device in the second sound signal, main audio acquisition device and auxiliary audio acquisition device in at least two audio acquisition devices are determined, the main audio acquisition device is adopted to record the sound of the main signal, and the auxiliary audio acquisition device is adopted to perform noise reduction processing on the auxiliary signal, including:
according to the amplitude parameter of the main signal in the second sound signal in each audio acquisition device, determining the audio acquisition device which acquires the amplitude parameter of the main signal in the second sound signal and accords with a preset rule as a main audio acquisition device, and determining the audio acquisition device which does not accord with the preset rule as an auxiliary audio acquisition device;
the main audio acquisition equipment is adopted to record the sound of the main signal, the auxiliary audio acquisition equipment is adopted to perform noise reduction processing on the auxiliary signal, the main signal is corrected through the auxiliary signal to obtain a corrected signal, and the corrected signal is used as a recording signal.
4. The method of claim 3, wherein after performing sound recording using the primary audio capture device and performing noise reduction using a secondary audio capture device, the method further comprises:
if the amplitude parameter of the main signal in the sound information collected by the auxiliary audio collecting device accords with a preset rule and the amplitude parameter of the main signal in the sound information collected by the main audio collecting device does not accord with the preset rule in the sound recording process, determining the main audio collecting device from the original auxiliary audio collecting device and switching the original main audio collecting device into the auxiliary audio collecting device.
5. The method of claim 3, wherein the modifying the main signal by the auxiliary signal to obtain a modified signal, and using the modified signal as the recording signal comprises:
according to the auxiliary signal collected by the auxiliary audio acquisition equipment, carrying out phase reversal processing on the sound phase of the auxiliary signal to obtain a phase reversal signal of the auxiliary signal;
and offsetting a second sound signal in the main audio acquisition equipment according to the inverted signal of the auxiliary audio acquisition equipment to obtain the correction signal.
6. An apparatus for recording, the apparatus being configured to include at least two audio capture devices, the apparatus comprising:
the main sound source determining module is used for acquiring the acquired first sound signal and determining the first sound signal as a main sound source according to a preset standard;
the main signal determining module is used for comparing a second sound signal acquired by any one of the at least two audio acquisition devices with the main sound source in a frequency spectrum manner, and determining a main signal and an auxiliary signal in the second sound signal;
the audio acquisition equipment determining module is used for determining main audio acquisition equipment and auxiliary audio acquisition equipment in at least two audio acquisition equipment according to sound parameters of a main signal in a second sound signal in each audio acquisition equipment, recording the sound of the main signal by adopting the main audio acquisition equipment, and performing noise reduction processing on the auxiliary signal by adopting the auxiliary audio acquisition equipment;
the dominant sound source determination module is specifically configured to:
acquiring preset voice awakening instruction content;
determining whether a first sound signal acquired by any one of at least two audio acquisition devices is matched with the voice wake-up instruction content;
and if so, determining the first sound signal as a main sound source.
7. Computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the recording method as claimed in any one of claims 1 to 5 when executing the program.
8. A storage medium containing computer-executable instructions for performing the sound recording method of any one of claims 1-5 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911128555.3A CN110827845B (en) | 2019-11-18 | 2019-11-18 | Recording method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911128555.3A CN110827845B (en) | 2019-11-18 | 2019-11-18 | Recording method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110827845A CN110827845A (en) | 2020-02-21 |
| CN110827845B true CN110827845B (en) | 2022-04-22 |
Family
ID=69556366
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911128555.3A Active CN110827845B (en) | 2019-11-18 | 2019-11-18 | Recording method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110827845B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114121026A (en) * | 2020-08-25 | 2022-03-01 | 华为技术有限公司 | Recording method and device |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2303471A (en) * | 1995-07-19 | 1997-02-19 | Olympus Optical Co | Voice activated recording apparatus |
| CN103428339A (en) * | 2012-05-17 | 2013-12-04 | 西安闻泰电子科技有限公司 | Method for controlling mobile phone to be operated through voice input |
| CN104538040A (en) * | 2014-11-28 | 2015-04-22 | 广东欧珀移动通信有限公司 | Method and device for dynamically selecting communication voice signals |
| CN104702787A (en) * | 2015-03-12 | 2015-06-10 | 深圳市欧珀通信软件有限公司 | Sound acquisition method applied to MT (Mobile Terminal) and MT |
| CN104754430A (en) * | 2013-12-30 | 2015-07-01 | 重庆重邮信科通信技术有限公司 | Noise reduction device and method for terminal microphone |
| CN105469819A (en) * | 2014-08-20 | 2016-04-06 | 中兴通讯股份有限公司 | Microphone selection method and apparatus thereof |
| CN107742523A (en) * | 2017-11-16 | 2018-02-27 | 广东欧珀移动通信有限公司 | Audio signal processing method, device and mobile terminal |
| CN108538320A (en) * | 2018-03-30 | 2018-09-14 | 广东欧珀移动通信有限公司 | Recording control method and device, readable storage medium storing program for executing, terminal |
| WO2018219459A1 (en) * | 2017-06-01 | 2018-12-06 | Telefonaktiebolaget Lm Ericsson (Publ) | A method and an apparatus for enhancing an audio signal captured in an indoor environment |
| CN109151211A (en) * | 2018-09-30 | 2019-01-04 | Oppo广东移动通信有限公司 | Method of speech processing, device and electronic equipment |
| CN109246299A (en) * | 2018-08-31 | 2019-01-18 | 深圳市万普拉斯科技有限公司 | Rapid Speech recording method, device, mobile terminal and computer storage medium |
-
2019
- 2019-11-18 CN CN201911128555.3A patent/CN110827845B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2303471A (en) * | 1995-07-19 | 1997-02-19 | Olympus Optical Co | Voice activated recording apparatus |
| CN103428339A (en) * | 2012-05-17 | 2013-12-04 | 西安闻泰电子科技有限公司 | Method for controlling mobile phone to be operated through voice input |
| CN104754430A (en) * | 2013-12-30 | 2015-07-01 | 重庆重邮信科通信技术有限公司 | Noise reduction device and method for terminal microphone |
| CN105469819A (en) * | 2014-08-20 | 2016-04-06 | 中兴通讯股份有限公司 | Microphone selection method and apparatus thereof |
| CN104538040A (en) * | 2014-11-28 | 2015-04-22 | 广东欧珀移动通信有限公司 | Method and device for dynamically selecting communication voice signals |
| CN104702787A (en) * | 2015-03-12 | 2015-06-10 | 深圳市欧珀通信软件有限公司 | Sound acquisition method applied to MT (Mobile Terminal) and MT |
| WO2018219459A1 (en) * | 2017-06-01 | 2018-12-06 | Telefonaktiebolaget Lm Ericsson (Publ) | A method and an apparatus for enhancing an audio signal captured in an indoor environment |
| CN107742523A (en) * | 2017-11-16 | 2018-02-27 | 广东欧珀移动通信有限公司 | Audio signal processing method, device and mobile terminal |
| CN108538320A (en) * | 2018-03-30 | 2018-09-14 | 广东欧珀移动通信有限公司 | Recording control method and device, readable storage medium storing program for executing, terminal |
| CN109246299A (en) * | 2018-08-31 | 2019-01-18 | 深圳市万普拉斯科技有限公司 | Rapid Speech recording method, device, mobile terminal and computer storage medium |
| CN109151211A (en) * | 2018-09-30 | 2019-01-04 | Oppo广东移动通信有限公司 | Method of speech processing, device and electronic equipment |
Non-Patent Citations (2)
| Title |
|---|
| Design, Implementation and Testing of Mobile Phone Application for Pleasant Wake up;Ondrej Krejcar et al.;《 2011 Sixth IEEE International Symposium on Electronic Design, Test and Application》;IEEE;20110310;全文 * |
| 传声器阵列语音采集处理系统设计;夭淼等;《电声技术》;中国知网;20100717;第34卷(第7期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110827845A (en) | 2020-02-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8032364B1 (en) | Distortion measurement for noise suppression system | |
| JP4842583B2 (en) | Method and apparatus for multisensory speech enhancement | |
| CN108076226B (en) | Method for adjusting call quality, mobile terminal and storage medium | |
| CN107464565B (en) | Far-field voice awakening method and device | |
| WO2017031846A1 (en) | Noise elimination and voice recognition method, apparatus and device, and non-volatile computer storage medium | |
| CN108630219B (en) | Processing system, method and device for echo suppression audio signal feature tracking | |
| CN109361995B (en) | Volume adjusting method and device for electrical equipment, electrical equipment and medium | |
| JP4975025B2 (en) | Multisensory speech enhancement using clean speech prior distribution | |
| US10629226B1 (en) | Acoustic signal processing with voice activity detector having processor in an idle state | |
| EP4068284A1 (en) | Live broadcast audio processing method and apparatus, and electronic device and storage medium | |
| US20180190310A1 (en) | De-reverberation control method and apparatus for device equipped with microphone | |
| CN110675887B (en) | Multi-microphone switching method and system for conference system | |
| US9773510B1 (en) | Correcting clock drift via embedded sine waves | |
| US11398220B2 (en) | Speech processing device, teleconferencing device, speech processing system, and speech processing method | |
| CN110992967A (en) | Voice signal processing method and device, hearing aid and storage medium | |
| WO2015085946A1 (en) | Voice signal processing method, apparatus and server | |
| CN109215672B (en) | Method, device and equipment for processing sound information | |
| CN110827845B (en) | Recording method, device, equipment and storage medium | |
| CN112309414A (en) | Active noise reduction method based on audio coding and decoding, earphone and electronic equipment | |
| KR20150032562A (en) | Method and deivce for eliminating noise, and mobile terminal | |
| CN110992975B (en) | Voice signal processing method and device and terminal | |
| CN109473111B (en) | Voice enabling device and method | |
| CN111048096B (en) | Voice signal processing method and device and terminal | |
| CN114743571A (en) | Audio processing method and device, storage medium and electronic equipment | |
| CN112420064B (en) | Voice echo cancellation processing method and device for wireless loudspeaker box equipment and intelligent terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |