CN117153182A - Noise reduction control method, device, equipment and storage medium - Google Patents
Noise reduction control method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN117153182A CN117153182A CN202311015012.7A CN202311015012A CN117153182A CN 117153182 A CN117153182 A CN 117153182A CN 202311015012 A CN202311015012 A CN 202311015012A CN 117153182 A CN117153182 A CN 117153182A
- Authority
- CN
- China
- Prior art keywords
- noise
- sound
- target
- noise reduction
- sudden
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000009467 reduction Effects 0.000 title claims abstract description 104
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000001914 filtration Methods 0.000 claims abstract description 41
- 230000009471 action Effects 0.000 claims description 21
- 238000007493 shaping process Methods 0.000 claims description 18
- 239000011159 matrix material Substances 0.000 claims description 13
- 238000012544 monitoring process Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 2
- 102000008482 12E7 Antigen Human genes 0.000 description 1
- 108010020567 12E7 Antigen Proteins 0.000 description 1
- 101000893549 Homo sapiens Growth/differentiation factor 15 Proteins 0.000 description 1
- 101000692878 Homo sapiens Regulator of MON1-CCZ1 complex Proteins 0.000 description 1
- 102100026436 Regulator of MON1-CCZ1 complex Human genes 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0232—Processing in the frequency domain
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The application relates to the technical field of intelligent equipment, and discloses a noise reduction control method, device, equipment and storage medium, wherein the method comprises the following steps: when sudden noise is detected, acquiring an image of a sound source generating the sudden noise; determining the type of the sudden noise according to the image of the sound source; determining a target filtering parameter according to the type of the bursty noise; denoising the target sound according to the target filtering parameters; by the method, when the sudden noise is detected, the type of the sudden noise is determined according to the image of the sound source generating the sudden noise, then the target filtering parameters are determined according to the type, and noise reduction is carried out on the target sound according to the target filtering parameters, so that the sudden noise in the target sound can be eliminated, and the voice quality is improved.
Description
Technical Field
The present application relates to the field of intelligent devices, and in particular, to a noise reduction control method, apparatus, device, and storage medium.
Background
At present, most types of pickup devices used by intelligent devices are all-directional, so that noise in an environment is included in target sound picked up by the intelligent devices besides human voice, and common noise reduction modes can only eliminate conventional noise in the environment, and sudden noise cannot be eliminated at all, so that noise still exists in the finally picked-up sound, and therefore the sudden noise in the target sound cannot be eliminated in the modes.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present application and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The application mainly aims to provide a noise reduction control method, device, equipment and storage medium, and aims to solve the technical problem that the prior art cannot eliminate sudden noise in target sound.
In order to achieve the above object, the present application provides a noise reduction control method, including the steps of:
when sudden noise is detected, acquiring an image of a sound source generating the sudden noise;
determining the type of the sudden noise according to the image of the sound source;
determining a target filtering parameter according to the type of the bursty noise;
and denoising the target sound according to the target filtering parameters.
Optionally, the determining the type of the sudden noise according to the image of the sound source includes:
identifying, by an image processing device, an image of the sound source;
determining the action type generating the sudden noise and the relative position of the sound source and the pickup device according to the identification result;
determining a relative angle according to the relative positions of the sound source and the target user;
and determining the type of the sudden noise according to the relative angle and the action type of the sudden noise.
Optionally, the determining the type of the sudden noise according to the relative angle and the action type of the sudden noise includes:
acquiring a pickup angle of pickup equipment;
determining a pickup matrix according to the pickup angle and the relative position of the sound source and pickup equipment;
wave velocity shaping is carried out on the relative angle through signal processing equipment according to the pickup matrix and the action type of the sudden noise;
and determining the type of the sudden noise according to the wave speed shaping result.
Optionally, the determining the type of the bursty noise according to the wave speed shaping result includes:
determining a noise characteristic value of the sudden noise according to a wave speed shaping result;
acquiring a preset noise characteristic value set;
comparing the noise characteristic value of the sudden noise with each noise characteristic value in the preset noise characteristic value set in sequence;
and determining the type of the bursty noise according to the successfully matched noise characteristic value.
Optionally, after the noise reduction is performed on the target sound according to the target filtering parameter, the method further includes:
identifying the target sound after noise reduction to obtain a sound feature set;
acquiring a current application scene of the intelligent equipment when the noise characteristics of the sudden noise do not exist in the sound characteristic set;
and transmitting the target sound after noise reduction according to the current application scene.
Optionally, the transmitting the noise-reduced target sound data according to the current application scene includes:
when the current application scene is a recording scene, converting the target sound after noise reduction to obtain sound data to be stored;
and storing the sound data to be stored to a digital storage medium.
Optionally, the transmitting the noise-reduced target sound data according to the current application scene includes:
when the application scene is a call scene, transmitting the noise-reduced target sound to a terminal of an opposite user through a target channel;
when receiving a sound adjusting request sent by a terminal of an opposite user, increasing the gain of the sound pickup device;
acquiring current sound through the voice monitoring equipment with increased gain;
when the sound source is detected to continuously generate the sudden noise, the current sound is subjected to noise reduction through a target filtering parameter;
and transmitting the current noise after noise reduction to the terminal of the opposite user through the target channel.
In addition, in order to achieve the above object, the present application also proposes a noise reduction control device including:
an acquisition module for acquiring an image of a sound source generating sudden noise when the sudden noise is detected;
a determining module, configured to determine a type of the bursty noise according to an image of the sound source;
the determining module is further used for determining a target filtering parameter according to the type of the bursty noise;
and the noise reduction module is used for reducing noise of the target sound according to the target filtering parameters.
In addition, in order to achieve the above object, the present application also proposes a noise reduction control apparatus including: a memory, a processor, and a noise reduction control program stored on the memory and executable on the processor, the noise reduction control program configured to implement the noise reduction control method as described above.
In addition, in order to achieve the above object, the present application also proposes a storage medium having a noise reduction control program stored thereon, which when executed by a processor, implements the noise reduction control method as described above.
According to the noise reduction control method, when sudden noise is detected, an image of a sound source generating the sudden noise is acquired; determining the type of the sudden noise according to the image of the sound source; determining a target filtering parameter according to the type of the bursty noise; denoising the target sound according to the target filtering parameters; by the method, when the sudden noise is detected, the type of the sudden noise is determined according to the image of the sound source generating the sudden noise, then the target filtering parameters are determined according to the type, and noise reduction is carried out on the target sound according to the target filtering parameters, so that the sudden noise in the target sound can be eliminated, and the voice quality is improved.
Drawings
FIG. 1 is a schematic diagram of a configuration of a noise reduction control device of a hardware operating environment according to an embodiment of the present application;
FIG. 2 is a flowchart of a noise reduction control method according to a first embodiment of the present application;
FIG. 3 is a schematic diagram showing the relative angles of an embodiment of the noise reduction control method according to the present application;
FIG. 4 is a schematic diagram illustrating a noise reduction effect of an embodiment of a noise reduction control method according to the present application;
FIG. 5 is a flowchart of a second embodiment of the noise reduction control method of the present application;
FIG. 6 is a schematic overall flow chart of an embodiment of a noise reduction control method according to the present application;
fig. 7 is a schematic functional block diagram of a noise reduction control device according to a first embodiment of the present application.
The achievement of the objects, functional features and advantages of the present application will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a noise reduction control device in a hardware running environment according to an embodiment of the present application.
As shown in fig. 1, the noise reduction control apparatus may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a high-speed random access Memory (Random Access Memory, RAM) Memory or a stable nonvolatile Memory (NVM), such as a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 does not constitute a limitation of the noise reduction control apparatus, and may include more or fewer components than shown, or may combine certain components, or may have a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a noise reduction control program may be included in the memory 1005 as one type of storage medium.
In the noise reduction control apparatus shown in fig. 1, the network interface 1004 is mainly used for data communication with a network integration platform workstation; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the noise reduction control apparatus of the present application may be provided in the noise reduction control apparatus, and the noise reduction control apparatus calls the noise reduction control program stored in the memory 1005 through the processor 1001 and executes the noise reduction control method provided by the embodiment of the present application.
Based on the hardware structure, the embodiment of the noise reduction control method is provided.
Referring to fig. 2, fig. 2 is a flowchart of a first embodiment of a noise reduction control method according to the present application.
In a first embodiment, the noise reduction control method includes the steps of:
step S10, when the sudden noise is detected, an image of a sound source generating the sudden noise is acquired.
It should be noted that, the execution body of the present embodiment is a noise reduction control device, and may be other devices that can implement the same or similar functions, for example, a noise reduction control system, etc., which is not limited in this embodiment, and in this embodiment, the noise reduction control system is taken as an example for explanation.
It will be appreciated that the noise reduction control system comprises a sound source, a 6DOF camera for capturing an image of the sound source, an image processing device for recognizing the image of the sound source and determining the type of action that produces said bursty noise, the relative position of the sound source and the sound pick-up device, a signal processing device for wave velocity shaping the relative angle, determining the type of bursty noise, which may be an image processor (Image Signal Processor, ISP), a signal processing device, which may be a digital signal processor (Digital Signal Processing, DSP), provided on the smart device, and a filter for denoising the target sound according to the target filtering parameters.
It should be understood that the bursty noise refers to noise generated in a bursty manner, and the bursty noise includes, but is not limited to, knocking noise generated by suddenly knocking a desktop, friction noise generated by friction between a contact surface of a chair and the ground, and human voice speaking at a short distance, etc., the bursty noise can be picked up by a omni-directional microphone on the smart device, and the image refers to an image of a sound source generating the bursty noise, which can be an object of the desktop and knocking the desktop, a user speaking at a short distance, etc., and the image can be photographed by a 6DOF camera.
And step S20, determining the type of the sudden noise according to the image of the sound source.
It is understood that the type refers to a noise type of generated burst noise classified according to an object characteristic of a noise source, the burst noise type is classified into a aerodynamic noise type, a mechanical noise type, and an electromagnetic noise type, the burst noise type is classified according to a time characteristic, the burst noise type is classified into a stationary noise type, an unsteady noise type, and a impulse noise type, and the burst noise type is classified according to a frequency component characteristic of the noise source, the burst noise type is classified into a low frequency noise type (less than 300 HZ), a medium frequency noise type (300 HZ-800 HZ), and a high frequency noise type (more than 800 HZ).
Further, step S20 includes: identifying, by an image processing device, an image of the sound source; determining the action type generating the sudden noise and the relative position of the sound source and the pickup device according to the identification result; determining a relative angle according to the relative positions of the sound source and the target user; and determining the type of the sudden noise according to the relative angle and the action type of the sudden noise.
It should be understood that after obtaining the image of the sound source, the image processing device recognizes the image of the sound source, and determines the type of motion that generates the sudden noise according to the recognition result, where the type of motion may be tapping, friction or collision, and the like, and determines the relative position of the sound source and the sound pickup device, then determines the angle formed by the sound source relative to the target user based on the position of the target user, and then determines the type of sudden noise according to the relative angle and the type of motion of the sudden noise.
It will be appreciated that referring to fig. 3, fig. 3 is a schematic view of relative angles, specifically: taking two all-finger microphones as an example, for example, MIC1 and MIC2, the pickup range of the two microphones is 30 ° -150 °, the angle of the first beam is 30 °, the angle of the second beam is 90 °, the angle of the third beam is 150 °, and the position of the sound source is a forward direction with respect to the position of the target user, and the determined relative angle is 90 °.
Further, the determining the type of the bursty noise according to the relative angle and the action type of the bursty noise comprises: acquiring a pickup angle of pickup equipment; determining a pickup matrix according to the pickup angle and the relative position of the sound source and pickup equipment; wave velocity shaping is carried out on the relative angle through signal processing equipment according to the pickup matrix and the action type of the sudden noise; and determining the type of the sudden noise according to the wave speed shaping result.
It is understood that the pickup matrix refers to a matrix of pickup by a pickup device, the pickup matrix may be determined according to a pickup angle, a relative position of a sound source and the pickup device, after the image processing device determines a relative angle and an action type of sudden noise, the relative angle and the action type of sudden noise are transmitted to the signal processing device, and the signal processing device performs wave velocity shaping on the relative angle according to the pickup matrix and the action type of sudden noise, and then determines the type of sudden noise according to a wave velocity shaping result.
Further, the determining the type of the bursty noise according to the wave speed shaping result includes: determining a noise characteristic value of the sudden noise according to a wave speed shaping result; acquiring a preset noise characteristic value set; comparing the noise characteristic value of the sudden noise with each noise characteristic value in the preset noise characteristic value set in sequence; and determining the type of the bursty noise according to the successfully matched noise characteristic value.
It should be understood that the preset noise characteristic value set refers to a pre-stored noise characteristic value set, each noise characteristic value in the preset noise characteristic value set corresponds to a respective noise type, after wave speed forming is performed, the noise characteristic value of the bursty noise is determined according to a wave speed forming result, then the noise characteristic value of the bursty noise is sequentially compared with each noise characteristic value in the preset noise characteristic value set, then a successfully matched noise characteristic value is extracted from a matching result, and then the noise type corresponding to the successfully matched noise characteristic value in the preset noise characteristic value set is used as the bursty noise type.
And step S30, determining target filtering parameters according to the type of the bursty noise.
It should be understood that the target filter parameter refers to a parameter that filters bursty noise in a target sound, the target filter parameter corresponding to a type of bursty noise, and in particular, when the type of bursty noise is obtained, the target filter parameter corresponding to the type of bursty noise is called.
And S40, denoising the target sound according to the target filtering parameters.
It can be understood that after the target filtering parameters are obtained, the target sound is noise reduced by the filter according to the target filtering parameters to eliminate the sudden noise in the target sound, for example, referring to fig. 4, fig. 4 is a schematic diagram of noise reduction effect, specifically: the first part is the target sound, the second part is the sudden noise, and the third part is the target sound after noise reduction, namely the human voice after the sudden noise in the target sound is eliminated.
The embodiment obtains an image of a sound source generating sudden noise when the sudden noise is detected; determining the type of the sudden noise according to the image of the sound source; determining a target filtering parameter according to the type of the bursty noise; denoising the target sound according to the target filtering parameters; by the method, when the sudden noise is detected, the type of the sudden noise is determined according to the image of the sound source generating the sudden noise, then the target filtering parameters are determined according to the type, and noise reduction is carried out on the target sound according to the target filtering parameters, so that the sudden noise in the target sound can be eliminated, and the voice quality is improved.
In an embodiment, as shown in fig. 5, a second embodiment of the noise reduction control method according to the present application is provided based on the first embodiment, and after the step S40, the method further includes:
step S501, the target sound after noise reduction is identified, and a sound feature set is obtained.
It should be understood that the sound feature set refers to a set of features of a target sound after noise reduction, and after noise reduction is performed on the target sound, the signal processing device further identifies the noise-reduced target sound to determine whether noise features of sudden noise in the sound feature set are noise features of the sudden noise.
Step S502, when there is no noise feature of the sudden noise in the sound feature set, acquiring a current application scenario of the intelligent device.
It may be understood that when it is determined that the noise feature of the sudden noise does not exist in the sound feature set, it is indicated that the sudden noise in the target sound has been eliminated, at this time, whether other conventional noise exists is further determined, if yes, the filtering parameters need to be replaced, and other conventional noise is eliminated according to the filtering parameters, if no, the noise-reduced target sound is transmitted, and the current application scenario refers to a scenario in which the target user uses the intelligent device at the current moment, where the current application scenario includes, but is not limited to, a recording scenario, a call scenario, and the like.
Step S503, transmitting the noise-reduced target sound according to the current application scene.
It should be understood that, after the current application scene is acquired, the noise-reduced target sound is transmitted according to the current application scene.
Further, step S503 includes: when the current application scene is a recording scene, converting the target sound after noise reduction to obtain sound data to be stored; and storing the sound data to be stored to a digital storage medium.
It can be understood that when the current application scene is determined to be a recording scene, it is indicated that the user is recording by using the target intelligent device, at this time, the target audio mixing data is converted into a format of a digital signal, and then the converted target audio mixing data is stored in the digital storage medium.
Further, step S503 includes: when the application scene is a call scene, transmitting the noise-reduced target sound to a terminal of an opposite user through a target channel; when receiving a sound adjusting request sent by a terminal of an opposite user, increasing the gain of the sound pickup device; acquiring current sound through the voice monitoring equipment with increased gain; when the sound source is detected to continuously generate the sudden noise, the current sound is subjected to noise reduction through a target filtering parameter; and transmitting the current noise after noise reduction to the terminal of the opposite user through the target channel.
It can be understood that when the application scenario of the target intelligent device is determined to be a call scenario, it indicates that the user is using the target intelligent device to make a call with the counterpart user, and at this time, the target sound after noise reduction is transmitted to the terminal of the counterpart user through the target channel, where the terminal may be an electronic terminal such as a mobile phone, a tablet, or an intelligent device.
It should be appreciated that after hearing the target sound after noise reduction, an inaudible condition may occur, and the opposite user may say "what is just what? The method includes the steps that after a user receives a voice operation such as a loud point, a terminal controller generates a corresponding voice adjustment request according to the voice operation, the voice adjustment request is sent to an intelligent device controller through a terminal, the intelligent device controller increases the gain of a sound pickup device after receiving the voice adjustment request, and simultaneously, a prompt sound for reminding the user to speak in a loud point is played, after hearing the prompt sound, the user also increases the speaking volume, picks up the current sound through the sound pickup device after increasing the gain, judges whether the sound source continues to generate sudden noise, if yes, the fact that the same sudden noise exists in the current sound, the current sound needs to be reduced through a target filtering parameter, and the current sound after noise reduction is transmitted to the terminal of the user of the other side through a target channel again.
Note that, referring to fig. 6, fig. 6 is an overall flow schematic, specifically: when the sudden noise is detected, the image of the sound source generating the sudden noise is shot through a 6DOF camera, then the image of the sound source is identified through an image processing device, the action type generating the sudden noise and the relative position of the sound source and a sound pickup device are determined according to the identification result, then the relative angle is determined according to the relative position of the sound source and the sound pickup device, then the relative angle is subjected to wave velocity forming according to the sound pickup matrix and the action type of the sudden noise through a signal processing device, the noise characteristic value of the sudden noise is determined according to the wave velocity forming result, then the type of the sudden noise is determined according to the noise characteristic value, and a target filtering parameter is called according to the type of the sudden noise, noise in the target sound is eliminated through a filter according to the target filtering parameter, and then the noise-reduced target sound is transmitted.
In the embodiment, a sound feature set is obtained by identifying the target sound after noise reduction; acquiring a current application scene of the intelligent equipment when the noise characteristics of the sudden noise do not exist in the sound characteristic set; transmitting the noise-reduced target sound according to the current application scene; through the mode, after the sound feature set of the target sound after noise reduction is identified, whether the noise feature of sudden noise exists in the sound feature set is judged, if not, the target sound after noise reduction is transmitted according to the current application scene of the intelligent equipment, so that the accuracy of the transmitted sound can be effectively improved, and the experience of a user is further improved.
In addition, the embodiment of the application also provides a storage medium, wherein the storage medium stores a noise reduction control program, and the noise reduction control program realizes the steps of the noise reduction control method when being executed by a processor.
Because the storage medium adopts all the technical schemes of all the embodiments, the storage medium has at least all the beneficial effects brought by the technical schemes of the embodiments, and the description is omitted here.
In addition, referring to fig. 7, an embodiment of the present application further proposes a noise reduction control device, where the noise reduction control device includes:
an acquisition module 10 is configured to acquire, when sudden noise is detected, an image of a sound source generating the sudden noise.
A determining module 20, configured to determine the type of the bursty noise according to the image of the sound source.
The determining module 20 is further configured to determine a target filtering parameter according to the type of the bursty noise.
And the noise reduction module 30 is used for reducing noise of the target sound according to the target filtering parameters.
The embodiment obtains an image of a sound source generating sudden noise when the sudden noise is detected; determining the type of the sudden noise according to the image of the sound source; determining a target filtering parameter according to the type of the bursty noise; denoising the target sound according to the target filtering parameters; by the method, when the sudden noise is detected, the type of the sudden noise is determined according to the image of the sound source generating the sudden noise, then the target filtering parameters are determined according to the type, and noise reduction is carried out on the target sound according to the target filtering parameters, so that the sudden noise in the target sound can be eliminated, and the voice quality is improved.
It should be noted that the above-described working procedure is merely illustrative, and does not limit the scope of the present application, and in practical application, a person skilled in the art may select part or all of them according to actual needs to achieve the purpose of the embodiment, which is not limited herein.
In addition, technical details not described in detail in the present embodiment may refer to the noise reduction control method provided in any embodiment of the present application, and are not described herein.
In an embodiment, the determining module 20 is further configured to identify, by an image processing device, an image of the sound source; determining the action type generating the sudden noise and the relative position of the sound source and the pickup device according to the identification result; determining a relative angle according to the relative positions of the sound source and the target user; and determining the type of the sudden noise according to the relative angle and the action type of the sudden noise.
In an embodiment, the determining module 20 is further configured to obtain a pickup angle of the pickup device; determining a pickup matrix according to the pickup angle and the relative position of the sound source and pickup equipment; wave velocity shaping is carried out on the relative angle through signal processing equipment according to the pickup matrix and the action type of the sudden noise; and determining the type of the sudden noise according to the wave speed shaping result.
In an embodiment, the determining module 20 is further configured to determine a noise characteristic value of the bursty noise according to a wave velocity shaping result; acquiring a preset noise characteristic value set; comparing the noise characteristic value of the sudden noise with each noise characteristic value in the preset noise characteristic value set in sequence; and determining the type of the bursty noise according to the successfully matched noise characteristic value.
In an embodiment, the noise reduction module 30 is further configured to identify a target sound after noise reduction, so as to obtain a sound feature set; acquiring a current application scene of the intelligent equipment when the noise characteristics of the sudden noise do not exist in the sound characteristic set; and transmitting the target sound after noise reduction according to the current application scene.
In an embodiment, the noise reduction module 30 is further configured to, when the current application scenario is a recording scenario, convert the target sound after noise reduction to obtain sound data to be stored; and storing the sound data to be stored to a digital storage medium.
In an embodiment, the noise reduction module 30 is further configured to transmit, when the application scenario is a call scenario, the noise-reduced target sound to the terminal of the opposite user through the target channel; when receiving a sound adjusting request sent by a terminal of an opposite user, increasing the gain of the sound pickup device; acquiring current sound through the voice monitoring equipment with increased gain; when the sound source is detected to continuously generate the sudden noise, the current sound is subjected to noise reduction through a target filtering parameter; and transmitting the current noise after noise reduction to the terminal of the opposite user through the target channel.
Other embodiments of the noise reduction control device or the implementation method thereof can refer to the above method embodiments, and are not repeated here.
It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily occurring in sequence, but may be performed alternately or alternately with other steps or at least a portion of the other steps or stages.
Furthermore, it should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. Read Only Memory)/RAM, magnetic disk, optical disk) and including several instructions for causing a terminal device (which may be a mobile phone, a computer, an integrated platform workstation, or a network device, etc.) to perform the method according to the embodiments of the present application.
The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the application, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (10)
1. A noise reduction control method, characterized in that the noise reduction control method comprises the steps of:
when sudden noise is detected, acquiring an image of a sound source generating the sudden noise;
determining the type of the sudden noise according to the image of the sound source;
determining a target filtering parameter according to the type of the bursty noise;
and denoising the target sound according to the target filtering parameters.
2. The noise reduction control method according to claim 1, wherein the determining the type of the sudden noise from the image of the sound source includes:
identifying, by an image processing device, an image of the sound source;
determining the action type generating the sudden noise and the relative position of the sound source and the pickup device according to the identification result;
determining a relative angle according to the relative positions of the sound source and the target user;
and determining the type of the sudden noise according to the relative angle and the action type of the sudden noise.
3. The noise reduction control method according to claim 2, wherein the determining the type of the sudden noise according to the relative angle and the action type of the sudden noise includes:
acquiring a pickup angle of pickup equipment;
determining a pickup matrix according to the pickup angle and the relative position of the sound source and pickup equipment;
wave velocity shaping is carried out on the relative angle through signal processing equipment according to the pickup matrix and the action type of the sudden noise;
and determining the type of the sudden noise according to the wave speed shaping result.
4. A noise reduction control method according to claim 3, wherein said determining the type of the bursty noise from the wave velocity shaping result comprises:
determining a noise characteristic value of the sudden noise according to a wave speed shaping result;
acquiring a preset noise characteristic value set;
comparing the noise characteristic value of the sudden noise with each noise characteristic value in the preset noise characteristic value set in sequence;
and determining the type of the bursty noise according to the successfully matched noise characteristic value.
5. The noise reduction control method according to any one of claims 1 to 4, characterized by further comprising, after the noise reduction of the target sound according to the target filter parameter:
identifying the target sound after noise reduction to obtain a sound feature set;
acquiring a current application scene of the intelligent equipment when the noise characteristics of the sudden noise do not exist in the sound characteristic set;
and transmitting the target sound after noise reduction according to the current application scene.
6. The noise reduction control method according to claim 5, wherein the transmitting the noise reduced target sound data according to the current application scene includes:
when the current application scene is a recording scene, converting the target sound after noise reduction to obtain sound data to be stored;
and storing the sound data to be stored to a digital storage medium.
7. The noise reduction control method according to claim 5, wherein the transmitting the noise reduced target sound data according to the current application scene includes:
when the application scene is a call scene, transmitting the noise-reduced target sound to a terminal of an opposite user through a target channel;
when receiving a sound adjusting request sent by a terminal of an opposite user, increasing the gain of the sound pickup device;
acquiring current sound through the voice monitoring equipment with increased gain;
when the sound source is detected to continuously generate the sudden noise, the current sound is subjected to noise reduction through a target filtering parameter;
and transmitting the current noise after noise reduction to the terminal of the opposite user through the target channel.
8. A noise reduction control device, characterized by comprising:
an acquisition module for acquiring an image of a sound source generating sudden noise when the sudden noise is detected;
a determining module, configured to determine a type of the bursty noise according to an image of the sound source;
the determining module is further used for determining a target filtering parameter according to the type of the bursty noise;
and the noise reduction module is used for reducing noise of the target sound according to the target filtering parameters.
9. A noise reduction control apparatus, characterized by comprising: a memory, a processor, and a noise reduction control program stored on the memory and executable on the processor, the noise reduction control program being configured to implement the noise reduction control method according to any one of claims 1 to 7.
10. A storage medium having a noise reduction control program stored thereon, which when executed by a processor, implements the noise reduction control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311015012.7A CN117153182A (en) | 2023-08-11 | 2023-08-11 | Noise reduction control method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311015012.7A CN117153182A (en) | 2023-08-11 | 2023-08-11 | Noise reduction control method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117153182A true CN117153182A (en) | 2023-12-01 |
Family
ID=88897858
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311015012.7A Pending CN117153182A (en) | 2023-08-11 | 2023-08-11 | Noise reduction control method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117153182A (en) |
-
2023
- 2023-08-11 CN CN202311015012.7A patent/CN117153182A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107534725B (en) | Voice signal processing method and device | |
| CN111034222B (en) | Sound pickup apparatus, sound pickup method, and computer program product | |
| US11277686B2 (en) | Electronic device with audio zoom and operating method thereof | |
| US9124984B2 (en) | Hearing aid, signal processing method, and program | |
| US12051441B2 (en) | Multi-register-based speech detection method and related apparatus, and storage medium | |
| CN110970057A (en) | Sound processing method, device and equipment | |
| CN115482830B (en) | Voice enhancement method and related equipment | |
| CN114697812A (en) | Sound collection method, electronic equipment and system | |
| CN105827793B (en) | A kind of speech-oriented output method and mobile terminal | |
| JP2023511090A (en) | Stereo sound collection method and apparatus, terminal device, and computer-readable storage medium | |
| CN113542960B (en) | Audio signal processing method, system, device, electronic equipment and storage medium | |
| CN117480554A (en) | Voice enhancement method and related equipment | |
| US11875800B2 (en) | Talker prediction method, talker prediction device, and communication system | |
| CN111182416B (en) | Processing method and device and electronic equipment | |
| CN117153182A (en) | Noise reduction control method, device, equipment and storage medium | |
| US11956606B2 (en) | Audio signal processing method and audio signal processing apparatus that process an audio signal based on posture information | |
| CN113395451B (en) | Video shooting method and device, electronic equipment and storage medium | |
| CN114650492A (en) | Wireless personal communication via a hearing device | |
| CN115914517A (en) | Sound signal processing method and electronic equipment | |
| US20220337945A1 (en) | Selective sound modification for video communication | |
| JP2020178150A (en) | Voice processing device and voice processing method | |
| WO2023228713A1 (en) | Sound processing device and method, information processing device, and program | |
| CN116249062B (en) | Hearing-aid equipment state intelligent quality inspection method, system and medium | |
| US20240062769A1 (en) | Apparatus, Methods and Computer Programs for Audio Focusing | |
| CN114078466A (en) | Video call voice processing method, communication terminal and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |