CN110197671A - Orient sound pick-up method, sound pick-up outfit and storage medium - Google Patents
Orient sound pick-up method, sound pick-up outfit and storage medium Download PDFInfo
- Publication number
- CN110197671A CN110197671A CN201910524995.4A CN201910524995A CN110197671A CN 110197671 A CN110197671 A CN 110197671A CN 201910524995 A CN201910524995 A CN 201910524995A CN 110197671 A CN110197671 A CN 110197671A
- Authority
- CN
- China
- Prior art keywords
- sound
- orientation
- multiple target
- pick
- pickup
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/04—Time compression or expansion
- G10L21/055—Time compression or expansion for synchronising with other signals, e.g. video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention discloses a kind of orientation sound pick-up method, sound pick-up outfit and storage mediums, by the orientation pickup instruction for obtaining collected multiple target sounds and user's input, and to the multiple target sound delay compensation, so that the timing of the multiple target sound is consistent；Using target sound corresponding with the orientation pickup instruction in the multiple target sound as direction sound, and noise reduction is carried out to the direction sound.To during sound pick-up outfit picks up sound, delay compensation is carried out to the sound of all directions of recording, the sound of user's assigned direction is accurately picked up again, and noise reduction process is carried out to the noise in the sound picked up, and then interference of the sound of non-pointing direction to recording result is reduced, so that the orientation pickup of sound pick-up outfit is reached optimum efficiency.
Description
Technical field
The present invention relates to audio signal processing technique fields more particularly to a kind of orientation sound pick-up method, sound pick-up outfit and storage to be situated between
Matter.
Background technique
The sound pick-up outfits such as most of sound pick-up outfit, such as recording pen, recorder and desktop conferencing recorder have been in the market
The public visual field is come into.With the improvement of living standards, requirement of the people to sound pick-up outfit is higher and higher, it is more and more to record
Sound equipment also has this function of directional recording.
However, most of sound pick-up outfits are all to determine recording direction to the adjustment of sound pick-up outfit by user, then choose
The voice data that microphone corresponding with recording direction is recorded, and the voice data of selection is enhanced, refer to realize
Determine the orientation pickup in direction.But in practical applications, the assigned direction of microphone and indefinite, Jin Erhuo in sound pick-up outfit
More or few sound for including non-designated direction, so that the orientation pickup of sound pick-up outfit is difficult to reach optimum efficiency.
Summary of the invention
The main purpose of the present invention is to provide a kind of orientation sound pick-up method, sound pick-up outfit and storage mediums, it is intended to solve
Certainly the orientation pickup function of sound pick-up outfit is difficult to the technical issues of achieving the desired results.
To achieve the above object, the present invention provides a kind of orientation sound pick-up methods, comprising the following steps:
The orientation pickup instruction of collected multiple target sounds and user's input is obtained, and to the multiple target sound
Sound delay compensation, so that the timing of the multiple target sound is consistent；
It is and right using target sound corresponding with the orientation pickup instruction in the multiple target sound as being directed toward sound
The direction sound carries out noise reduction.
Optionally, described to the multiple target sound delay compensation, so that the timing one of the multiple target sound
The step of cause includes:
The sound of preset reference microphone acquisition is determined from collected multiple target sounds, and by preset reference Mike
The sound of elegance collection as standard voice, make by the target sound in collected multiple target sounds in addition to the standard voice
For non-standardized sounds；
Determine the timing of the standard voice, and according to the timing of the standard voice adjust the non-standardized sounds when
Sequence, so that the timing of the non-standardized sounds is consistent with the timing of the standard voice.
Optionally, the step of orientation pickup instruction for obtaining collected multiple target sounds and user's input is wrapped
It includes:
Corresponding orientation pickup instruction is generated according to the operation of user in the display interface, and is referred to according to the orientation pickup
It enables and sound is acquired by each microphone in microphone array；
Using each collected sound of microphone as target sound.
Optionally, the step of orientation pickup instruction for obtaining collected multiple target sounds and user's input it
Afterwards, further includes:
Corresponding horizontal angle value and elevation value are determined according to the orientation pickup instruction of user's input, and by the horizontal angle
Value and the elevation value are shown on the display interface；
It is described using target sound corresponding with the orientation pickup instruction in the multiple target sound as be directed toward sound
The step of include:
Corresponding direction orientation is determined according to the horizontal angle value and the elevation value, and by the multiple target sound
In target sound corresponding with the direction orientation as the direction sound.
Optionally, described using target sound corresponding with the orientation pickup instruction in the multiple target sound as referring to
After the step of to sound, further includes:
Signal sampling and normalized are carried out to the direction sound；
By the direction voice input after normalized into Predetermined filter, to enhance the direction sound.
Optionally, described the step of carrying out noise reduction to the direction sound, includes:
By the direction voice input into default noise Estimation Algorithm, to identify the noise in the direction sound；
It determines frequency, amplitude and the phase of the noise, and exports antinoise corresponding with the noise, to described
It is directed toward sound and carries out noise reduction, wherein the antinoise is that, amplitude identical as the noise frequency be identical and the sound of opposite in phase
Wave.
Optionally, after described the step of carrying out noise reduction to the direction sound, further includes:
Direction sound after noise reduction is uploaded to cloud server, and after getting the reading instruction of user's input, from
Cloud server downloads corresponding direction sound.
Optionally, the model ES7210 of the microphone array, the directive property of the microphone array are omnidirectional, heart
At least one of direction, hypercardioid are directed toward and 8 fonts are directed toward；
Predetermined filter is at least one in spatial filter, time domain filtering, auditory filter and Wiener filter
Kind；
Default noise Estimation Algorithm is logarithm spectral amplitude optimal estimation method and/or MCRA (Minima-Controlled-
Recursive-Averaging Algorithms, recursive average) algorithm.
In addition, to achieve the above object, the present invention also provides a kind of sound pick-up outfit, the sound pick-up outfit include: memory,
Processor and the orientation pickup program that is stored on the memory and can run on the processor, the orientation pickup journey
The step of orientation sound pick-up method as described above is realized when sequence is executed by the processor.
In addition, to achieve the above object, it is described computer-readable the present invention also provides a kind of computer readable storage medium
It is stored with orientation pickup program on storage medium, realizes that orientation is picked up as described above when the orientation pickup program is executed by processor
The step of sound method.
The present invention provides a kind of orientation sound pick-up method, sound pick-up outfit and storage medium, the orientation sound pick-up method passes through
The orientation pickup instruction of collected multiple target sounds and user's input is obtained, and the multiple target sound time delay is mended
It repays, so that the timing of the multiple target sound is consistent；Will in the multiple target sound with the orientation pickup instruction pair
The target sound answered carries out noise reduction as direction sound, and to the direction sound.To pick up the mistake of sound in sound pick-up outfit
Cheng Zhong carries out delay compensation to the sound of all directions of recording, then accurately picks up the sound of user's assigned direction, and to picking up
Noise in the sound got carries out noise reduction process, and then reduces interference of the sound of non-pointing direction to recording result, makes to record
The orientation pickup of sound equipment reaches optimum efficiency.
Detailed description of the invention
Fig. 1 is the structural schematic diagram for the hardware running environment that the embodiment of the present invention is related to；
Fig. 2 is the flow diagram of present invention orientation one embodiment of sound pick-up method；
Fig. 3 be it is of the present invention to the multiple target sound delay compensation so that the multiple target sound when
The consistent steps flow chart of sequence refines schematic diagram；
Fig. 4 is the flow diagram of present invention orientation another embodiment of sound pick-up method.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
As shown in Figure 1, Fig. 1 is the terminal structure schematic diagram for the hardware running environment that the embodiment of the present invention is related to.
Terminal of the present invention is a kind of device, which can be sound pick-up outfit, can also be server, computer, intelligent hand
Machine, tablet computer, portable computer etc. have the terminal device of store function.
As shown in Figure 1, the terminal may include: processor 1001, such as CPU, communication bus 1002, user interface
1003, network interface 1004, memory 1005.Wherein, communication bus 1002 is for realizing the connection communication between these components.
User interface 1003 may include display screen (Display), input unit such as keyboard (Keyboard), optional user interface
1003 can also include standard wireline interface and wireless interface.Network interface 1004 optionally may include that the wired of standard connects
Mouth, wireless interface (such as WI-FI interface).Memory 1005 can be high speed RAM memory, be also possible to stable memory
(non-volatile memory), such as magnetic disk storage.Memory 1005 optionally can also be independently of aforementioned processor
1001 storage device.
Optionally, terminal can also include camera, Wi-Fi module etc., and details are not described herein.
It will be understood by those skilled in the art that the restriction of the not structure paired terminal of terminal structure shown in Fig. 1, can wrap
It includes than illustrating more or fewer components, perhaps combines certain components or different component layouts.
In terminal shown in Fig. 1, network interface 1004 is mainly used for connecting background server, carries out with background server
Data communication；User interface 1003 includes mainly input unit such as keyboard, and keyboard includes Wireless Keyboard and wired keyboard, is used for
Client is connected, carries out data communication with client；And processor 1001 can be used for calling what is stored in memory 1005 to determine
To pickup program, and execute following operation:
The orientation pickup instruction of collected multiple target sounds and user's input is obtained, and to the multiple target sound
Sound delay compensation, so that the timing of the multiple target sound is consistent；
It is and right using target sound corresponding with the orientation pickup instruction in the multiple target sound as being directed toward sound
The direction sound carries out noise reduction.
Further, processor 1001 can call the orientation pickup program stored in memory 1005, also execute following
Operation:
The sound of preset reference microphone acquisition is determined from collected multiple target sounds, and by preset reference Mike
The sound of elegance collection as standard voice, make by the target sound in collected multiple target sounds in addition to the standard voice
For non-standardized sounds；
Determine the timing of the standard voice, and according to the timing of the standard voice adjust the non-standardized sounds when
Sequence, so that the timing of the non-standardized sounds is consistent with the timing of the standard voice.
Further, processor 1001 can call the orientation pickup program stored in memory 1005, also execute following
Operation:
Corresponding orientation pickup instruction is generated according to the operation of user in the display interface, and is referred to according to the orientation pickup
It enables and sound is acquired by each microphone in microphone array；
Using each collected sound of microphone as target sound.
Further, processor 1001 can call the orientation pickup program stored in memory 1005, also execute following
Operation:
Corresponding horizontal angle value and elevation value are determined according to the orientation pickup instruction of user's input, and by the horizontal angle
Value and the elevation value are shown on the display interface；
It is described using target sound corresponding with the orientation pickup instruction in the multiple target sound as be directed toward sound
The step of include:
Corresponding direction orientation is determined according to the horizontal angle value and the elevation value, and by the multiple target sound
In target sound corresponding with the direction orientation as the direction sound.
Further, processor 1001 can call the orientation pickup program stored in memory 1005, also execute following
Operation:
Signal sampling and normalized are carried out to the direction sound；
By the direction voice input after normalized into Predetermined filter, to enhance the direction sound.
Further, processor 1001 can call the orientation pickup program stored in memory 1005, also execute following
Operation:
By the direction voice input into default noise Estimation Algorithm, to identify the noise in the direction sound；
It determines frequency, amplitude and the phase of the noise, and exports antinoise corresponding with the noise, to described
It is directed toward sound and carries out noise reduction, wherein the antinoise is that, amplitude identical as the noise frequency be identical and the sound of opposite in phase
Wave.
Further, processor 1001 can call the orientation pickup program stored in memory 1005, also execute following
Operation:
Direction sound after noise reduction is uploaded to cloud server, and after getting the reading instruction of user's input, from
Cloud server downloads corresponding direction sound.
The specific embodiment of this terminal and each embodiment of following orientation sound pick-up methods are essentially identical, and therefore not to repeat here.
Referring to Fig. 2, Fig. 2 is the flow diagram of present invention orientation one embodiment of sound pick-up method, it is provided in this embodiment
Orientation sound pick-up method includes the following steps:
Step S10 obtains the orientation pickup instruction of collected multiple target sounds and user's input, and to described more
A target sound delay compensation, so that the timing of the multiple target sound is consistent；
Sound pick-up outfit in the present embodiment is built-in with multiple microphones, obtains collected multiple target sounds and user
The orientation pickup of input instructs, and the orientation pickup instruction is the instruction in the determination pickup orientation of user's input.It is readily comprehensible,
The position of built-in multiple microphones and sound generation source is different in sound pick-up outfit, thus collected multiple target sounds when
Sequence is also different.In general, the microphone nearest apart from sound generation source, is initially received sound, farthest apart from sound generation source
Microphone, receives sound the latest, and sound extends longer.In the present embodiment, delay compensation is carried out to multiple target sounds, so that
The timing for obtaining multiple target sounds is consistent.
Step S20, using target sound corresponding with the orientation pickup instruction in the multiple target sound as direction
Sound, and noise reduction is carried out to the direction sound.
After obtaining the consistent multiple target sounds of timing, due to the orientation pickup instruction include azimuth information, then from
Extract corresponding with azimuth information target sound in multiple target sounds, and using the target sound as direction sound,
The sound corresponding with user's assigned direction for being directed toward sound, that is, sound pick-up outfit and including.Noise reduction is carried out to sound is directed toward, to increase
The orientation pickup effect of strong sound pick-up outfit.
A kind of orientation sound pick-up method is present embodiments provided, it is defeated by obtaining collected multiple target sounds and user
The orientation pickup instruction entered, and to the multiple target sound delay compensation, so that the timing one of the multiple target sound
It causes；Using target sound corresponding with the orientation pickup instruction in the multiple target sound as direction sound, and to described
It is directed toward sound and carries out noise reduction.Thus during sound pick-up outfit picks up sound, when being carried out to the sound of all directions of recording
Prolong compensation, then accurately pick up the sound of user's assigned direction, and noise reduction process is carried out to the noise in the sound picked up, into
And interference of the sound of non-pointing direction to recording result is reduced, so that the orientation pickup of sound pick-up outfit is reached optimum efficiency.
Further, referring to Fig. 3, Fig. 3 be it is of the present invention to the multiple target sound delay compensation so that institute
State the timing consistent steps flow chart refinement schematic diagram of multiple target sounds, it is described to the multiple target sound delay compensation,
So that the consistent step of the timing of the multiple target sound includes:
Step S11, determines the sound of preset reference microphone acquisition from collected multiple target sounds, and will preset
Mesh of the sound of reference microphone acquisition as standard voice, in collected multiple target sounds in addition to the standard voice
Sound is marked as non-standardized sounds；
Step S12 determines the timing of the standard voice, and described non-standard according to the adjustment of the timing of the standard voice
The timing of sound, so that the timing of the non-standardized sounds is consistent with the timing of the standard voice.
As described above, including multiple microphones in sound pick-up outfit, the sound of each microphone records exists in timing
It is different.In the present embodiment, a microphone is preset as benchmark microphone, and the sound that preset reference microphone is acquired
As standard voice, then to target sound carry out delay compensation this during, the standard voice included with sound pick-up outfit
Timing as standard；Using the target sound in collected multiple target sounds in addition to the standard voice as non-standard
Sound, that is to say, that target sound carry out delay compensation this during, it is only necessary to non-standardized sounds carry out timing on
Adjustment.
After multiple target sounds are divided into standard voice and non-standardized sounds, the timing of the standard voice is determined,
And using the timing of the standard voice as benchmark, adjust the timing of non-standardized sounds so that the timing of non-standardized sounds with
The timing of standard voice is consistent, so that the timing of the multiple target sounds obtained is consistent, realizes the time delay to recorded voice
Compensation.The present embodiment is by the above-mentioned means, carry out delay compensation to target sound, to reduce the sound of non-pointing direction to record
The interference of sound result.
Further, the step of orientation pickup instruction for obtaining collected multiple target sounds and user's input
Include:
Step S13 generates corresponding orientation pickup according to the operation of user in the display interface and instructs, and according to described fixed
Sound is acquired by each microphone in microphone array to pickup instruction；
Step S14, using each collected sound of microphone as target sound.
Particularly, corresponding orientation pickup is generated according to the operation of user in the display interface to instruct, so it is easy to understand that
User can also generate the instruction of corresponding orientation pickup by other means, for example, user can by adjusting the orientation of terminal,
To generate corresponding orientation pickup instruction；User can also be by directly inputting azimuth information, to generate corresponding orientation pickup
Instruction, the present embodiment are not particularly limited herein.After getting the orientation pickup instruction of user's input, picked up according to the orientation
Sound instruction acquires sound by each microphone in microphone array.Preferably, in order to reach comprehensive pickup effect, wheat
The composition form of microphone is 6+1 mode in gram wind array, i.e. 6 microphones form closed loop around an intermediate microphone；On
The model ES7210 of microphone array is stated, the directive property of above-mentioned microphone array is omnidirectional, heart-shaped direction, hypercardioid direction
And 8 font be directed toward at least one of.So, the sound of comprehensive collection sound pick-up outfit local environment, and will be each
A collected sound of microphone is as target sound.
The present embodiment is by the above-mentioned means, the comprehensive sound collected around sound pick-up outfit, and as target sound
Sound, and then ensure that user can accomplish that 360 degree of assigned directions carry out pickup.
Further, above-mentioned steps S10 obtains collected multiple target sounds and the orientation pickup of user's input refers to
After order, further includes:
Step S30 determines corresponding horizontal angle value and elevation value according to the orientation pickup instruction of user's input, and by institute
It states horizontal angle value and the elevation value is shown on the display interface；
It is described using target sound corresponding with the orientation pickup instruction in the multiple target sound as be directed toward sound
The step of include:
Step S21 determines corresponding direction orientation according to the horizontal angle value and the elevation value, and will be the multiple
Target sound corresponding with the direction orientation is as the direction sound in target sound.
It include the azimuth information that user determines pickup direction in the orientation pickup instruction of user's input, specifically, described
It include that horizontal angle value and elevation value in order to allow user to determine the correctness of azimuth information facilitate use in orientation pickup instruction
Family judges whether the direction of sound pick-up outfit orientation pickup meets expection, and horizontal angle value and elevation value are shown in display interface
On.In this way, if user's discovery direction that sound pick-up outfit picks up sound at this time does not meet expection or user wants to change
Pickup direction can all be realized by re-entering orientation pickup instruction.
It is easily understood that can determine that user is intended to carry out the direction of pickup according to horizontal angle value and elevation value, and
Using above-mentioned direction as pointing direction.Since a target sound is, and each microphone collected by microphone institute
Position on sound pick-up outfit is fixed, therefore can be determined according to horizontal angle value and elevation value corresponding on sound pick-up outfit
Microphone, and using the target sound of the microphone records as direction sound.The present embodiment is by the above-mentioned means, according to orientation
Pickup, which instructs, determines corresponding microphone on sound pick-up outfit, and using the sound of the microphone records as sound is directed toward, precisely
Realization orient pickup.
Further, above-mentioned steps S20 is by target corresponding with the orientation pickup instruction in the multiple target sound
After sound is as direction sound, further includes:
Step S40 carries out signal sampling and normalized to the direction sound；
Step S50, by the direction voice input after normalized into Predetermined filter, to enhance the direction sound
Sound.
It determines after being directed toward sound, carries out signal sampling, above-mentioned signal sampling, i.e., according between the regular hour to sound is directed toward
It is interposed between on voice data and acquires its instantaneous value point by point, to realize the discretization of sound.Particularly, signal is carried out to direction sound
After sampling, Fourier transformation can also be carried out to the sound after discrete, and according to the difference of working frequency, to different sound numbers
According to being weighted, and discrete multiple voice datas are normalized.It is normalized to sound is directed toward
Afterwards, further, it by the direction voice input after normalized into Predetermined filter, to enhance the direction sound, mentions
Height is directed toward performance of the sound under reverberant ambiance, and particularly, Predetermined filter is spatial filter, time domain filtering, sense of hearing filter
At least one of wave device and Wiener filter.
The present embodiment is by the above-mentioned means, enhance the sound of pointing direction, and then improve the effect of orientation pickup.
Further, described the step of carrying out noise reduction to the direction sound, includes:
Step S22, by the direction voice input into default noise Estimation Algorithm, to identify in the direction sound
Noise；
Step S23 determines frequency, amplitude and the phase of the noise, and output antinoise corresponding with the noise,
To carry out noise reduction to the direction sound, wherein the antinoise is that, amplitude identical as the noise frequency be identical and phase
Opposite sound wave.
In the present embodiment, it is also preset with noise Estimation Algorithm, presetting noise Estimation Algorithm is the optimal estimation of logarithm spectral amplitude
Method and/or MCRA algorithm carry out noise estimation to the direction sound using default noise Estimation Algorithm, to identify direction sound
Noise in sound, and determine frequency, amplitude and the phase of the noise.Again to the direction voice input and sound wave frequency
Rate is identical, amplitude is identical and the antinoise sound wave of opposite in phase realize with the phase cancellation of noise, thus to be directed toward sound into
Row noise reduction reduces interference of the noise source being directed toward in sound to recording result, the orientation pickup of sound pick-up outfit is made to reach best effective
Fruit.
Further, above-mentioned referring to Fig. 4, Fig. 4 is the flow diagram of present invention orientation another embodiment of sound pick-up method
Step S20 carries out the direction sound after noise reduction, further includes:
Direction sound after noise reduction is uploaded to cloud server, and referred in the reading for getting user's input by step S60
After order, corresponding direction sound is downloaded from cloud server.
It realizes to after the enhancing and noise reduction for being directed toward sound, so it is easy to understand that direction sound at this time is ideal.This reality
Apply in example, be also equipped be directed toward sound automatic backup function, the direction sound after noise reduction is uploaded to cloud server, so as to
Family can extract direction sound at any time, correspondingly, downloading and broadcasting from cloud server after getting the reading instruction of user's input
Put corresponding direction sound.By the above-mentioned means, the backup to sound is directed toward is realized, to meet the more demands of user.
Further, the model ES7210 of above-mentioned microphone array, the directive property of above-mentioned microphone array are omnidirectional, the heart
At least one of shape is directed toward, hypercardioid is directed toward and 8 fonts are directed toward；
Predetermined filter is at least one in spatial filter, time domain filtering, auditory filter and Wiener filter
Kind；
Default noise Estimation Algorithm is logarithm spectral amplitude optimal estimation method and/or MCRA (Minima-Controlled-
Recursive-Averaging Algorithms, recursive average) algorithm.
In addition, the embodiment of the present invention also proposes a kind of computer readable storage medium, the computer readable storage medium
On be stored with orientation pickup program, when the orientation pickup program is executed by processor realize as follows operate:
The orientation pickup instruction of collected multiple target sounds and user's input is obtained, and to the multiple target sound
Sound delay compensation, so that the timing of the multiple target sound is consistent；
It is and right using target sound corresponding with the orientation pickup instruction in the multiple target sound as being directed toward sound
The direction sound carries out noise reduction.
Further, following operation is also realized when the orientation pickup program is executed by processor:
The sound of preset reference microphone acquisition is determined from collected multiple target sounds, and by preset reference Mike
The sound of elegance collection as standard voice, make by the target sound in collected multiple target sounds in addition to the standard voice
For non-standardized sounds；
Determine the timing of the standard voice, and according to the timing of the standard voice adjust the non-standardized sounds when
Sequence, so that the timing of the non-standardized sounds is consistent with the timing of the standard voice.
Further, following operation is also realized when the orientation pickup program is executed by processor:
Corresponding orientation pickup instruction is generated according to the operation of user in the display interface, and is referred to according to the orientation pickup
It enables and sound is acquired by each microphone in microphone array；
Using each collected sound of microphone as target sound.
Further, following operation is also realized when the orientation pickup program is executed by processor:
Corresponding horizontal angle value and elevation value are determined according to the orientation pickup instruction of user's input, and by the horizontal angle
Value and the elevation value are shown on the display interface；
It is described using target sound corresponding with the orientation pickup instruction in the multiple target sound as be directed toward sound
The step of include:
Corresponding direction orientation is determined according to the horizontal angle value and the elevation value, and by the multiple target sound
In target sound corresponding with the direction orientation as the direction sound.
Further, following operation is also realized when the orientation pickup program is executed by processor:
Signal sampling and normalized are carried out to the direction sound；
By the direction voice input after normalized into Predetermined filter, to enhance the direction sound.
Further, following operation is also realized when the orientation pickup program is executed by processor:
By the direction voice input into default noise Estimation Algorithm, to identify the noise in the direction sound；
It determines frequency, amplitude and the phase of the noise, and exports antinoise corresponding with the noise, to described
It is directed toward sound and carries out noise reduction, wherein the antinoise is that, amplitude identical as the noise frequency be identical and the sound of opposite in phase
Wave.
Further, following operation is also realized when the orientation pickup program is executed by processor:
Direction sound after noise reduction is uploaded to cloud server, and after getting the reading instruction of user's input, from
Cloud server downloads corresponding direction sound.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the system that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or system institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or system.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in a storage medium
In (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal device (can be mobile phone, computer, clothes
Business device, air conditioner or the network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of orientation sound pick-up method, which is characterized in that the described method comprises the following steps:
The orientation pickup instruction of collected multiple target sounds and user's input is obtained, and when to the multiple target sound
Prolong compensation, so that the timing of the multiple target sound is consistent；
Using target sound corresponding with the orientation pickup instruction in the multiple target sound as direction sound, and to described
It is directed toward sound and carries out noise reduction.
2. orientation sound pick-up method as described in claim 1, which is characterized in that described to be mended to the multiple target sound time delay
It repays, so that the consistent step of the timing of the multiple target sound includes:
The sound of preset reference microphone acquisition is determined from collected multiple target sounds, and by preset reference Mike's elegance
The sound of collection is as standard voice, and the target sound in collected multiple target sounds in addition to the standard voice is as non-
Standard voice；
It determines the timing of the standard voice, and adjusts the timing of the non-standardized sounds according to the timing of the standard voice,
So that the timing of the non-standardized sounds is consistent with the timing of the standard voice.
3. orientation sound pick-up method as described in claim 1, which is characterized in that it is described obtain collected multiple target sounds with
And user input orientation pickup instruction the step of include:
Corresponding orientation pickup instruction is generated according to the operation of user in the display interface, and is instructed and is led to according to the orientation pickup
Cross each microphone acquisition sound in microphone array；
Using each collected sound of microphone as target sound.
4. orientation sound pick-up method as described in claim 1, which is characterized in that it is described obtain collected multiple target sounds with
And user input orientation pickup instruction the step of after, further includes:
Determine corresponding horizontal angle value and elevation value according to the orientation pickup instruction of user's input, and by the horizontal angle value with
And the elevation value is shown on the display interface；
It is described to instruct corresponding target sound as the step for being directed toward sound with the orientation pickup in the multiple target sound
Suddenly include:
Determine corresponding direction orientation according to the horizontal angle value and the elevation value, and by the multiple target sound with
The corresponding target sound in the direction orientation is as the direction sound.
5. as described in claim 1 orientation sound pick-up method, which is characterized in that it is described by the multiple target sound with it is described
Orienting pickup instructs corresponding target sound to be used as after the step of being directed toward sound, further includes:
Signal sampling and normalized are carried out to the direction sound；
By the direction voice input after normalized into Predetermined filter, to enhance the direction sound.
6. orientation sound pick-up method as described in claim 1, which is characterized in that the step for carrying out noise reduction to the direction sound
Suddenly include:
By the direction voice input into default noise Estimation Algorithm, to identify the noise in the direction sound；
It determines frequency, amplitude and the phase of the noise, and exports antinoise corresponding with the noise, to the direction
Sound carries out noise reduction, wherein the antinoise is that, amplitude identical as the noise frequency be identical and the sound wave of opposite in phase.
7. orientation sound pick-up method as described in claim 1, which is characterized in that the step for carrying out noise reduction to the direction sound
After rapid, further includes:
Direction sound after noise reduction is uploaded to cloud server, and after getting the reading instruction of user's input, from cloud
Server downloads corresponding direction sound.
8. the orientation sound pick-up method as described in any one of claim 1-7, which is characterized in that the type of the microphone array
It number is ES7210, the directive property of the microphone array is omnidirectional, heart-shaped is directed toward, during hypercardioid is directed toward and 8 fonts are directed toward
At least one；
Predetermined filter is at least one of spatial filter, time domain filtering, auditory filter and Wiener filter；
Default noise Estimation Algorithm is logarithm spectral amplitude optimal estimation method and/or MCRA (Minima-Controlled-
Recursive-Averaging Algorithms, recursive average) algorithm.
9. a kind of sound pick-up outfit, which is characterized in that the sound pick-up outfit includes: memory, processor and is stored in the storage
On device and the orientation pickup program that can run on the processor, the orientation pickup program are arranged for carrying out such as claim
Described in any one of 1 to 8 the step of orientation sound pick-up method.
10. a kind of storage medium, which is characterized in that be stored with orientation pickup program, the orientation pickup on the storage medium
The step of orientation sound pick-up method as claimed in any one of claims 1 to 8 is realized when program is executed by processor.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910524995.4A CN110197671A (en) | 2019-06-17 | 2019-06-17 | Orient sound pick-up method, sound pick-up outfit and storage medium |
| PCT/CN2019/101711 WO2020252886A1 (en) | 2019-06-17 | 2019-08-21 | Directional sound pickup method, recording device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910524995.4A CN110197671A (en) | 2019-06-17 | 2019-06-17 | Orient sound pick-up method, sound pick-up outfit and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110197671A true CN110197671A (en) | 2019-09-03 |
Family
ID=67754676
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910524995.4A Pending CN110197671A (en) | 2019-06-17 | 2019-06-17 | Orient sound pick-up method, sound pick-up outfit and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110197671A (en) |
| WO (1) | WO2020252886A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110769318A (en) * | 2019-09-30 | 2020-02-07 | 视联动力信息技术股份有限公司 | Control method and device for video network recording equipment |
| WO2021114953A1 (en) * | 2019-12-12 | 2021-06-17 | 华为技术有限公司 | Voice signal acquisition method and apparatus, electronic device, and storage medium |
| CN113038329A (en) * | 2021-03-22 | 2021-06-25 | 深圳市科奈信科技有限公司 | Earphone radio control method, device and storage medium |
| CN113068101A (en) * | 2021-03-16 | 2021-07-02 | Oppo广东移动通信有限公司 | Ring array pickup control method and device, storage medium and ring array |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101447190A (en) * | 2008-06-25 | 2009-06-03 | 北京大学深圳研究生院 | Voice enhancement method employing combination of nesting-subarray-based post filtering and spectrum-subtraction |
| CN102324237A (en) * | 2011-05-30 | 2012-01-18 | 深圳市华新微声学技术有限公司 | Microphone array voice wave beam formation method, speech signal processing device and system |
| CN102509552A (en) * | 2011-10-21 | 2012-06-20 | 浙江大学 | Method for enhancing microphone array voice based on combined inhibition |
| CN102831898A (en) * | 2012-08-31 | 2012-12-19 | 厦门大学 | Microphone array voice enhancement device with sound source direction tracking function and method thereof |
| CN102969002A (en) * | 2012-11-28 | 2013-03-13 | 厦门大学 | Microphone array speech enhancement device capable of suppressing mobile noise |
| CN103916723A (en) * | 2013-01-08 | 2014-07-09 | 联想(北京)有限公司 | Sound acquisition method and electronic equipment |
| CN104378570A (en) * | 2014-09-28 | 2015-02-25 | 小米科技有限责任公司 | Sound recording method and device |
| CN105679329A (en) * | 2016-02-04 | 2016-06-15 | 厦门大学 | Microphone array voice enhancing device adaptable to strong background noise |
| CN106603878A (en) * | 2016-12-09 | 2017-04-26 | 奇酷互联网络科技（深圳）有限公司 | Voice positioning method, device and system |
| CN107481729A (en) * | 2017-09-13 | 2017-12-15 | 百度在线网络技术（北京）有限公司 | A kind of method and system that intelligent terminal is upgraded to far field speech-sound intelligent equipment |
| CN108269582A (en) * | 2018-01-24 | 2018-07-10 | 厦门美图之家科技有限公司 | A kind of orientation sound pick-up method and computing device based on two-microphone array |
| US10089998B1 (en) * | 2018-01-15 | 2018-10-02 | Advanced Micro Devices, Inc. | Method and apparatus for processing audio signals in a multi-microphone system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150281853A1 (en) * | 2011-07-11 | 2015-10-01 | SoundFest, Inc. | Systems and methods for enhancing targeted audibility |
| CN107123421A (en) * | 2017-04-11 | 2017-09-01 | 广东美的制冷设备有限公司 | Sound control method, device and home appliance |
| CN108962272A (en) * | 2018-06-21 | 2018-12-07 | 湖南优浪语音科技有限公司 | Sound pick-up method and system |
| CN109788382A (en) * | 2019-01-25 | 2019-05-21 | 深圳大学 | A kind of distribution microphone array pickup system and method |
-
2019
- 2019-06-17 CN CN201910524995.4A patent/CN110197671A/en active Pending
- 2019-08-21 WO PCT/CN2019/101711 patent/WO2020252886A1/en unknown
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101447190A (en) * | 2008-06-25 | 2009-06-03 | 北京大学深圳研究生院 | Voice enhancement method employing combination of nesting-subarray-based post filtering and spectrum-subtraction |
| CN102324237A (en) * | 2011-05-30 | 2012-01-18 | 深圳市华新微声学技术有限公司 | Microphone array voice wave beam formation method, speech signal processing device and system |
| CN102509552A (en) * | 2011-10-21 | 2012-06-20 | 浙江大学 | Method for enhancing microphone array voice based on combined inhibition |
| CN102831898A (en) * | 2012-08-31 | 2012-12-19 | 厦门大学 | Microphone array voice enhancement device with sound source direction tracking function and method thereof |
| CN102969002A (en) * | 2012-11-28 | 2013-03-13 | 厦门大学 | Microphone array speech enhancement device capable of suppressing mobile noise |
| CN103916723A (en) * | 2013-01-08 | 2014-07-09 | 联想(北京)有限公司 | Sound acquisition method and electronic equipment |
| CN104378570A (en) * | 2014-09-28 | 2015-02-25 | 小米科技有限责任公司 | Sound recording method and device |
| CN105679329A (en) * | 2016-02-04 | 2016-06-15 | 厦门大学 | Microphone array voice enhancing device adaptable to strong background noise |
| CN106603878A (en) * | 2016-12-09 | 2017-04-26 | 奇酷互联网络科技（深圳）有限公司 | Voice positioning method, device and system |
| CN107481729A (en) * | 2017-09-13 | 2017-12-15 | 百度在线网络技术（北京）有限公司 | A kind of method and system that intelligent terminal is upgraded to far field speech-sound intelligent equipment |
| US10089998B1 (en) * | 2018-01-15 | 2018-10-02 | Advanced Micro Devices, Inc. | Method and apparatus for processing audio signals in a multi-microphone system |
| CN108269582A (en) * | 2018-01-24 | 2018-07-10 | 厦门美图之家科技有限公司 | A kind of orientation sound pick-up method and computing device based on two-microphone array |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110769318A (en) * | 2019-09-30 | 2020-02-07 | 视联动力信息技术股份有限公司 | Control method and device for video network recording equipment |
| WO2021114953A1 (en) * | 2019-12-12 | 2021-06-17 | 华为技术有限公司 | Voice signal acquisition method and apparatus, electronic device, and storage medium |
| CN113068101A (en) * | 2021-03-16 | 2021-07-02 | Oppo广东移动通信有限公司 | Ring array pickup control method and device, storage medium and ring array |
| CN113038329A (en) * | 2021-03-22 | 2021-06-25 | 深圳市科奈信科技有限公司 | Earphone radio control method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020252886A1 (en) | 2020-12-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110197671A (en) | Orient sound pick-up method, sound pick-up outfit and storage medium | |
| CN109817236A (en) | Audio defeat method, apparatus, electronic equipment and storage medium based on scene | |
| KR101954550B1 (en) | Volume adjustment method, system and equipment, and computer storage medium | |
| KR101874895B1 (en) | Method for providing augmented reality and terminal supporting the same | |
| CN111050269A (en) | Audio processing method and electronic equipment | |
| US20210217433A1 (en) | Voice processing method and apparatus, and device | |
| US20120183164A1 (en) | Social network for sharing a hearing aid setting | |
| US9479876B2 (en) | Processor-readable medium, apparatus and method for updating a hearing aid | |
| CN113873379B (en) | Mode control method and device and terminal equipment | |
| US20210044896A1 (en) | Electronic device with audio zoom and operating method thereof | |
| CN107256139A (en) | Method of adjustment, terminal and the computer-readable recording medium of audio volume | |
| CN113873378A (en) | Earphone noise processing method and device and earphone | |
| CN107592471A (en) | A kind of high dynamic range images image pickup method and mobile terminal | |
| WO2021114953A1 (en) | Voice signal acquisition method and apparatus, electronic device, and storage medium | |
| CN105282430A (en) | Electronic device using composition information of picture and shooting method using the same | |
| CN113132863B (en) | Stereo pickup method, apparatus, terminal device, and computer-readable storage medium | |
| CN109493877A (en) | A kind of sound enhancement method and device of auditory prosthesis | |
| CN113676592B (en) | Recording method, recording device, electronic equipment and computer readable medium | |
| CN108053371A (en) | A kind of image processing method, terminal and computer readable storage medium | |
| CN115442709A (en) | Audio processing method, virtual bass enhancement system, apparatus, and storage medium | |
| CN106302974B (en) | information processing method and electronic equipment | |
| US11257511B1 (en) | Voice equalization based on face position and system therefor | |
| CN114724055A (en) | Video switching method, device, storage medium and equipment | |
| CN116668892B (en) | Audio signal processing method, electronic device and readable storage medium | |
| TWM550619U (en) | Electronic device for acquiring hearing data based on facial image recognition result |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190903 |
|
| RJ01 | Rejection of invention patent application after publication |