CN109686380A - Processing method, device and the electronic equipment of voice signal - Google Patents
Processing method, device and the electronic equipment of voice signal Download PDFInfo
- Publication number
- CN109686380A CN109686380A CN201910120548.2A CN201910120548A CN109686380A CN 109686380 A CN109686380 A CN 109686380A CN 201910120548 A CN201910120548 A CN 201910120548A CN 109686380 A CN109686380 A CN 109686380A
- Authority
- CN
- China
- Prior art keywords
- reverberation time
- reverberation
- absorption coefficient
- voice signal
- room
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
Abstract
This application involves Audiotechnica fields, and this application provides a kind of processing method of voice signal, device and electronic equipment, the processing method of the voice signal includes: the first reverberation time of measurement；Wave absorption coefficient or reflection coefficient are generated according to sound wave reflecting material；Predicted for the second reverberation time according to the first reverberation time and absorption coefficient；Or the second reverberation time was predicted according to the first reverberation time and reflection coefficient；Reverberation Rejection parameter is adjusted according to the second reverberation time.The embodiment of the present application can be directly deployed on specific electronic equipment.For different application scenarios, electronic equipment can conveniently and efficiently predict the reverberation time of ambient enviroment with lower signal transmission power, and Reverberation Rejection parameter is adjusted according to the reverberation time of prediction, improve the quality of voice signal, performance robustness of the electronic equipment under specific application scene is improved, audio experience of the user under different application scene is improved.
Description
Technical field
This application involves Audiotechnica fields, in particular to a kind of processing method of voice signal, device and electronics
Equipment.
Background technique
In the application scenarios of video conference or voice control, reverberation in environment, especially prolonged reverberation, meeting
Voice signal is reduced in the quality acoustically or in identification.But current user's audio experience under different application scene is bad.
Summary of the invention
In order to solve the problems, such as that user's audio experience is bad under different application scene, the embodiment of the present application provides a kind of language
Processing method, device and the electronic equipment of sound signal make user that can obtain good sense of hearing body under different application scene
It tests.
In a first aspect, the embodiment of the present application provides a kind of processing method of voice signal, comprising the following steps: measurement the
One reverberation time；Wave absorption coefficient or reflection coefficient are generated according to sound wave reflecting material；According to first reverberation time
Predicted for the second reverberation time with the absorption coefficient；Or according to first reverberation time and reflection coefficient prediction second
Reverberation time；Reverberation Rejection parameter is adjusted according to second reverberation time.
Wherein, described that second reverberation time was predicted according to first reverberation time and the absorption coefficient；Or according to
First reverberation time and the reflection coefficient predict that the second reverberation time included:
Utilize calculating formula:
Fit the weighted value of six face wall body absorption coefficient of room, wherein T is first reverberation time, and V is room appearance
Product, αiFor the absorption coefficient of room the i-th face wall body, wiFor absorption coefficientiWeighted value, SiFor the area of room the i-th face wall body；
By the absorption coefficient of room the i-th face wall bodyiWith the weighted value w of the absorption coefficientiMultiplication obtains the final absorption system of the i-th face wall body
Number；Second reverberation time is obtained using the final absorption coefficient of six face wall body of room.
Wherein, after the first reverberation time of the measurement further include: compensated to first reverberation time.
Wherein, described compensate to first reverberation time includes: that first reverberation time is added offset,
The offset is 8-24ms.
It wherein, include: to start to measure by touch screen or physical button reception before the first reverberation time of the measurement
The instruction of first reverberation time.
It is wherein, described that generate wave absorption coefficient or reflection coefficient according to sound wave reflecting material include: display reflected sound
Wave material information receives the reflected acoustic wave material of user's selection.
Wherein, it is described according to second reverberation time adjust Reverberation Rejection parameter include: by second reverberation time
It is divided into multiple grades；For different grades of second reverberation time, different Reverberation Rejection parameters is selected.
Wherein, first reverberation time is after indoor sound source stops sounding, needed for indoor acoustic density decaying 20dB
The time wanted；Second reverberation time is after indoor sound source stops sounding, required for indoor acoustic density decaying 60dB
Time.
Second aspect, the embodiment of the present application provide a kind of processing unit of voice signal, comprising:
Measuring unit, for measuring for the first reverberation time；
Generation unit, for generating wave absorption coefficient or reflection coefficient according to sound wave reflecting material；
Predicting unit, for predicting for the second reverberation time according to first reverberation time and the absorption coefficient；Or
For predicting for the second reverberation time according to first reverberation time and the reflection coefficient；
Adjustment unit, for adjusting Reverberation Rejection parameter according to second reverberation time.
Wherein, the predicting unit is also used to:
Utilize calculating formula:
Fit the weighted value of six face wall body absorption coefficient of room, wherein T is first reverberation time, and V is room appearance
Product, αiFor the absorption coefficient of room the i-th face wall body, wiFor absorption coefficientiWeighted value, SiFor the area of room the i-th face wall body；
By the absorption coefficient of room the i-th face wall bodyiWith the weighted value w of the absorption coefficientiMultiplication obtains the final absorption system of the i-th face wall body
Number；Second reverberation time is obtained using the final absorption coefficient of six face wall body of room.
Wherein, the processing unit of the voice signal further include: compensating unit, for being carried out to first reverberation time
Compensation.
The third aspect, the embodiment of the present application provide a kind of electronic equipment, including memory, processor and are stored in institute
The computer program that can be run in memory and on the processor is stated, the processor executes real when the computer program
The step of existing any of the above-described method.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, are stored thereon with computer journey
Sequence, when which is executed by processor the step of realization any of the above-described method.
The processing method of the embodiment of the present application voice signal has the following beneficial effects:
The embodiment of the present application provides a kind of processing method of voice signal, including measures for the first reverberation time, according to survey
First reverberation time of amount and absorption coefficient (or reflection coefficient) predicted for the second reverberation time, according to the second reverberation time tune
Whole Reverberation Rejection parameter first measures first compared with directly measuring for the second reverberation time in the prior art in the embodiment of the present application
Reverberation time, then predicted for the second reverberation time, Reverberation Rejection parameter is adjusted according to the reverberation time of prediction, to improve language
The quality of sound signal makes user that can obtain good audio experience under different application scene.
The embodiment of the present application can be directly deployed on specific electronic equipment, and can be surveyed automatically with lower transmission power
The room reverberation time is measured, the strategy parameter for inhibiting reverberation in electronic equipment is then customized according to the reverberation time of measurement, is improved
Performance robustness of the electronic equipment under specific application scene improves audio experience of the user under different application scene.
Detailed description of the invention
Fig. 1 is the schematic illustration of existing measurement reverberation time；
Fig. 2 is the processing method first pass schematic diagram of the embodiment of the present application voice signal；
Fig. 3 is the processing method second procedure schematic diagram of the embodiment of the present application voice signal；
Fig. 4 is the processing method third flow diagram of the embodiment of the present application voice signal；
Fig. 5 is the processing unit first structure diagram of the embodiment of the present application voice signal；
The processing unit third structural schematic diagram of Fig. 6 the embodiment of the present application voice signal；
Fig. 7 is the structural schematic diagram of the embodiment of the present application electronic equipment.
Specific embodiment
The application is further introduced with reference to the accompanying drawings and examples.
In following introductions, term " first ", " second " only for descriptive purposes, and should not be understood as instruction or dark
Show relative importance.Following introductions provide multiple embodiments of the application, can replace or merge between different embodiments
Combination, therefore the application is it is also contemplated that all possible combinations comprising documented identical and/or different embodiments.Thus, such as
Fruit one embodiment include feature A, B, C, another embodiment include feature B, D, then the application also should be regarded as include containing
A, the every other possible combined embodiment of one or more of B, C, D, although the embodiment may be in the following contents
In have specific literature record.
In following introductions, statement " having ", " can have ", "comprising" and " comprising " or " may include " and " can be with
Including " indicate that there are corresponding feature (for example, elements of such as numerical value, function, operation or component etc), but be not excluded for depositing
In additional feature.
In following introductions, when an element (for example, first element) is referred to as " (operation or communication) is couple to " or " connects
Be connected to " another element (for example, second element) when, other elements can be directly coupled or connected, or may exist
Intermediary element (for example, third element).On the other hand, when an element (for example, first element) referred to as " is directly coupled to "
Or when " being directly connected to " another element (for example, second element), it should be appreciated that be not present intermediary element (for example, third element).
Following description provides example, and does not carry out to range, applicability described in claims or example
Limitation.The function and arrangement of the element of description can be made a change in the case where not departing from the range of teachings herein.Respectively
Various processes or component can suitably be omitted, substitute or be added to a example.Such as described method can be with described suitable
Sequence different sequence executes, and can add, omits or combine various steps.Furthermore, it is possible to will be retouched about some examples
The feature stated is combined in other examples.
In real life, when sound wave is propagated indoors, it can be reflected by barriers such as wall, ceiling, floors, every reflection
It will once be absorbed by barrier.In this way, sound wave will pass through multiple reflections and suction indoors after sound source stops sounding
It receives, finally just disappears, after user may feel that sound source stops sounding, there are also the mixing of several sound waves to continue for some time, i.e. room
Interior sound source still has sound wave continuity phenomenon after stopping sounding, and this phenomenon is called reverberation, is called the reverberation time this period.
The reverberation time that different application scenarios need is not identical.For example, the reverberation time of music hall and arenas is than lecture
The Room will be grown.The reverberation time that different voice signals needs in Same Scene is not also identical.For example, in music hall, schwa
Happy to require to play in strongly accented rhythms, the reverberation time wants shorter, and the symphonic reverberation time will be grown.But in video conference or voice
In the application scenarios of control, reverberation in environment, especially prolonged reverberation can reduce voice signal and acoustically or know
Quality in not keeps user's audio experience bad.Therefore need to set in different application scenarios the different reverberation time with
User is set to obtain preferable experience effect.But the method and Reverberation Rejection scheme of existing measurement reverberation time can not use
Family obtains preferable experience effect under different application scenarios.
Fig. 1 is the schematic illustration of existing measurement reverberation time, as shown in Figure 1, the specific measuring process of reverberation time
It include: that audible device 11 establishes stable sound field in the environment first；It is then turned off audible device 11, the measurement letter of receiving device 12
Number die-away time to obtain the reverberation time；Finally joined according to the Reverberation Rejection scheme that the reverberation time of measurement sets application apparatus
Number.When measuring the reverberation time, existing reverberation time receiving device 12 and application apparatus are separated, mixing in measurement environment
The sound time needs the signal transmission power with higher of audible device 11 and receiving device 12 to have biggish dynamic range.It is existing
Application apparatus be difficult to meet above-mentioned two condition, cause for reverberation time measurement scheme to be directly integrated into application apparatus and be difficult to
It realizes.Therefore, existing reverberation time receiving device 12 and application apparatus are separated, and receiving device 12 can not quickly in real time
Serve promoted application apparatus properties of product.Therefore, it is necessary to one kind can be integrated in the reverberation measurement scheme of application apparatus,
To promote audio experience of the user under different application scene.
In order to solve the problems, such as that user's audio experience is bad under different application scene, the embodiment of the present application provides a kind of language
The processing method of sound signal, comprising: the first reverberation time of measurement；According to sound wave reflecting material generation wave absorption coefficient or instead
Penetrate coefficient；Predicted for the second reverberation time according to the first reverberation time and absorption coefficient；Or according to the first reverberation time and reflection
Second reverberation time of coefficient prediction；Reverberation Rejection parameter is adjusted according to the second reverberation time.
By the technical solution of the embodiment of the present application, for different application scenarios, electronic equipment can be with lower letter
Number transmission power conveniently and efficiently predicts the reverberation time of ambient enviroment, and adjusts electronic equipment according to the reverberation time of prediction
Reverberation Rejection parameter.To improve the performance robust of the quality and electronic equipment of voice signal under specific application scene
Property, make user that can obtain good audio experience under different application scene.
For the ease of the understanding of those skilled in the art, the application is by following embodiment to technical side provided by the present application
The specific implementation process of case is illustrated.
Embodiment one
Fig. 2 is the processing method first pass schematic diagram of the embodiment of the present application voice signal, as shown in Fig. 2, the application is real
The processing method of illustrative phrase sound signal is applied the following steps are included: step 101, measured for the first reverberation time；Step 102, according to sound wave
Reflecting material generates wave absorption coefficient or reflection coefficient；Step 103, according to the first reverberation time and absorption coefficient prediction the
Two reverberation time；Or the second reverberation time was predicted according to the first reverberation time and reflection coefficient；Step 104, mixed according to second
Ring time adjustment Reverberation Rejection parameter.Step 101-104 is described in detail below.
Step 101, measured for the first reverberation time.
In some embodiments, electronic equipment can measure for the first reverberation time by steady-state noise method, when the first reverberation
Between for after indoor sound source stops sounding, indoor acoustic density decays the time required for 20dB.The steady-state noise method includes: use
In the touch screen of electronic equipment or after by physical button input starting to measure the instruction of the first reverberation time, electronic equipment is first at family
A stable voice signal is established in the room；Then electronic equipment dissection voice signal opens microphone and receives the language
Sound signal, while recording the decay curve of the voice signal；Last electronic equipment passes through under voice signal in measurement decay curve
The time of drop 20dB obtained for the first reverberation time.- 5dB and -35dB two in electronic equipment general measure voice signal decay curve
Time between a level obtained for the first reverberation time.Wherein the dissection voice signal for example may include user in electronic equipment
Touch screen or by physical button input dissection voice signal instruction.The dissection voice signal for example can also include user
It is more than the preset time, the electronic equipment dissection voice signal in the preset time that electronic equipment setting voice signal plays.
In further embodiments, electronic equipment can measure the first reverberation time, the party by pulse integration response method
Method calculates the acoustic pressure attenuation function of voice signal according to the impulse response of spectrum density and tested room, finally measures acoustic pressure decaying
The time of voice signal decline 20dB obtained for the first reverberation time in function.
Step 102, wave absorption coefficient or reflection coefficient are generated according to sound wave reflecting material.
In some embodiments, user designs display screen and selection key on an electronic device.User passes through selection
Key determines the sound wave reflecting material of electronic equipment ambient enviroment.Electronic equipment is by showing that screen shows final selection knot
Fruit, and wave absorption coefficient is generated according to the sound wave reflecting material that user determines.
In further embodiments, sound wave reflecting material different in electronic equipment storage ambient enviroment and sound wave reflection
The corresponding absorption coefficient of material, and wave absorption coefficient is generated according to the sound wave reflecting material of user's selection.
In further embodiments, user designs display screen and selection key on an electronic device.User passes through choosing
Select the sound wave reflecting material that key determines electronic equipment ambient enviroment.Electronic equipment is by showing that screen shows final selection knot
Fruit, and acoustic reflection coefficient is generated according to the sound wave reflecting material that user determines.
In further embodiments, sound wave reflecting material different in electronic equipment storage ambient enviroment and sound wave reflection
The corresponding reflection coefficient of material, and acoustic reflection coefficient is generated according to the sound wave reflecting material of user's selection.
In further embodiments, the sound wave reflecting material that electronic equipment can be selected according to user generates wave absorption system
Number α, passes through calculating formula (1):
β2+ α=1 (1)
Obtain reflection coefficient β.Such as the absorption coefficient according to calculating formula (1) and the first face wall body1Obtain the first face wall body
Reflection coefficient β1。
Step 103, the second reverberation time was predicted according to the first reverberation time and absorption coefficient；Or when according to the first reverberation
Between and reflection coefficient predict the second reverberation time.
In some embodiments, for electronic equipment according to the first reverberation time, absorption coefficient and calculating formula, prediction second is mixed
Ring the time.Second reverberation time was the time required for indoor acoustic density decaying 60dB after indoor sound source stops sounding.
In further embodiments, electronic equipment is according to the first reverberation time, reflection coefficient β and calculating formula, prediction second
Reverberation time.
Step 104, Reverberation Rejection parameter is adjusted according to the second reverberation time.
In some embodiments, electronic equipment adjusts Reverberation Rejection parameter according to the second reverberation time of prediction, so as to
Family can possess good audio experience.
In further embodiments, the second reverberation time can be divided into multiple by electronic equipment according to different application demands
Grade, voice signal and different grades of second reverberation time for current electronic device, selects different Reverberation Rejections to join
Number.
The embodiment of the present application provides a kind of processing method of voice signal, by the technical solution of the embodiment of the present application,
For different application scenarios, electronic equipment can measure for the first reverberation time with lower signal transmission power, according to first
Reverberation time and absorption coefficient predicted for the second reverberation time, and adjusted Reverberation Rejection parameter according to the second reverberation time, and existing
Directly measuring for the second reverberation time in technology compares, and first measures for the first reverberation time in the embodiment of the present application, then predicts that second is mixed
The time is rung, Reverberation Rejection parameter is adjusted according to the reverberation time of prediction, to improve the quality of voice signal, user is made to exist
Different application scene can obtain good audio experience.
The embodiment of the present application can be directly deployed on specific electronic equipment, and electronic equipment is for the first time in some application environment
When middle broadcasting voice signal, can with the lower transmission power automatic measurement room reverberation time, then according to the reverberation of measurement when
Between customize electronic equipment in inhibit reverberation strategy parameter.This adjustment for specific application scene Reverberation Rejection parameter can make
The performance for obtaining Speech processing algorithm is more excellent, improves performance robustness of the electronic equipment under specific application scene,
Improve audio experience of the user under different application scene.
The embodiment of the present application can be with automatic Acquisition Environment reverberation parameters, and can pointedly adjust Speech processing side
The relevant parameter of method.The sound source audible device of electronic equipment itself can be multiplexed by the technical solution of the embodiment of the present application and is connect
Equipment is received, the cost of measurement reverberation time is reduced, improves audio experience of the user under different application scene.
Embodiment two
Fig. 3 is the processing method second procedure schematic diagram of the embodiment of the present application voice signal, as shown in figure 3, the application is real
The processing method of illustrative phrase sound signal is applied the following steps are included: step 201, measured for the first reverberation time；Step 202, according to sound wave
Reflecting material generates wave absorption coefficient or reflection coefficient；Step 203A, utilizes calculating formula:
Fitting the weighted value of six face wall body absorption coefficient of room, wherein T was the first reverberation time, and V is room volume,
αiFor the absorption coefficient of room the i-th face wall body, wiFor absorption coefficientiWeighted value, SiFor the area of room the i-th face wall body；Step
Rapid 203B, by the absorption coefficient of room the i-th face wall bodyiWith the weighted value w of the absorption coefficientiIt is final that multiplication obtains the i-th face wall body
Absorption coefficient；Step 203C obtained for the second reverberation time using the final absorption coefficient of six face wall body of room；Step 204,
Reverberation Rejection parameter is adjusted according to the second reverberation time.Wherein step 201-202,204 and step 101-102,104 basic phases
Together, step 101-102,104 are referred to.Step 203A-203C is described in detail below.
Step 203A, utilizes calculating formula:
Fitting the weighted value of six face wall body absorption coefficient of room, wherein T was the first reverberation time, and V is room volume,
αiFor the absorption coefficient of room the i-th face wall body, wiFor absorption coefficientiWeighted value, SiFor the area of room the i-th face wall body.
In some embodiments, electronic equipment generates wave absorption coefficient according to sound wave reflecting material, utilizes calculating formula
(2):
The weighted value of six face wall body absorption coefficient of room can be fitted.In calculating formula (2), according to step 201-202,
Available known quantity: T was the first reverberation time, and V is room volume, αiFor the absorption coefficient of room the i-th face wall body, SiFor room
Between the i-th face wall body area.Absorption coefficient is fitted according to known quantity and calculating formula (2)iWeighted value wi, such as according to meter
Formula (2) can be fitted to obtain the absorption coefficient of the first face wall1Weighted value w1, the absorption coefficient of the second face wall2Weighted value
w2Deng.Wherein, weighted value wiOptimum value be make the smallest weighted value w of equation the right and left difference in calculating formula (2)i。
Step 203B, by the absorption coefficient of room the i-th face wall bodyiWith the weighted value w of the absorption coefficientiMultiplication obtains i-th
The final absorption coefficient of face wall body.
In some embodiments, calculating formula (3) are utilized:
αi0=αi*ωi (3)
The final absorption coefficient of the i-th face wall body is obtained, i.e., by the absorption coefficient of room the i-th face wall bodyiWith the absorption coefficient
Weighted value wiMultiplication obtains the final absorption coefficient of the i-th face wall body, such as the absorption coefficient of the first face wall body is α10=α1*
ω1.Electronic equipment obtains the final reflection coefficient of the i-th face wall body by calculating formula (1).
Step 203C obtained for the second reverberation time using the final absorption coefficient of six face wall body of room.
In some embodiments, electronic equipment will obtain the final reflection coefficient of six face wall body of room and be brought into calculating formula
(4) shock response of t moment is calculated:
Wherein: γ=0.5772157 ...；
The first order exponential integral function of Ei () expression standard；
Indicate the average-size of three-dimensional space；
Lx,Ly,LzRespectively indicate the length, width and height of three-dimensional space；
Wherein βx,1, βx,2It is opposite
Two sides wall reflection coefficient, βy,1, βy,2For the reflection coefficient of opposite two sides wall, βz,1, βz,2For two opposite face walls
The reflection coefficient of body.
In further embodiments, electronic equipment is calculated after h (t), and h (t) is brought into calculating formula (5):
Obtain the curve that energy is decayed at any time.Based on this curve, when electronic equipment can be predicted to obtain the second reverberation
Between.
In further embodiments, electronic equipment generates the reflection coefficient β of the i-th face wall body according to sound wave reflecting materiali, lead to
Calculating formula (1) is crossed to be absorbed factor alphai, the weighted value w of room the i-th face wall body absorption coefficient is fitted using calculating formula (2)i。
After electronic equipment obtains the final absorption coefficient of the i-th face wall body using calculating formula (3), then passes through calculating formula (1) and obtain the i-th face wall
The final reflection coefficient of body finally obtained for the second reverberation time using the final reflection coefficient of six face wall body of room.
The embodiment of the present application provides a kind of processing method of voice signal, by the technical solution of the embodiment of the present application,
For different application scenarios, electronic equipment can be fitted the weighted value of six face wall body absorption coefficient of room, obtain final suction
Coefficient is received, the final absorption coefficient of six face wall body of room is recycled to obtain for the second reverberation time, with directly survey in the prior art
Two reverberation time of flow control is compared, and first measures for the first reverberation time in the embodiment of the present application, is fitted final absorption coefficient, then predict
Second reverberation time adjusted Reverberation Rejection parameter according to the reverberation time of prediction, to improve the quality of voice signal, made
User can obtain good audio experience in different application scene.
The embodiment of the present application can be directly deployed on specific electronic equipment, and electronic equipment is for the first time in some application environment
When middle broadcasting voice signal, can with the lower transmission power automatic measurement room reverberation time, then according to the reverberation of measurement when
Between customize electronic equipment in inhibit reverberation strategy parameter.This adjustment for specific application scene Reverberation Rejection parameter can make
The performance for obtaining Speech processing algorithm is more excellent, improves performance robustness of the electronic equipment under specific application scene,
Improve audio experience of the user under different application scene.
The embodiment of the present application can be with automatic Acquisition Environment reverberation parameters, and can pointedly adjust Speech processing side
The relevant parameter of method.The sound source audible device of electronic equipment itself can be multiplexed by the technical solution of the embodiment of the present application and is connect
Equipment is received, the cost of measurement reverberation time is reduced, improves audio experience of the user under different application scene.
Embodiment three
Fig. 4 is the processing method third flow diagram of the embodiment of the present application voice signal, as shown in figure 3, the application is real
The processing method of illustrative phrase sound signal is applied the following steps are included: step 301A, measured for the first reverberation time；Step 301B, to first
Reverberation time compensates；Step 302, wave absorption coefficient or reflection coefficient are generated according to sound wave reflecting material；Step
303, the second reverberation time was predicted according to the first reverberation time and absorption coefficient；Or according to the first reverberation time and reflection coefficient
Predicted for the second reverberation time；Step 304, Reverberation Rejection parameter is adjusted according to the second reverberation time.Wherein step 302-304 and step
Rapid 102-104 is essentially identical, refers to step 102-104, step 301A and the identical part of step 101, refers to step
101.Step 301B is described in detail below.
Step 301B compensated for the first reverberation time.
In some embodiments, when electronic equipment measures the first reverberation using steady-state noise method or impulse response ballistic method
Between during, due to electronic equipment performance itself, from the electronic equipment dissection voice signal to the Mike of electronic equipment
It will appear time delay between the voice signal that wind receives.Therefore electronic equipment needs mend the first reverberation time of measurement
It repays.
In further embodiments, electronic equipment is received for the first time from opening microphone to microphone and is had signal
Certain time delay is needed the first reverberation time when calculating the first final reverberation time plus offset.The offset is to beat
It opens microphone and receives time delay between voice signal for the first time to microphone, and the offset is 8-24ms.
In some embodiments, step 301B can also be executed in other steps, if after 301A and step 303 it
Before.Such as step 301B can be executed after 301A and before step 302.Such as step 301B can also be in step
It is executed after 302 and before step 303.
The embodiment of the present application provides a kind of processing method of voice signal, by the technical solution of the embodiment of the present application,
For different application scenarios, electronic equipment can be compensated for the first reverberation time, obtain the first final reverberation time,
Compared with directly measuring for the second reverberation time in the prior art, first measured for the first reverberation time in the embodiment of the present application, to first
Reverberation time compensates, then predicts for the second reverberation time, and Reverberation Rejection parameter is adjusted according to the reverberation time of prediction, thus
The quality of voice signal is improved, makes user that can obtain good audio experience in different application scene.
The embodiment of the present application can be directly deployed on specific electronic equipment, and electronic equipment is for the first time in some application environment
When middle broadcasting voice signal, can with the lower transmission power automatic measurement room reverberation time, then according to the reverberation of measurement when
Between customize electronic equipment in inhibit reverberation strategy parameter.This adjustment for specific application scene Reverberation Rejection parameter can make
The performance for obtaining Speech processing algorithm is more excellent, improves performance robustness of the electronic equipment under specific application scene,
Improve audio experience of the user under different application scene.
The embodiment of the present application can be with automatic Acquisition Environment reverberation parameters, and can pointedly adjust Speech processing side
The relevant parameter of method.The sound source audible device of electronic equipment itself can be multiplexed by the technical solution of the embodiment of the present application and is connect
Equipment is received, the cost of measurement reverberation time is reduced, improves audio experience of the user under different application scene.
Fig. 5 is the processing unit first structure diagram of the embodiment of the present application voice signal, as shown in figure 5, the application is real
The processing unit 50 for applying illustrative phrase sound signal includes: measuring unit 51, generation unit 52, predicting unit 53 and adjustment unit 54.
Measuring unit 51, for measuring for the first reverberation time.
Generation unit 52, for generating wave absorption coefficient or reflection coefficient according to sound wave reflecting material.
Predicting unit 53, for predicting for the second reverberation time according to the first reverberation time and absorption coefficient；Or it is used for root
Predicted for the second reverberation time according to the first reverberation time and reflection coefficient.
Adjustment unit 54, for adjusting Reverberation Rejection parameter according to the second reverberation time.
Wherein, predicting unit 53 is also used to utilize calculating formula:
Fitting the weighted value of six face wall body absorption coefficient of room, wherein T was the first reverberation time, and V is room volume,
αiFor the absorption coefficient of room the i-th face wall body, wiFor absorption coefficientiWeighted value, SiFor the area of room the i-th face wall body；It will
The absorption coefficient of room the i-th face wall bodyiWith the weighted value w of the absorption coefficientiMultiplication obtains the final absorption system of the i-th face wall body
Number；Obtained for the second reverberation time using the final absorption coefficient of six face wall body of room.
In this specification, for the embodiment of the processing unit of the first voice signal, since it is substantially similar to
The embodiment of the processing method of one voice signal and the processing method of the second voice signal, related place refer to the first voice letter
Number processing method and the second voice signal processing method embodiment introduction.
Fig. 6 is the processing unit third structural schematic diagram of the embodiment of the present application voice signal, as shown in fig. 6, the application is real
The processing unit 60 for applying illustrative phrase sound signal includes: measuring unit 61, generation unit 62, predicting unit 63, adjustment unit 64 and mends
Repay unit 65.
Measuring unit 61, for measuring for the first reverberation time.
Generation unit 62, for generating wave absorption coefficient or reflection coefficient according to sound wave reflecting material.
Predicting unit 63, for predicting for the second reverberation time according to the first reverberation time and absorption coefficient；Or it is used for root
Predicted for the second reverberation time according to the first reverberation time and reflection coefficient.
Adjustment unit 64, for adjusting Reverberation Rejection parameter according to the second reverberation time.
Compensating unit 65, for being compensated to the first reverberation time.
In this specification, for the embodiment of the processing unit of third voice signal, since it is substantially similar to
The embodiment of the processing method of three voice signals, the embodiment that related place refers to the processing method of third voice signal are situated between
It continues.
Fig. 7 be the embodiment of the present application electronic equipment structural schematic diagram, the electronic equipment of the application for example can for
Family provides the equipment of voice and/or data association, has the handheld device of loudspeaker and earpiece or can play audio text
The processing equipment of part.The electronic equipment of the application for example can for interactive intelligent tablet computer, mobile phone, tablet computer, personal computer,
Laptop, desktop computer, personal digital assistant (Personal Digital Assistant, PDA) etc., but be not limited to
This.As shown in fig. 7, electronic equipment 70 includes memory 71, processor 72, microphone 74 and loudspeaker 75, memory 71, processing
It is communicated between device 72, microphone 74 and loudspeaker 75 by bus 73.
In some embodiments, processor 72 for example can be single or multiple core central processing unit, or be specific collection
At circuit, or it is configured to implement one or more integrated circuits of the application.Memory 71 can be high random access
Memory (Random Access Memory, RAM), or nonvolatile memory (non-volatile memory),
A for example, at least magnetic disk storage.Memory 71 is used to store computer instruction 711, may include in computer instruction 711
Program code.
In further embodiments, loudspeaker 75 is for issuing voice signal.Microphone 74 is for receiving voice signal.Place
Device 72 is managed for measuring for the first reverberation time；Wave absorption coefficient or reflection coefficient are generated according to sound wave reflecting material；According to
First reverberation time and absorption coefficient predicted for the second reverberation time；Or according to the first reverberation time and reflection coefficient prediction second
Reverberation time；Reverberation Rejection parameter is adjusted according to the second reverberation time.
In further embodiments, processor 72 is also used to: utilize calculating formula:
Fitting the weighted value of six face wall body absorption coefficient of room, wherein T was the first reverberation time, and V is room volume,
αiFor the absorption coefficient of room the i-th face wall body, wiFor absorption coefficientiWeighted value, SiFor the area of room the i-th face wall body；It will
The absorption coefficient of room the i-th face wall bodyiWith the weighted value w of the absorption coefficientiMultiplication obtains the final absorption system of the i-th face wall body
Number；Obtained for the second reverberation time using the final absorption coefficient of six face wall body of room.
In further embodiments, processor 72 is also used to: measurement the first reverberation time after, to the first reverberation time into
Row compensation.
In further embodiments, processor 72 is also used to: being compensated to the first reverberation time, including by the first reverberation
Time adds offset, offset 8-24ms.
In further embodiments, processor 72 is also used to: before the first reverberation time of measurement, passing through touch screen or object
Reason key receives the instruction for starting to measure for the first reverberation time.
In further embodiments, processor 72 is also used to: according to sound wave reflecting material generate wave absorption coefficient or
Reflection coefficient shows reflected acoustic wave material information, receives the reflected acoustic wave material of user's selection.
In further embodiments, processor 72 is also used to: the second reverberation time was divided into multiple grades；For different etc.
Second reverberation time of grade, select different Reverberation Rejection parameters.
In further embodiments, the first reverberation time was indoor acoustic density decaying after indoor sound source stops sounding
Time required for 20dB；Second reverberation time was after indoor sound source stops sounding, needed for indoor acoustic density decaying 60dB
The time wanted.
Those skilled in the art can be understood that the technical solution of the application can be come by software and/or hardware
It realizes." unit " and " module " in this specification refers to complete independently or cooperates with other component complete specific function
Software and/or hardware, wherein hardware for example can be FPGA (Field-ProgrammaBLE Gate Array, scene can compile
Journey gate array), IC (Integrated Circuit, integrated circuit) etc..
Unit and/or module are managed everywhere in the application, can pass through the analog circuit reality of realization function described herein
It is existing, it can also be realized by executing the software of function described herein.
Present invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, which is located
Manage the step of realizing the above method when device executes.Wherein, computer readable storage medium can include but is not limited to any type
Disk, including floppy disk, CD, DVD, CD-ROM, mini drive and magneto-optic disk, ROM, RAM, EPROM, EEPROM, DRAM,
VRAM, flash memory device, magnetic or optical card, nanosystems (including molecular memory IC), or be suitable for store instruction and/
Or any kind of medium or equipment of data.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it
Its mode is realized.The apparatus embodiments described above are merely exemplary, for example, the division of the unit, only
A kind of logical function partition, there may be another division manner in actual implementation, such as: multiple units or components can combine, or
It is desirably integrated into another system, or some features can be ignored or not executed.In addition, shown or discussed each composition portion
Mutual coupling or direct-coupling or communication connection is divided to can be through some interfaces, the INDIRECT COUPLING of equipment or unit
Or communication connection, it can be electrical, mechanical or other forms.
Each functional unit in each embodiment of the application can be fully integrated in one processing unit, be also possible to each
Unit can also be integrated in one unit individually as a unit with two or more units；It is above-mentioned integrated
Unit both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
Described above is only preferred embodiment of the present application, is not intended to limit this application, for the skill of this field
For art personnel, various changes and changes are possible in this application.Within the spirit and principles of this application, made any to repair
Change, equivalent replacement, improvement etc., should be included within the scope of protection of this application.
Claims (13)
1. a kind of processing method of voice signal characterized by comprising
Measured for the first reverberation time；
Wave absorption coefficient or reflection coefficient are generated according to sound wave reflecting material；
Predicted for the second reverberation time according to first reverberation time and the absorption coefficient；Or when according to first reverberation
Between and the reflection coefficient predict the second reverberation time；
Reverberation Rejection parameter is adjusted according to second reverberation time.
2. the processing method of voice signal according to claim 1, which is characterized in that it is described according to first reverberation when
Between and the absorption coefficient predict the second reverberation time；Or according to first reverberation time and reflection coefficient prediction the
Two reverberation time included:
Utilize calculating formula:
Fit the weighted value of six face wall body absorption coefficient of room, wherein T is first reverberation time, and V is room volume, αi
For the absorption coefficient of room the i-th face wall body, wiFor absorption coefficientiWeighted value, SiFor the area of room the i-th face wall body；
By the absorption coefficient of room the i-th face wall bodyiWith the weighted value w of the absorption coefficientiMultiplication obtains the final suction of the i-th face wall body
Receive coefficient；
Second reverberation time is obtained using the final absorption coefficient of six face wall body of room.
3. the processing method of voice signal according to claim 1 or 2, which is characterized in that when the first reverberation of the measurement
Between after further include:
First reverberation time is compensated.
4. the processing method of voice signal according to claim 3, which is characterized in that described to first reverberation time
It compensates and includes:
First reverberation time is added into offset, the offset is 8-24ms.
5. the processing method of voice signal according to claim 1 or 2, which is characterized in that when the first reverberation of the measurement
Between before include:
The instruction for starting to measure first reverberation time is received by touch screen or physical button.
6. the processing method of voice signal according to claim 1 or 2, which is characterized in that described according to sound wave reflecting material
Material generates wave absorption coefficient or reflection coefficient includes:
Show reflected acoustic wave material information,
Receive the reflected acoustic wave material of user's selection.
7. the processing method of voice signal according to claim 1 or 2, which is characterized in that described mixed according to described second
Ringing time adjustment Reverberation Rejection parameter includes:
Second reverberation time is divided into multiple grades；
For different grades of second reverberation time, different Reverberation Rejection parameters is selected.
8. the processing method of voice signal according to claim 1 or 2, which is characterized in that
First reverberation time is the time required for indoor acoustic density decaying 20dB after indoor sound source stops sounding；
Second reverberation time is the time required for indoor acoustic density decaying 60dB after indoor sound source stops sounding.
9. a kind of processing unit of voice signal characterized by comprising
Measuring unit, for measuring for the first reverberation time；
Generation unit, for generating wave absorption coefficient or reflection coefficient according to sound wave reflecting material；
Predicting unit, for predicting for the second reverberation time according to first reverberation time and the absorption coefficient；Or it is used for
Predicted for the second reverberation time according to first reverberation time and the reflection coefficient；
Adjustment unit, for adjusting Reverberation Rejection parameter according to second reverberation time.
10. the processing unit of voice signal according to claim 9, which is characterized in that the predicting unit is also used to:
Utilize calculating formula:
Fit the weighted value of six face wall body absorption coefficient of room, wherein T is first reverberation time, and V is room volume, αi
For the absorption coefficient of room the i-th face wall body, wiFor absorption coefficientiWeighted value, SiFor the area of room the i-th face wall body；
By the absorption coefficient of room the i-th face wall bodyiWith the weighted value w of the absorption coefficientiMultiplication obtains the final suction of the i-th face wall body
Receive coefficient；
Second reverberation time is obtained using the final absorption coefficient of six face wall body of room.
11. the processing unit of voice signal according to claim 9, which is characterized in that the processing of the voice signal fills
It sets further include:
Compensating unit, for being compensated to first reverberation time.
12. a kind of electronic equipment, including memory, processor and storage are in the memory and can be on the processor
The computer program of operation, which is characterized in that the processor realizes the claims 1-8 when executing the computer program
Any one of the method the step of.
13. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The step of any one of claim 1-8 the method is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910120548.2A CN109686380B (en) | 2019-02-18 | 2019-02-18 | Voice signal processing method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910120548.2A CN109686380B (en) | 2019-02-18 | 2019-02-18 | Voice signal processing method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109686380A true CN109686380A (en) | 2019-04-26 |
| CN109686380B CN109686380B (en) | 2021-06-18 |
Family
ID=66196407
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910120548.2A Active CN109686380B (en) | 2019-02-18 | 2019-02-18 | Voice signal processing method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109686380B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111627460A (en) * | 2020-05-13 | 2020-09-04 | 广州国音智能科技有限公司 | Ambient reverberation detection method, device, equipment and computer readable storage medium |
| WO2023134328A1 (en) * | 2022-01-14 | 2023-07-20 | 华为技术有限公司 | Electronic device control method and apparatus, and electronic device |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110222372A1 (en) * | 2010-03-12 | 2011-09-15 | University Of Maryland | Method and system for dereverberation of signals propagating in reverberative environments |
| CN102790931A (en) * | 2011-05-20 | 2012-11-21 | 中国科学院声学研究所 | Distance sense synthetic method in three-dimensional sound field synthesis |
| CN103440869A (en) * | 2013-09-03 | 2013-12-11 | 大连理工大学 | Audio-reverberation inhibiting device and inhibiting method thereof |
| WO2014008098A1 (en) * | 2012-07-03 | 2014-01-09 | Dts, Inc. | System for estimating a reverberation time |
| CN104703111A (en) * | 2013-12-09 | 2015-06-10 | 中国科学院声学研究所 | Room reverberation synthesis method |
| US9558757B1 (en) * | 2015-02-20 | 2017-01-31 | Amazon Technologies, Inc. | Selective de-reverberation using blind estimation of reverberation level |
| CN106710602A (en) * | 2016-12-29 | 2017-05-24 | 南方科技大学 | Acoustic reverberation time estimation method and device |
| CN107071636A (en) * | 2016-12-29 | 2017-08-18 | 北京小鸟听听科技有限公司 | To the dereverberation control method and device of the equipment with microphone |
| CN107680603A (en) * | 2016-08-02 | 2018-02-09 | 电信科学技术研究院 | A kind of reverberation time method of estimation and device |
| WO2018111038A1 (en) * | 2016-12-15 | 2018-06-21 | 한양대학교 산학협력단 | Multichannel microphone-based reverberation time estimation method and device which use deep neural network |
| CN109151702A (en) * | 2018-09-21 | 2019-01-04 | 歌尔科技有限公司 | Effect adjusting method, audio frequency apparatus and the readable storage medium storing program for executing of audio frequency apparatus |
| US20190035415A1 (en) * | 2017-07-25 | 2019-01-31 | Verizon Patent And Licensing Inc. | Audio processing for speech |
-
2019
- 2019-02-18 CN CN201910120548.2A patent/CN109686380B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110222372A1 (en) * | 2010-03-12 | 2011-09-15 | University Of Maryland | Method and system for dereverberation of signals propagating in reverberative environments |
| CN102790931A (en) * | 2011-05-20 | 2012-11-21 | 中国科学院声学研究所 | Distance sense synthetic method in three-dimensional sound field synthesis |
| WO2014008098A1 (en) * | 2012-07-03 | 2014-01-09 | Dts, Inc. | System for estimating a reverberation time |
| CN103440869A (en) * | 2013-09-03 | 2013-12-11 | 大连理工大学 | Audio-reverberation inhibiting device and inhibiting method thereof |
| CN104703111A (en) * | 2013-12-09 | 2015-06-10 | 中国科学院声学研究所 | Room reverberation synthesis method |
| US9558757B1 (en) * | 2015-02-20 | 2017-01-31 | Amazon Technologies, Inc. | Selective de-reverberation using blind estimation of reverberation level |
| CN107680603A (en) * | 2016-08-02 | 2018-02-09 | 电信科学技术研究院 | A kind of reverberation time method of estimation and device |
| WO2018111038A1 (en) * | 2016-12-15 | 2018-06-21 | 한양대학교 산학협력단 | Multichannel microphone-based reverberation time estimation method and device which use deep neural network |
| CN106710602A (en) * | 2016-12-29 | 2017-05-24 | 南方科技大学 | Acoustic reverberation time estimation method and device |
| CN107071636A (en) * | 2016-12-29 | 2017-08-18 | 北京小鸟听听科技有限公司 | To the dereverberation control method and device of the equipment with microphone |
| US20190035415A1 (en) * | 2017-07-25 | 2019-01-31 | Verizon Patent And Licensing Inc. | Audio processing for speech |
| CN109151702A (en) * | 2018-09-21 | 2019-01-04 | 歌尔科技有限公司 | Effect adjusting method, audio frequency apparatus and the readable storage medium storing program for executing of audio frequency apparatus |
Non-Patent Citations (2)
| Title |
|---|
| 刘亚涛，乔晓亮，王立峰: "《测量混响时间的几种方法》", 《农家科技（下旬刊）》 * |
| 王华: "《基于最大似然估计的混响时间盲估计方法》", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111627460A (en) * | 2020-05-13 | 2020-09-04 | 广州国音智能科技有限公司 | Ambient reverberation detection method, device, equipment and computer readable storage medium |
| WO2023134328A1 (en) * | 2022-01-14 | 2023-07-20 | 华为技术有限公司 | Electronic device control method and apparatus, and electronic device |
| CN116489572A (en) * | 2022-01-14 | 2023-07-25 | 华为技术有限公司 | Electronic equipment control method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109686380B (en) | 2021-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8861742B2 (en) | Masker sound generation apparatus and program | |
| CN1671253B (en) | Test apparatus, test method, and computer program | |
| US8724821B2 (en) | Sound field controller | |
| Pelegrín-García et al. | Measurement and prediction of voice support and room gain in school classrooms | |
| CN109686380A (en) | Processing method, device and the electronic equipment of voice signal | |
| Nijs et al. | Expressing legal demands in acoustical quantities; is the reverberation time a good predictor for the speech intelligibility in a sports hall? | |
| CN109067998A (en) | Sound adjusting method, terminal device and the device with store function | |
| WO2005104610A1 (en) | Resonance frequency determining method, resonance frequency selecting method, and resonance frequency determining apparatus | |
| CN110475181A (en) | Equipment configuration method, device, equipment and storage medium | |
| Bevilacqua et al. | New method for the computation of acoustical parameters according to the updated Italian Legislation | |
| CN102680938A (en) | Human audible localization for sound emitting devices | |
| CN109168118A (en) | Reverberation detection method, device and electronic equipment | |
| Wenmaekers et al. | How orchestra members influence stage acoustic parameters on five different concert hall stages and orchestra pits | |
| CN113782002B (en) | Speech recognition testing method and system based on reverberation simulation | |
| CN113556652B (en) | Voice processing method, device, equipment and system | |
| Bradley | The evolution of newer auditorium acoustics measures | |
| Virjonen et al. | Optimized reference spectrum for rating the façade sound insulation | |
| CN102592606A (en) | Isostatic signal processing method for compensating small-space audition acoustical environment | |
| Halmrast | Acoustics in between: Perception of sound in rooms beyond standard criteria. | |
| WO2019026678A1 (en) | Information processing device, information processing method, and program | |
| Accolti et al. | Room acoustics: Idealized field and real field considerations | |
| JP7403436B2 (en) | Acoustic signal synthesis device, program, and method for synthesizing multiple recorded acoustic signals of different sound fields | |
| US20240064229A1 (en) | Speakerphone with room acoustics characterization and related methods | |
| Vos | Comments on “Influences of low-frequency energy and testing environment on annoyance responses to supersonic aircraft noise when heard indoors”[J. Acoust. Soc. Am. 148 (1), 414–429 (2020)] | |
| Woolworth | Using Realistic Test Signals to Evaluate Existing Structures for Low Frequency Sound Transmission from Clubs, Live Music Venues, Discos, and Exercise Facilities |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |