CN106875953A - Simulation remixed audio processing method and system - Google Patents
Simulation remixed audio processing method and system Download PDFInfo
- Publication number
- CN106875953A CN106875953A CN201710017653.4A CN201710017653A CN106875953A CN 106875953 A CN106875953 A CN 106875953A CN 201710017653 A CN201710017653 A CN 201710017653A CN 106875953 A CN106875953 A CN 106875953A
- Authority
- CN
- China
- Prior art keywords
- audio signal
- simulation
- audio
- sound channel
- vocal tract
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004088 simulation Methods 0.000 title claims abstract description 83
- 238000003672 processing method Methods 0.000 title claims abstract description 27
- 230000005236 sound signal Effects 0.000 claims abstract description 108
- 230000001755 vocal effect Effects 0.000 claims abstract description 28
- 238000012545 processing Methods 0.000 claims description 16
- 238000000034 method Methods 0.000 claims description 13
- 238000012546 transfer Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 2
- 230000015572 biosynthetic process Effects 0.000 claims 1
- 230000002035 prolonged effect Effects 0.000 claims 1
- 230000004044 response Effects 0.000 description 19
- 238000004422 calculation algorithm Methods 0.000 description 15
- 230000000694 effects Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 9
- 230000004888 barrier function Effects 0.000 description 8
- 230000000644 propagated effect Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000035807 sensation Effects 0.000 description 2
- 210000001367 artery Anatomy 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000006854 communication Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000004992 fission Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004080 punching Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 210000003462 vein Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/003—Changing voice quality, e.g. pitch or formants
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Mathematical Physics (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
The present invention provides a kind of simulation remixed audio processing method, and it includes：The the first sound channel original audio signal and second sound channel original audio signal that are input into are carried out respectively after LPF, and delay scheduled time section, form the first and second vocal tract analog early reflection audio signals；By the FIR filter group of multiple series connection after first sound channel and second sound channel simulation early reflection audio signal are overlapped, the first and second vocal tract analog early stage reverberant audio signals after analog obstacle thing influences on the early reflection audio signal simulated are formed；By the first and second vocal tract analog early reflection audio signals respectively by the IIR all-pass filter groups of multiple cascades, the first and second vocal tract analog late reverberation audio signals are formed；First and second sound channel original audio signals are accordingly mixed in proportion with the first and second vocal tract analog early stage reverberant audio signals, the first and second vocal tract analog late reverberation audio signals respectively, final simulation reverberant audio signal is formed.
Description
Technical field
The present invention relates to digital signal processing technique field, specifically, it is related to a kind of simulation remixed audio processing method
And system.
Background technology
Sound wave is propagated in particular space, and by the barrier roundtrip such as wall, ceiling, i.e., convenient sound source stops it
Afterwards, voice signal can still remain in space a period of time disappear phenomenon be called reverberation.Natural physics reverberation depends on sky
Between very many conditions such as size, the shape in space, the shape of barrier reflecting surface and material, the humidity of air.So will
Obtain a kind of specific reverberation effect, it is necessary to specially designed building, often or the king-sized building of scale, such as music
The places such as the Room, theatre.
Reverberation produce sound field experience can give people a kind of effect for staying certain ambient scene, though it is various game or
Various K sing show field, and user pursues complete immersion experience very much, so the reverberation effect for meeting vision environment can very great Cheng
Strengthen the experience of user on degree.
But, in common business KTV boxes, the OK a karaoke club ok phonographs of family, sedan, personal mobile phone and open air
It is do not possess the steric requirements required by nature physics reverberation in the occasions such as pull bar sound equipment and equipment.Therefore, there has been and use meter
The demand of equipment simulating acoustic reverberation phenomenon is calculated, it is special particularly after the theoretical foundation of the digitized processing of sound is improved
Reverberation algorithm be essential.
The content of the invention
To solve the above problems, the invention provides a kind of simulation remixed audio of the reverberation effect for simulating various environment
Processing method.The audio-frequency processing method includes：
LPF is carried out to the first sound channel original audio signal and second sound channel original audio signal that are input into respectively,
And after delay scheduled time section, form first vocal tract analog early reflection audio signal of the simulation after air medium is propagated
Early reflection audio signal is simulated with second sound channel；
The first vocal tract analog early reflection audio signal and second sound channel simulation early reflection audio signal are carried out
By the FIR filter group of multiple series connection after superposition, form analog obstacle thing carries out shadow to the early reflection audio signal simulated
The first vocal tract analog early stage reverberant audio signal and second sound channel simulation early stage reverberant audio signal after sound；
By the first vocal tract analog early reflection audio signal and second sound channel simulation early reflection audio signal difference
By the IIR all-pass filter groups of multiple cascades, the first vocal tract analog late reverberation audio signal and second sound channel simulation are formed
Late reverberation audio signal；
By the first sound channel original audio signal and second sound channel original audio signal accordingly respectively with the first vocal tract analog
Early stage reverberant audio signal, second sound channel simulation early stage reverberant audio signal, the first vocal tract analog late reverberation audio signal and
Second sound channel simulation late reverberation audio signal mixes in proportion, forms final simulation reverberant audio signal.
In one embodiment, simulation remixed audio processing method of the invention, it is preferred that the FIR filtering
Device group includes multiple single pole low pass filters being connected in series, and the transfer function of single pole low pass filter is as follows：
Wherein, the value of coefficient band is adjustable, and its absolute value is less than 1.
In one embodiment, simulation remixed audio processing method of the invention, it is preferred that the coefficient band
Value determined by below equation：
Wherein
fc=e[-0.595435*log(d)+10.5189]
fsIt is the sample rate of system, d is given propagation distance.
In one embodiment, simulation remixed audio processing method of the invention, it is preferred that the IIR all-pass
Wave filter group includes at least four IIR all-pass filters.
In one embodiment, simulation remixed audio processing method of the invention, it is preferred that the all-pass wave filtering
The transfer function of device is：
In one embodiment, simulation remixed audio processing method of the invention, it is preferred that by the complete of cascade
Signal after bandpass filter group is further added to simulate and is used as producing simulation late reverberation sound in early reflection audio signal
A part of input signal of frequency signal.
In one embodiment, simulation remixed audio processing method of the invention, it is preferred that in all-pass filter
In ripple device group, ratio output will be carried out again by gain amplifier by filtered each audio signal of single filter,
Wherein, gain factor is adjustable.
In one embodiment, simulation remixed audio processing method of the invention, it is preferred that in FIR filters
In ripple device group, ratio output will be carried out again by gain amplifier by each audio signal after each delayer, wherein,
Gain factor and delay parameter are adjustable.
According to another aspect of the present invention, a kind of simulation remixed audio processing system is additionally provided.The system includes：
Audio devices, it is used to produce and provide original audio signal, and is divided into according to the left and right ear for reaching listening object
First channel audio signal and second sound channel audio signal；
Simulation reverberant audio processing unit, it is used to the first initial channel audio signal and second sound channel sound that will receive
Frequency signal is carried out at audio mixing by early reflection simulaed path, later stage scattering analogue path and late reverberation analogue unit
Reason forms simulation reverberant audio signal；And
Audio output device, it is used to the simulation reverberant audio signal output that will be formed；
In one embodiment, simulation remixed audio processing system of the invention, it is preferred that the simulation reverberation
Apparatus for processing audio also includes that ambient parameter adjusts interface, and it is used to the environment according to the simulation of selected needs come described in adjusting
Parameters in simulation reverberant audio processing unit.
The present invention is advantageous in that, simulation remixed audio processing method provided by the present invention and system can be realized
Simulation reverberation space size is adjusted, the barrier parameter to being simulated is adjusted.Additionally, reverberation density and duration with
And reverberation tone color is adjustable.
Importantly, the realization of the method for the present invention both can be in the equipment of additional operating system as application journey
Sequence is used, and also is adapted for being realized using DSP in embedded device, to realize high real-time, such as various karaoke equipments, sound card
Deng.
Other features and advantages of the present invention will be illustrated in the following description, also, the partly change from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by specification, rights
Specifically noted structure is realized and obtained in claim and accompanying drawing.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the accompanying drawing wanted needed for technology description to do simple introduction：
Fig. 1 is the structured flowchart that reverberation algorithm commonly used in the prior art is realized；
Fig. 2 shows carries out the impulse response figure after reverberation using prior art；
Fig. 3 shows the flow chart that the reverberation algorithm designed according to the principle of the invention is realized；
Fig. 4 shows the structured flowchart of single pole low pass filter according to an embodiment of the invention；
Fig. 5 and Fig. 6 respectively illustrate the frequency response chart of low pass filter under different parameters；
Fig. 7 shows the FIR filter structure frame of adjustable early reflection tone color according to an embodiment of the invention
Figure；
Fig. 8 shows a kind of structured flowchart of simple all-pass filter；
Fig. 9 shows the unit impulse response figure of all-pass filter as shown in Figure 8；
Figure 10 shows a kind of structured flowchart of other systems nested in all-pass filter；
Figure 11 shows a kind of structured flowchart of nested other systems in all-pass filter of practicality；
Figure 12 shows the unit impulse response figure of all-pass filter as shown in figure 11；
Figure 13 shows the cascade structure schematic diagram of all-pass filter according to an embodiment of the invention；
Figure 14 shows the unit impulse response figure of the all-pass filter for cascading as shown in fig. 13 that；
Figure 15 shows the structured flowchart for carrying out reverberation analogue audio frequency algorithm according to one embodiment of present invention；
Figure 16 shows the unit impulse response figure of reverberation simulation algorithm as shown in figure 15, and
Figure 17 shows and provided by the present invention is used to adjust algorithm structure parameter simulate varying environment reverberation effect
Interface schematic diagram.
Specific embodiment
Describe embodiments of the present invention in detail below with reference to drawings and Examples, how the present invention is applied whereby
Technological means solves technical problem, and reaches the implementation process of technique effect and can fully understand and implement according to this.Need explanation
As long as not constituting conflict, each embodiment in the present invention and each feature in each embodiment can be combined with each other,
The technical scheme for being formed is within protection scope of the present invention.
Meanwhile, in the following description, many details are elaborated for illustrative purposes, to provide to of the invention real
Apply the thorough understanding of example.It will be apparent, however, to one skilled in the art, that the present invention can be without tool here
Body details or described ad hoc fashion are implemented.
In addition, can be in the such as one group department of computer science of computer executable instructions the step of the flow of accompanying drawing is illustrated
Performed in system, and, although logical order is shown in flow charts, but in some cases, can be with different from herein
Order perform shown or described step.
Fig. 1 shows the structured flowchart that reverberation algorithm commonly used in the prior art is realized.As shown in figure 1, left and right acoustic channels
Original audio signal is separately input to be processed in the first delay filter 101 and the second delay filter 102.Simultaneously by
Through delay output left channel audio signal feed back to the first delay filter input and the second delay filter it is defeated
Enter.These feedback signals can typically be carried out scaling or are reduced, so that it is determined that they are to simulation according to the result of debugging
The influence of audio signal.Same principle, will pass through the right channel audio signal for postponing to export and has fed back to the first delay filter
Input and the second delay filter input.
As shown in figure 1, can be by L channel original audio signal by a delayer of such as 176ms, then on year-on-year basis
Example is exported after amplifying as the audio signal of simulation reverberation all the way.L channel original audio signal for example has by one simultaneously
The more delayer of high delay time 246ms, then directly exports.
Itself is fed back simulated audio signal is influenceed when, 0.5 gain factor can be selected.Divide afterwards
The left and right acoustic channels audio signal that will not simulate passes through low pass filter (signal of such as 0-6kHz) and high-pass filter is (for example
The signal of more than 6kHz).When by high-pass filter, gain factor can select the parameter less than 1, for example select gain because
Son is 0.4, to weaken influence of the high-frequency signal to audio mixing.
The benefit of this structure shown in Fig. 1 is that the computing capability and memory space of needs are little, is easy to various calculating to set
It is standby to realize.But, this structure still suffers from very big deficiency in the effect that reverberation is simulated.
Fig. 2 shows the impulse response figure of the reverberation algorithm of this structure.As seen from the figure, its reverberation effect density
Low, granular sensation is strong, metallic sound is very big.And the algorithm does not have the interface of tone color adjustment, it is impossible to simulate each in space
Plant difference of the barrier material to the absorbability of sound wave.
Therefore, the invention provides a kind of acoustic simulation remixed audio processing method for simulating various environment.
As shown in figure 3, which show the flow chart that the reverberation algorithm designed according to the principle of the invention is realized.
In figure 3, which show the workflow of whole algorithm.The algorithm is using two-channel stereo sound audio as sharp
Encourage input.In step S301, the first sound channel original audio signal and second sound channel original audio signal to being input into respectively
Carry out after LPF, and delay scheduled time section, form first vocal tract analog morning of the simulation after air medium is propagated
Phase reflected acoustic signal and second sound channel simulation early reflection audio signal.
The step for be mainly used in simulated air communication process early reflection signal.Early reflection signal path is：
Audio signal can be by single pole low pass filter first, and the wave filter is that a low pass filter can be with analog signal in air
Strength retrogression during middle propagation.Then by being input to adder after predelay cushion space.Path representation L channel
First sound reflection, be also the primary event signal of maximum intensity.Same R channel can also experience a same structure
Treatment, but the path parameter of R channel can be inconsistent with L channel, the locus different so as to distinguish left and right acoustic channels
And propagation path.
Next, influence of the distribution of obstacles in simulation space to early reflection in step s 302.Specifically, will
First vocal tract analog early reflection audio signal and second sound channel are simulated after early reflection audio signal is overlapped by multiple
The FIR filter group of series connection, forms the first sound channel after analog obstacle thing influences on the early reflection audio signal simulated
Simulation early stage reverberant audio signal and second sound channel simulation early stage reverberant audio signal.
By left and right acoustic channels by the propagation that can be superimposed after first time space reflection, FIR filters of being connected on propagation path
Ripple device.The distribution of obstacles that just can be simulated by the parameter for adjusting the wave filter in space is combined with different barriers to sound
The absorbability of ripple signal.By adjusting the parameters of the FIR filter group, the tone color of reverberation can also be adjusted.
Then, in step S303, simulation is reverberated to the continuous of lingering sound.Specifically, by the first vocal tract analog in early days
The IIR all-pass filter groups that reflected acoustic signal and second sound channel simulation early reflection audio signal are cascaded by multiple respectively,
Form the first vocal tract analog late reverberation audio signal and second sound channel simulation late reverberation audio signal.
Due to sound by early reflection after, had split into many parts.Passed through again to the signal that early reflection is returned
The IIR all-pass filter groups for constituting in cascaded fashion are crossed, so as to sound exponentially be doubled in the way of similar fission, from
And greatly enhance the density of reverberation and the uniformity of decay.The number of IIR all-pass filters cascade can be according to the calculating selected
Platform computing capability difference does appropriate increase and decrease, and principle is to maintain more than 4.Certainly, the more reverberation of the wave filter of series connection are more intensive.
Finally, in step s 304, the influence that the distribution of obstacles in simulation space is reverberated to lingering sound.Specifically, by
One sound channel original audio signal and second sound channel original audio signal accordingly respectively with the first vocal tract analog early stage reverberant audio
Signal, second sound channel simulation early stage reverberant audio signal, the first vocal tract analog late reverberation audio signal and second sound channel simulation
Late reverberation audio signal mixes in proportion, forms final simulation reverberant audio signal.
The propagation path that barrier in space is directed to each time in fact can all produce influence.Foregoing describes why
Sample produces influence to early reflection.Influence in the present invention to lingering sound is also by being similar to what the structure of FIR filter was realized, often
The output of the IIR all-pass filters of one-level all can be aggregated into final output by a coefficient scaling, multiple IIR all-pass wave filterings
Device cascades up, and its output and corresponding coefficient can also form a bigger FIR filter of time delay span, by changing
This system is united, thus it is possible to vary the parameter such as the tone color of lingering sound and the degree of closure in space.
It is discussed in detail the implementation of each dummy run phase below.As shown in figure 4, by single-pole filter structure come
The decay that simulated sound is propagated in atmosphere.The transfer function of single pole low pass filter is as follows：
Wherein, the value of coefficient band is adjustable, and its absolute value is less than 1.As can be seen from the above equation, the wave filter has
One zero point and a limit, for the stability of system, it is necessary to assure the absolute value of band parameters is less than 1.With this understanding
Can be by the low-pass characteristic that adjusts the value of band to produce different, so as to simulate suction of the different steric requirements to voice signal
Receive.
Fig. 5 and Fig. 6 respectively illustrate the frequency response curve when band is equal to 0.2 and 0.8.
Summarized by many experiments, draw the empirical equation between propagation distance and band coefficients, such as following formula.Thus may be used
To determine band coefficients according to the space size to be simulated and generation source position, fs is the sample rate of system, and generally we make
Use 48kHz.Here, d represents given distance.
Wherein fc=e[-0.595435*log(d)+10.5189] (3)
Next, starting to simulate early reflection.Early reflection is the reflection in space than larger reflector to sound source,
Existing causality (showing as cascade connection in the structure) in reflection process, has concurrency relation (to be showed in figure again each time
It is FIR taps), as shown in Figure 7.Preferably, FIR filter group includes multiple single pole low pass filters being connected in series.
Signal strength per road is determined by the size of FIR tap coefficients TAP.If N grades of signal is s [N], the arteries and veins of its attenuation model
Punching response is h (n), and impulse response can be tried to achieve by transfer function above.N grades of tap coefficient represents with An, then total defeated
Going out can be expressed as formula：
Then simulation later stage scattering.Later stage scattering have impact on the tone color of last or end syllable, and later stage scattering is more intensive, and amplitude envelops are dull
Property more good then sense of hearing it is better, after generation the phase scattering way on use all-pass filter.Simple all-pass filter
Structure is as shown in Figure 8.
In fig. 8, if W-nIt is the k time delay of sampling, its transform (transfer function) is as follows, its unit pulse
Response is as shown in figure 9, the mould of | H (z) | is equal to 1.It follows that its frequency response is straight, so all-pass filter is,
But it can expand the copy for carrying out many signals in time domain.
However, above-mentioned simple all-pass filter e insufficient to produce scattered signal real enough.When actually used,
What is used is the improved all-pass filter on the basis of basic all-pass filter.As shown in Figure 10, it is embedding in all-pass filter
Set other systems G (z).
Overall transfer function is changed into shown in following formula after nesting.Due to being all-pass filter, so frequency response is special
Property determined by internal G (z)：
Simulation remixed audio processing method of the invention, it is preferred that IIR all-pass filters group includes at least four
IIR all-pass filters.As shown in figure 11, by after the nesting of said structure, can not only set up more close in scattering process
The sound copy of collection, and the low pass decay that the air in later stage scattering process is caused can be simulated, the transmission letter of said structure
Number H (z) is as follows,
Its unit impulse response is as shown in figure 12.
Same scattered signal can also experience multiple reflections, and it is more more arrive the path that last signal experiences, can be more intensive,
Having causality between these scattered signals has coordination, can also allow these signals to carry out tone color by a FIR filter
Adjustment.As shown in figure 13.
If N grades of signal is s [N], the impulse response of its attenuation model is h (n), and impulse response can be by above
Transfer function is tried to achieve.N grades of tap coefficient represents that then total output can be expressed as formula with tapn：
Wherein symbol represents convolution.
If driving source is unit pulse signal, the output of S2_Out, that is, the impulse response of cascade structure is such as schemed
Shown in 14.
If the signal being originally inputted is SignaIN, the signal of final output is SignalOut, then final import and export can
Represented with following formula：
SignalOut=q0*Signal+q1*S1out+q2*S2out (9)
Q0 represents the ratio of primary signal in final output signal, when the recipient of simulated sound is also simultaneously the hair of sound
The person's of going out such case, q0 is not 0, because some signal is conducted by body, other situations value is 0.Q1 is represented
The ratio of early stage reverberation, q2 represents the ratio of later stage scattered signal.
As shown in figure 15, which show the detailed algorithm knot that principle of the invention is simulated remixed audio treatment
Structure block diagram.
Figure 16 shows the impulse response figure of the algorithm structure of Figure 15, and it is employ six IIR all-pass filters mixed
Ring the unit impulse response of algorithm.From the simulated effect figure, for being compared with the prior art, reverberation effect of the invention is close
The metallic sound that degree is high, granular sensation is small and weak and weakens, therefore the reverberation effect of simulation is more true to nature and comfortable.
Additionally, as shown in Figure 15, simulation remixed audio processing method of the invention, by the all-pass filter for cascading
Signal after group is further also added to simulate and is used as producing simulation late reverberation audio signal in early reflection audio signal
A part of input signal.
And, in all-pass filter group, will be by filtered each audio signal of single filter again by increasing
Beneficial amplifier carries out ratio output, and gain factor therein is adjustable parameter.
In one embodiment, simulation remixed audio processing method of the invention, it is preferred that in FIR filters
In ripple device group, ratio output will be carried out again by gain amplifier by each audio signal after each delayer, wherein,
Gain factor and delay parameter are adjustable.
Present invention also offers for changing these parameters to change the interface of simulated environment, as shown in figure 17.Its
In provide such as various environment such as cubicle, bathroom, big room, gymnasium, hall, church, valley under analog parameter
Selection.Therefore, can be realized being adjusted simulation reverberation space size according to the present invention, the barrier parameter to being simulated is entered
Row regulation.Additionally, reverberation density and duration and reverberation tone color are adjustable.
Because the method for the present invention describes what is realized in computer systems.The computer system can for example be set
In control core processor.For example, method described herein can be implemented as the software that can be performed with control logic, its by
CPU in control system is performed.Function as herein described can be implemented as storage in readable Jie of non-transitory tangible computer
Programmed instruction set in matter.When implemented in this fashion, the computer program includes one group of instruction, when group instruction is by counting
It promotes computer to perform the method that can implement above-mentioned functions when calculation machine runs.FPGA can be installed temporarily or permanently
In non-transitory tangible computer computer-readable recording medium, such as ROM chip, computer storage, disk or other storages
Medium.In addition to being realized with software, logic as herein described can utilize discrete parts, integrated circuit and FPGA
The FPGA that equipment (such as, field programmable gate array (FPGA) or microprocessor) is used in combination, or including them
Any other equipment of any combination embodies.All such embodiments are intended to fall under within the scope of the present invention.
According to another aspect of the present invention, a kind of simulation remixed audio processing system is additionally provided.The system includes：
Audio devices, it is used to produce and provide original audio signal, and is divided into according to the left and right ear for reaching listening object
First channel audio signal and second sound channel audio signal；
Simulation reverberant audio processing unit, it is used to the first initial channel audio signal and second sound channel sound that will receive
Frequency signal is carried out at audio mixing by early reflection simulaed path, later stage scattering analogue path and late reverberation analogue unit
Reason forms simulation reverberant audio signal；And
Audio output device, it is used to the simulation reverberant audio signal output that will be formed；
In one embodiment, simulation remixed audio processing system of the invention, it is preferred that the simulation reverberation
Apparatus for processing audio also includes that ambient parameter adjusts interface, and it is used to the environment according to the simulation of selected needs come described in adjusting
Parameters in simulation reverberant audio processing unit.
The present invention is advantageous in that, simulation remixed audio processing method provided by the present invention and system can be realized
Simulation reverberation space size is adjusted, the barrier parameter to being simulated is adjusted.Additionally, reverberation density and duration with
And reverberation tone color is adjustable.
What is more important, the realization of the method for the present invention can both be used in conduct application in the equipment of additional operating system
Program is used, and also is adapted for being realized using DSP in embedded device, to realize high real-time, such as various karaoke equipments, sound
Card etc..
It should be understood that disclosed embodiment of this invention is not limited to ad hoc structure disclosed herein or treatment step
Suddenly, the equivalent substitute of these features that those of ordinary skill in the related art are understood should be extended to.It should also be understood that
It is that term as used herein is only used for describing the purpose of specific embodiment, and is not intended to limit.
" one embodiment " or " embodiment " mentioned in specification means special characteristic, the structure for describing in conjunction with the embodiments
Or characteristic is included at least one embodiment of the present invention.Therefore, the phrase " reality that specification various places throughout occurs
Apply example " or " embodiment " same embodiment might not be referred both to.
Although above-mentioned example is used to illustrate principle of the present invention in one or more applications, for the technology of this area
For personnel, in the case of without departing substantially from principle of the invention and thought, hence it is evident that can in form, the details of usage and implementation
It is upper various modifications may be made and without paying creative work.Therefore, the present invention is defined by the appended claims.
Claims (10)
1. it is a kind of to simulate remixed audio processing method, it is characterised in that methods described includes：
LPF is carried out to the first sound channel original audio signal and second sound channel original audio signal that are input into respectively, and is prolonged
After slow predetermined amount of time, simulation is formed by the first vocal tract analog early reflection audio signal after air medium propagation and the
Two vocal tract analog early reflection audio signals；
The first vocal tract analog early reflection audio signal and second sound channel simulation early reflection audio signal are overlapped
Afterwards by the FIR filter group of multiple series connection, after formation analog obstacle thing influences on the early reflection audio signal simulated
The first vocal tract analog early stage reverberant audio signal and second sound channel simulation early stage reverberant audio signal；
The first vocal tract analog early reflection audio signal and second sound channel simulation early reflection audio signal are passed through respectively
The IIR all-pass filter groups of multiple cascade, form the first vocal tract analog late reverberation audio signal and second sound channel simulation later stage
Reverberant audio signal；
By the first sound channel original audio signal and second sound channel original audio signal accordingly respectively with the first vocal tract analog in early days
Reverberant audio signal, second sound channel simulation early stage reverberant audio signal, the first vocal tract analog late reverberation audio signal and second
Vocal tract analog late reverberation audio signal mixes in proportion, forms final simulation reverberant audio signal.
2. it is as claimed in claim 1 to simulate remixed audio processing method, it is characterised in that the FIR filter group includes many
The individual single pole low pass filter being connected in series, the transfer function of single pole low pass filter is as follows：
Wherein, the value of coefficient band is adjustable, and its absolute value is less than 1.
3. simulation remixed audio processing method as claimed in claim 2, it is characterised in that the value of the coefficient band by with
Lower formula determines：
Wherein
fc=e[-0.595435*log(d)+10.5189]
fsIt is the sample rate of system, d is given propagation distance.
4. it is as claimed in claim 1 to simulate remixed audio processing method, it is characterised in that the IIR all-pass filters group bag
Include at least four IIR all-pass filters.
5. it is as claimed in claim 4 to simulate remixed audio processing method, it is characterised in that the transmission letter of the all-pass filter
Number is：
6. the simulation remixed audio processing method as any one of claim 1-5, it is characterised in that by the complete of cascade
Signal after bandpass filter group is further added to simulate and is used as producing simulation late reverberation sound in early reflection audio signal
A part of input signal of frequency signal.
7. the simulation remixed audio processing method as any one of claim 1-5, it is characterised in that in all-pass filter
In ripple device group, ratio output will be carried out again by gain amplifier by filtered each audio signal of single filter,
Wherein, gain factor is adjustable.
8. the simulation remixed audio processing method as any one of claim 1-5, it is characterised in that in FIR filters
In ripple device group, ratio output will be carried out again by gain amplifier by each audio signal after each delayer, wherein,
Gain factor and delay parameter are adjustable.
9. it is a kind of to simulate remixed audio processing system, it is characterised in that the system includes：
Audio devices, it is used to produce and provide original audio signal, and is divided into first according to the left and right ear for reaching listening object
Channel audio signal and second sound channel audio signal；
Simulation reverberant audio processing unit, it is used to the first initial channel audio signal and second sound channel the audio letter that will be received
Number by early reflection simulaed path, later stage scattering analogue path and late reverberation analogue unit carry out audio mixing process shape
Into simulation reverberant audio signal；And
Audio output device, it is used to the simulation reverberant audio signal output that will be formed.
10. it is as claimed in claim 9 to simulate remixed audio processing system, it is characterised in that the simulation reverberant audio treatment
Device also includes that ambient parameter adjusts interface, and it is used to the environment according to the simulation of selected needs to adjust the simulation reverberation
Parameters in apparatus for processing audio.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710017653.4A CN106875953B (en) | 2017-01-11 | 2017-01-11 | Method and system for processing analog mixed sound audio |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710017653.4A CN106875953B (en) | 2017-01-11 | 2017-01-11 | Method and system for processing analog mixed sound audio |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106875953A true CN106875953A (en) | 2017-06-20 |
| CN106875953B CN106875953B (en) | 2020-10-13 |
Family
ID=59157395
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710017653.4A Active CN106875953B (en) | 2017-01-11 | 2017-01-11 | Method and system for processing analog mixed sound audio |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106875953B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107281753A (en) * | 2017-06-21 | 2017-10-24 | 网易（杭州）网络有限公司 | Scene audio reverberation control method and device, storage medium and electronic equipment |
| CN110189740A (en) * | 2019-06-24 | 2019-08-30 | 上海矽诺微电子有限公司 | Reverberation circuit and its control method, chip and device |
| CN112150992A (en) * | 2020-09-27 | 2020-12-29 | 长沙幻音电子科技有限公司 | Tone simulation method, system and device for plucked musical instrument and computer equipment |
| CN112153535A (en) * | 2020-09-03 | 2020-12-29 | Oppo（重庆）智能科技有限公司 | Sound field expansion method, circuit, electronic equipment and storage medium |
| CN112652290A (en) * | 2020-12-14 | 2021-04-13 | 北京达佳互联信息技术有限公司 | Method for generating reverberation audio signal and training method of audio processing model |
| RU2762879C1 (en) * | 2020-02-19 | 2021-12-23 | Ямаха Корпорейшн | Audio signal processing method and audio signal processing device |
| CN116193322A (en) * | 2023-04-25 | 2023-05-30 | 南京芯驰半导体科技有限公司 | Audio processing circuit, method, electronic device and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1294782A (en) * | 1998-03-25 | 2001-05-09 | 雷克技术有限公司 | Audio signal processing method and appts. |
| CN1719512A (en) * | 2005-07-15 | 2006-01-11 | 北京中星微电子有限公司 | Digital audio frequency reverberation simulation system |
| CN101136197A (en) * | 2007-10-16 | 2008-03-05 | 得理微电子（上海）有限公司 | Digital reverberation processor based on time-varying delay-line |
| CN101661746A (en) * | 2008-08-29 | 2010-03-03 | 三星电子株式会社 | Digital audio sound reverberator and digital audio reverberation method |
| CN101964190A (en) * | 2009-07-24 | 2011-02-02 | 敦泰科技(深圳)有限公司 | Method and device for restoring signal under speaker cut-off frequency to original sound |
| CN102523553A (en) * | 2012-01-29 | 2012-06-27 | 昊迪移通(北京)技术有限公司 | Holographic audio method and device for mobile terminal equipment based on sound source contents |
| CN105519139A (en) * | 2013-07-22 | 2016-04-20 | 弗朗霍夫应用科学研究促进协会 | Method for processing an audio signal; signal processing unit, binaural renderer, audio encoder and audio decoder |
| CN106303789A (en) * | 2016-10-31 | 2017-01-04 | 维沃移动通信有限公司 | A kind of way of recording, earphone and mobile terminal |
-
2017
- 2017-01-11 CN CN201710017653.4A patent/CN106875953B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1294782A (en) * | 1998-03-25 | 2001-05-09 | 雷克技术有限公司 | Audio signal processing method and appts. |
| CN1719512A (en) * | 2005-07-15 | 2006-01-11 | 北京中星微电子有限公司 | Digital audio frequency reverberation simulation system |
| CN101136197A (en) * | 2007-10-16 | 2008-03-05 | 得理微电子（上海）有限公司 | Digital reverberation processor based on time-varying delay-line |
| CN101661746A (en) * | 2008-08-29 | 2010-03-03 | 三星电子株式会社 | Digital audio sound reverberator and digital audio reverberation method |
| CN101964190A (en) * | 2009-07-24 | 2011-02-02 | 敦泰科技(深圳)有限公司 | Method and device for restoring signal under speaker cut-off frequency to original sound |
| CN102523553A (en) * | 2012-01-29 | 2012-06-27 | 昊迪移通(北京)技术有限公司 | Holographic audio method and device for mobile terminal equipment based on sound source contents |
| CN105519139A (en) * | 2013-07-22 | 2016-04-20 | 弗朗霍夫应用科学研究促进协会 | Method for processing an audio signal; signal processing unit, binaural renderer, audio encoder and audio decoder |
| CN106303789A (en) * | 2016-10-31 | 2017-01-04 | 维沃移动通信有限公司 | A kind of way of recording, earphone and mobile terminal |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107281753A (en) * | 2017-06-21 | 2017-10-24 | 网易（杭州）网络有限公司 | Scene audio reverberation control method and device, storage medium and electronic equipment |
| CN107281753B (en) * | 2017-06-21 | 2020-10-23 | 网易（杭州）网络有限公司 | Scene sound effect reverberation control method and device, storage medium and electronic equipment |
| CN110189740A (en) * | 2019-06-24 | 2019-08-30 | 上海矽诺微电子有限公司 | Reverberation circuit and its control method, chip and device |
| RU2762879C1 (en) * | 2020-02-19 | 2021-12-23 | Ямаха Корпорейшн | Audio signal processing method and audio signal processing device |
| US11546717B2 (en) | 2020-02-19 | 2023-01-03 | Yamaha Corporation | Sound signal processing method and sound signal processing device |
| US11895485B2 (en) | 2020-02-19 | 2024-02-06 | Yamaha Corporation | Sound signal processing method and sound signal processing device |
| CN112153535A (en) * | 2020-09-03 | 2020-12-29 | Oppo（重庆）智能科技有限公司 | Sound field expansion method, circuit, electronic equipment and storage medium |
| WO2022048376A1 (en) * | 2020-09-03 | 2022-03-10 | Oppo广东移动通信有限公司 | Sound field expansion method and circuit, electronic device, and storage medium |
| CN112153535B (en) * | 2020-09-03 | 2022-04-08 | Oppo广东移动通信有限公司 | Sound field expansion method, circuit, electronic equipment and storage medium |
| CN112150992A (en) * | 2020-09-27 | 2020-12-29 | 长沙幻音电子科技有限公司 | Tone simulation method, system and device for plucked musical instrument and computer equipment |
| CN112652290A (en) * | 2020-12-14 | 2021-04-13 | 北京达佳互联信息技术有限公司 | Method for generating reverberation audio signal and training method of audio processing model |
| CN116193322A (en) * | 2023-04-25 | 2023-05-30 | 南京芯驰半导体科技有限公司 | Audio processing circuit, method, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106875953B (en) | 2020-10-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106875953A (en) | Simulation remixed audio processing method and system | |
| US8670570B2 (en) | Environmental effects generator for digital audio signals | |
| KR101627652B1 (en) | An apparatus and a method for processing audio signal to perform binaural rendering | |
| US8126172B2 (en) | Spatial processing stereo system | |
| CN102638757B (en) | Generate and control the method and system of the digital reverberation for audio signal | |
| CN105900457A (en) | Methods and systems for designing and applying numerically optimized binaural room impulse responses | |
| US6917686B2 (en) | Environmental reverberation processor | |
| CN107835483B (en) | Generating binaural audio by using at least one feedback delay network in response to multi-channel audio | |
| CN111065041B (en) | Generating binaural audio by using at least one feedback delay network in response to multi-channel audio | |
| CN102440003A (en) | Audio spatialization and environment simulation | |
| TW200833158A (en) | Simulation of acoustic obstruction and occlusion | |
| CN104581610A (en) | Virtual stereo synthesis method and device | |
| EP4205103B1 (en) | Method for generating a reverberation audio signal | |
| CN101516055B (en) | Method and device capable of simulating three-dimensional echo sound effect in different acoustic environments | |
| WO2007040315A1 (en) | Method and apparatus to generate spatial sound | |
| CN108040317A (en) | A kind of hybrid sense of hearing sound field broadening method | |
| CN110853661B (en) | Artificial reverberation generation device and method | |
| CN102523553B (en) | Holographic audio method and device for mobile terminal equipment based on sound source contents | |
| Meacham et al. | Auralization of a hybrid sound field using a wave-stress tensor based model | |
| James | A classification of multi-point spectral sound shapes | |
| Xia et al. | A hybrid approach for reverberation simulation | |
| Szwec | Reverberation | |
| Giesbrecht et al. | Algorithmic Reverberation | |
| Bai et al. | Comparative study of optimal design strategies of reverberators | |
| Balik | Optimized structure for multichannel digital reverberation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 518055 2201, 2202, 2203, 2204, 2205, block a, building 8, Shenzhen International Innovation Valley, Dashi 1st Road, Xili community, Nanshan District, Shenzhen City, Guangdong Province Patentee after: SHENZHEN CHUANGCHENG MICROELECTRONICS Co.,Ltd. Address before: 518055 3rd floor, building 5, Dayuan industrial North District, Pingshan 1st Road, Xili University Town, Nanshan District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN CHUANGCHENG MICROELECTRONICS Co.,Ltd. |