CN108600936A - Multichannel audio processing method, device, computer readable storage medium and terminal - Google Patents
Multichannel audio processing method, device, computer readable storage medium and terminal Download PDFInfo
- Publication number
- CN108600936A CN108600936A CN201810356544.XA CN201810356544A CN108600936A CN 108600936 A CN108600936 A CN 108600936A CN 201810356544 A CN201810356544 A CN 201810356544A CN 108600936 A CN108600936 A CN 108600936A
- Authority
- CN
- China
- Prior art keywords
- audio
- pending
- multichannel
- mode instruction
- frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 238000003860 storage Methods 0.000 title claims abstract description 19
- 238000012545 processing Methods 0.000 claims abstract description 265
- 230000001052 transient effect Effects 0.000 claims description 102
- 230000008859 change Effects 0.000 claims description 53
- 238000000034 method Methods 0.000 claims description 40
- 238000005070 sampling Methods 0.000 claims description 14
- 230000000694 effects Effects 0.000 abstract description 61
- 238000010586 diagram Methods 0.000 description 15
- 238000009527 percussion Methods 0.000 description 10
- 238000001514 detection method Methods 0.000 description 8
- 238000011282 treatment Methods 0.000 description 8
- 230000008901 benefit Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 6
- 238000011269 treatment regimen Methods 0.000 description 6
- 239000002131 composite material Substances 0.000 description 5
- 238000001228 spectrum Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000004904 shortening Methods 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000008602 contraction Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 230000003313 weakening effect Effects 0.000 description 2
- 238000012952 Resampling Methods 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/307—Frequency adjustment, e.g. tone control
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/003—Changing voice quality, e.g. pitch or formants
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The present invention discloses a kind of multichannel audio processing method, multichannel audio processing unit, multichannel audio processing hardware device, computer readable storage medium and multichannel audio processing terminal.Wherein, which includes obtaining pending multichannel audio;Obtain audio processing parameters;Based on audio processing parameters, pending multichannel audio is handled.The embodiment of the present invention is by taking the technical solution, it can be according to audio processing parameters, pending multichannel audio is handled accordingly, it is possible thereby to corresponding audio frequency effect be obtained according to different audio processing parameters, to solve the technical issues of how improving user experience effect.
Description
Technical field
The present invention relates to a kind of Audiotechnica fields, more particularly to a kind of multichannel audio processing method, device, calculating
Machine readable storage medium storing program for executing and terminal.
Background technology
With the prevalence of audio interaction, the audio information transmitting carrier as this interaction more and more.In order to obtain
Good Interactive Experience effect, user start to increasingly focus on the experience effect of audio.
Currently, the prior art is generally handled for monophonic audio.For multichannel audio, since processing is single
There is no consider each channel audio in multichannel audio to the method for channel audio.Therefore, user can not be directed to more sound
Channel audio is adjusted, to obtain preferably experience effect.
In this regard, a kind of multichannel audio processing method can get good user experience effect of offer is the skill of urgent need to resolve
Art problem.
Invention content
The technical problem to be solved by the present invention is to provide a kind of multichannel audio processing method, with solve at least partly how
The technical issues of improving user experience effect.In addition, it is hard also to provide a kind of multichannel audio processing unit, multichannel audio processing
Part device, computer readable storage medium and multichannel audio processing terminal.
To achieve the goals above, according to an aspect of the present invention, following technical scheme is provided:
A kind of multichannel audio processing method, including:
Obtain pending multichannel audio;
Obtain audio processing parameters;
Based on the audio processing parameters, the pending multichannel audio is handled.
Further, the step of acquisition audio processing parameters, including:
When receiving audio mode instruction, obtain and corresponding, the described pending multichannel of audio mode instruction
The audio processing parameters of audio.
Further, the audio mode instruction is that modes of deflection instructs;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving the modes of deflection instruction, obtain corresponding, described pending more with modes of deflection instruction
The audio envelope of channel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Adjust the audio envelope of the pending multichannel audio.
Further, the step of audio envelope of the adjustment pending multichannel audio specifically includes:
Adjust the fundamental frequency and formant of the pending multichannel audio.
Further, the audio mode instruction is holding mode instruction;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving the holding mode instruction, obtain corresponding with the holding mode instruction, described pending more
The audio envelope and fundamental frequency of channel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
In the case where keeping the audio envelope, the fundamental frequency is adjusted.
Further, the audio mode instruction is clear and melodious mode instruction;
It is described when receive audio mode instruction when, obtain it is corresponding, described pending more with audio mode instruction
The step of audio processing parameters of channel audio, including:
When receiving clear and melodious mode instruction, pending multichannel corresponding with the clear and melodious mode instruction, described is obtained
The transient pulse of audio and audio frequency phase;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
The phase of the transient pulse is set as zero in the full frequency-domain of the pending multichannel audio, alternatively,
The phase of the transient pulse is set as zero in the full frequency-domain of the pending multichannel audio, and to the transient pulse
Amplitude is limited;
Set the audio frequency phase to preset value.
Further, the audio mode instruction is that smooth mode instructs;
It is described when receive audio mode instruction when, obtain it is corresponding, described pending more with audio mode instruction
The step of audio processing parameters of channel audio, including:
When receiving the smooth mode instruction, obtain corresponding, described pending more with smooth mode instruction
The transient pulse of channel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Based on the transient pulse, in the frequency domain of the pending multichannel audio, to transient state in scheduled frequency range
The amplitude of frequency domain corresponding to pulse is smoothed.
Further, the audio mode instruction is that velocity mode instructs;
It is described when receive audio mode instruction when, obtain it is corresponding, described pending more with audio mode instruction
The step of audio processing parameters of channel audio, including:
When receiving the velocity mode instruction, obtain corresponding, described pending more with velocity mode instruction
The scheduled sample rate and formant or fundamental frequency of channel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Down-sampling is carried out to the pending multichannel audio according to scheduled sample rate;
The formant of the pending multichannel audio is smoothed;Alternatively,
Adjust the fundamental frequency of the pending multichannel audio.
Further, the audio mode instruction is sound quality mode instruction;
It is described when receive audio mode instruction when, obtain it is corresponding, described pending more with audio mode instruction
The step of audio processing parameters of channel audio, including:
When receiving the sound quality mode instruction, obtain corresponding with the sound quality mode instruction, described pending more
The transient pulse of channel audio, fundamental frequency, formant;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
The transient pulse of the smooth pending multichannel audio and the formant in real time;
The fundamental frequency of the pending multichannel audio is adjusted in real time.
Further, the audio mode instruction is that across frequency band smooth mode instructs;
It is described when receive audio mode instruction when, obtain it is corresponding, described pending more with audio mode instruction
The step of audio processing parameters of channel audio, including:
When receiving across the frequency band smooth mode instruction, obtain it is corresponding with across the frequency band smooth mode instruction,
The audio frequency phase of the pending multichannel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Based on the audio frequency phase, the phase at least two frequency bands of the pending multichannel audio is carried out smooth
Processing.
Further, the audio mode instruction is smooth mode instruction in subband;
It is described when receive audio mode instruction when, obtain it is corresponding, described pending more with audio mode instruction
The step of audio processing parameters of channel audio, including:
When receiving in the subband smooth mode and instructing, obtain it is corresponding with smooth mode instruction in the subband,
The audio frequency phase of the pending multichannel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Based on the audio frequency phase, the phase in the subband of any frequency band of the pending multichannel audio is put down
Sliding processing.
Further, the audio mode instruction is speed-variation without tone mode instruction;
It is described when receive audio mode instruction when, obtain it is corresponding, described pending more with audio mode instruction
The step of audio processing parameters of channel audio, including:
When receiving the speed-variation without tone mode instruction, obtain it is corresponding with the speed-variation without tone mode instruction,
The audio duration of the pending multichannel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
The audio duration of the pending multichannel audio shorten or extension is handled.
Further, for modified tone, speed change pattern does not instruct for the audio mode instruction;
It is described when receive audio mode instruction when, obtain it is corresponding, described pending more with audio mode instruction
The step of audio processing parameters of channel audio, including:
When receive it is described modified tone not speed change pattern instruct when, obtain with it is described modify tone not speed change pattern instruction it is corresponding,
The fundamental frequency of the pending multichannel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Adjust the fundamental frequency of the pending multichannel audio.
Further, the audio mode instruction is modified tone speed change pattern instruction;
It is described when receive audio mode instruction when, obtain it is corresponding, described pending more with audio mode instruction
The step of audio processing parameters of channel audio, including:
When receiving the modified tone speed change pattern instruction, obtain corresponding, described with the modified tone speed change pattern instruction
The audio duration and fundamental frequency of pending multichannel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
The audio duration shorten or extension is handled;
Adjust the fundamental frequency.
To achieve the goals above, according to another aspect of the present invention, following technical scheme is also provided:
A kind of multichannel audio processing unit, including:
First acquisition module, for obtaining pending multichannel audio;
Second acquisition module, for obtaining audio processing parameters;
Processing module is handled the pending multichannel audio for being based on the audio processing parameters.
Further, the second acquisition module is additionally operable to, when receiving audio mode instruction, obtain and the audio mode
Instruct the audio processing parameters of corresponding, the described pending multichannel audio.
Further, the audio mode instruction is that modes of deflection instructs;
Second acquisition module is specifically used for, when receiving the modes of deflection instruction, obtaining and the modes of deflection
Instruct the audio envelope of corresponding, the described pending multichannel audio;
The processing module is specifically used for adjusting the audio envelope of the pending multichannel audio.
Further, the processing module is specifically used for adjusting the fundamental frequency and resonance of the pending multichannel audio
Peak.
Further, the audio mode instruction is holding mode instruction;
Second acquisition module is specifically used for when receiving the holding mode instruction, obtains and the holding pattern
Instruct the audio envelope and fundamental frequency of corresponding, the described pending multichannel audio;
The processing module is specifically used in the case where keeping the audio envelope, adjusts the fundamental frequency.
Further, the audio mode instruction is clear and melodious mode instruction;
Second acquisition module is specifically used for when receiving clear and melodious mode instruction, obtains and the clear and melodious mode instruction
The transient pulse of corresponding, the described pending multichannel audio and audio frequency phase;
The processing module is specifically used for the transient pulse in the full frequency-domain of the pending multichannel audio
Phase is set as zero, alternatively, setting the phase of the transient pulse in the full frequency-domain of the pending multichannel audio
Zero, and the amplitude of the transient pulse is limited, and set the audio frequency phase to preset value.
Further, the audio mode instruction is that smooth mode instructs;
Second acquisition module is specifically used for, when receiving the smooth mode instruction, obtaining and the smooth mode
Instruct the transient pulse of corresponding, the described pending multichannel audio;
The processing module is specifically used for being based on the transient pulse, in the frequency domain of the pending multichannel audio,
The amplitude of frequency domain corresponding to transient pulse in scheduled frequency range is smoothed.
Further, the audio mode instruction is that velocity mode instructs;
Second acquisition module is specifically used for, when receiving the velocity mode instruction, obtaining and the velocity mode
Instruct the scheduled sample rate and formant or fundamental frequency of corresponding, the described pending multichannel audio;
The processing module is specifically used for carrying out down-sampling to the pending multichannel audio according to scheduled sample rate;
Also, the formant of the pending multichannel audio is smoothed;Alternatively, the adjustment pending multichannel
The fundamental frequency of audio.
Further, the audio mode instruction is sound quality mode instruction;
Second acquisition module is specifically used for when receiving the sound quality mode instruction, obtains and the sound quality pattern
Instruct the transient pulse of corresponding, the described pending multichannel audio, fundamental frequency, formant;
The processing module is specifically used for the transient pulse of the smooth pending multichannel audio in real time and described
Formant, and the fundamental frequency of the pending multichannel audio is adjusted in real time.
Further, the audio mode instruction is that across frequency band smooth mode instructs;
Second acquisition module is specifically used for when receiving across the frequency band smooth mode instruction, obtain with it is described across
Frequency band smooth mode instructs the audio frequency phase of corresponding, the described pending multichannel audio;
The processing module is specifically used for being based on the audio frequency phase, at least two of the pending multichannel audio
Phase in frequency band is smoothed.
Further, the audio mode instruction is smooth mode instruction in subband;
Second acquisition module is specifically used for, when receiving smooth mode instruction in the subband, obtaining and the son
The audio frequency phase of corresponding, the described pending multichannel audio is instructed with interior smooth mode;
The processing module is specifically used for being based on the audio frequency phase, to any frequency band of the pending multichannel audio
Subband in phase be smoothed.
Further, the audio mode instruction is speed-variation without tone mode instruction;
Second acquisition module is specifically used for when receiving the speed-variation without tone mode instruction, obtains and the change
The audio duration of corresponding, the described pending multichannel audio of fast invariable tone mode instruction;
The processing module to the audio duration of the pending multichannel audio shorten or extension is handled.
Further, for modified tone, speed change pattern does not instruct for the audio mode instruction;
Second acquisition module is specifically used for, when receiving the modified tone not speed change pattern instruction, obtaining and the change
Adjust not speed change pattern instruct the fundamental frequency of corresponding, the described pending multichannel audio;
The processing module is specifically used for adjusting the fundamental frequency of the pending multichannel audio.
Further, the audio mode instruction is modified tone speed change pattern instruction;
Second acquisition module is specifically used for, when receiving the modified tone speed change pattern instruction, obtaining and the modified tone
Speed change pattern instructs the audio duration and fundamental frequency of corresponding, the described pending multichannel audio;
The processing module is specifically used for the audio duration shorten or extension is handled, and adjusts the fundamental frequency.
To achieve the goals above, according to a further aspect of the invention, following technical scheme is also provided:
A kind of multichannel audio processing hardware device, including:
Memory, for storing non-transitory computer-readable instruction;And
Processor, for running the computer-readable instruction so that the processor is realized any of the above-described more when executing
The step of described in channel audio processing method technical solution.
To achieve the goals above, according to a further aspect of the invention, following technical scheme is also provided:
A kind of computer readable storage medium, for storing non-transitory computer-readable instruction, when the non-transitory
When computer-readable instruction is executed by computer so that the computer executes any of the above-described multichannel audio processing method technology
The step of described in scheme.
To achieve the goals above, according to a further aspect of the invention, following technical scheme is also provided:
A kind of multichannel audio processing terminal, including any of the above-described multichannel audio processing unit.
A kind of multichannel audio processing method of offer of the embodiment of the present invention, multichannel audio processing unit, multichannel audio
Handle hardware device, computer readable storage medium and multichannel audio processing terminal.Wherein, the multichannel audio processing method
Including obtaining pending multichannel audio;Obtain audio processing parameters;Based on audio processing parameters, to pending multichannel audio
It is handled..The embodiment of the present invention, can be according to audio processing parameters, to pending multichannel by taking the technical solution
Audio is handled accordingly, it is possible thereby to corresponding audio frequency effect be obtained according to different audio processing parameters, to improve
User experience effect.
Above description is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention, and
It can be implemented in accordance with the contents of the specification, and to allow the above and other objects, features and advantages of the present invention can be brighter
It is aobvious understandable, it is special below to lift preferred embodiment, and coordinate attached drawing, detailed description are as follows.
Description of the drawings
Fig. 1 a are the flow diagram according to the multichannel audio processing method of one embodiment of the invention;
Fig. 1 b are the flow diagram according to the multichannel audio processing method of another embodiment of the present invention;
Fig. 2 is schematic diagram according to one embodiment of the invention, for selecting percussion mode and smooth mode;
Fig. 3 is the flow diagram according to the multichannel audio processing method of another embodiment of the present invention;
Fig. 4 is the structural schematic diagram according to the multichannel audio processing unit of one embodiment of the invention;
Fig. 5 is the structural schematic diagram that hardware device is handled according to the multichannel audio of one embodiment of the invention;
Fig. 6 is the structural schematic diagram according to the computer readable storage medium of one embodiment of the invention;
Fig. 7 is the structural schematic diagram according to the multichannel audio processing terminal of one embodiment of the invention;
Fig. 8 is the structural schematic diagram according to the multichannel audio processing terminal of another embodiment of the present invention.
Specific implementation mode
Illustrate that embodiments of the present invention, those skilled in the art can be by this specification below by way of specific specific example
Disclosed content understands other advantages and effect of the present invention easily.Obviously, described embodiment is only the present invention
A part of the embodiment, instead of all the embodiments.The present invention can also be subject to reality by way of a different and different embodiment
It applies or applies, the various details in this specification can also be based on different viewpoints and application, in the spirit without departing from the present invention
Lower carry out various modifications or alterations.It should be noted that in the absence of conflict, the feature in following embodiment and embodiment can
To be combined with each other.Based on the embodiments of the present invention, those of ordinary skill in the art are without creative efforts
The every other embodiment obtained, shall fall within the protection scope of the present invention.
It should be noted that the various aspects of embodiment within the scope of the appended claims are described below.Ying Xian
And be clear to, aspect described herein can be embodied in extensive diversified forms, and any specific structure described herein
And/or function is only illustrative.Based on the present invention, it will be understood by one of ordinary skill in the art that one described herein
Aspect can be independently implemented with any other aspect, and can combine the two or both in these aspects or more in various ways.
For example, carry out facilities and equipments in terms of any number set forth herein can be used and/or put into practice method.In addition, can make
With other than one or more of aspect set forth herein other structures and/or it is functional implement this equipment and/or
Put into practice the method.
It should also be noted that, the diagram provided in following embodiment only illustrates the basic structure of the present invention in a schematic way
Think, component count, shape and the size when only display is with related component in the present invention rather than according to actual implementation in schema are painted
System, when actual implementation kenel, quantity and the ratio of each component can be a kind of random change, and its assembly layout kenel also may be used
It can be increasingly complex.
In addition, in the following description, specific details are provided for a thorough understanding of the examples.However, fields
The skilled person will understand that the aspect can be put into practice without these specific details.
The technical issues of in order to solve how to improve user experience effect, the embodiment of the present invention provide a kind of multichannel audio
Processing method.As shown in Figure 1a, which mainly includes the following steps S1 to step S3.Wherein:
Step S1:Obtain pending multichannel audio.
Wherein, pending multichannel audio can be offline pending multichannel audio, can also be online pending more
Channel audio, this is not limited by the present invention.Wherein, multichannel audio includes but not limited to 3.1 channel audios, 5.1 sound channel sounds
Frequently, 7.1 channel audios etc..
Step S2:Obtain audio processing parameters.
Wherein, audio processing parameters include but not limited to fundamental frequency, transient pulse, audio frequency phase, audio duration etc..
Step S3:Based on the audio processing parameters, pending multichannel audio is handled.
In order to make it easy to understand, the process for handling audio processing parameters is described in detail with specific embodiment below.
It, can be by the fundamental frequency of each channel audio, formant, transient pulse, audio envelope etc. for Combined Treatment parameter
Audio processing parameters are mixed, and are then handled.
It, can be respectively to the fundamental frequency of each channel audio, formant, transient pulse, audio pack for separating treatment parameter
The audio processing parameters such as network carry out independent processing.
For formant, can be smoothed (alternatively referred to as amplitude limiting processing);It for example, can be to formant
Amplitude carries out threshold processing;
For transient pulse, can be smoothed.
For audio envelope, can be smoothed.
It, can be according to preset frequency from carrying out up-sampling or down-sampling is handled for sample rate.
For fundamental frequency, fundamental frequency can be increased or reduced by way of zero insertion value or extraction, to increase or reduce pitch, from
And increases or lower the tone;
For audio frequency phase, audio frequency phase can be carried out to increase or reduce processing;
For audio duration, it can carry out shortening or extension is handled;
The above-mentioned mode handled for different audio processing parameters is not exhaustive, and those skilled in the art are above-mentioned
Simple transformation (for example, arrangement, combination) or equivalent replacement can also be carried out on the basis of listed mode, these should also be included in this
Within the protection domain of invention.
The present embodiment, can be according to audio processing parameters, to pending multichannel audio by taking above-mentioned technical proposal
It is handled accordingly, it is possible thereby to corresponding audio frequency effect be obtained according to different audio processing parameters, to improve use
Family experience effect.
In an alternative embodiment, as shown in Figure 1 b, step S2 may include:
When receiving audio mode instruction, the pending multichannel audio corresponding with audio mode instruction is obtained
Audio processing parameters.
In the present embodiment, audio mode instruction can be by user by terminal, and to touch, mouse is clicked, keyboard taps
Etc. modes implemented.
Wherein, terminal includes but not limited to smart mobile phone, palm PC, computer etc..
Above-mentioned audio mode includes but not limited to:Combined Treatment pattern, separating treatment pattern, velocity mode, quality mode,
Balanced mode, modes of deflection keep pattern, percussion mode, soft door limiting mode, composite mode, clear and melodious pattern, stable mode, put down
Slip form type, across frequency band smooth mode, smooth mode, whole smooth mode isotype in subband.
It includes but not limited to following manner that above-mentioned audio mode, which instructs mode corresponding with audio processing parameters,:
The corresponding audio processing parameters of Combined Treatment mode instruction are Combined Treatment parameter;Wherein, the Combined Treatment parameter
The parameter after audio processing parameters to mix each sound channel;
The corresponding audio processing parameters of separating treatment mode instruction are separating treatment parameter;Wherein, the separating treatment parameter
It is the separate audio processing parameters of each sound channel;
It is audio envelope that modes of deflection, which instructs corresponding audio processing parameters,;
It is audio envelope and fundamental frequency to keep the corresponding audio processing parameters of mode instruction;Wherein, fundamental frequency refers to the frequency of fundamental tone
Rate, the pitch for determining audio;
The corresponding audio processing parameters of clear and melodious mode instruction are transient pulse and audio frequency phase;
It is transient pulse that smooth mode, which instructs corresponding audio processing parameters,;
Stable mode instruction takes into account in clear and melodious mode instruction and smooth mode instruction;
It is sample rate and formant or fundamental frequency etc. that velocity mode, which instructs corresponding audio processing parameters,;
It is transient pulse, fundamental frequency, formant that quality mode, which instructs corresponding audio processing parameters,;
It is continuity of audio and audio consistency that balanced mode, which instructs corresponding audio processing parameters,;
It is the phase of audio corresponding to each frequency band in audio frequency domain that across frequency band smooth mode, which instructs corresponding audio processing parameters,
Position;
It is audio corresponding to scheduled frequency band in audio frequency domain that smooth mode, which instructs corresponding audio processing parameters, in subband
Phase;
The corresponding audio processing parameters of speed-variation without tone mode instruction are audio duration;
Speed change pattern instructs corresponding audio processing parameters for fundamental frequency for modified tone;
It is the fundamental frequency of the duration and audio of audio that modified tone speed change pattern, which instructs corresponding audio processing parameters,.
It will be apparent to one skilled in the art that above-mentioned corresponded manner is not exhaustive, those skilled in the art are in above-mentioned listed side
Simple transformation or equivalent replacement can also be carried out on the basis of formula, these simple transformations or equivalent replacement should also be included in the present invention
Protection domain within.
In this step, can pre-establish audio mode instruction and the audio processing parameters of pending multichannel audio it
Between correspondence;Then, it when receiving audio mode instruction, according to the correspondence, obtains and is instructed with audio mode
The audio processing parameters of corresponding, pending multichannel audio.Wherein, acquisition modes include but not limited to local acquisition modes,
Long-range acquisition modes.Wherein, local acquisition modes can be from being stored in advance in the terminals such as smart mobile phone, tablet computer
The audio processing parameters that corresponding, pending multichannel audio is instructed with audio mode are obtained in memory;Long-range acquisition modes
It can be corresponding with audio mode instruction from remote equipment acquisition by the communication modes such as 3G, 4G, WI FI, bluetooth, wait for
Handle the audio processing parameters of multichannel audio.
It can be seen that the invention is characterized in that above-mentioned technical proposal, instructed according to the audio mode that user sends out, carry out with
Corresponding processing so that user can obtain corresponding audio frequency effect according to the hobby of oneself, to improve user
Experience effect.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction is that modes of deflection instructs;
When receiving audio mode instruction, it is specific to obtain the step of instructing corresponding audio processing parameters with audio mode
Including:
When receiving modes of deflection instruction, audio envelope is obtained;
Based on audio processing parameters, the step of handling pending multichannel audio, specifically includes:
Adjust the audio envelope of the pending multichannel audio.
Further, the step of audio envelope of the pending multichannel audio of above-mentioned adjustment can specifically include:Adjustment waits for
Handle the fundamental frequency and formant of multichannel audio.
Since audio envelope can shift with the variation of pitch, and pitch is determined by fundamental frequency;So this reality
The audio envelope of the pending multichannel audio can be adjusted by adjusting the fundamental frequency of pending multichannel audio by applying example, to
The tone color that audio can be changed, which thereby enhances user experience.
Again since the harmonic wave of audio is determined by its formant;So the present embodiment can also be by adjusting the resonance of audio
Peak adjusts audio envelope, so as to realizing the variation of overtone.
The embodiment of the present invention receive audio mode instruction when, by adjusting pending multichannel audio fundamental frequency and altogether
Shake peak, to change audio envelope, the audio frequency effect of tone and tone color variation is realized, to improve user experience effect.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction is holding mode instruction;
When receiving audio mode instruction, the sound that corresponding, pending multichannel audio is instructed with audio mode is obtained
The step of frequency processing parameter, specifically includes:
When receiving holding mode instruction, the sound of corresponding, the pending multichannel audio of mode instruction is obtained and kept
Frequency envelope and fundamental frequency;
Based on audio processing parameters, the step of handling pending multichannel audio, specifically includes:
In the case where keeping audio envelope, fundamental frequency is adjusted.
Wherein, fundamental frequency can pass through the acquisitions such as correlation method, the waveform estimation technique, Cepstrum Method, cycle histogram method.
The present embodiment obtains the audio envelope and fundamental frequency of pending multichannel audio when receiving audio mode instruction,
And in the case where keeping audio envelope, adjust fundamental frequency;For example, the fundamental frequency can be increased or reduced, to realize that this is pending
The modified tone of multichannel audio, to improve user experience effect.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction is clear and melodious mode instruction;
When receiving audio mode instruction, the sound that corresponding, pending multichannel audio is instructed with audio mode is obtained
The step of frequency processing parameter, including:
When receiving clear and melodious mode instruction, the wink of multichannel audio corresponding with clear and melodious mode instruction, pending is obtained
State pulse and audio frequency phase;
Based on audio processing parameters, the step of processing pending multichannel audio, including:
The phase of transient pulse is set as zero in the full frequency-domain of pending multichannel audio, alternatively, pending at this
The phase of the transient pulse is set as zero in the full frequency-domain of multichannel audio, and the amplitude of the transient pulse is limited;
Set the audio frequency phase to preset value.
Wherein it is possible to the amplitude versus frequency characte based on pending multichannel audio, in the full frequency-domain of pending multichannel audio
The phase of transient pulse is set as zero.
The present embodiment obtains transient pulse and the audio phase of pending multichannel audio when receiving audio mode instruction
Position;Then, according to the amplitude versus frequency characte and phase-frequency characteristic of pending multichannel audio, pass through the full range in pending multichannel audio
The phase of transient pulse is set as zero in domain, alternatively, by the transient pulse in the full frequency-domain of the pending multichannel audio
Phase be set as zero, and the amplitude of the transient pulse is limited, and set audio frequency phase to preset value, weakens wink
Piping caused by state pulse can acoustically obtain clear and melodious audio frequency effect, to improve user experience effect.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction is that smooth mode instructs;
When receiving audio mode instruction, the sound that corresponding, pending multichannel audio is instructed with audio mode is obtained
The step of frequency processing parameter, including:
When receiving smooth mode instruction, the wink that corresponding, pending multichannel audio is instructed with smooth mode is obtained
State pulse;
Based on audio processing parameters, the step of processing pending multichannel audio, including:
Based on transient pulse, in the frequency domain of pending multichannel audio, to transient pulse in scheduled frequency range, institute is right
The amplitude of frequency domain is answered to be smoothed.
The present embodiment obtains the transient pulse of pending multichannel audio when receiving audio mode instruction;Then, base
In the amplitude versus frequency characte of pending multichannel audio, in the frequency domain of pending multichannel audio, to transient state in scheduled frequency range
The amplitude of frequency domain corresponding to pulse is smoothed, and is realized in frequency domain to the amplitude limit of transient pulse, thus acoustically may be used
To obtain smooth audio frequency effect, to improve user experience effect.
Those skilled in the art will be understood that the embodiment peace glide yupin effect in the clear and melodious audio frequency effect of above-mentioned acquisition
On the basis of embodiment, obvious variant or equivalent replacement can also be carried out, for example, those skilled in the art can take into account it is above-mentioned
Stable mode is formed in the case of clear and melodious pattern and smooth mode.When the embodiment of the present invention receives stable mode instruction, obtain
Take transient pulse and the audio frequency phase of pending multichannel audio;Then, by wink in the full frequency-domain of pending multichannel audio
The phase of state pulse is set as zero, alternatively, setting the phase of transient pulse in the full frequency-domain of pending multichannel audio
Zero, and the amplitude of transient pulse is limited;Set audio frequency phase to preset value;And in the frequency of pending multichannel audio
In domain, the amplitude of frequency domain corresponding to transient pulse in scheduled frequency range is smoothed, realizes the limit to transient pulse
Thus width can acoustically obtain the audio frequency effect between clear and melodious and smooth, to improve user experience effect.
The embodiment of the present invention in the specific implementation, on the basis of the above embodiments, can also increase corresponding step.Example
Such as, it can also include transient pulse detection pattern.The transient pulse detection pattern includes but not limited to percussion mode, Soft Thresholding for Signal mould
Formula and composite mode.Wherein, the corresponding audio processing parameters of percussion mode are multiple transient pulses separately;Soft door limiting mode
Corresponding audio processing parameters are a transient pulse in predetermined period;The corresponding audio processing parameters of composite mode are more
A transient pulse separately, and a transient pulse in predetermined period.By the detection pattern, it can obtain and wait locating
The case where managing transient pulse in multichannel audio, so as to targetedly handle transient pulse.
When the embodiment of the present invention, which receives percussion mode instruction, Soft Thresholding for Signal mode instruction or composite mode, to be instructed, for
Corresponding detection pattern carries out corresponding transient pulse processing.
For example, by taking user selects audio mode by way of touch terminal as an example, wherein audio mode is to tap
Pattern.As shown in Fig. 2, user clicks transient pulse detection pattern by terminal, then, percussion mode is selected;Audio is clicked again
Pattern selects smooth mode to handle pending multichannel audio.It is specific as follows:
As shown in figure 3, the present embodiment provides a kind of multichannel audio processing methods, including:
Step Sa1:Obtain pending multichannel audio;
Step Sa2:Obtain transient pulse detection pattern;Wherein, which is percussion mode;
Step Sa3:When receiving percussion mode instruction, determine that detection object is multiple transient pulses separately;
Step Sa4:When receiving smooth mode instruction, obtain and corresponding, the pending more sound of smooth mode instruction
Multiple transient pulses separately of channel audio;
Step Sa5:In the frequency domain of the pending multichannel audio, to multiple winks separately in scheduled frequency range
The amplitude of frequency domain corresponding to state pulse is smoothed.
Similarly, if receiving Soft Thresholding for Signal mode instruction, a transient pulse in predetermined period is carried out smooth
Processing, can obtain smooth audio frequency effect, which thereby enhance user experience.Those skilled in the art can be according to of the invention real
It applies example and carries out modification or equivalent replacement, details are not described herein.The embodiment of these modifications or equivalent replacement should also be included in this hair
Within bright protection domain.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction is that velocity mode instructs;
When receiving audio mode instruction, the sound that corresponding, pending multichannel audio is instructed with audio mode is obtained
The step of frequency processing parameter, including:
When receiving velocity mode instruction, obtains and instruct the pre- of corresponding, pending multichannel audio with velocity mode
Fixed sample rate and formant or fundamental frequency;
Based on audio processing parameters, the step of processing pending multichannel audio, including:
Down-sampling is carried out to pending multichannel audio according to scheduled sample rate;
The formant of pending multichannel audio is smoothed;Alternatively, adjusting the base of pending multichannel audio
Frequently.
Wherein, carry out down-sampling to pending multichannel audio for example can be down-sampled to 4kHz by the audio of 48kHz, also
Down-sampling can be realized by extracting even number of samples point, this is not limited by the present invention.Audio frequency may be implemented by down-sampling
The continuation in domain easily causes the aliasing of audible spectrum;Preferably, therefore, it can also be carried out before carrying out down-sampling step anti-mixed
It is folded to be filtered.
In the present embodiment, above-mentioned velocity mode can be considered as speed processing mode of priority, refer to when changing tone, first
According to scheduled sample rate, down-sampling is carried out to pending multichannel audio and is then handled based on short-term spectrum characteristic.
Since handled data volume is few, so that processing time shortens, processing speed is which thereby enhanced.
In practical applications, when user selects velocity mode, the embodiment of the present invention selects scheduled part acoustic characteristic
It is handled, for example, the formant to pending multichannel audio can be selected to handle, alternatively, to pending more sound
The formant of channel audio and transient pulse are handled etc., thus improve the processing speed for handling pending multichannel audio,
To improve user experience effect.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction is sound quality mode instruction;
When receiving audio mode instruction, the sound that corresponding, pending multichannel audio is instructed with audio mode is obtained
The step of frequency processing parameter, including:
When receiving sound quality mode instruction, the wink of multichannel audio corresponding with sound quality mode instruction, pending is obtained
State pulse, fundamental frequency, formant;
Based on audio processing parameters, the step of processing pending multichannel audio, including:
The transient pulse of smooth pending multichannel audio and formant in real time;
The fundamental frequency of pending multichannel audio is adjusted in real time.
In practical applications, when user selects quality mode, the embodiment of the present invention is to the pending multichannel audio
Transient pulse, fundamental frequency, formant are handled in real time, with change tone and tone color and caused by weakening transient pulse it is ear-piercing
Loudness hence improves sound quality, to improve user experience effect.
Certainly, those skilled in the art can also be in the basic shape of above-mentioned velocity mode embodiment and sound quality pattern Example
At balanced mode.When receiving balanced mode instruction, the place for taking into account velocity mode embodiment and sound quality pattern Example is carried out
Reason, details are not described herein.The embodiment of these obvious variants or equivalent replacement should also be included within protection scope of the present invention.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction is across frequency band smooth mode
Instruction;
When receiving audio mode instruction, the sound that corresponding, pending multichannel audio is instructed with audio mode is obtained
The step of frequency processing parameter, including:
When receiving across frequency band smooth mode instruction, obtain corresponding, pending more with the instruction of across frequency band smooth mode
The audio frequency phase of channel audio;
Based on audio processing parameters, the step of processing pending multichannel audio, including:
Based on audio frequency phase, the phase at least two frequency bands of pending multichannel audio is smoothed.
Phase-frequency characteristic of the present embodiment based on pending multichannel audio, for multiple frequency bands of pending multichannel audio
Interior, for example, first band, second band and third frequency band, phase corresponding with transient pulse is smoothed, so that
Multichannel audio is more smooth acoustically, to improve user experience effect.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction is smooth mode in subband
Instruction;
When receiving audio mode instruction, the sound that corresponding, pending multichannel audio is instructed with audio mode is obtained
The step of frequency processing parameter, including:
When receiving smooth mode instruction in subband, obtain corresponding, pending more with smooth mode instruction in subband
The audio frequency phase of channel audio;
Based on audio processing parameters, the step of processing pending multichannel audio, including:
Based on audio frequency phase, the phase in the subband of any frequency band of pending multichannel audio is smoothed.
The present embodiment obtains the audio frequency phase of pending multichannel audio when receiving smooth mode instruction in subband,
And based on the phase-frequency characteristic of the pending multichannel audio, the phase in the subband of its any frequency band is smoothed, with
Acoustically so that audio is smooth, to improve user experience effect.
Certainly, in practical applications, those skilled in the art can also in summary across frequency band smooth mode embodiment and
Smooth mode embodiment in subband forms whole smooth mode;When receiving whole smooth mode instruction, obtain pending more
The audio frequency phase of channel audio;Then, at least two frequency bands of pending multichannel audio phase and any frequency band
Subband in phase be smoothed so that more smooth in acoustically audio, to improve user experience.These
The embodiment of obvious variant should also be included within protection scope of the present invention.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction is speed-variation without tone pattern
Instruction;
When receiving audio mode instruction, the sound that corresponding, pending multichannel audio is instructed with audio mode is obtained
The step of frequency processing parameter, including:
When receiving speed-variation without tone mode instruction, obtain corresponding with speed-variation without tone mode instruction, pending more
The audio duration of channel audio;
Based on audio processing parameters, the step of processing pending multichannel audio, including:
The audio duration of pending multichannel audio shorten or extension is handled.
Those skilled in the art will be understood that the embodiment of the present invention can also carry out pending multichannel audio in frequency domain
Processing, to realize the audio frequency effect of speed-variation without tone.For example, pending multichannel audio is divided into several sections;Then, exist successively
Between two adjacent section audios, into row interpolation;Finally, then resampling is carried out;And so on, until all segmentations have been processed
At, be achieved in the identical technique effect of adjustment audio duration in the time domain, to realize to pending multichannel audio
Speed-variation without tone processing.
The present embodiment in the case where ensuring that tone color does not change tone, by time domain to pending multichannel audio
The shortening or extension of audio duration are carried out, it is thus achieved that the variation of velocity of sound, to improve user experience effect.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction is the not speed change pattern that modifies tone
Instruction;
When receiving audio mode instruction, the sound that corresponding, pending multichannel audio is instructed with audio mode is obtained
The step of frequency processing parameter, including:
When receiving modified tone not speed change pattern instruction, obtains and the not speed change pattern instruction that modifies tone is corresponding, pending more
The fundamental frequency of channel audio;
Based on audio processing parameters, the step of processing pending multichannel audio, including:
Adjust the fundamental frequency of pending multichannel audio.
The present embodiment is adjusted by the fundamental frequency to pending multichannel audio, for example, in the enterprising line of frequency domain
It inserts, realizes that (relationship between wherein each harmonic components is or not the contraction to the frequency spectrum of the pending multichannel audio or extension
Become), it is thus achieved that the audio frequency effect of modified tone, to improve user experience effect.
In an alternative embodiment, Fig. 1 b illustrated embodiments are based on, audio mode instruction refers to for modified tone speed change pattern
It enables;
When receiving audio mode instruction, the sound that corresponding, pending multichannel audio is instructed with audio mode is obtained
The step of frequency processing parameter, including:
When receiving modified tone speed change pattern instruction, obtain and modified tone corresponding, the pending multichannel of speed change pattern instruction
The audio duration and fundamental frequency of audio;
Based on audio processing parameters, the step of processing pending multichannel audio, including:
Audio duration shorten or extension is handled;
Adjust fundamental frequency.
The present embodiment may be implemented both to become by the aforementioned speed-variation without tone embodiment of synthesis and the not speed change embodiment that modifies tone
The audio frequency effect that speed modifies tone again, to improve user experience.
Those skilled in the art will be understood that on the basis of above-mentioned each embodiment, can also carry out obvious variant (example
Such as, cited pattern is combined) or equivalent replacement, for example, those skilled in the art can be in the base of above-described embodiment
On plinth, in conjunction with Combined Treatment pattern and separating treatment pattern, pending multichannel audio is handled.
Hereinbefore, although describing each step in multichannel audio processing method embodiment according to above-mentioned sequence
It suddenly, can also it will be apparent to one skilled in the art that the step in the embodiment of the present invention not necessarily executes in the order described above
Other sequences such as inverted order, parallel, intersection execute, moreover, on the basis of above-mentioned steps, those skilled in the art can also add again
Enter other steps, the mode of these obvious variants or equivalent replacement should also be included within protection scope of the present invention, herein not
It repeats again.
The following is an embodiment of the apparatus of the present invention, and apparatus of the present invention embodiment can be used for executing the method for the present invention embodiment and realize
The step of, for convenience of description, illustrates only and do not disclose, ask with the relevant part of the embodiment of the present invention, particular technique details
With reference to the method for the present invention embodiment.
The technical issues of in order to solve how to improve user experience effect, the embodiment of the present invention provide a kind of multichannel audio
Processing unit.The device can execute the step of described in above-mentioned multichannel audio processing method embodiment.As shown in figure 4, should
Device includes mainly:First acquisition module 41, the second acquisition module 42 and processing module 43.Wherein, the first acquisition module 41 is used
In the pending multichannel audio of acquisition.Second acquisition module 42 is for obtaining audio processing parameters.Processing module 43 is for being based on
Audio processing parameters handle pending multichannel audio.
Wherein, pending multichannel audio can be offline pending multichannel audio, can also be online pending more
Channel audio, this is not limited by the present invention.Wherein, multichannel audio includes but not limited to 3.1 channel audios, 5.1 sound channel sounds
Frequently, 7.1 channel audios etc..
Wherein, audio processing parameters include but not limited to fundamental frequency, transient pulse, audio frequency phase, audio duration etc..
The present embodiment respectively by the first acquisition module 41 and the second acquisition module 42 obtain pending multichannel audio and
Audio processing parameters;Then, then by processing module 43, audio processing parameters are based on, at pending multichannel audio
Reason;Corresponding audio frequency effect can be obtained according to different audio processing parameters, to improve user experience effect.
In an alternative embodiment, as shown in figure 4, the second acquisition module 42 is additionally operable to refer to when receiving audio mode
When enabling, the audio processing parameters that corresponding, pending multichannel audio is instructed with audio mode are obtained.
Audio mode includes but not limited to:Combined Treatment pattern, separating treatment pattern, velocity mode, quality mode, balance
Pattern, keeps pattern, percussion mode, soft door limiting mode, composite mode, clear and melodious pattern, stable mode, smooth mould at modes of deflection
Formula, across frequency band smooth mode, smooth mode, whole smooth mode isotype in subband.
In the present embodiment, audio mode instruction can be by user by terminal, and to touch, mouse is clicked and/or keyboard
The modes such as percussion are implemented.
Above-mentioned audio processing parameters include but not limited to fundamental frequency, formant, audio frequency phase, transient pulse, audio duration etc..
The invention is characterized in that above-mentioned technical proposal, the second acquisition module 42 gets the audio mode that user sends out and refers to
It enables, then processing module carries out corresponding processing, so that user can obtain corresponding sound according to the hobby of oneself
Yupin effect, to improve user experience effect.
In an alternative embodiment, audio mode instruction is that modes of deflection instructs;
Second acquisition module 42 is specifically used for, when receiving modes of deflection instruction, obtaining corresponding with modes of deflection instruction
, the audio envelope of pending multichannel audio;
Processing module 43 is specifically used for adjusting the audio envelope of pending multichannel audio.
In a preferred embodiment, processing module 43 is specifically used for adjusting the fundamental frequency of pending multichannel audio and be total to
Shake peak.
In the embodiment of the present invention, for the second acquisition module 42 when receiving audio mode instruction, processing module 43 passes through tune
The fundamental frequency and formant of whole pending multichannel audio realize the audio effect of tone and tone color variation to change audio envelope
Fruit, to improve user experience effect.
In an alternative embodiment, audio mode instruction is holding mode instruction;
Second acquisition module 42 is specifically used for when receiving holding mode instruction, obtains corresponding with mode instruction is kept
, the audio envelope and fundamental frequency of pending multichannel audio;
Processing module 43 is specifically used in the case where keeping audio envelope, adjusts fundamental frequency.
Wherein, fundamental frequency can pass through the acquisitions such as correlation method, the waveform estimation technique, Cepstrum Method, cycle histogram method.
In the present embodiment, the second acquisition module 42 obtains pending multichannel audio when receiving audio mode instruction
Audio envelope and fundamental frequency, then, processing module 43 in the case where keeping audio envelope, adjust fundamental frequency;For example, can increase
Or reduce the fundamental frequency, to realize the modified tone of the pending multichannel audio, to improve user experience effect.
In an alternative embodiment, audio mode instruction is clear and melodious mode instruction;
Second acquisition module 42 is specifically used for when receiving clear and melodious mode instruction, obtains corresponding with clear and melodious mode instruction
, the transient pulse of pending multichannel audio and audio frequency phase;
Processing module 43 is specifically used for setting the phase of transient pulse in the full frequency-domain of pending multichannel audio
Zero, alternatively, the phase of transient pulse is set as zero in the full frequency-domain of pending multichannel audio, and to the width of transient pulse
Value is limited, and sets audio frequency phase to preset value.
In the present embodiment, the second acquisition module 42 obtains pending multichannel audio when receiving audio mode instruction
Transient pulse and audio frequency phase;Then, processing module 43 is according to the amplitude versus frequency characte and phase-frequency characteristic of pending multichannel audio,
By the way that the phase of transient pulse is set as zero in the full frequency-domain of pending multichannel audio, alternatively, in pending multichannel
The phase of transient pulse is set as zero in the full frequency-domain of audio, and the amplitude of transient pulse is limited, and by audio
Phase is set as preset value, weakens piping caused by transient pulse, can acoustically obtain clear and melodious audio frequency effect,
To improve user experience effect.
In an alternative embodiment, audio mode instruction is that smooth mode instructs;
Second acquisition module 42 is specifically used for, when receiving smooth mode instruction, obtaining corresponding with smooth mode instruction
, the transient pulse of pending multichannel audio;
Processing module 43 is specifically used for being based on transient pulse, in the frequency domain of pending multichannel audio, to preset frequency
The amplitude of frequency domain corresponding to transient pulse is smoothed in range.
In the present embodiment, the second acquisition module 42 obtains pending multichannel audio when receiving audio mode instruction
Transient pulse;Then, amplitude versus frequency characte of the processing module 43 based on pending multichannel audio, in pending multichannel audio
In frequency domain, the amplitude of frequency domain corresponding to transient pulse in scheduled frequency range is smoothed, is realized in frequency domain to wink
Thus the amplitude limit of state pulse can acoustically obtain smooth audio frequency effect, to improve user experience effect.
In an alternative embodiment, audio mode instruction is that velocity mode instructs;
Second acquisition module 42 is specifically used for, when receiving velocity mode instruction, obtaining corresponding with velocity mode instruction
, the scheduled sample rate of pending multichannel audio and formant or fundamental frequency;
Processing module 43 is specifically used for carrying out down-sampling to pending multichannel audio according to scheduled sample rate;Also,
The formant of pending multichannel audio is smoothed;Alternatively, adjusting the fundamental frequency of pending multichannel audio.
In the present embodiment, above-mentioned velocity mode can be considered as speed processing mode of priority, refer to when changing tone, first
According to scheduled sample rate, down-sampling is carried out to pending multichannel audio and is then handled based on short-term spectrum characteristic.
Since handled data volume is few, so that processing time shortens, processing speed is which thereby enhanced.
In an alternative embodiment, audio mode instruction is sound quality mode instruction;
Second acquisition module 42 is specifically used for when receiving sound quality mode instruction, obtains corresponding with sound quality mode instruction
, the transient pulse of pending multichannel audio, fundamental frequency, formant;
Processing module 43 is specifically used for the transient pulse of smooth pending multichannel audio and formant in real time, and adjusts in real time
The fundamental frequency of whole pending multichannel audio.
For the present embodiment when implementing, when user selects quality mode, the second acquisition module 42 gets pending more sound
The transient pulse of channel audio, fundamental frequency, formant;Then, transient pulse of the processing module 43 to the pending multichannel audio, base
Frequently, formant is handled in real time, to change tone and tone color and ear-piercing loudness caused by weakening transient pulse, is thus changed
Sound quality has been apt to it, to improve user experience effect.
In an alternative embodiment, audio mode instruction is that across frequency band smooth mode instructs;
Second acquisition module 42 is specifically used for, when receiving across frequency band smooth mode instruction, obtaining and across the smooth mould of frequency band
Formula instructs the audio frequency phase of corresponding, pending multichannel audio;
Processing module 43 is specifically used for being based on audio frequency phase, to the phase at least two frequency bands of pending multichannel audio
Position is smoothed.
Phase-frequency characteristic of the present embodiment based on pending multichannel audio, for multiple frequency bands of pending multichannel audio
Interior, for example, first band, second band and third frequency band, phase corresponding with transient pulse is smoothed, so that
Multichannel audio is more smooth acoustically, to improve user experience effect.
In an alternative embodiment, audio mode instruction is smooth mode instruction in subband;
Second acquisition module 42 is specifically used for, when receiving smooth mode instruction in subband, obtaining and smooth mould in subband
Formula instructs the audio frequency phase of corresponding, pending multichannel audio;
Processing module 43 is specifically used for being based on audio frequency phase, in the subband of any frequency band of pending multichannel audio
Phase is smoothed.
In the present embodiment, the second acquisition module 42 obtains pending more sound when receiving smooth mode instruction in subband
The audio frequency phase of channel audio;Then, phase-frequency characteristic of the processing module 43 based on the pending multichannel audio, to its any frequency band
Subband in phase be smoothed, with acoustically so that audio it is smooth, to improve user experience effect.
In an alternative embodiment, audio mode instruction is speed-variation without tone mode instruction;
Second acquisition module 42 is specifically used for when receiving speed-variation without tone mode instruction, obtains and speed-variation mode transfer
Formula instructs the audio duration of corresponding, pending multichannel audio;
Processing module 43 to the audio duration of pending multichannel audio shorten or extension is handled.
The present embodiment obtains pending multichannel audio by taking above-mentioned technical proposal, using the second acquisition module 42
Audio duration;Then, the shortening of audio duration is carried out to pending multichannel audio in time domain by processing module 43 or prolonged
It is long, in the case where ensuring that tone color does not change tone, the variation of velocity of sound is realized, to improve user experience effect.
In an alternative embodiment, for modified tone, speed change pattern does not instruct for audio mode instruction;
Second acquisition module 42 is specifically for when receiving modified tone not speed change pattern instruction, obtaining and the not speed change mould that modifies tone
Formula instructs the fundamental frequency of corresponding, pending multichannel audio;
Processing module 43 is specifically used for adjusting the fundamental frequency of pending multichannel audio.
The present embodiment is adjusted the fundamental frequency of pending multichannel audio by processing module 43, for example, on frequency domain
Linear interpolation is carried out, realizes the contraction to the frequency spectrum of the pending multichannel audio or extension (between wherein each harmonic components
Relationship it is constant), it is thus achieved that modified tone audio frequency effect, to improve user experience effect.
In an alternative embodiment, audio mode instruction is modified tone speed change pattern instruction;
Second acquisition module 42 is specifically used for, when receiving modified tone speed change pattern instruction, obtaining and referring to modified tone speed change pattern
Enable the audio duration and fundamental frequency of corresponding, pending multichannel audio;
Processing module 43 is specifically used for audio duration shorten or extension is handled, and adjusts fundamental frequency.
The present embodiment passes through above-mentioned second by the aforementioned speed-variation without tone embodiment of synthesis and the not speed change embodiment that modifies tone
Acquisition module 42 and processing module 43, the audio frequency effect that not only speed change may be implemented but also modify tone, to improve user experience.
The detailed descriptions such as the technique effect of operation principle, realization in relation to multichannel audio processing unit embodiment can be joined
The related description in multichannel audio processing method embodiment is stated before examination, and details are not described herein.
Fig. 5 is the hardware block diagram of diagram multichannel audio processing hardware device according to an embodiment of the present disclosure.Such as Fig. 5 institutes
Show, it includes memory 51 and processor 52 to handle hardware device 50 according to the multichannel audio of the embodiment of the present disclosure.
The memory 51 is for storing non-transitory computer-readable instruction.Specifically, memory 51 may include one
Or multiple computer program products, the computer program product may include various forms of computer readable storage mediums, example
Such as volatile memory and/or nonvolatile memory.The volatile memory for example may include random access memory
(RAM) and/or cache memory (cache) etc..The nonvolatile memory for example may include read-only memory
(ROM), hard disk, flash memory etc..
The processor 52 can be central processing unit (CPU) or have data-handling capacity and/or instruction execution energy
The processing unit of the other forms of power, and other components in multichannel audio processing hardware device 50 can be controlled to execute
Desired function.In one embodiment of the disclosure, the processor 52 is for running the calculating stored in the memory 51
Machine readable instruction so that multichannel audio processing hardware device 50 executes the multichannel audio of each embodiment of the disclosure above-mentioned
The all or part of step of processing method.
Those skilled in the art will be understood that the technical issues of in order to solve how to obtain good user experience effect, this
Can also include structure well known to communication bus, interface etc. in embodiment, these well known structures should also be included in this hair
Within bright protection domain.
The respective description that can be referred in foregoing embodiments is described in detail in relation to the present embodiment, details are not described herein.
Fig. 6 is the schematic diagram for illustrating computer readable storage medium according to an embodiment of the present disclosure.As shown in fig. 6, root
According to the computer readable storage medium 60 of the embodiment of the present disclosure, it is stored thereon with non-transitory computer-readable instruction 61.When this
When non-transitory computer-readable instruction 61 is run by processor, the ratio of the video features of each embodiment of the disclosure above-mentioned is executed
To all or part of step of method.
Above computer readable storage medium storing program for executing 60 includes but not limited to:Optical storage media (such as:CD-ROM and DVD), magnetic
Optical storage media (such as:MO), magnetic storage medium (such as:Tape or mobile hard disk), with built-in rewritable nonvolatile
Memory media (such as:Storage card) and with built-in ROM media (such as:ROM boxes).
The respective description that can be referred in foregoing embodiments is described in detail in relation to the present embodiment, details are not described herein.
Fig. 7 is the hardware architecture diagram for illustrating the terminal device according to the embodiment of the present disclosure.As shown in fig. 7, more sound
Channel audio processing terminal 70 includes above-mentioned multichannel audio processing unit embodiment 71.
The terminal device can be implemented in a variety of manners, and the terminal device in the disclosure can include but is not limited to such as
Mobile phone, smart phone, laptop, digit broadcasting receiver, PDA (personal digital assistant), PAD (tablet computer),
PMP (portable media player), navigation device, vehicle-mounted terminal equipment, vehicle-mounted display terminal, vehicle electronics rearview mirror etc.
Mobile terminal device and such as number TV, desktop computer etc. fixed terminal equipment.
As the embodiment of equivalent replacement, which can also include other assemblies.As shown in figure 8, the multichannel sound
Frequency processing terminal 80 may include that power supply unit 81, wireless communication unit 82, A/V (audio/video) input unit 83, user are defeated
Enter unit 84, sensing unit 85, interface unit 86, controller 87, output unit 88 and memory 89 etc..Fig. 8 shows tool
There is the terminal of various assemblies, it should be understood that being not required for implementing all components shown, can also alternatively implement more
More or less component.
Wherein, wireless communication unit 82 allows the radio communication between terminal 80 and wireless communication system or network.A/V
Input unit 83 is for receiving audio or video signal.It is defeated that user input unit 84 can generate key according to order input by user
Enter data with the various operations of control terminal equipment.The current state of 85 detection terminal 80 of sensing unit, is used the position of terminal 80
Family for the acceleration or deceleration of the orientation of the presence or absence of touch input of terminal 80, terminal 80, terminal 80 is mobile and direction etc., and
And generate order or the signal for the operation for being used for control terminal 80.Interface unit 86 is used as at least one external device (ED) and terminal 80
Connection can by interface.Output unit 88 is configured to provide output signal with vision, audio and/or tactile manner.It deposits
Reservoir 89 can store the software program etc. of the processing and control operation that are executed by controller 87, or can temporarily store
Oneself is through output or the data that will be exported.Memory 89 may include the storage medium of at least one type.Moreover, terminal 80 can
To cooperate with the network storage device for the store function for executing memory 89 by network connection.87 usual control terminal of controller
The overall operation of equipment.In addition, controller 87 may include for reproducing or the multi-media module of multimedia playback data.Control
The handwriting input executed on the touchscreen or picture can be drawn input and are identified as word by device 87 with execution pattern identifying processing
Symbol or image.Power supply unit 81 receives external power or internal power under the control of controller 87 and provides operation each element
With the electric power appropriate needed for component.
The disclosure propose video features comparison method various embodiments can with use such as computer software,
Hardware or any combination thereof computer-readable medium implement.Hardware is implemented, the ratio for the video features that the disclosure proposes
To the various embodiments of method can by using application-specific IC (AS I C), digital signal processor (DSP),
Digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, control
Device, microcontroller, microprocessor are designed to execute at least one of electronic unit of function described herein to implement,
In some cases, the various embodiments of the comparison method for the video features that the disclosure proposes can be real in controller 87
It applies.For software implementation, the disclosure propose video features comparison method various embodiments can with allow execute extremely
A kind of few individual software module of functions or operations is implemented.Software code can be by being write with any programming language appropriate
Software application (or program) implement, software code can be stored in memory 89 and be executed by controller 87.
The respective description that can be referred in foregoing embodiments is described in detail in relation to the present embodiment, details are not described herein.
The basic principle of the disclosure is described above in association with specific embodiment, however, it is desirable to, it is noted that in the disclosure
The advantages of referring to, advantage, effect etc. are only exemplary rather than limitation, must not believe that these advantages, advantage, effect etc. are the disclosure
Each embodiment is prerequisite.In addition, detail disclosed above is merely to exemplary effect and the work being easy to understand
With, and it is unrestricted, it is that must be realized using above-mentioned concrete details that above-mentioned details, which is not intended to limit the disclosure,.
The block diagram of device, device, equipment, system involved in the disclosure only as illustrative example and is not intended to
It is required that or hint must be attached in such a way that box illustrates, arrange, configure.As those skilled in the art will appreciate that
, it can be connected by any way, arrange, configure these devices, device, equipment, system.Such as "include", "comprise", " tool
" etc. word be open vocabulary, refer to " including but not limited to ", and can be used interchangeably with it.Vocabulary used herein above
"or" and " and " refer to vocabulary "and/or", and can be used interchangeably with it, unless it is not such that context, which is explicitly indicated,.Here made
Vocabulary " such as " refers to phrase " such as, but not limited to ", and can be used interchangeably with it.
In addition, as used herein, the "or" instruction separation that is used in the enumerating of the item started with "at least one"
It enumerates, so that enumerating for such as " A, B or C's being at least one " means A or B or C or AB or AC or BC or ABC (i.e. A and B
And C).In addition, wording " exemplary " does not mean that the example of description is preferred or more preferable than other examples.
It may also be noted that in the system and method for the disclosure, each component or each step are can to decompose and/or again
Combination nova.These decompose and/or reconfigure the equivalent scheme that should be regarded as the disclosure.
The technology instructed defined by the appended claims can not departed from and carried out to the various of technology described herein
Change, replace and changes.In addition, the scope of the claims of the disclosure is not limited to process described above, machine, manufacture, thing
Composition, means, method and the specific aspect of action of part.It can be essentially identical using being carried out to corresponding aspect described herein
Function either realize essentially identical result there is currently or to be developed later processing, machine, manufacture, event group
At, means, method or action.Thus, appended claims include such processing within its scope, machine, manufacture, event
Composition, means, method or action.
The above description of disclosed aspect is provided so that any person skilled in the art can make or use this
It is open.Various modifications in terms of these are readily apparent to those skilled in the art, and are defined herein
General Principle can be applied to other aspect without departing from the scope of the present disclosure.Therefore, the disclosure is not intended to be limited to
Aspect shown in this, but according to the widest range consistent with principle disclosed herein and novel feature.
In order to which purpose of illustration and description has been presented for above description.In addition, this description is not intended to the reality of the disclosure
It applies example and is restricted to form disclosed herein.Although already discussed above multiple exemplary aspects and embodiment, this field skill
Art personnel will be recognized that its certain modifications, modification, change, addition and sub-portfolio.
Claims (31)
1. a kind of multichannel audio processing method, which is characterized in that including:
Obtain pending multichannel audio;
Obtain audio processing parameters;
Based on the audio processing parameters, the pending multichannel audio is handled.
2. according to the method described in claim 1, it is characterized in that, the step of the acquisition audio processing parameters, including:
When receiving audio mode instruction, obtain and corresponding, the described pending multichannel audio of audio mode instruction
Audio processing parameters.
3. according to the method described in claim 2, it is characterized in that, audio mode instruction is modes of deflection instruction;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel audio of audio mode instruction
Audio processing parameters the step of, including:
When receiving the modes of deflection instruction, obtain and corresponding, the described pending multichannel of modes of deflection instruction
The audio envelope of audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Adjust the audio envelope of the pending multichannel audio.
4. according to the method described in claim 3, it is characterized in that, the audio pack of the adjustment pending multichannel audio
The step of network, specifically includes:
Adjust the fundamental frequency and formant of the pending multichannel audio.
5. according to the method described in claim 2, it is characterized in that, audio mode instruction is holding mode instruction;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel audio of audio mode instruction
Audio processing parameters the step of, including:
When receiving the holding mode instruction, pending multichannel corresponding with the holding mode instruction, described is obtained
The audio envelope and fundamental frequency of audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
In the case where keeping the audio envelope, the fundamental frequency is adjusted.
6. according to the method described in claim 2, it is characterized in that, audio mode instruction is clear and melodious mode instruction;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving clear and melodious mode instruction, pending multichannel audio corresponding with the clear and melodious mode instruction, described is obtained
Transient pulse and audio frequency phase;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
The phase of the transient pulse is set as zero in the full frequency-domain of the pending multichannel audio, alternatively, described
The phase of the transient pulse is set as zero in the full frequency-domain of pending multichannel audio, and to the amplitude of the transient pulse
It is limited;
Set the audio frequency phase to preset value.
7. according to the method described in claim 2, it is characterized in that, audio mode instruction is smooth mode instruction;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving the smooth mode instruction, obtain and corresponding, the described pending multichannel of smooth mode instruction
The transient pulse of audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Based on the transient pulse, in the frequency domain of the pending multichannel audio, to transient pulse in scheduled frequency range
The amplitude of corresponding frequency domain is smoothed.
8. according to the method described in claim 2, it is characterized in that, audio mode instruction is velocity mode instruction;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving the velocity mode instruction, obtain and corresponding, the described pending multichannel of velocity mode instruction
The scheduled sample rate and formant or fundamental frequency of audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Down-sampling is carried out to the pending multichannel audio according to scheduled sample rate;
The formant of the pending multichannel audio is smoothed;Alternatively,
Adjust the fundamental frequency of the pending multichannel audio.
9. according to the method described in claim 2, it is characterized in that, audio mode instruction is sound quality mode instruction;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving the sound quality mode instruction, pending multichannel corresponding with the sound quality mode instruction, described is obtained
The transient pulse of audio, fundamental frequency, formant;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
The transient pulse of the smooth pending multichannel audio and the formant in real time;
The fundamental frequency of the pending multichannel audio is adjusted in real time.
10. according to the method described in claim 2, it is characterized in that, audio mode instruction refers to for across frequency band smooth mode
It enables;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving across the frequency band smooth mode instruction, obtain corresponding, described with across the frequency band smooth mode instruction
The audio frequency phase of pending multichannel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Based on the audio frequency phase, the phase at least two frequency bands of the pending multichannel audio is smoothly located
Reason.
11. according to the method described in claim 2, it is characterized in that, audio mode instruction is that smooth mode refers in subband
It enables;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving smooth mode instruction in the subband, obtain corresponding, described with smooth mode instruction in the subband
The audio frequency phase of pending multichannel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Based on the audio frequency phase, the phase in the subband of any frequency band of the pending multichannel audio is smoothly located
Reason.
12. according to the method described in claim 2, it is characterized in that, audio mode instruction refers to for speed-variation without tone pattern
It enables;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving the speed-variation without tone mode instruction, obtain corresponding, described with the speed-variation without tone mode instruction
The audio duration of pending multichannel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
The audio duration of the pending multichannel audio shorten or extension is handled.
13. according to the method described in claim 2, it is characterized in that, audio mode instruction is modified tone, speed change pattern does not refer to
It enables;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving the modified tone not speed change pattern instruction, obtains and the not speed change pattern instruction that modifies tone is corresponding, described
The fundamental frequency of pending multichannel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
Adjust the fundamental frequency of the pending multichannel audio.
14. according to the method described in claim 2, it is characterized in that, audio mode instruction is modified tone speed change pattern instruction;
It is described when receive audio mode instruction when, obtain and corresponding, the described pending multichannel of audio mode instruction
The step of audio processing parameters of audio, including:
When receiving modified tone speed change pattern instruction, obtain and the modified tone speed change pattern instruction is corresponding, described waits locating
Manage the audio duration and fundamental frequency of multichannel audio;
It is described to be based on the audio processing parameters, the step of processing the pending multichannel audio, including:
The audio duration shorten or extension is handled;
Adjust the fundamental frequency.
15. a kind of multichannel audio processing unit, which is characterized in that including:
First acquisition module, for obtaining pending multichannel audio;
Second acquisition module, for obtaining audio processing parameters;
Processing module is handled the pending multichannel audio for being based on the audio processing parameters.
16. device according to claim 15, which is characterized in that second acquisition module is additionally operable to:
When receiving audio mode instruction, obtain and corresponding, the described pending multichannel audio of audio mode instruction
Audio processing parameters.
17. device according to claim 16, which is characterized in that the audio mode instruction is that modes of deflection instructs;
Second acquisition module is specifically used for, when receiving the modes of deflection instruction, obtaining and instructing with the modes of deflection
The audio envelope of corresponding, the described pending multichannel audio;
The processing module is specifically used for adjusting the audio envelope of the pending multichannel audio.
18. device according to claim 17, which is characterized in that the processing module is specifically used for waiting for described in adjustment
Handle the fundamental frequency and formant of multichannel audio.
19. device according to claim 16, which is characterized in that the audio mode instruction is holding mode instruction;
Second acquisition module is specifically used for when receiving the holding mode instruction, obtains and the holding mode instruction
The audio envelope and fundamental frequency of corresponding, the described pending multichannel audio;
The processing module is specifically used in the case where keeping the audio envelope, adjusts the fundamental frequency.
20. device according to claim 16, which is characterized in that the audio mode instruction is clear and melodious mode instruction;
Second acquisition module is specifically used for when receiving clear and melodious mode instruction, obtains corresponding with the clear and melodious mode instruction
, the transient pulse of the pending multichannel audio and audio frequency phase;
The processing module is specifically used for the phase of the transient pulse in the full frequency-domain of the pending multichannel audio
It is set as zero, or the phase of the transient pulse is set as zero in the full frequency-domain of the pending multichannel audio, and
The amplitude of the transient pulse is limited, and sets the audio frequency phase to preset value.
21. device according to claim 16, which is characterized in that the audio mode instruction is that smooth mode instructs;
Second acquisition module is specifically used for, when receiving the smooth mode instruction, obtaining and instructing with the smooth mode
The transient pulse of corresponding, the described pending multichannel audio;
The processing module is specifically used for being based on the transient pulse, in the frequency domain of the pending multichannel audio, to pre-
The amplitude for determining frequency domain corresponding to transient pulse in frequency range is smoothed.
22. device according to claim 16, which is characterized in that the audio mode instruction is that velocity mode instructs;
Second acquisition module is specifically used for, when receiving the velocity mode instruction, obtaining and instructing with the velocity mode
The scheduled sample rate and formant or fundamental frequency of corresponding, the described pending multichannel audio;
The processing module is specifically used for carrying out down-sampling to the pending multichannel audio according to scheduled sample rate;And
And the formant of the pending multichannel audio is smoothed;Alternatively, the adjustment pending multichannel sound
The fundamental frequency of frequency.
23. device according to claim 16, which is characterized in that the audio mode instruction is sound quality mode instruction;
Second acquisition module is specifically used for when receiving the sound quality mode instruction, obtains and the sound quality mode instruction
The transient pulse of corresponding, the described pending multichannel audio, fundamental frequency, formant;
The processing module is specifically used for the transient pulse and the resonance of the smooth pending multichannel audio in real time
Peak, and the fundamental frequency of the pending multichannel audio is adjusted in real time.
24. device according to claim 16, which is characterized in that the audio mode instruction is that across frequency band smooth mode refers to
It enables;
Second acquisition module is specifically used for, when receiving across the frequency band smooth mode instruction, obtaining and described across frequency band
Smooth mode instructs the audio frequency phase of corresponding, the described pending multichannel audio;
The processing module is specifically used for being based on the audio frequency phase, at least two frequency bands of the pending multichannel audio
Interior phase is smoothed.
25. device according to claim 16, which is characterized in that the audio mode instruction is that smooth mode refers in subband
It enables;
Second acquisition module is specifically used for when receiving smooth mode instruction in the subband, in acquisition and the subband
Smooth mode instructs the audio frequency phase of corresponding, the described pending multichannel audio;
The processing module is specifically used for being based on the audio frequency phase, to the son of any frequency band of the pending multichannel audio
Phase in band is smoothed.
26. device according to claim 16, which is characterized in that the audio mode instruction is that speed-variation without tone pattern refers to
It enables;
Second acquisition module is specifically used for when receiving the speed-variation without tone mode instruction, obtains with the speed change not
The audio duration of corresponding, the described pending multichannel audio of modified tone mode instruction;
The processing module to the audio duration of the pending multichannel audio shorten or extension is handled.
27. device according to claim 16, which is characterized in that for modified tone, speed change pattern does not refer to for the audio mode instruction
It enables;
Second acquisition module is specifically used for, when receiving the modified tone not speed change pattern instruction, obtaining with the modified tone not
Speed change pattern instructs the fundamental frequency of corresponding, the described pending multichannel audio;
The processing module is specifically used for adjusting the fundamental frequency of the pending multichannel audio.
28. device according to claim 16, which is characterized in that the audio mode instruction refers to for modified tone speed change pattern
It enables;
Second acquisition module is specifically used for, when receiving the modified tone speed change pattern instruction, obtaining and the modified tone speed change
The audio duration and fundamental frequency of corresponding, the described pending multichannel audio of mode instruction;
The processing module is specifically used for the audio duration shorten or extension is handled, and adjusts the fundamental frequency.
29. a kind of multichannel audio handles hardware device, including:
Memory, for storing non-transitory computer-readable instruction;And
Processor, for running the computer-readable instruction so that realized according to claim 1- when the processor executes
Multichannel audio processing method described in any one of 14.
30. a kind of computer readable storage medium, for storing non-transitory computer-readable instruction, when the non-transitory meter
When calculation machine readable instruction is executed by computer so that the computer perform claim requires more sound described in any one of 1-14
Channel audio processing method.
31. a kind of multichannel audio processing terminal, including any a kind of multichannel audio processing in claim 15-28
Device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810356544.XA CN108600936B (en) | 2018-04-19 | 2018-04-19 | Multi-channel audio processing method, device, computer-readable storage medium and terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810356544.XA CN108600936B (en) | 2018-04-19 | 2018-04-19 | Multi-channel audio processing method, device, computer-readable storage medium and terminal |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108600936A true CN108600936A (en) | 2018-09-28 |
CN108600936B CN108600936B (en) | 2020-01-03 |
Family
ID=63613502
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810356544.XA Active CN108600936B (en) | 2018-04-19 | 2018-04-19 | Multi-channel audio processing method, device, computer-readable storage medium and terminal |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108600936B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112086104A (en) * | 2020-08-18 | 2020-12-15 | 珠海市杰理科技股份有限公司 | Method and device for obtaining fundamental frequency of audio signal, electronic equipment and storage medium |
WO2021097666A1 (en) * | 2019-11-19 | 2021-05-27 | Beijing Didi Infinity Technology And Development Co., Ltd. | Systems and methods for processing audio signals |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101211557A (en) * | 2006-12-27 | 2008-07-02 | 三星电子株式会社 | Method and apparatus to post-process an audio signal |
CN101860617A (en) * | 2009-04-12 | 2010-10-13 | 比亚迪股份有限公司 | Mobile terminal with voice processing effect and method thereof |
CN103155030A (en) * | 2011-07-15 | 2013-06-12 | 华为技术有限公司 | Method and apparatus for processing a multi-channel audio signal |
CN104780091A (en) * | 2014-01-13 | 2015-07-15 | 北京发现角科技有限公司 | Instant messaging method and instant messaging system with speech and audio processing function |
CN105979468A (en) * | 2015-12-04 | 2016-09-28 | 乐视致新电子科技(天津)有限公司 | Audio frequency processing method and device |
CN107705795A (en) * | 2017-09-27 | 2018-02-16 | 天津大学 | Multichannel audio processing method based on KSVD algorithms |
-
2018
- 2018-04-19 CN CN201810356544.XA patent/CN108600936B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101211557A (en) * | 2006-12-27 | 2008-07-02 | 三星电子株式会社 | Method and apparatus to post-process an audio signal |
CN101860617A (en) * | 2009-04-12 | 2010-10-13 | 比亚迪股份有限公司 | Mobile terminal with voice processing effect and method thereof |
CN103155030A (en) * | 2011-07-15 | 2013-06-12 | 华为技术有限公司 | Method and apparatus for processing a multi-channel audio signal |
CN104780091A (en) * | 2014-01-13 | 2015-07-15 | 北京发现角科技有限公司 | Instant messaging method and instant messaging system with speech and audio processing function |
CN105979468A (en) * | 2015-12-04 | 2016-09-28 | 乐视致新电子科技(天津)有限公司 | Audio frequency processing method and device |
CN107705795A (en) * | 2017-09-27 | 2018-02-16 | 天津大学 | Multichannel audio processing method based on KSVD algorithms |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021097666A1 (en) * | 2019-11-19 | 2021-05-27 | Beijing Didi Infinity Technology And Development Co., Ltd. | Systems and methods for processing audio signals |
CN112086104A (en) * | 2020-08-18 | 2020-12-15 | 珠海市杰理科技股份有限公司 | Method and device for obtaining fundamental frequency of audio signal, electronic equipment and storage medium |
CN112086104B (en) * | 2020-08-18 | 2022-04-29 | 珠海市杰理科技股份有限公司 | Method and device for obtaining fundamental frequency of audio signal, electronic equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN108600936B (en) | 2020-01-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9311043B2 (en) | Adaptive audio feedback system and method | |
WO2020113733A1 (en) | Animation generation method and apparatus, electronic device, and computer-readable storage medium | |
CN108845736A (en) | Exchange method and system for vehicle-mounted voice system | |
CN104318928B (en) | Sub-band processing unit, the method and storage medium for generating synthesized subband signal | |
CN105843572A (en) | Information processing method and deformable electronic device | |
CN108597527A (en) | Multichannel audio processing method, device, computer readable storage medium and terminal | |
CN106658284A (en) | Addition of virtual bass in the frequency domain | |
CN109495792A (en) | A kind of subtitle adding method, device, electronic equipment and the readable medium of video | |
CN109151595A (en) | Method for processing video frequency, device, terminal and medium | |
CN108600936A (en) | Multichannel audio processing method, device, computer readable storage medium and terminal | |
CN103201705B (en) | Content output device and the method exporting video content on its display | |
CN109410918A (en) | For obtaining the method and device of information | |
CN110276006A (en) | Methods of exhibiting, device, electronic equipment and the computer readable storage medium of painted eggshell | |
CN109508450A (en) | The operating method of table, device, storage medium and electronic equipment in online document | |
CN106653049A (en) | Addition of virtual bass in time domain | |
CN111028828A (en) | Voice interaction method based on screen drawing, screen drawing and storage medium | |
JP2023538943A (en) | Audio data processing methods, devices, equipment and storage media | |
CN110519645A (en) | Playback method, device, electronic equipment and the computer-readable medium of video content | |
CN106448688A (en) | Audio coding method and related device | |
CN110262867A (en) | A kind of long-range control method and device based on onboard system | |
CN108495234A (en) | Multichannel audio processing method, device and computer readable storage medium | |
CN109003633A (en) | Audio-frequency processing method, device and electronic equipment | |
CN109242936A (en) | Draw method, apparatus, storage medium and the electronic equipment of object content data | |
CN110085214A (en) | Audio originates point detecting method and device | |
CN106328111B (en) | Audio-frequency processing method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |