CN106067990A - Audio-frequency processing method, device and video player - Google Patents
Audio-frequency processing method, device and video player Download PDFInfo
- Publication number
- CN106067990A CN106067990A CN201610497437.XA CN201610497437A CN106067990A CN 106067990 A CN106067990 A CN 106067990A CN 201610497437 A CN201610497437 A CN 201610497437A CN 106067990 A CN106067990 A CN 106067990A
- Authority
- CN
- China
- Prior art keywords
- audio signal
- audio
- characteristic
- frequency
- video data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
Abstract
The present invention relates to audio-frequency processing method, device and video player, the method includes obtaining the audio signal being associated with video data；Obtaining the first audio signal and the second audio signal according to described audio signal, wherein, described second audio signal is relative to described first delayed audio signal the first time delay；The first sound channel outfan to earphone interface is provided by described first audio signal；And provide the second sound channel outfan to earphone interface by described second audio signal.The video playback of stereo audio can be had with relatively low cost realization.
Description
Technical field
The present invention relates to areas of information technology, particularly relate to a kind of for the audio signal in video data audio frequency at
Reason method and apparatus, and apply the method and the video player of device.
Background technology
User is more and more higher to the requirement of the audio visual effect of video media, and increasing user wishes by intelligence hands
During the terminal unit viewing videos such as machine, panel computer, computer, it is possible to enjoy stereo audio, but, in a lot of video source
Audio signal not according to stereo mode collection, utilize the existing video player loaded on terminal unit to play nothing
Method directly produces stereo audio, if by the external equipment such as stereo speaker, stereophone, can be greatly increased again use
The cost at family.
Summary of the invention
Technical problem
In view of this, the present invention proposes a kind of audio-frequency processing method, device and video player, it is possible to relatively low cost
Realize the video playback with stereo audio.
Solution
On the one hand, a kind of audio-frequency processing method, the audio signal being associated with video data including acquisition are proposed；According to institute
Stating audio signal and obtain the first audio signal and the second audio signal, wherein, described second audio signal is relative to described first
Delayed audio signal the first time delay；The first sound channel outfan to earphone interface is provided by described first audio signal；And will
Described second audio signal provides the second sound channel outfan to earphone interface.
On the other hand, a kind of apparatus for processing audio is proposed, including audio frequency obtaining widget, relevant to video data for obtaining
The audio signal of connection；Delay unit, for obtaining the first audio signal and the second audio signal according to described audio signal, its
In, described second audio signal is relative to described first delayed audio signal the first time delay；First provides parts, for by described
First audio signal provides the first sound channel outfan to earphone interface；And second provide parts, for by described second sound
Frequently signal provides the second sound channel outfan to earphone interface.
Another aspect, proposes a kind of video player, including according to the apparatus for processing audio described in the above.
Beneficial effect
According to each aspect of the present invention, the associate audio signal of video data being divided into two-way, wherein a road is relative to separately
After one tunnel postpones, exporting two sound channel outfans to earphone respectively, user can be had by the two of earphone receiver uppicks
The two-way audio in relative time delay, simulates sound and arrives ears time different phenomenon in its natural state, it is achieved that " virtual ring
Around stereo " effect, enhance telepresenc when user listens to.So, even if original audio signal is only in video
Being the monophonic normal audio signals that gathers of monophonic, earphone is also ear the most common, without stereo processing module
Machine, user also can experience stereo audio, thus achieve the played in stereo effect of video with relatively low cost, significantly carry
High Consumer's Experience.
According to below with reference to the accompanying drawings detailed description of illustrative embodiments, the further feature of the present invention and aspect being become
Clear.
Accompanying drawing explanation
The accompanying drawing of the part comprising in the description and constituting description together illustrates the present invention's with description
Exemplary embodiment, feature and aspect, and for explaining the principle of the present invention.
Fig. 1 illustrates the flow chart of a kind of audio-frequency processing method.
Fig. 2 a and Fig. 2 b shows the time domain beamformer of an example of the first audio signal and the second audio signal.
Fig. 3 shows the flow chart of the audio-frequency processing method of an example according to an embodiment of the invention.
Fig. 4 shows the flow chart of the audio-frequency processing method of an example according to an embodiment of the invention.
Fig. 5 shows the amplitude-versus-frequency curve of the band-pass filter group being made up of two band filters.
Fig. 6 shows the flow chart of the audio-frequency processing method of an example according to an embodiment of the invention.
Fig. 7 shows the structure chart of apparatus for processing audio according to an embodiment of the invention.
Fig. 8 shows the structure chart of the apparatus for processing audio of an example according to an embodiment of the invention.
Fig. 9 shows the structure chart of the apparatus for processing audio of an example according to an embodiment of the invention.
Figure 10 shows the structure chart of the apparatus for processing audio of an example according to an embodiment of the invention.
Figure 11 shows the structured flowchart of a kind of audio processing equipment of an alternative embodiment of the invention.
Detailed description of the invention
Various exemplary embodiments, feature and the aspect of the present invention is described in detail below with reference to accompanying drawing.In accompanying drawing identical
Reference represent the same or analogous element of function.Although the various aspects of embodiment shown in the drawings, but remove
Non-specifically is pointed out, it is not necessary to accompanying drawing drawn to scale.
The most special word " exemplary " means " as example, embodiment or illustrative ".Here as " exemplary "
Illustrated any embodiment should not necessarily be construed as preferred or advantageous over other embodiments.
It addition, in order to better illustrate the present invention, detailed description of the invention below gives numerous details.
It will be appreciated by those skilled in the art that do not have some detail, the present invention equally implements.In some instances, for
Method well known to those skilled in the art, means, element and circuit are not described in detail, in order to highlight the purport of the present invention.
Embodiment 1
Fig. 1 illustrates the flow chart of a kind of audio-frequency processing method.As it is shown in figure 1, the method
Specifically include that
Step 101, obtains the audio signal being associated with video data；
Step 102, obtains the first audio signal and the second audio signal, wherein, described second according to described audio signal
Audio signal is relative to described first delayed audio signal the first time delay；
Step 103, provides the first sound channel outfan to earphone interface by described first audio signal；And
Step 104, provides the second sound channel outfan to earphone interface by described second audio signal.
According to the method for this embodiment, the associate audio signal of video data being divided into two-way, wherein a road is relative to separately
After one tunnel postpones, exporting two sound channel outfans to earphone respectively, user can be had by the two of earphone receiver uppicks
The two-way audio in relative time delay, simulates sound and arrives ears time different phenomenon in its natural state, it is achieved that " virtual ring
Around stereo " effect, enhance telepresenc when user listens to.So, even if original audio signal is only in video
Being the monophonic normal audio signals that gathers of monophonic, earphone is also ear the most common, without stereo processing module
Machine, user also can experience stereo audio, thus achieve the played in stereo effect of video with relatively low cost, significantly carry
High Consumer's Experience.
Below in conjunction with some concrete examples, the various possible specific implementation of the present embodiment is illustrated.This
A little examples are only exemplary and explanat, are not intended to limit the present invention.
Those skilled in the art can pass through prior art means, obtains the audio signal being associated with video data, this
Bright without limitation.For example, by the conventional means in video player, video data can be decoded, and from solution
Data after Ma isolate audio signal.Video data can be locally stored video file, it is also possible to be based on stream matchmaker
The video flowing of physique formula, correspondingly, the audio signal obtained can be audio file, it is also possible to be sound based on stream media format
Frequency stream.Video data can be complete video file or video flowing, it is also possible to is the fragment in video file or video flowing.
In one example, acquired audio signal can be monophonic audio signal, binaural audio signal or
Multi-channel audio signal more than triple-track.In the case of monophonic audio signal, can be by acquired monophonic audio
Signal is divided into two-way, and a road is as the first audio signal (being considered as original, the most delayed audio signal), by another road
Postpone to delay when first as the second audio signal, thus obtain the two-way audio signal with relative time delay.So can make
Originally the monophonic audio signal of stereophonic effect is not had to have stereophonic effect.In the case of binaural audio signal, can
Using the audio signal (the first channel audio signal) of one of them sound channel as the first audio signal, the audio frequency of another sound channel is believed
Number (second sound channel audio signal) postpones to delay when first as the second audio signal, thus obtains the two-way with relative time delay
Audio signal.In the case of multichannel audio, the audio signal of the part sound channel in described audio signal can be mixed
As the first audio signal, delay when the audio signal of other sound channels in described audio signal is mixed described in consolidation delay first
As the second audio signal.As such, it is possible to make the double track originally having stereophonic effect or multi-channel audio signal retain it
On the premise of original stereophonic effect, further enhancing stereophonic effect.
Fig. 2 a and Fig. 2 b shows the time domain beamformer of an example of the first audio signal and the second audio signal, wherein
Fig. 2 a shows the most delayed two-way original audio signal, and Fig. 2 b illustrated a wherein road delayed audio signal very first time
After, first audio signal with relative time delay obtained and the second audio signal.
In one example, the first audio signal obtained and the second audio signal can be original firmly by terminal unit
Part passage (left and right sound channels of such as sound card) provides the first, second sound channel outfan to earphone interface (the most left and right respectively
Sound channel outfan), thus when earphone inserts earphone interface, first, second can be play respectively by two receivers of earphone
Audio signal.Owing to earphone is the left and right ear that first, second audio signal is directly respectively transmitted the pure man, it is ensured that ears are same
Time individually receive the audio signal in relative time delay, therefore the effect in this relative time delay can embody, it is possible to realizes this reality
Execute the played in stereo effect that example is brought.
The first time delay in the present embodiment, can be based on user generally impression and the empirical value that determines, for example,
Value between 10ms-30ms, such as, take 20ms.This first time delay can be default fixed value, it is also possible to be can be by user's root
The variable value of setting is needed according to self.In one example, this first time delay can also be can be according to the characteristic of video data
Carry out self-adaptative adjustment.Below in conjunction with Fig. 3, provide an example determining the first time delay according to the characteristic of described video data.
Fig. 3 shows the flow chart of the audio-frequency processing method of an example according to an embodiment of the invention, such as Fig. 3
Shown in, the method, on the basis of the method shown in Fig. 1, also includes: step 105: according to the characteristic of video data, determine first
Time delay.
Video data has different characteristics, these different characteristics result in user watch video when, need
Different auditory perceptions.For example, some video may relate to more grand audio scene (such as war scene be more
Movie and television play, the video such as symphony), now need the first longer time delay to strengthen stereo audio, it is provided that to have stronger
The auditory perception of depth feelings, and some video may relate to more peace and quiet or clear and melodious audio scene (such as talks with more shadow
Video depending on play, talk shows, light music etc.), now need the first shorter time delay to be decreased slightly as low stereo audio, it is provided that
The auditory perception become apparent from.This example is by determining described first time delay according to the characteristic of video data, it is possible to targetedly
Ground meets the user's different needs when watching the video of different qualities to auditory perception, improves Consumer's Experience.
In one example, the characteristic realized in the following way according to video data the first time delay can be determined: root
According to the video information being associated with video data, determine the characteristic relevant with the broadcasting content of video data；And according to regard
The characteristic that the broadcasting content of frequency evidence is relevant, determines the first time delay.
In this example, video data can be complete video file or video flowing (such as one complete film or
TV programme), the video information being associated with video data can be that video data is play the description of content, such as content
Type, such as war film, symphony, talk show etc..This information can such as obtain from the server storing this information.Root
According to this information, i.e. can determine that the characteristic relevant with the broadcasting content of video data, such as, relate to grand scene more, or relate to
Quiet scene is more, according to this characteristic, i.e. can determine that the first time delay.For example, for play content be that war film etc. relates to
And the video data that grand scene is more, can the first time delay be arranged longer (such as more than 20ms), for playing content be
Conversational class program etc. relates to the video that quiet scene is more, shorter (such as 20ms is once) that can the first time delay be arranged, institute
The first time delay arranged can be applicable in the playing process of whole video data (the most whole program video), with easier side
Formula is provided with stereophonic effect targetedly.
In another example, the characteristic realized in the following way according to video data can determine the first time delay:
Determine the feature (i.e. as the characteristic of described video data) of the audio signal being associated with video data；True according to this feature
Fixed first time delay.
In this example, the fragment during video data can be regarded as video file or video flowing.A lot of videos would generally
Change between the scene of different qualities, such as, even if war film, also can be alternately present war scene and dialogue scene.Cause
This, the mode of this example can fully take into account the characteristic of different fragments in video and carry out accommodation.
As example, the feature of audio signal can include but not limited to the frequecy characteristic of audio signal, audio signal
Average energy and audio signal are at the zero-crossing rate etc. of time domain.
Such as can analyze the frequency of the audio signal being associated with each fragment in video file or video flowing (each video data)
Spectrum, determines that it is relatively strong at the acoustical signal of which frequency range, the audio signal high frequency of such as certain fragment low frequency relatively by force
Relatively weak, less the first time delay can be set for this fragment, the audio signal high frequency of certain fragment is relatively weak and low frequency
Relatively strong, the first bigger time delay can be set for this fragment.Again for example, it is possible to analyze and each fragment (each video data)
The number of the voice messaging (such as voice dialogue) that the audio signal being associated is comprised, for example, it is possible to based on audio signal
Average energy (such as audio signal short-time average energy in scheduled duration) and/or zero-crossing rate based on audio signal
(such as audio signal is counted and this video in the zero crossing density of time domain, such as total zero passage of the audio signal of certain video data
The ratio of the duration of data), the voice dialogue in audio signal is tentatively identified, if average energy is higher and/or mistake
Zero rate is higher, then mean that voice dialogue is more, can arrange the first less time delay for corresponding video data, otherwise,
The first bigger time delay can be set, etc..
In one example, first time delay of predeterminable multiple candidates, such as 5ms, 10ms, 20ms, 25ms etc..According to institute
The characteristic of the video data determined or the selection according to user, can switch between first time delay of these candidates.Certainly, also
Can according to determined by the characteristic of video data convert in real time the first time delay, the present invention is without limitation.
In addition to producing stereophonic effect by time delay, the embodiment of the present invention also can be further by first,
Two audio signals, before being sent to earphone interface, carry out frequency domain adjustment respectively, improve play sound effect further.Below in conjunction with
Fig. 4, illustrates the example of this respect.
Fig. 4 shows the flow chart of the audio-frequency processing method of an example according to an embodiment of the invention, such as Fig. 4
Shown in, the method for this example includes:
Step 401, obtains the audio signal being associated with video data；
Step 402, obtains the first audio signal and the second audio signal according to described audio signal；
Step 403, after described first audio signal being carried out the first bandpass filtering treatment by the first band filter, carries
First sound channel outfan of supply earphone interface；And
Step 404, after described second audio signal being carried out the second bandpass filtering treatment by the second band filter, carries
The second sound channel outfan of supply earphone interface；
Wherein, described second audio signal is relative to described first delayed audio signal the first time delay.
It is known that band filter refers to by the frequency component in certain frequency range, and the frequency of other scopes
Component decays to the wave filter of extremely low level.First, second band filter in this example can be by multiple bandpass filterings
The band-pass filter group (such as digital band-pass filter group) of device composition, thus multiple passband is provided.In order to exemplarily illustrate
The principle of band filter, Fig. 5 shows the amplitude-versus-frequency curve of the band-pass filter group being made up of two band filters, its
In the mid frequency of two passbands be 5000Hz and 15000Hz respectively, passband gain respectively may be about 14dB.
In one example, the first band filter and the second band filter can have identical frequency characteristic, with
First, second audio signal is produced same frequency domain adjust, it is achieved such as strengthen bass with strengthen impact, strengthen high pitch with
Strengthen penetration power or equalize each frequency range so that the sound required effect such as softer.
In another example, the first band filter and the second band filter can have different frequency characteristics,
First, second audio signal to be produced different frequency domain adjustment, wherein, the first band filter and the second band filter pin
Filtering Processing to the first audio signal and the second audio signal can be complementary, such as, can strengthen for the first audio signal
Low frequency, weakens low frequency accordingly for the second audio signal or strengthens high frequency, thus simulating high and low frequency sound respectively from difference
The natural scene (such as symphony, high and low music device is arranged on diverse location) in direction, to further enhance presence,
Strengthen stereophonic effect.
The first band filter and the frequency characteristic of the second band filter in this example can be based on user general
Determine all over impression.For example, the passband quantity of first, second band filter can be rule of thumb set (such as
3-15, such as 5), the mid frequency position of each passband is (such as at the scheduled frequency range as a example by 60Hz to 14000hz
In uniformly or non-uniform Distribution) and the passband gain of each passband.These parameters determine first, second band filter
Frequency characteristic.These parameters can be default fixed value, it is also possible to is can be needed the variable of setting by user according to self
Value.In one example, it is also possible to be adaptively adjusted the frequency of first, second band filter according to the characteristic of video data
Rate characteristic.The frequency characteristic of first, second band filter can adjust in the same manner, adjust by different way or only
Adjust one of them.Below in conjunction with Fig. 6, provide one and determine the first and/or second bandpass filtering according to the characteristic of video data
The example of the frequency characteristic of device.
Fig. 6 shows the flow chart of the audio-frequency processing method of an example according to an embodiment of the invention, such as Fig. 6
Shown in, the method, on the basis of the method shown in Fig. 4, also includes: step 405: according to the characteristic of video data, determine first
Band filter and/or the frequency characteristic of the second band filter.For example, it is possible to by determining the first band filter respectively
And/or second the passband gain of each passband of band filter determine its frequency characteristic.
As mentioned previously, video data has different characteristics, and these different characteristics result in user and regard in viewing
Frequently, when, different auditory perceptions is needed.This example by according to the characteristic of video data determine the first band filter and/
Or second frequency characteristic of band filter, it is possible to meet user targetedly when watching the video of different qualities to audition
The different needs of impression, improve Consumer's Experience.
In one example, the characteristic realized in the following way according to video data the first bandpass filtering can be determined
Device and/or the frequency characteristic of the second band filter: according to the video information being associated with described video data, determine with described
The characteristic that the broadcasting content of video data is relevant, according to the characteristic that the broadcasting content of described and described video data is relevant, determines
First band filter and/or the frequency characteristic of the second band filter.
In this example, video data can be complete video file or video flowing (such as one complete film or
TV programme), refer to mentioned above about " video information being associated with video data ".According to this information, i.e. can determine that
The characteristic relevant with the broadcasting content of video data, such as, relate to overcast scene more, or it is more to relate to cheerful and light-hearted scene,
Etc., according to this characteristic, i.e. can determine that the frequency characteristic of first, second band filter.For example, epic etc. is related to
And the video data that overcast scene is more, first and/or second band filter passband at the passband of low frequency region can be improved
Gain, to strengthen low frequency, relates to, for variety show etc., the video that cheerful and light-hearted scene is more, can improve the first and/or second band logical
Wave filter at the passband gain of the passband of high-frequency region to strengthen high frequency, etc..Set for whole video file or video flowing
The frequency characteristic of the first and/or second unified band filter, can enter one in the way of more simple and easy to do targetedly
Step improves auditory effect.
In another example, the characteristic according to described video data can be realized in the following way, determine first
Band filter and/or the frequency characteristic of the second band filter: determine the audio signal that is associated with described video data
Feature；Described first band filter and/or the frequency characteristic of described second band filter is determined according to described feature.
In this example, the fragment during video data can be regarded as video file or video flowing.As it was noted above, it is a lot
Video would generally be changed between the scene of different qualities, and therefore, this example fully takes into account the characteristic of different fragments in video
And carry out accommodation.As example, this feature can include the frequecy characteristic of audio signal.Such as can analyze and each fragment
The frequency spectrum of the audio signal that (each video data) is associated, determines that it is the strongest at the acoustical signal of which frequency range.Such as certain
Fragment high frequency is relatively strong and low frequency is relatively weak, can improve the first and/or second band filter at height for this fragment
The passband gain of the passband in frequency domain to strengthen high frequency, more such as certain fragment low frequency is relatively strong and high frequency is relatively weak, can
To improve the first and/or second band filter at the passband gain of the passband of low frequency region to strengthen low frequency for this fragment,
Etc..
In one example, the frequency characteristic configuration of first and/or second band filter of predeterminable multiple candidates, root
The characteristic of video data determined by according to or the selection according to user, can switch between the configuration of these candidates.Certainly, also
Can according to determined by the characteristic of video data convert in real time the frequency characteristic of the first and/or second band filter, this
Bright without limitation.
Embodiment 2
Fig. 7 shows the structure chart of apparatus for processing audio according to an embodiment of the invention.The device of this embodiment
700 can be used for realizing the operation of each step of method in embodiment 1, and the most various concrete examples and beneficial effect thereof can be found in enforcement
Example 1, is not repeated herein description for simplicity's sake.
As it is shown in fig. 7, the device 700 of this embodiment includes: audio frequency obtaining widget 701, for obtaining and video data phase
The audio signal of association；Delay unit 702, for obtaining the first audio signal and the second audio frequency letter according to described audio signal
Number, wherein, described second audio signal is relative to described first delayed audio signal the first time delay；First provides parts 703, uses
In providing the first sound channel outfan to earphone interface by described first audio signal；And second provide parts 704, for will
Described second audio signal provides the second sound channel outfan to earphone interface.
Fig. 8 shows the structure chart of the apparatus for processing audio of an example according to an embodiment of the invention.At this
In example, device 700 may also include the first time delay on the basis of shown in Fig. 7 and determines parts 705, for according to described video counts
According to characteristic, determine described first time delay.
In one example, described first time delay determines that parts 705 comprise the steps that first content characteristic determines parts, is used for
According to the video information being associated with described video data, determine the characteristic relevant with the broadcasting content of described video data, the
One determines subassembly, for the characteristic relevant according to the broadcasting content of described and described video data, determines described first time delay.
In one example, described first time delay determines that parts 705 comprise the steps that fisrt feature determines parts, is used for determining
Feature with the audio signal that described video data is associated；Second determines subassembly, described for determining according to described feature
First time delay.Wherein, described feature can include following in one or more: the frequecy characteristic of described audio signal, described
The average energy of audio signal and described audio signal are at the zero-crossing rate of time domain.
Fig. 9 shows the structure chart of the apparatus for processing audio of an example according to an embodiment of the invention.At this
In example, device 700 is on the basis of shown in Fig. 7, and first provides parts 703 to include the first band filter 7031, for right
After described first audio signal carries out the first bandpass filtering treatment, it is provided that to the first sound channel outfan of earphone interface；Second carries
The second band filter 7041 is included for parts 704, after described second audio signal is carried out the second bandpass filtering treatment,
It is supplied to the second sound channel outfan of earphone interface.
Figure 10 shows the structure chart of the apparatus for processing audio of an example according to an embodiment of the invention.At this
In example, device 700 may also include that on the basis of shown in Fig. 9 frequency characteristic determines parts 706, for according to described video
The characteristic of data, determines described first band filter and/or the frequency characteristic of described second band filter.
In one example, described frequency characteristic determines that parts 706 comprise the steps that the second content character determines parts, is used for
According to the video information being associated with described video data, determine the characteristic relevant with the broadcasting content of described video data, the
One frequency characteristic determines subassembly, for the characteristic relevant according to the broadcasting content of described and described video data, determines described
First band filter and/or the frequency characteristic of described second band filter.
In one example, described frequency characteristic determines that parts 706 comprise the steps that second feature determines parts, is used for determining
Feature with the audio signal that described video data is associated；Second frequency characteristic determines subassembly, for according to described feature
Determine described first band filter and/or the frequency characteristic of described second band filter.Wherein, described feature can include
The frequecy characteristic of audio signal.
In one example, described first band filter and/or described second band filter can be respectively provided with multiple
Passband；Described frequency characteristic determines that parts can be specifically for: according to the characteristic of described video data, determines described first band respectively
The passband gain of each passband of bandpass filter and/or described second band filter.
In one example, the frequency characteristic of described first band filter can be with the frequency of described second band filter
Characteristic is similar and different.
In one example, described delay unit 702 comprises the steps that branching unit, for described audio signal is divided into two
Road, wherein a road is as described first audio signal, and the first delay cell, described in postponing another road in described two-way
Delay when first as described second audio signal.
In one example, described delay unit 702 comprises the steps that the first mixed cell, for by described audio signal
The audio signal mixing of part sound channel as described first audio signal, the second mixed cell, for by described audio signal
In the audio signal mixing of other sound channels, the second delay cell, described for the output of described second mixed cell is postponed
Delay when first as described second audio signal.
Embodiment 3
Another embodiment of the present invention also proposes a kind of video player, and it can include the Audio Processing dress according to embodiment 2
Put.
The method and apparatus of the embodiment of the present invention can apply to video player, such as can be at video player to video
After file or video flowing are decoded, the method for the application embodiment of the present invention, or the device embedding of the embodiment of the present invention is regarded
Frequently, in player, user thus can be made to experience stereo audio when watching video, and without any special solid
The external equipments such as sound earphone, audio amplifier, to the audio signal in video file or video flowing itself be whether stereo audio signal,
It is that multichannel, alliteration sound channel or monophonic audio signal etc. also have no requirement.
Each step of the method and apparatus of the embodiment of the present invention and each module all can pass through software, hardware or hardware and software
The mode combined realizes, and such as, certain module can embed in video player application, and certain module can embed sound card etc.
In hardware device, or special-purpose software or hardware also can be completely or partially used to realize.
Embodiment 4
Figure 11 shows the structured flowchart of a kind of audio processing equipment of an alternative embodiment of the invention.Described equipment
1100 can be to possess the host server of computing capability, personal computer PC or portable portable computer or end
End etc..Calculating node is not implemented and limits by the specific embodiment of the invention.
Described equipment 1100 includes processor (processor) 1110, communication interface (Communications
Interface) 1120, memorizer (memory) 1130 and bus 1140.Wherein, processor 1110, communication interface 1120 and
Memorizer 1130 completes mutual communication by bus 1140.
Communication interface 1120 is used for and network device communications, and wherein the network equipment includes such as Virtual Machine Manager center, is total to
Enjoy storage etc..
Processor 1110 is used for performing program.Processor 1110 is probably a central processor CPU, or special collection
Become circuit ASIC (Application Specific Integrated Circuit), or be configured to implement the present invention
One or more integrated circuits of embodiment.
Memorizer 1130 is used for depositing file.Memorizer 1130 may comprise high-speed RAM memorizer, it is also possible to also includes non-
Volatile memory (non-volatile memory), for example, at least one disk memory.Memorizer 1130 can also be to deposit
Memory array.Memorizer 1130 is also possible to by piecemeal, and described piece can be by certain rule sets synthesis virtual volume.
In a kind of possible embodiment, said procedure can be the program code including computer-managed instruction.This journey
Sequence is particularly used in the method realized described in embodiment 1.
Those of ordinary skill in the art are it is to be appreciated that each exemplary cell in embodiment described herein and algorithm
Step, it is possible to being implemented in combination in of electronic hardware or computer software and electronic hardware.These functions are actually with hardware also
It is that software form realizes, depends on application-specific and the design constraint of technical scheme.Professional and technical personnel can be for
Specific application selects different methods to realize described function, but this realization is it is not considered that exceed the model of the present invention
Enclose.
If using the form of computer software realize described function and as independent production marketing or use time, then exist
To a certain extent it is believed that all or part of (part such as contributed prior art) of technical scheme is
Embody in form of a computer software product.This computer software product is generally stored inside the non-volatile of embodied on computer readable
In storage medium, including some instructions with so that computer equipment (can be that personal computer, server or network set
Standby etc.) perform all or part of step of various embodiments of the present invention method.And aforesaid storage medium include USB flash disk, portable hard drive,
Read only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic
The various medium that can store program code such as dish or CD.
The above, the only detailed description of the invention of the present invention, but protection scope of the present invention is not limited thereto, and any
Those familiar with the art, in the technical scope that the invention discloses, can readily occur in change or replace, should contain
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with described scope of the claims.
Claims (29)
1. an audio-frequency processing method, including
Obtain the audio signal being associated with video data；
Obtaining the first audio signal and the second audio signal according to described audio signal, wherein, described second audio signal is relative
In described first delayed audio signal the first time delay；
The first sound channel outfan to earphone interface is provided by described first audio signal；And
The second sound channel outfan to earphone interface is provided by described second audio signal.
Audio-frequency processing method the most according to claim 1, also includes:
According to the characteristic of described video data, determine described first time delay.
Audio-frequency processing method the most according to claim 2, wherein, according to the characteristic of described video data, determines described
One time delay, including:
According to the video information being associated with described video data, determine the spy relevant with the broadcasting content of described video data
Property,
The characteristic that broadcasting content according to described and described video data is relevant, determines described first time delay.
Audio-frequency processing method the most according to claim 2, wherein, according to the characteristic of described video data, determines described
One time delay, including:
Determine the feature of the audio signal being associated with described video data；
Described first time delay is determined according to described feature.
Audio-frequency processing method the most according to claim 4, wherein, described feature include following in one or more: institute
State the frequecy characteristic of audio signal, the average energy of described audio signal and the described audio signal zero-crossing rate in time domain.
Audio-frequency processing method the most according to claim 1, wherein,
The first sound channel outfan to earphone interface is provided by described first audio signal, including: by the first band filter
After described first audio signal is carried out the first bandpass filtering treatment, it is provided that to the first sound channel outfan of earphone interface；
The second sound channel outfan to earphone interface is provided by described second audio signal, including: by the second band filter
After described second audio signal is carried out the second bandpass filtering treatment, it is provided that to the second sound channel outfan of earphone interface.
Audio-frequency processing method the most according to claim 6, also includes:
According to the characteristic of described video data, determine described first band filter and/or the frequency of described second band filter
Rate characteristic.
Audio-frequency processing method the most according to claim 7, wherein, according to the characteristic of described video data, determines described
One band filter and/or the frequency characteristic of described second band filter, including:
According to the video information being associated with described video data, determine the spy relevant with the broadcasting content of described video data
Property,
The characteristic that broadcasting content according to described and described video data is relevant, determines described first band filter and/or institute
State the frequency characteristic of the second band filter.
Audio-frequency processing method the most according to claim 7, wherein, according to the characteristic of described video data, determines described
One band filter and/or the frequency characteristic of described second band filter, including:
Determine the feature of the audio signal being associated with described video data；
Described first band filter and/or the frequency characteristic of described second band filter is determined according to described feature.
Audio-frequency processing method the most according to claim 9, wherein, described feature includes that the frequency of described audio signal is special
Levy.
11. audio-frequency processing methods according to claim 7, wherein, described first band filter and/or described second band
Bandpass filter is respectively provided with multiple passband；
According to the characteristic of described video data, determine described first band filter and/or the frequency of described second band filter
Rate characteristic, including:
According to the characteristic of described video data, determine described first band filter and/or described second band filter respectively
The passband gain of each passband.
12. audio-frequency processing methods according to claim 6, wherein, the frequency characteristic of described first band filter and institute
The frequency characteristic stating the second band filter is similar and different.
13. according to the audio-frequency processing method described in any one in claim 1-12, wherein, obtains according to described audio signal
First audio signal and the second audio signal, including:
Described audio signal is divided into two-way, and wherein a road is as described first audio signal, and another road is postponed described first
Shi Yanhou is as described second audio signal.
14. according to the audio-frequency processing method described in any one in claim 1-12, wherein, obtains according to described audio signal
First audio signal and the second audio signal, including:
The audio signal of the part sound channel in described audio signal is mixed as described first audio signal, described audio frequency is believed
The audio signal of other sound channels in number is delayed as described second audio signal when mixing described in consolidation delay first.
15. 1 kinds of apparatus for processing audio, including
Audio frequency obtaining widget, for obtaining the audio signal being associated with video data；
Delay unit, for obtaining the first audio signal and the second audio signal, wherein, described second according to described audio signal
Audio signal is relative to described first delayed audio signal the first time delay；
First provides parts, for providing the first sound channel outfan to earphone interface by described first audio signal；And
Second provides parts, for providing the second sound channel outfan to earphone interface by described second audio signal.
16. apparatus for processing audio according to claim 15, also include:
First time delay determines parts, for the characteristic according to described video data, determines described first time delay.
17. apparatus for processing audio according to claim 16, wherein, described first time delay determines that parts include:
First content characteristic determines parts, for according to the video information being associated with described video data, determining and regard with described
The characteristic that the broadcasting content of frequency evidence is relevant,
First determines subassembly, for according to the relevant characteristic of the broadcasting content of described and described video data, determines described the
One time delay.
18. apparatus for processing audio according to claim 16, wherein, described first time delay determines parts, including:
Fisrt feature determines parts, for determining the feature of the audio signal being associated with described video data；
Second determines subassembly, for determining described first time delay according to described feature.
19. apparatus for processing audio according to claim 18, wherein, described feature include following in one or more:
The frequecy characteristic of described audio signal, the average energy of described audio signal and described audio signal are at the zero-crossing rate of time domain.
20. apparatus for processing audio according to claim 15, wherein:
Described first provides parts to include the first band filter, for described first audio signal is carried out the first bandpass filtering
After process, it is provided that to the first sound channel outfan of earphone interface；
Described second provides parts to include the second band filter, for described second audio signal is carried out the second bandpass filtering
After process, it is provided that to the second sound channel outfan of earphone interface.
21. apparatus for processing audio according to claim 20, also include:
Frequency characteristic determines parts, for the characteristic according to described video data, determines described first band filter and/or institute
State the frequency characteristic of the second band filter.
22. apparatus for processing audio according to claim 21, wherein, described frequency characteristic determines that parts include:
Second content character determines parts, for according to the video information being associated with described video data, determining and regard with described
The characteristic that the broadcasting content of frequency evidence is relevant,
First frequency characteristic determines subassembly, for the characteristic relevant according to the broadcasting content of described and described video data, really
Fixed described first band filter and/or the frequency characteristic of described second band filter.
23. apparatus for processing audio according to claim 21, wherein, described frequency characteristic determines that parts include:
Second feature determines parts, for determining the feature of the audio signal being associated with described video data；
Second frequency characteristic determines subassembly, for determining described first band filter and/or described the according to described feature
The frequency characteristic of two band-pass filter.
24. apparatus for processing audio according to claim 23, wherein, described feature includes that the frequency of described audio signal is special
Levy.
25. apparatus for processing audio according to claim 21, wherein, described first band filter and/or described second
Band filter is respectively provided with multiple passband；
Described frequency characteristic determine parts specifically for: according to the characteristic of described video data, determine that described first band is logical respectively
The passband gain of each passband of wave filter and/or described second band filter.
26. apparatus for processing audio according to claim 20, wherein, the frequency characteristic of described first band filter and institute
The frequency characteristic stating the second band filter is similar and different.
27. according to the apparatus for processing audio described in any one in claim 15-26, and wherein, described delay unit includes:
Branching unit, for described audio signal is divided into two-way, wherein a road is as described first audio signal,
First delay cell, delays during for another road in described two-way is postponed described first as described second audio frequency letter
Number.
28. according to the apparatus for processing audio described in any one in claim 15-26, and wherein, described delay unit includes:
First mixed cell, for mixing the audio signal of the part sound channel in described audio signal as described first audio frequency
Signal,
Second mixed cell, for the audio signal of other sound channels in described audio signal is mixed,
Second delay cell, delays as described second sound during for the output of described second mixed cell is postponed described first
Frequently signal.
29. 1 kinds of video players, including according to the apparatus for processing audio described in any one in claim 15-28.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610497437.XA CN106067990A (en) | 2016-06-29 | 2016-06-29 | Audio-frequency processing method, device and video player |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610497437.XA CN106067990A (en) | 2016-06-29 | 2016-06-29 | Audio-frequency processing method, device and video player |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106067990A true CN106067990A (en) | 2016-11-02 |
Family
ID=57421563
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610497437.XA Pending CN106067990A (en) | 2016-06-29 | 2016-06-29 | Audio-frequency processing method, device and video player |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106067990A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111179970A (en) * | 2019-08-02 | 2020-05-19 | 腾讯科技（深圳）有限公司 | Audio and video processing method, audio and video synthesizing device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1604689A (en) * | 2003-09-29 | 2005-04-06 | 西门子公司 | Method and device for reproducing a binaural output signal generated from a monaural input signal |
| CN201069641Y (en) * | 2007-07-26 | 2008-06-04 | 欧多尔(佛冈)数码电子制造有限公司 | Audio signal processor |
| CN102968993A (en) * | 2006-04-13 | 2013-03-13 | 弗劳恩霍夫应用研究促进协会 | Audio signal decorrelator |
| CN103037290A (en) * | 2011-10-07 | 2013-04-10 | 索尼公司 | Audio processing device, audio processing method, recording medium, and program |
-
2016
- 2016-06-29 CN CN201610497437.XA patent/CN106067990A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1604689A (en) * | 2003-09-29 | 2005-04-06 | 西门子公司 | Method and device for reproducing a binaural output signal generated from a monaural input signal |
| CN102968993A (en) * | 2006-04-13 | 2013-03-13 | 弗劳恩霍夫应用研究促进协会 | Audio signal decorrelator |
| CN201069641Y (en) * | 2007-07-26 | 2008-06-04 | 欧多尔(佛冈)数码电子制造有限公司 | Audio signal processor |
| CN103037290A (en) * | 2011-10-07 | 2013-04-10 | 索尼公司 | Audio processing device, audio processing method, recording medium, and program |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111179970A (en) * | 2019-08-02 | 2020-05-19 | 腾讯科技（深圳）有限公司 | Audio and video processing method, audio and video synthesizing device, electronic equipment and storage medium |
| CN111179970B (en) * | 2019-08-02 | 2023-10-20 | 腾讯科技（深圳）有限公司 | Audio and video processing method, synthesis device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102597987B (en) | Virtual audio processing for loudspeaker or headphone playback | |
| US10440496B2 (en) | Spatial audio processing emphasizing sound sources close to a focal distance | |
| CN105611481B (en) | A kind of man-machine interaction method and system based on spatial sound | |
| CN104349267B (en) | Audio system | |
| US9826331B2 (en) | Method and apparatus for sound processing in three-dimensional virtual scene | |
| CN106105269B (en) | Acoustic signal processing method and equipment | |
| CN101946526B (en) | Stereophonic widening | |
| RU2444154C2 (en) | Method and device to generate stereo signal with improved perception property | |
| US9794715B2 (en) | System and methods for processing stereo audio content | |
| CN106797524B (en) | For rendering the method and apparatus and computer readable recording medium of acoustic signal | |
| US20110116638A1 (en) | Apparatus of generating multi-channel sound signal | |
| CN105959878B (en) | The control method and device of stereo component system | |
| CN107005778A (en) | The audio signal processing apparatus and method rendered for ears | |
| CN102447839B (en) | A kind of video creating method based on Quartz Composer and device | |
| CN108293165A (en) | Enhance the device and method of sound field | |
| CN108683984A (en) | Method and apparatus for rendering acoustic signal | |
| CN105404642B (en) | A kind of audio frequency playing method and user terminal | |
| CN102972047A (en) | Method and apparatus for reproducing stereophonic sound | |
| CN101924317B (en) | Dual-channel processing device, method and sound playing system thereof | |
| CN110580914A (en) | Audio processing method and equipment and device with storage function | |
| CN106954139A (en) | A kind of sound field rendering method and system for combining earphone and loudspeaker | |
| CN105075294B (en) | Audio signal processor | |
| CN102006545A (en) | Audio-signal processing device and method for processing audio signal | |
| CN109074813A (en) | Handle high definition audio data | |
| KR20170101629A (en) | Apparatus and method for providing multilingual audio service based on stereo audio signal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161102 |